Search NASA⌕ Search

SEARCH · Search NASA

Results for “cloud applications”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53

Radiative Studies of Planetary Atmospheres

Retrieval algorithms and associated software for application to CIRS infrared spectral data have been developed and coded. A general forward radiative transfer code has been written that runs efficiently on a Macintosh, even at high spectral resolution (0.5 per centimeter). It makes use of the correlated-k approach for representation of the gaseous absorption and can include those gases listed in the HITRAN and GEISA atlases, along with collision-induced absorption. Cloud effects are included as spectrally dependent absorbers. Provision has been made for future extension to include particle scattering in an n-stream approximation. The primary purpose of the code is to produce synthetic data and to serve as the forward calculating element in gas and cloud retrieval programs developed for the Mac as well as other platforms. Initial development of algorithms and production software suitable for application to CIRS data to be obtained from Jupiter, Saturn and Titan has been completed, and production versions of the software for application to the spectral data are in place. This includes temperature, gaseous constituent, and cloud opacity retrieval, algorithms that can be applied to both nadir and limb data. This work has been done as a cooperative effort between Conrath and Matcheva (Cornell), Achterberg (GSFWSSAI), and Flasar (GSFC).

Conrath, Barney J.↗

Exploring Infiniband Hardware Virtualization in OpenNebula towards Efficient High-Performance Computing

has been widely accepted that software virtualization has a big negative impact on high-performance computing (HPC) application performance. This work explores the potential use of Infiniband hardware virtualization in an OpenNebula cloud towards the efficient support of MPI-based workloads. We have implemented, deployed, and tested an Infiniband network on the FermiCloud private Infrastructure-as-a-Service (IaaS) cloud. To avoid software virtualization towards minimizing the virtualization overhead, we employed a technique called Single Root Input/Output Virtualization (SRIOV). Our solution spanned modifications to the Linux’s Hypervisor as well as the OpenNebula manager. We evaluated the performance of the hardware virtualization on up to 56 virtual machines connected by up to 8 DDR Infiniband network links, with micro-benchmarks (latency and bandwidth) as well as w a MPI-intensive application (the HPL Linpack benchmark).

Pais Pitta de Lacerda Ruivo, Tiago↗

Shape and Structure

The convenient availability and simplicity of the Lorenz-Mie theory has resulted in a widespread practice of treating nonspherical particles (especially those in random orientation) as if they were spheres to which Lorenz-Mie results are applicable. However, the assumption of sphericity is rarely made after first having studied the effects of nonsphericity and having concluded that they are negligible. On the contrary, overwhelming evidence suggests that scattering properties of nonspherical particles, including those in random orientation, can significantly differ from those of volume- or surface-equivalent spheres. Hence, the last few decades have demonstrated major research efforts aimed at a significantly better understanding of the effects of particle shape and morphology on electromagnetic scattering. The goal of this presentation is to provide a concise summary of these efforts. The recent availability of theoretical techniques for computing single and multiple scattering of light by realistic polydispersions of spherical and nonspherical particles and the strong dependence of the Stokes scattering matrix on particle size, shape, and refractive index make polarization and depolarization measurements a powerful particle characterization tool. This presentation will focus on recent applications of photopolarimetric and lidar depolarization measurements to remote sensing characterization of tropospheric aerosols, polar stratospheric clouds (PSCs) and contrails. The talk will include (1) a short theoretical overview of the effects of particle microphysics on particle single-scattering characteristics; (2) the use of multi-angle multi-spectral photopolarimetry to retrieve the optical thickness, size distribution, refractive index, and number concentration of tropospheric aerosols over the ocean surface; and (3) the application of the T-matrix method to constraining the PSC and contrail particle microphysics using multi-spectral measurements of lidar backscatter and depolarization

Mishchenko, Michael↗

Earthdata User Interface (EUI) Library

As more remote sensing data moves to the cloud, the design tools we use to build user experiences and visualizations need to change and adapt to make the best use this new data reality. EUI 2.0, the next major iteration of the Earthdata User Interface Library, aims to make creating rich user experiences around NASA's Earth Observation System Data and Information System (EOSDIS) data easy and user-friendly. Building on a solid framework of design components, EUI 2.0 will be open source and have off-the-shelf integration with the Common Metadata Repository (CMR), basic mapping and visualization tools, a refreshed design toolkit for building apps and websites that fit the Earthdata design theme and guidelines. EUI 2.0 will allow for the rapid development of websites and applications based on EOSDIS tools and data holdings. It will also make use of cloud data availability to enable data visualization and analysis without the need to download and sync data.

Siarto, Jeff↗

Cirrus parameterization from the FIRE ER-2 observations

Primary goals for the FIRE field experiments were validation of satellite cloud retrievals and study of cloud radiation parameters. The radiometers and lidar observations which were acquired from the NASA ER-2 high altitude aircraft during the FIRE cirrus field study may be applied to derive quantities which would be applicable for comparison to satellite retrievals and to define the cirrus radiative characteristics. The analysis involves parameterization of the vertical cloud distribution and relative radiance effects. An initial case study from the 28 Oct. 1986 cirrus experiment has been carried out, and results from additional experiment days are to be reported. The observations reported are for 1 day. Analysis of the many other cirrus observation cases from the FIRE study show variability of results.

Spinhirne, James D.↗

Magnetic field amplification and generation in hypervelocity meteoroid impacts with application to lunar paleomagnetism

A one-dimensional numerical model for the expansion of impact-produced vapor clouds is used to investigate magnetic field generation mechanisms in events such as meteor collisions with the moon. The resulting cloud properties, such as ionization fraction, electrical conductivity, radial expansion velocity, mass density, and energy density are estimated. The model is initiated with the peak shock states and pressure thresholds for incipient and complete vaporization of anorthosite lunar surface materials by iron and GA composition meteorites. The expansion of the spherical gas cloud into a vacuum was traced with a one-dimensional explicit lagrangian hydrodynamic code. The hypervelocity impact plasmas produced are found to be significant in the amplitudes and orientations of the magnetic fields generated. An ambient magnetic field could have been provided by the core dynamo, which would have interacted with the expanding plasmas and formed induced paleomagnetic fields. Several other field-contribution mechanisms are discussed and discarded as potential remanent magnetism contributors.

Hood, L. L.↗

"Electrostructural Phase Changes" In Charged Particulate Clouds: Planetary and Astrophysical Implications

There is empirical evidence that freely-suspended triboelectrostatically charged particulate clouds of dielectric materials undergo rapid conversion from (nominally) monodispersed "aerosols" to a system of well-defined grain aggregates after grain motion or fluid turbulence ceases within the cloud. In United States Microgravity Laboratory Space Shuttle experiments USML-1 and USML-2, it was found that ballistically-energized grain dispersions would rapidly convert into populations of filamentary aggregates after natural fluid (air) damping of grain motion. Unless continuously disrupted mechanically, it was impossible to maintain a non-aggregated state for the grain clouds of sand-size materials. Similarly, ground- based experiments with very fine dust-size material produced the same results: rapid, impulsive "collapse" of the dispersed grains into well-defined filamentary structures. In both ground-based and microgravity experiments, the chains or filaments were created by long-range dipole electrostatic forces and dipole-induced dielectric interactions, not by monopole interactions. Maintenance of the structures was assisted by short-range static boundary adhesion forces and van der Waals interactions. When the aggregate containers in the USML experiments were disturbed after aggregate formation, the quiescently disposed filaments would rearrange themselves into fractal bundles and tighter clusters as a result of enforced encounters with one another. The long-range dipole interactions that bring the grains together into aggregates are a product of randomly-distributed monopole charges on the grain surfaces. In computer simulations, it has been shown that when the force vectors of all the random charges (of both sign) on a grain are resolved mathematically by assuming Coulombic interaction between them, the net result is a dipole moment on individual grains, even though the grains are electrically neutral insofar as there is no predominance, on their surface, of one charge sign over another. The random charges of both sign derive from natural grain-to-grain interactions that produce triboelectrification via charge exchange every time grain surfaces make contact with one another. The conversion from a random distribution of grains (upon which there are randomly distributed charges) into an organization of electrostatically-ordered aggregates, can be regarded (within the framework of granular-material science) as an "electrical or Coulombic phase change" of the particulate cloud. It is not totally dissimilar from the more normal phase-change concept in which, for example, a gas with long free-path-molecules suddenly becomes a solid as a result of structural ordering of the molecules (notably, also the result of electronic forces, albeit at a different scale). In both the gas-to-solid case, and the aerosol-to-aggregate case, the same materials and charges are present before and after the phase change, but their arrangement now has a higher degree of order and a lower-energy configuration. An input of energy into the system is required to reverse the situation. The aggregates in the USML experiments were observed to undergo at least two phase changes as noted above. The point about phase changes, and by implication, the "electrostructural" reorganizations in particulate clouds, is the following: (a) they can occur very rapidly, almost spontaneously, above a critical cloud density, (b) in going from a higher energy state to a lower energy state, they convert to a denser system, (c) energy must be required to reverse the situation, implying that energy is released during the high-to-low energy phase change. In applying this information to natural particulate clouds, some inferences can be made (it is stressed that reference is still to dielectric materials attracted by dipole forces). There are several natural settings to which the USML observations apply, and to which the phase-change implications likewise apply. Dense clouds of triboelectrically-charged, kinetically-energized grains are to be found in volcanic eruptions (particularly on earth), aeolian dust storms (particularly on Mars), meteorite impact ejecta curtains (on all planets), in "immature" debris rings around planets (e.g., that from which our own Moon may have condensed), and in gravitationally collapsing protoplanetary dust/planetesimal debris disks where dielectric granules are being increasingly brought into collisional relationships with one another (increasing both charge exchange and physical proximity). It is noted that in many of these cases, the degree of electrical charging on the grains is likely to be much higher than that in the USML experiments where charging was not enhanced above the "normal", naturally encountered level for the particular materials (quartz, glass, and various silicate minerals). Application of the phase-change concept suggests that volcanic, aeolian, and impact debris clouds may, under certain circumstances, undergo rapid, impulsive, or even catastrophic collapse into a denser state that will lead to rapid precipitation or fall-out of suspended particulates. Although this idea has been suggested previously by the author , the phase change concept possibly permits some new insights into cloud-system behavior. For example, in a protoplanetary debris disk, the work of gravity may suddenly be enhanced by electrostatically driven collapse of the system when materials reach a critical intergranular spacing or grain number density. This might reduce the rate of planet formation by orders of magnitude (considering the ratio of g-forces to electrostatic ones for very small grains in close proximity), and indeed, it might drive the collapse into a system configuration that would perhaps not be created by gravity alone. Additional information is contained in the original.

Marshall, J. R.↗

A Comparison of MERRA and NARR Reanalysis Datasets with the DOE ARM SGP Continuous Forcing data

In this study, the atmospheric state, precipitation, cloud fraction, and radiative fluxes from Modern Era Retrospective-analysis for Research and Applications (MERRA) and North American Regional Reanalysis (NARR) are collected and compared with the Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) continuous forcing during the period 1999-2001. For the atmospheric state, the three datasets have excellent agreement for the horizontal wind components and air temperature. NARR and ARM have generally good agreement for humidity, except for several biases in the PBL and in the upper troposphere. MERRA, on the other hand, suffers from a year-round negative bias in humidity except for the month of June. For the vertical pressure velocity, significant differences exist with the largest biases occurring during the spring upwelling and summer downwelling periods. Although NARR and MERRA share many resemblances to each other, ARM outperforms these reanalyses in terms of correlation with cloud fraction. Because the ARM forcing is constrained by observed precipitation that gives the adequate mass, heat, and moisture budgets, much of the precipitation (specifically during the late spring/early summer) is caused by smaller-scale forcing that is not captured by the reanalyses. Both NARR and MERRA capture the seasonal variation of CF observed by ARM radar-lidar and GOES with high correlations (0.92-0.78), but having negative biases of 14% and 3%, respectively. Compared to the ARM observations, MERRA shows a better agreement for both SW and LW fluxes except for LW-down (due to a negative bias in water vapor), NARR has significant positive bias for SW-down and negative bias for LW-down under clear- and all-sky conditions . The NARR biases result from a combination of too few clouds and a lack of sufficient extinction by aerosols and water vapor in the atmospheric column. The results presented here represent only one location for a limited time period, and more comparisons at different locations and longer time period are needed.

Kennedy, Aaron D.↗

Cosmic rays in molecular clouds probed by H 2 rovibrational lines

Context. Low-energy cosmic rays (<1 TeV) play a fundamental role in the chemical and dynamical evolution of molecular clouds, as they control the ionisation, dissociation, and excitation of H 2 . Their characterisation is therefore important both for the interpretation of observations and for the development of theoretical models. However, the methods used so far for estimating the cosmic-ray ionisation rate in molecular clouds have several limitations due to uncertainties in the adopted chemical networks. Aims. Here, we refine and extend a previously proposed method to estimate the cosmic-ray ionisation rate in molecular clouds by observing rovibrational transitions of H 2 at near-infrared wavelengths, which are mainly excited by secondary cosmic-ray electrons. Methods. Combining models of interstellar cosmic-ray propagation and attenuation in molecular clouds with the rigorous calculation of the expected secondary electron spectrum and updated electron-H 2 excitation cross sections, we derive the intensity of the four H 2 rovibrational transitions observable in cold dense gas: (1—0)O(2), (1—0)Q(2), (1—0)S(0), and (1—0)O(4). Results. The proposed method allows the estimation of the cosmic-ray ionisation rate for a given observed line intensity and H 2 column density. We are also able to deduce the shape of the low-energy cosmic-ray proton spectrum impinging upon the molecular cloud. In addition, we present a look-up plot and a web-based application that can be used to constrain the low-energy spectral slope of the interstellar cosmic-ray proton spectrum. We finally comment on the capability of the James Webb Space Telescope to detect these near-infrared H 2 lines, which will make it possible to derive, for the first time, spatial variation in the cosmic-ray ionisation rate in dense gas. Besides the implications for the interpretation of the chemical-dynamic evolution of a molecular cloud, it will finally be possible to test competing models of cosmic-ray propagation and attenuation in the interstellar medium, as well as compare cosmic-ray spectra in different Galactic regions

79 ASTRONOMY AND ASTROPHYSICS↗

Using Total Lightning Observations to Enhance Lightning Safety

Lightning is often the underrated threat faced by the public when it comes to dangerous weather phenomena. Typically, larger scale events such as floods, hurricanes, and tornadoes receive the vast majority of attention by both the general population and the media. This comes from the fact that these phenomena are large, longer lasting, can impact a large swath of society at one time, and are dangerous events. The threat of lightning is far more isolated on a case by case basis, although millions of cloud-to-ground lightning strikes hit this United States each year. While attention is given to larger meteorological events, lightning is the second leading cause of weather related deaths in the United States. This information raises the question of what steps can be taken to improve lightning safety. Already, the meteorological community s understanding of lightning has increased over the last 20 years. Lightning safety is now better addressed with the National Weather Service s access to the National Lightning Detection Network data and enhanced wording in their severe weather warnings. Also, local groups and organizations are working to improve public awareness of lightning safety with easy phrases to remember, such as "When Thunder Roars, Go Indoors." The impacts can be seen in the greater array of contingency plans, from airports to sports stadiums, addressing the threat of lightning. Improvements can still be made and newer technologies may offer new tools as we look towards the future. One of these tools is a network of sensors called a lightning mapping array (LMA). Several of these networks exist across the United States. NASA s Short-term Prediction Research and Transition Center (SPoRT), part of the Marshall Spaceflight Center, has access to three of these networks from Huntsville, Alabama, the Kennedy Space Center, and Washington D.C. The SPoRT program s mission is to help transition unique products and observations into the operational forecast environment. SPoRT has been collaborating with the Huntsville National Weather Service (NWS) Office since 2003 and has since included several other offices to better implement LMA observations into real-time applications. Much of that work has focused on the LMA s ability to detect intra-cloud lightning in addition to cloud-to-ground lightning strikes. Combined, these observations are called total lightning. With total lightning observations, NWS offices can enhance their situational awareness and improve severe weather warnings. Just as importantly, the observed intra-cloud flashes often precede the first cloud-to-ground strike by a few minutes. SPoRT and its partner NWS offices are working to develop visualizations and applications to better utilize these data. However, there is a drawback. The LMAs have a short range of no more than 200 km. This is being addressed with the next generation geostationary satellite, GOES-R, which will boast the Geostationary Lightning Mapper (GLM). SPoRT, in conjunction with NOAA s GOES-R Proving Ground, is working to prepare the end user community for the GLM era using the LMA observations as a demonstration tool. Working collaboratively with our NWS partners, SPoRT is working to determine how best to integrate these future observations to improve both severe storm warnings and lightning safety.

Stano, Geoffrey T.↗

ATMOSPHERIC RETRIEVAL FOR SUPER-EARTHS: UNIQUELY CONSTRAINING THE ATMOSPHERIC COMPOSITION WITH TRANSMISSION SPECTROSCOPY

We present a retrieval method based on Bayesian analysis to infer the atmospheric compositions and surface or cloud-top pressures from transmission spectra of exoplanets with general compositions. In this study, we identify what can unambiguously be determined about the atmospheres of exoplanets from their transmission spectra by applying the retrieval method to synthetic observations of the super-Earth GJ 1214b. Our approach to inferring constraints on atmospheric parameters is to compute their joint and marginal posterior probability distributions using the Markov Chain Monte Carlo technique in a parallel tempering scheme. A new atmospheric parameterization is introduced that is applicable to general atmospheres in which the main constituent is not known a priori and clouds may be present. Our main finding is that a unique constraint of the mixing ratios of the absorbers and two spectrally inactive gases (such as N{sub 2} and primordial H{sub 2}+ He) is possible if the observations are sufficient to quantify both (1) the broadband transit depths in at least one absorption feature for each absorber and (2) the slope and strength of the molecular Rayleigh scattering signature. A second finding is that the surface pressure or cloud-top pressure can be quantified if a surface or cloud deck is present at low optical depth. A third finding is that the mean molecular mass can be constrained by measuring either the Rayleigh scattering slope or the shapes of the absorption features, thus enabling one to distinguish between cloudy hydrogen-rich atmospheres and high mean molecular mass atmospheres. We conclude, however, that without the signature of molecular Rayleigh scattering-even with robustly detected infrared absorption features (>10{sigma})-there is no reliable way to tell from the transmission spectrum whether the absorber is a main constituent of the atmosphere or just a minor species with a mixing ratio of X{sub abs} < 0.1%. The retrieval method leads us to a conceptual picture of which details in transmission spectra are essential for unique characterizations of well-mixed exoplanet atmospheres.

79 ASTRONOMY AND ASTROPHYSICS↗

All-sky Retrieval of Atmospheric Temperature, Water Vapor, Clouds, Trace Gases, and Surface Properties from Operational Hyperspectral IR Sounders

Operational IR sounders such AIRS, CrIS, and IASI provide high quality hyperspectral measurements for weather and climate applications. We will describe a new all-sky Single Field-of-view Sounder Atmospheric Product (SiFSAP). The uniqueness of this product is that it uses all available channels from hyperspectral sounders and the optimal estimation retrieval is done at a single FOV spatial resolution. The SiFSAP includes atmospheric temperature, water vapor, clouds, trace gases, surface skin, and surface emissivity and will be produced operationally at NASA GES DISC. We will describe the core component of the SiFSAP algorithm, which is the Principal Component-based Radiative Transfer Model (PCRTM), and will show example applications of the SiFSAP product for various atmospheric weather and dynamics studies. We also describe a new Climate Fingerprinting Sounder Product (ClimFiSP), which is derived from spatiotemporally averaged level-1 hyperspectral radiances directly. The ClimFiSP algorithm uses consistent radiative kernels and a robust spectral fingerprinting method. It provides fast and accurate data fusion products from multiple satellite sensors. We have applied this method to both AIRS and CrIS (on SNPP and on NOAA 20) data and generated two decades climate data records for atmospheric temperature, water vapor, cloud, trace gases, and surface skin temperature. The ClimFiSP are being transitioned to NASA data centers for routine generations level-3 products.

pcrtm↗

Using Multi-scale Modeling Systems to Study the Precipitation Processes

Numerical cloud models, which are based the non-hydrostatic equations of motion, have been extensively applied to cloud-scale and mesoscale processes during the past four decades. Because cloud-scale dynamics are treated explicitly, uncertainties stemming from convection that have to be parameterized in (hydrostatic) large-scale models are obviated, or at least mitigated, in cloud models. Global models will use the non-hydrostatic framework when their horizontal resolution becomes about 10 km, the theoretical limit for the hydrostatic approximation. This juncture will be reached one to two decades from now. Recently, a multi-scale modeling system with unified physics was developed at NASA Goddard. It consists of (1) a cloud-resolving model (CRM), (2) a regional scale model, (3) a coupled CRM and global model, and (4) a land modeling system. The same microphysical processes, long and short wave radiative transfer processes and the explicit cloud-radiation, and cloudland surface interactive processes are applied in this multi-scale modeling system. In this talk, a review of developments and applications of the multi-scale modeling system will be presented. In particular, the results from using multi-scale modeling system to study the interactions between clouds, precipitation, and aerosols will be presented.

Tao, Wei-Kuo↗

NIAC Phase II Orbiting Rainbows: Future Space Imaging with Granular Systems

Inspired by the light scattering and focusing properties of distributed optical assemblies in Nature, such as rainbows and aerosols, and by recent laboratory successes in optical trapping and manipulation, we propose a unique combination of space optics and autonomous robotic system technology, to enable a new vision of space system architecture with applications to ultra-lightweight space optics and, ultimately, in-situ space system fabrication. Typically, the cost of an optical system is driven by the size and mass of the primary aperture. The ideal system is a cloud of spatially disordered dust-like objects that can be optically manipulated: it is highly reconfigurable, fault-tolerant, and allows very large aperture sizes at low cost. This new concept is based on recent understandings in the physics of optical manipulation of small particles in the laboratory and the engineering of distributed ensembles of spacecraft swarms to shape an orbiting cloud of micron-sized objects. In the same way that optical tweezers have revolutionized micro- and nano-manipulation of objects, our breakthrough concept will enable new large scale NASA mission applications and develop new technology in the areas of Astrophysical Imaging Systems and Remote Sensing because the cloud can operate as an adaptive optical imaging sensor. While achieving the feasibility of constructing one single aperture out of the cloud is the main topic of this work, it is clear that multiple orbiting aerosol lenses could also combine their power to synthesize a much larger aperture in space to enable challenging goals such as exo-planet detection. Furthermore, this effort could establish feasibility of key issues related to material properties, remote manipulation, and autonomy characteristics of cloud in orbit. There are several types of endeavors (science missions) that could be enabled by this type of approach, i.e. it can enable new astrophysical imaging systems, exo-planet search, large apertures allow for unprecedented high resolution to discern continents and important features of other planets, hyperspectral imaging, adaptive systems, spectroscopy imaging through limb, and stable optical systems from Lagrange-points. Furthermore, future micro-miniaturization might hold promise of a further extension of our dust aperture concept to other more exciting smart dust concepts with other associated capabilities. Our objective in Phase II was to experimentally and numerically investigate how to optically manipulate and maintain the shape of an orbiting cloud of dust-like matter so that it can function as an adaptable ultra-lightweight surface. Our solution is based on the aperture being an engineered granular medium, instead of a conventional monolithic aperture. This allows building of apertures at a reduced cost, enables extremely fault-tolerant apertures that cannot otherwise be made, and directly enables classes of missions for exoplanet detection based on Fourier spectroscopy with tight angular resolution and innovative radar systems for remote sensing. In this task, we have examined the advanced feasibility of a crosscutting concept that contributes new technological approaches for space imaging systems, autonomous systems, and space applications of optical manipulation. The proposed investigation has matured the concept that we started in Phase I to TRL 3, identifying technology gaps and candidate system architectures for the space-borne cloud as an aperture.

Quadrelli, Marco B.↗

Let’s Unleash the Network Judgment: A Self-Supervised Approach for Cloud Image Analysis

Accurate cloud type identification and coverage analysis are crucial in understanding the Earth’s radiative budget. Traditional computer vision methods rely on low-level visual features of clouds for estimating cloud coverage or sky conditions. Several handcrafted approaches have been proposed; however, scope for improvement still exists. Newer deep neural networks (DNNs) have demonstrated superior performance for cloud segmentation and categorization. These methods, however, need expert engineering intervention in the preprocessing steps—in the traditional methods—or human assistance in assigning cloud or clear sky labels to a pixel for training DNNs. Such human mediation imposes considerable time and labor costs. We present the application of a new self-supervised learning approach to autonomously extract relevant features from sky images captured by ground-based cameras, for the classification and segmentation of clouds. We evaluate a joint embedding architecture that uses self-knowledge distillation plus regularization. We use two datasets to demonstrate the network’s ability to classify and segment sky images—one with ~85,000 images collected from our ground-based camera and another with 400 labeled images from the WSISEG database. We find that this approach can discriminate full-sky images based on cloud coverage, diurnal variation, and cloud base height. Additionally, it semantically segments the cloud areas without labels. The approach shows competitive performance in all tested tasks, suggesting a new alternative for cloud characterization.

54 ENVIRONMENTAL SCIENCES↗

Final Technical Report: Moving ASR Cloud Microphysical Retrievals Beyond the Vertical Column

Clouds of all types play important roles in atmospheric heating, surface heating and emission of radiation, hence energy, to space. Clouds not only affect atmospheric heating via their impacts on solar and terrestrial radiation, they also release kinetic energy to the atmosphere when they form and they extract kinetic energy from the atmosphere when they evaporate. To understand the impacts of clouds on weather and climate, one must be able to make accurate observations of the amount of water associated with them and the impact of this water on atmospheric and surface heating rates. One important cloud type is liquid water clouds. Liquid clouds are often found in the boundary layers of Earth at altitudes from just above the surface to approximately 2000 m above it, at a variety of temperatures, including temperatures below the freezing point of liquid water (0 °C). As a result, they are important constituents over the world’s oceans as well as over cold, ice-covered surfaces such as in the Arctic. Observationally estimating the total amount of liquid contained in a column through a liquid water cloud can now be accomplished to acceptable accuracies (except for the thinnest, lowest liquid containing clouds) using instruments called passive microwave radiometers. However, observationally determining the spatial distribution of liquid within these columns has proven to be difficult. The focus of this project was on the application of two radars operating at two different frequencies to retrieve the distribution of liquid water within columns passing through liquid water clouds. Motivation in this project for using two different radars operating at different frequencies is that as overlapping (in space) beams from the two radars pass through the same column of liquid water cloud absorption of power from one beam (the 94-GHz beam) is greater than absorption of power from the other beam (the 35-GHz beam). Therefore, the difference in returned powers between the two radar beams with distance from the radars is proportional to the amount of liquid water that the two beams have passed through. Therefore, one can use the differences in power between the two beams with distance through a liquid water cloud to determine the distribution of liquid water throughout the cloud. The two radars used in this study are the Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Program Ka-band Scanning ARM Cloud Radar (Ka-SACR) and the W-band Scanning ARM Cloud Radar (W-SACR). When this projected started in 2013, the Ka- and W-band SACRs were new technology, state-of-the-art sensors. To put together a sufficiently diverse and big set of test cases for the study, data from the SACRs deployed to NSA, SGP, TCAP and MAGIC were used, leading to a test set composed of 65 hours of suitable data spread over approximately 17 case study days. Using the Ka- and W-band SACR data from the case study periods, vertical distributions of liquid water content through liquid water clouds were retrieved. Because there are no other data sets with which to compare the retrievals, distributions of liquid water through a column were summed and compared to the total amounts of liquid water obtained by retrievals applied to passive microwave radiometer observations. The total amounts of liquid water (in units of millimeters, or the thickness in millimeters of the total liquid water in a vertical column if allowed to pool at the bottom of the column) between the two retrievals agreed to within 0.060 mm with a standard deviation of 0.31 mm, or to within 0.016 mm with a standard deviation of 0.12 mm once outliers were removed. The standard deviation of 0.12 mm was fairly independent of the total amount of liquid water in the clouds, indicating that retrieval errors were larger for clouds with smaller amounts of liquid in them. Errors in the retrieved total amounts of liquid were also found to be sensitive to the a priori information that was fed into the retrieval approach. Overall, standard deviations of 0.12 mm are sufficient for some cloud studies but for radiation studies standard deviations on the order of 0.02 mm need to be achieved for clouds with the lowest amounts of liquid water. Many modifications to the retrieval approach were tested subsequently in an attempt to reduce the standard deviations relative to the radiometer retrievals below 0.12 mm but none of them worked reliably. We decided to wait until the DOE ARM Program deployed its second generation SACR2s to its NSA and ENA sites for further retrieval evaluation. The SACR2s were engineered to better synchronize data between the Ka- and W-band radars, reducing potential sources of noise for radar retrieval of liquid water distributions within clouds. The SACR2s have improved in reliability recently and the system deployed to ENA is best positioned to provide the data to advance research on this path. This will be an ongoing research activity beyond the project because of the promise in SACR2 data from the DOE ARM ENA Facility.

58 GEOSCIENCES↗

Datum: A Scientific Metadata Catalog

The data catalog market is currently flooded with a myriad of different products, but none serve the scientific community well. There are cloud-native tools like Databricks, Snowflake,to on-premise solutions like Collibra and Datahub. The common failing of all these tools however, is their inability to serve the scientific data community directly. Most catalogs are targeted towards financial, health, or user data - not sensor or scientific domain data. They also prioritize integrations that often don’t exist or are just starting to be used in the scientific realm - all while ignoring common scientific tools and file types. Datum is a catalog which targets the scientific data directly, including the tools and networks in which those tools are used. We work with the producers and consumers of the data where they are, targeting cloud and on-premise with a focus on classified networks. Datum is an Erlang/Elixir application. Technical Features Note: The features listed below are still under development and may change, slightly, upon final delivery of the product. File Formats - Datum has the ability to read additional metadata and provides processing pipelines for the following file formats: Plain Text, PDF, LaTeX, HTML, Open Document Format (.odt), XML, CSV/TSV (and other standard delimiters), OpenDocument Database and Spreadsheets, Geo-Referenced TIFF, Common Data Format, HDF/HDF5, LabView TDMS, Excel, DeltaTables, Parquet, Apache Iceberg, Apache Hudi and many others. Metadata Collection - Scanners for the local and networked file systems and cloud storage providers. Network integration with common databases such as MSSQL and MySQL. User Plugin System - Users are able to provide either file processing, metadata extraction, or sampling plugins in the programming language of their choice. Authentication/Authorization -: OIDC integration, SCIM provisioning and EntraID integration out of the box. Full user and group management system with a “least privilege” operating mode. Governance - Customizable data governance platform; dictate and enforce required metadata, enforce data embargos, and enforce user agreements and NDAs before data access. Ability to create health checks on data, rejecting abandoned or poorly curated data and automatically removing it from the search index. Ability for users to submit corrections. Search - Semantic search is a first class citizen. No licenses to expensive, external software required. Integrated use of vectors and vector-based search allows for AI agent integration at all levels of operation. Metadata Model - Display and control data’s lineage and connections to other data and data directories. Data is modeled after a filesystem - an organization instantly recognizable and navigable by most any user. CLI and SDK - Ships with a Command Line Interface (CLI) tool and with a fully-featured Python SDK. This allows for rapid and programmatic use of Datum by every level of user. Minimal Infrastructure - Datum ships as a single executable file and can be run on any operating system and most CPU architectures. Datum has no reliance on external databases, search indexing tools, or other outside services - and it runs equally well on edge computing devices, cloud services, or in a clustered HPC environment.

darrington, john↗

Discrimination of Biomass Burning Smoke and Clouds in MAIAC Algorithm

The multi-angle implementation of atmospheric correction (MAIAC) algorithm makes aerosol retrievals from MODIS data at 1 km resolution providing information about the fine scale aerosol variability. This information is required in different applications such as urban air quality analysis, aerosol source identification etc. The quality of high resolution aerosol data is directly linked to the quality of cloud mask, in particular detection of small (sub-pixel) and low clouds. This work continues research in this direction, describing a technique to detect small clouds and introducing the smoke test to discriminate the biomass burning smoke from the clouds. The smoke test relies on a relative increase of aerosol absorption at MODIS wavelength 0.412 micrometers as compared to 0.47-0.67 micrometers due to multiple scattering and enhanced absorption by organic carbon released during combustion. This general principle has been successfully used in the OMI detection of absorbing aerosols based on UV measurements. This paper provides the algorithm detail and illustrates its performance on two examples of wildfires in US Pacific North-West and in Georgia/Florida of 2007.

Lyapustin, A.↗