Search NASA⌕ Search

SEARCH · Search NASA

Results for “cloud applications”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

X-composer: enabling cross-environments in-situ workflows between HPC and cloud

As large-scale scientific simulations and big data analyses become more popular, it is increasingly more expensive to store huge amounts of raw simulation results to perform post-analysis. To minimize the expensive data I/O, "in-situ" analysis is a promising approach, where data analysis applications analyze the simulation generated data on the fly without storing it first. However, it is challenging to organize, transform, and transport data at scales between two semantically different ecosystems due to the distinct software and hardware difference. To tackle these challenges, we design and implement the X-Composer framework. X-Composer connects cross-ecosystem applications to form an "in-situ" scientific workflow, and provides a unified approach and recipe for supporting such hybrid in-situ workflows on distributed heterogeneous resources. X-Composer reorganizes simulation data as continuous data streams and feeds them seamlessly into the Cloud-based stream processing services to minimize I/O overheads. For evaluation, we use X-Composer to set up and execute a cross-ecosystem workflow, which consists of a parallel Computational Fluid Dynamics simulation running on HPC, and a distributed Dynamic Mode Decomposition analysis application running on Cloud. Our experimental results show that X-Composer can seamlessly couple HPC and Big Data jobs in their own native environments, achieve good scalability, and provide high-fidelity analytics for ongoing simulations in real-time.

Wang, Dali↗

Lidar-Polarimeter Retrieval OSSEs in Support of NASA's Aerosols and Clouds-Convection-Precipitation (ACCP) Study

The 2017 Decadal Survey (DS) highlighted Earth System Science themes, science and application questions, and several high priority objectives that have led to the inclusion of Aerosols (A) and Clouds-Convection-Precipitation (CCP) as Designated Observables (DOs). On June 1, 2018, several NASA centers (GSFC, LaRC, JPL, MSFC, GRC and ARC) submitted a joint Study Plan to the NASA Earth Science Division for the Aerosol (A) and Cloud, Convection, and Precipitation (CCP) Pre-formulation Study (A-CCP). The DS and the A-CCP team recognized the science merit in combining the A and CCP DOs for both enhancing the ability to address a number of science objectives and also to provide an expanded capability to address additional objectives beyond those addressed by individual DOs.A critical element of the A-CCP observing strategy is to make extensive use of new passive and active sensors as well as of the so-called Program-of-Record (PoR), complemented by a fully integrated sub-orbital component. Central to this observing system design is the adoption of a Value Framework in which quantitative assessment of the science benefits of space-and air-borne assets is a key element. Given pre-defined A-CCP science objectives and geophysical variables with desired accuracies, A-CCP relies on a spectrum of Observing System Simulation Experiments (OSSEs) aimed at addressing pixel level retrieval uncertainties and sampling trade-offs. In this talk we will discuss a subset of Retrieval OSSEs being considered for A-CCP, namely, synergistic lidar-polarimeter retrievals of particular relevance for the A-CCP aerosol science objectives. Starting with aerosol states from the GEOS-5 Nature Run (G5NR) sampled along specific satellite orbits, we simulate polarized radiances at the desired polarimeter wavelengths with the Vector Linearized Direct Ordinate Radiative Transfer (VLIDORT) model, alongside the lidar signal for the relevant lidars with realistic error characterization. Next, inversions are performed with the Generalized Retrieval of Aerosol and Surface Properties (GRASP) system and the accuracy of the retrieved geophysical variables are assessed. In this presentation we will highlight results for key architectures being considered for A-CCP.

da Silva, Arlindo↗

Application of a Gaussian multilayer diffusion model to characterize dispersion of vertical HCl column density in rocket exhaust clouds

Solid rocket exhaust cloud dispersion cases, based on seven meteorological regimes for overland advection in the Cape Canaveral, Florida, area, are examined for launch vehicle environmental impacts. They include a space shuttle case and all seven meteorological cases for the Titan 3, which exhausts 60% less HC1. The C(HC1) decays are also compared with recent in cloud peak HC1 data from eight Titan 3 launches. It is stipulated that while good overall agreement provides validation of the model, its limitations are considerable and a dynamics model is needed to handle local convective situations.

Pellett, G. L.↗

Thermodynamic and cloud parameter retrieval using infrared spectral data

High-resolution infrared radiance spectra obtained from near nadir observations provide atmospheric, surface, and cloud property information. A fast radiative transfer model, including cloud effects, is used for atmospheric profile and cloud parameter retrieval. The retrieval algorithm is presented along with its application to recent field experiment data from the NPOESS Airborne Sounding Testbed - Interferometer (NAST-I). The retrieval accuracy dependence on cloud properties is discussed. It is shown that relatively accurate temperature and moisture retrievals can be achieved below optically thin clouds. For optically thick clouds, accurate temperature and moisture profiles down to cloud top level are obtained. For both optically thin and thick cloud situations, the cloud top height can be retrieved with an accuracy of approximately 1.0 km. Preliminary NAST-I retrieval results from the recent Atlantic-THORPEX Regional Campaign (ATReC) are presented and compared with coincident observations obtained from dropsondes and the nadir-pointing Cloud Physics Lidar (CPL).

Zhou, Daniel K.↗

Practical quantum computation of chemical and nuclear energy levels using quantum imaginary time evolution and Lanczos algorithms

Various methods have been developed for the quantum computation of the ground and excited states of physical and chemical systems, but many of them require either large numbers of ancilla qubits or high-dimensional optimization in the presence of noise. The quantum imaginary-time evolution (QITE) and quantum Lanczos (QLanczos) methods proposed in Motta et al. (2020) eschew the aforementioned issues. In this study, we demonstrate the practical application of these algorithms to challenging quantum computations of relevance for chemistry and nuclear physics, using the deuteron-binding energy and molecular hydrogen binding and excited state energies as examples. With the correct choice of initial and final states, we show that the number of timesteps in QITE and QLanczos can be reduced significantly, which commensurately simplifies the required quantum circuit and improves compatibility with NISQ devices. We have performed these calculations on cloud-accessible IBM Q quantum computers. With the application of readout-error mitigation and Richardson error extrapolation, we have obtained ground and excited state energies that agree well with exact results obtained from diagonalization.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

The Far-Infrared Polarization Spectrum: First Results and Analysis

We present data on the polarization of the thermal emission from Galactic Clouds at 60 micrometers, 100 micrometers, and 350 micrometers. There are examples of rising polarization spectra in dense cloud cores [P(350 micrometers/P(100 micrometers) approximately equal to 2], and falling spectra in cloud envelopes [P(350)/P(100 micrometers) approximately equal to 0.6]. We also present data showing that the relationship, P(tau), between polarization and optical depth in cloud cores is different from that in cloud envelopes. We review the principles governing the far-infrared polarization spectrum and discuss applications to the data on P(lambda) and P(tau). We conclude that the cloud envelopes we have observed must contain two populations of grains that differ in their polarization efficiencies and in their emission spectra. We propose a model for cloud envelopes in which the contrasting populations reside in domains of different mean temperatures where the warmer domains contain the aligned grains.

Hildebrand, R. H.↗

Seismology in the Cloud: A New Streaming Workflow

Data-intensive research in seismology is experiencing a recent boom, driven in part by large volumes of available data and advances in the growing field of data science. However, there are significant barriers to processing large data volumes, such as long retrieval times from data repositories, complex data management, and limited computational resources. New tools and platforms have reduced the barriers to entry for scientific cluster computing, including the maturation of the commercial cloud as an accessible instrument for research. Here, we build a customized research cluster in the cloud to test a new workflow for large-scale seismic analysis, in which data are processed as a stream (retrieved on-the-fly and acted upon without storing), with data from the Incorporated Research Institutions for Seismology Data Management Center. We use this workflow to deploy a spectral peak detection algorithm over 5.6 TB of compressed continuous seismic data from 2074 stations of the USArray Transportable Array EarthScope network. Using a 50-node cluster in the cloud, we completed the noise survey in 80 hr, with an average data throughput of 1.7 GB per minute. By varying cluster sizes, we find the scaling of our analysis to be sublinear, due to a combination of algorithmic limitations and data center response times. The cloud-based streaming workflow represents an order-of-magnitude increase in acquisition and processing speed compared to a traditional download-store-process workflow, and offers the additional benefits of employing a flexible, accessible, and widely used computing architecture. It is limited, however, due to its reliance on Internet transfer speeds and data center service capacity, and may not work well for repeated analyses or those for which even higher data throughputs are needed. These research applications will require a new class of cloud-native approaches in which both data and analysis are in the cloud.

58 GEOSCIENCES↗

Cloud-Based Numerical Weather Prediction for Near Real-Time Forecasting and Disaster Response

Cloud computing capabilities have rapidly expanded within the private sector, offering new opportunities for meteorological applications. Collaborations between NASA Marshall, NASA Ames, and contractor partners led to evaluations of private (NASA) and public (Amazon) resources for executing short-term NWP systems. Activities helped the Marshall team further understand cloud capabilities, and benchmark use of cloud resources for NWP and other applications

Disasters↗

Spatial distribution of melt-season cloud radiative effects over Greenland: Evaluating satellite observations, reanalyses, and model simulations against in situ measurements

Arctic clouds can profoundly influence surface radiation and thus surface melt. Over Greenland, these cloud radiative effects (CRE) vary greatly with the diverse topography. To investigate the ability of assorted platforms to reproduce heterogeneous CRE, we evaluate CRE spatial distributions from a satellite product, reanalyses, and a global climate model against estimates from 21 automatic weather stations (AWS). Net CRE estimated from AWS generally decreases with elevation, forming a “warm center” distribution. CRE areal averages from the five large–scale data sets we analyze are all around 10 W/m 2 . Modern–Era Retrospective Analysis for Research and Applications version 2 (MERRA–2), ERA–Interim, and Clouds and the Earth's Radiant Energy System (CERES) CRE estimates agree with AWS and reproduce the warm center distribution. However, the National Center for Atmospheric Research Arctic System Reanalysis (ASR) and the Community Earth System Model Large ENSemble Community Project (LENS) show strong warming in the south and northwest, forming a warm L–shape distribution. Discrepancies are mainly caused by longwave CRE in the accumulation zone. MERRA–2, ERA–Interim, and CERES successfully reproduce cloud fraction and its dominant positive influence on longwave CRE in this region. On the other hand, longwave CRE from ASR and LENS correlates strongly with ice water path instead of with cloud fraction or liquid water path. Moreover, ASR overestimates cloud fraction and LENS underestimates liquid water path substantially, both with limited spatial variability. MERRA–2 best captures the observed interstation changes, captures most of the observed cloud–radiation physics, and largely reproduces both albedo and cloud properties. Furthermore, the warm center CRE spatial distribution indicates that clouds enhance surface melt in the higher accumulation zone and reduce surface melt in the lower ablation zone.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

TPSAS-NF1676L-34528-DND

Since 2006, the Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP), aboard the Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) satellite, has provided a unique vertical perspective of Earth's atmosphere. These measurements have furthered our understanding of the role aerosols and clouds play in the climate system and have been leveraged for atmospheric modeling and air quality studies. In this seminar, the basics of LIDAR remote sensing will first be presented, including its operating principles, setup and geometry, the LIDAR equation, and different LIDAR types and techniques. Next, an overview of the LIDAR systems at NASA Langley Research Center will be provided, with an emphasis on the CALIPSO satellite mission, including available data products and examples of browse images. Lastly, several CALIPSO-based science applications and research projects will be discussed, including cloud contamination in passive satellite aerosol retrievals, aerosol detection limits, trends in aerosol vertical distribution, and air quality (PM2.5 concentrations).

Travis Toth↗

Automated detection of cloud and cloud-shadow in single-date Landsat imagery using neural networks and spatial post-processing

Use of Landsat data to answer ecological questions is contingent on the effective removal of cloud and cloud shadow from satellite images. We develop a novel algorithm to identify and classify clouds and cloud shadow, \textsc{sparcs}: Spacial Procedures for Automated Removal of Cloud and Shadow. The method uses neural networks to determine cloud, cloud-shadow, water, snow/ice, and clear-sky membership of each pixel in a Landsat scene, and then applies a set of procedures to enforce spatial rules. In a comparison to FMask, a high-quality cloud and cloud-shadow classification algorithm currently available, \textsc{sparcs} performs favorably, with similar omission errors for clouds (0.8% and 0.9%, respectively), substantially lower omission error for cloud-shadow (8.3% and 1.1%), and fewer errors of commission (7.8% and 5.0%). Additionally, textsc{sparcs} provides a measure of uncertainty in its classification that can be exploited by other processes that use the cloud and cloud-shadow detection. To illustrate this, we present an application that constructs obstruction-free composites of images acquired on different dates in support of algorithms detecting vegetation change.

cloud masking↗

Elastic Resource Management for Deep Learning Applications in a Container Cluster

The increasing demand for learning from massive datasets is restructuring our economy. Effective learning, however, involves nontrivial computing resources. Most businesses utilize commercial infrastructure providers (e.g., AWS) to host their computing clusters in the cloud, where various jobs compete for available resources. While cloud resource management is a fruitful research field that has made many advances in production, such as Kubernetes and YARN, few efforts have been invested to further optimize the system performance, especially for deep learning (DL) training jobs in a container cluster. This work introduces FlowCon, a system that is able to monitor the individual evaluation functions of DL jobs at runtime, and thus to make placement decisions on resource allocations elastically. Here, we present a detailed design and implementation of FlowCon and conduct intensive experiments over various DL models. The results demonstrate that FlowCon significantly improves DL job completion time and resource utilization efficiency, compared to default systems. According to the results, FlowCon is able to improve the completion time by up to 68.8% and meanwhile, reduce the makespan by 18.0%, in the presence of various DL job workloads.

97 MATHEMATICS AND COMPUTING↗

Study to develop improved spacecraft snow survey methods using Skylab/EREP data

The author has identified the following significant results. A segment of the interim S192 film product from the SL-2 mission has been examined. The film covers the White Mountains area near the California-Nevada border and contains useable data for spectral bands: band 3, band 7, band 9, and band 11. Whereas the snow surface exhibits wide variations in reflectance, no significant change in the reflectance of the clouds occurs over the spectral range of these four bands. In band 11 the clouds appear white and snow appears black; in the band 3 data, both the clouds and the snow appear white. Two potential applications are possible, based on these results. First, because the reflectance of the snow surface in the band 9 data is much lower at the lower elevation terrain of the White Mountains, it appears that the drop in reflectance in the near-IR portion of the spectrum may be related to the wetness of the snow surface. Secondly, the complete reversal in reflectance that is observed in band 11 data indicates that in this portion of the spectrum snow surfaces have a low reflectance regardless of the condition of the snow. Because clouds do not exhibit a similar drop in reflectance, measurements in this spectral band have potential use for automatically distinguishing snow from clouds.

Barnes, J. C.↗

Lidar-Polarimeter Retrieval OSSEs using a Nature Run in Support of NASA's Aerosols, Clouds, Convection and Precipitation (ACCP) Study

The 2017 Decadal Survey (DS) highlighted Earth System Science themes, science and application questions, and several high priority objectives that have led to the inclusion of Aerosols (A) and Clouds-Convection-Precipitation (CCP) as Designated Observables (DOs). On June 1, 2018, several NASA centers (GSFC, LaRC, JPL, MSFC, GRC and ARC) submitted a joint Study Plan to the NASA Earth Science Division for the Aerosol (A) and Cloud, Convection, and Precipitation (CCP) Pre-formulation Study (ACCP). The DS and the ACCP team recognized the science merit in combining the A and CCP DOs for both enhancing the ability to address a number of science objectives and also to provide an expanded capability to address additional objectives beyond those addressed by individual DOs. A critical element of the ACCP observing strategy is to make extensive use of new passive and active sensors as well as of the so-called Program-of-Record (PoR), complemented by a fully integrated sub-orbital component. Central to this observing system design is the adoption of a Value Framework in which quantitative assessment of the science benefits of space- and air-borne assets is a key element. Given pre-defined ACCP science objectives and geophysical variables with desired accuracies, ACCP relies on a spectrum of Observing System Simulation Experiments (OSSEs) aimed at addressing pixel level retrieval uncertainties and sampling trade-offs. In this talk we will discuss a subset of Retrieval OSSEs being considered for ACCP, namely, synergistic lidar-polarimeter retrievals based on observation simulations from the GEOS-5 Nature Run (G5NR). Starting with aerosol states from the GEOS-5 Nature Run (G5NR) sampled along specific satellite orbits, we simulate polarized radiances at the desired polarimeter wavelengths with the Vector Linearized Direct Ordinate Radiative Transfer (VLIDORT) model, alongside the lidar signal for the relevant lidars with realistic error characterization. Next, inversions are performed with the Generalized Retrieval of Aerosol and Surface Properties (GRASP) system and the accuracy of the retrieved geophysical variables are assessed. In this presentation we will highlight results for key architectures being considered for ACCP with emphasis on geophysical variables of particular relevance to ACCP’s aerosol science objectives.

A Da Silva↗

Kinetics and mechanism of the oxidation of S(IV) by ozone in aqueous solution with particular reference to SO2 conversion in nonurban tropospheric clouds

Results are presented from a laboratory study of the kinetics of the S(IV)-O3 reaction in aqueous solution, including measurements of the effects of UV radiation, dissolved transition metals, and an antioxidant (hydroquinone) on the rate. On the basis of the results, relative rates of S(IV) conversion by O3 in tropospheric cloud water are compared with those predicted for H2O2 and for O2. The reaction mechanism is discussed, with an outline given of the elements of a possible reaction scheme. Application of the rate constants obtained to SO2 conversion in cloud water predicts conversion rates by ozone to be competitive with those by H2O2 at pH above about 4.5 and to dominate at pH above about 5.5. It is pointed out that since these pH's are typical for nonurban tropospheric cloud water, ozone is a potentially important contributor to the overall oxidative conversion of SO2 to sulfate in the nonurban troposphere.

Maahs, H. G.↗

Cloud Services Enable Efficient AI-Guided Simulation Workflows across Heterogeneous Resources

Applications which fuse machine learning and simulation are rarely best served by a single computing resource. Highly parallel simulation codes are best deployed on super- computers, while AI tasks used to decide which simulations to perform may be best suited to specialized accelerators. Here we present a Function-as-a-Service (FaaS) system for executing complex, distributed computational campaigns that achieves performance parity with conventional workflow systems without the complexities of secure network connections between compute providers. One innovation enabling high performance is a subsystem that directly moves task data between sites, separate from the cloud-hosted FaaS system used to distribute task instructions. We also introduce a flexible scheduling system that allows us access factor of 2 trade offs between the amount of resources required to solve a problem at each compute site. We anticipate that this system will upgrade multi-site applications from demonstration projects to routine practice in computational science.

Ward, Logan↗

Toward Physics-informed Neural Networks for 3D Multi-layer Cloud Mask Reconstruction

Three-dimensional (3D) cloud retrievals are critical for understanding their impact on climate and other applications such as aviation safety, weather prediction, and remote sensing. However, obtaining high-resolution and accurate vertical representation of clouds remains unsolved due to the limitations imposed by satellite instrumentation, viewing conditions, and the complexity of cloud dynamics. Cloud masks are essential for comprehending various cloud vertical properties, but deriving accurate 3D cloud masks from 2D satellite imagery data is a challenging task. To tackle these challenges, we introduce a physics-informed loss function for training deep learning models that can extend 2D cloud images into 3D cloud masks. The proposed loss, called CloudMask Loss, is composed of two domain knowledge-informed loss terms: one for evaluating cloud position and thickness, and the other for measuring the number of layers. By combining these loss terms, we improve the trainability of the deep learning models for more accurate and meaningful results. We apply the proposed loss function to different neural networks and demonstrate significant improvements in multi-layer cloud mask reconstruction. Utilizing the same neural network architecture, our proposed loss outperforms standard binary crossentropy loss in terms of multi-layer cloud classification accuracy, number of layers accuracy, and thickness mean absolute error (MAE). The proposed loss function can be readily integrated into various neural network architectures, resulting in substantial performance gains in 3D cloud mask generation.

multi-layer clouds↗

Reflective all-sky thermal infrared cloud imager

A reflective all-sky imaging system has been built using a long-wave infrared microbolometer camera and a reflective metal sphere. This compact system was developed for measuring spatial and temporal patterns of clouds and their optical depth in support of applications including Earth-space optical communications. The camera is mounted to the side of the reflective sphere to leave the zenith sky unobstructed. The resulting geometric distortion is removed through an angular map derived from a combination of checkerboard-target imaging, geometric ray tracing, and sun-location-based alignment. A tape of high-emissivity material on the side of the reflector acts as a reference that is used to estimate and remove thermal emission from the metal sphere. In conclusion, once a bias that is under continuing study was removed, sky radiance measurements from the all-sky imager in the 8-14 μm wavelength range agreed to within 0.91 W/(m 2 sr) of measurements from a previously calibrated, lens-based infrared cloud imager over its 110° field of view.

47 OTHER INSTRUMENTATION↗