Search NASA⌕ Search

SEARCH · Search NASA

Results for “cloud systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49

Web-based Visualization and Analytics of Petascale Data: Equity as a Tide that Lifts All Boats

Scientists generate petabytes of data daily to help uncover environmental trends or behaviors that are hard to predict. For example, understanding climate simulations based on the long-term average of temperature, precipitation, and other environmental variables is essential to predicting and establishing root causes of future undesirable scenarios and assessing possible mitigation strategies. While supercomputer centers provide a powerful infrastructure for generating petabytes of simulation output, accessing and analyzing these datasets interactively remains challenging on multiple fronts. This paper presents an approach to managing, visualizing, and analyzing petabytes of data within a browser on equipment ranging from the top NASA supercomputer to commodity hardware like a laptop. Our novel data fabric abstraction layer allows user-friendly querying of scientific information while hid-ing the complexities of dealing with file systems or cloud services.We also optimize network utilization while streaming from petas-cale repositories through state-of-the-art progressive compression algorithms. Based on this abstraction, we provide customizable dashboards that can be accessed from any device with any inter-net connection, enabling interactive visual analysis of vast amounts of data to a wide range of users - from top scientists with access to leadership-class computing environments to undergraduate students of disadvantaged backgrounds from minority-serving institutions. We focus on NASA’s use of petascale climate datasets as an example of particular societal impact and, therefore, a case where achieving equity in science participation is critical. We validate our approach by improving the ability of climate scientists to visually explore their data via two fully interactive dashboards. We further validate our approach by deploying the dashboards and simplified training materials in the classroom at a minority-serving institution.These dashboards, released in simplified form to the general public, contribute significantly to a broader push to democratize the access and use of climate data.

Data visualization↗

Cloud computing security.

Cloud computing is a paradigm rapidly being embraced by government and industry as a solution for cost-savings, scalability, and collaboration. While a multitude of applications and services are available commercially for cloud-based solutions, research in this area has yet to fully embrace the full spectrum of potential challenges facing cloud computing. This tutorial aims to provide researchers with a fundamental understanding of cloud computing, with the goals of identifying a broad range of potential research topics, and inspiring a new surge in research to address current issues. We will also discuss real implementations of research-oriented cloud computing systems for both academia and government, including configuration options, hardware issues, challenges, and solutions.

99 GENERAL AND MISCELLANEOUS↗

Novel Approaches Toward Scalable Composable Workflows in Hyper-Heterogeneous Computing Environments

The annual Workshop on Workflows in Support of Large-Scale Science (WORKS) is a premier venue for the scientific workflow community to present the latest advances in research and development on the many facets of scientific workflows throughout their life-cycle. The Lightning Talks at WORKS focus on describing a novel tool, scientific workflow, or concept, which are work-in-progress and address emerging technologies and frameworks to foster discussion in the community. This paper summarizes the lightning talks at the 2023 edition of WORKS, covering five topics: leveraging large language models to build and execute workflows; developing a common workflow scheduler interface; scaling uncertainty workflow applications on exascale computing systems; evaluating a transcriptomics workflow for cloud vs. HPC systems; and best practices in migrating legacy workflows to workflow management systems.

Titov, Mikhail↗

CERES ERBE-like Monthly Regional Averages (ES-9) in HDF (CER_ES9_FM1+FM2_Edition2)

The ERBE-like Monthly Regional Averages (ES-9) product contains a month of space and time averaged Clouds and the Earth's Radiant Energy System (CERES) data for a single scanner instrument. The ES-9 is also produced for combinations of scanner instruments. All instantaneous shortwave and longwave fluxes at the Top-of-the-Atmosphere (TOA) from the CERES ES-8 product for a month are sorted by 2.5-degree spatial regions, by day number, and by the local hour of observation. The mean of the instantaneous fluxes for a given region-day-hour bin is determined and recorded on the ES-9 along with other flux statistics and scene information. For each region, the daily average flux is estimated from an algorithm that uses the available hourly data, scene identification data, and diurnal models. This algorithm is 'like' the algorithm used for the Earth Radiation Budget Experiment (ERBE). The ES-9 also contains hourly average fluxes for the month and an overall monthly average for each region. These average fluxes are given for both clear-sky and total-sky scenes. The following CERES ES9 data sets are currently available: CER_ES9_FM1+FM2_Edition1 CER_ES9_PFM+FM1+FM2_Edition1 CER_ES9_PFM+FM1+FM2_Edition2 CER_ES9_PFM+FM1_Edition1 CER_ES9_PFM+FM2_Edition1 CER_ES9_PFM+FM1_Edition2 CER_ES9_PFM+FM2_Edition2 CER_ES9_TRMM-PFM_Edition1 CER_ES9_TRMM-PFM_Edition2 CER_ES9_Terra-FM1_Edition1 CER_ES9_Terra-FM2_Edition1 CER_ES9_FM1+FM2_Edition2 CER_ES9_Terra-FM1_Edition2 CER_ES9_Terra-FM2_Edition2 CER_ES9_Aqua-FM3_Edition1 CER_ES9_Aqua-FM4_Edition1 CER_ES9_FM1+FM2+FM3+FM4_Edition1 CER_ES9_Aqua-FM3_Edition2 CER_ES9_Aqua-FM4_Edition2 CER_ES9_FM1+FM3_Edition2 CER_ES9_FM1+FM4_Edition2 CER_ES9_Aqua-FM3_Edition1-CV CER_ES9_Aqua-FM4_Edition1-CV CER_ES9_Terra-FM1_Edition1-CV CER_ES9_Terra-FM2_Edition1-CV. [Location=GLOBAL] [Temporal_Coverage: Start_Date=1998-01-01; Stop_Date=2002-12-31] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=180] [Data_Resolution: Latitude_Resolution=2.5 degree; Longitude_Resolution=2.5 degree; Horizontal_Resolution_Range=250 km - < 500 km or approximately 2.5 degrees - < 5.0 degrees; Temporal_Resolution=hourly, daily, monthly; Temporal_Resolution_Range=Hourly - < Daily, Daily - < Weekly, Monthly - < Annual].

LONGWAVE FLUX↗

A Machine Learning Approach to Determine Surface Radiative Fluxes based on CERES Observations

The Clouds and Earth’s Radiant Energy System (CERES) projects provides satellite-based observations of the radiative fluxes and clouds systems. CERES climate quality data products typically take several months of calibration and validation before release to the public. An alternative data product, Fast Longwave and Shortwave radiative Flux (FLASHFlux), was created to provide data to the applied sciences and educational users. FLASHFlux provides Top-of-Atmosphere radiative fluxes, Clouds properties, and parameterized surface radiative fluxes within four days for footprint (Level 2) data. We investigate the use of Artificial Neural Network (ANN) using MODerate resolution Imaging Spectroradiometer (MODIS) derived clouds properties and meteorology from the Global Assimilation and Meteorology Office (GMAO) scaled to the CERES footprint from the CERES Clouds Radiative Swath (CRS) data product to compute surface radiative fluxes. We test ANN produce fluxes against surface fluxes produced from the Fu-Liou model used in CRS and the Langley Parameterized Shortwave Algorithm (LPSA) and Langley Parameterized Longwave Algorithm (LPLA) used in FLASHFlux. We also validated each model with ground-based observations. Furthermore, we investigate Leave-One-Feature-Out Importance (LOFO) to evaluate the significance of each feature in our training and provide insight for future models. Advances in machine learning, along with increases in computational capabilities and available data allow us to estimate effects of unresolved processes in our climate without direct modeling. This work evaluates the ability to create accurate data-driven models to supplement or replace current models that estimate surface radiative fluxes.

Climatology↗

Advanced Optical Diagnostics for Ice Crystal Cloud Measurements in the NASA Glenn Propulsion Systems Laboratory

A light extinction tomography technique has been developed to monitor ice water clouds upstream of a direct connected engine in the Propulsion Systems Laboratory (PSL) at NASA Glenn Research Center (GRC). The system consists of 60 laser diodes with sheet generating optics and 120 detectors mounted around a 36-inch diameter ring. The sources are pulsed sequentially while the detectors acquire line-of-sight extinction data for each laser pulse. Using computed tomography algorithms, the extinction data are analyzed to produce a plot of the relative water content in the measurement plane. To target the low-spatial-frequency nature of ice water clouds, unique tomography algorithms were developed using filtered back-projection methods and direct inversion methods that use Gaussian basis functions. With the availability of a priori knowledge of the mean droplet size and the total water content at some point in the measurement plane, the tomography system can provide near real-time in-situ quantitative full-field total water content data at a measurement plane approximately 5 feet upstream of the engine inlet. Results from ice crystal clouds in the PSL are presented. In addition to the optical tomography technique, laser sheet imaging has also been applied in the PSL to provide planar ice cloud uniformity and relative water content data during facility calibration before the tomography system was available and also as validation data for the tomography system. A comparison between the laser sheet system and light extinction tomography resulting data are also presented. Very good agreement of imaged intensity and water content is demonstrated for both techniques. Also, comparative studies between the two techniques show excellent agreement in calculation of bulk total water content averaged over the center of the pipe.

Bencic, Timothy J.↗

Comparisons of CFD Simulations of Icing Wind Tunnel Clouds with Experiments Conducted at the NASA Propulsions Systems Laboratory

This paper evaluates simulation predictions against experimental test data of icing clouds that were produced during 2018 ice crystal icing physics tests conducted at the NASA Propulsion Systems Laboratory icing wind tunnel. Aero-thermal and cloud parameters are set and known upstream at the tunnel inlet and spray system, but change as the cloud and air thermodynamically interact as the flowing masses reach the tunnel test section. Utilizing the ANSYS Fluent Discrete Phase Model function, 3D computational fluid dynamics (CFD) simulations were performed, capturing the thermodynamic interactions between the test parameters, and providing predictions of the aero thermal and cloud conditions at the tunnel test section. Simulation predictions were compared with test data that were measured at the tunnel exit plane. Evaluations focused on the cloud concentration (total water content), humidity content, and air temperature. CFD simulation predictions showed areas of agreement and disagreement. Simulations showed that cloud concentration profiles at the test section are strongly related to the initial spray nozzle pattern used at the tunnel inlet. Experimental data suggest that greater dispersion of the cloud occurred as the simulated cloud predicted areas of high and low cloud concentration compared to test data profiles. Simulations, however, captured the magnitude and location of the change in humidity content and the change in air temperature due to the presence of the cloud reasonably well, when compared to test data. This result would suggest that while the ANSYS simulation did not fully predict the spreading of the cloud as measured during experiment, it did capture evaporation and the molecular movements of air and vapor relatively well.

CFD↗

Comparisons of CFD Simulations of Icing Wind Tunnel Clouds with Experiments Conducted at the NASA Propulsions Systems Laboratory

This paper evaluates simulation predictions against experimental test data of icing clouds that were produced during 2018 ice crystal icing physics tests conducted at the NASA Propulsion Systems Laboratory icing wind tunnel. Aero-thermal and cloud parameters are set and known upstream at the tunnel inlet and spray system, but change as the cloud and air thermodynamically interact as the flowing masses reach the tunnel test section. Utilizing the ANSYS Fluent Discrete Phase Model function, 3D computational fluid dynamics (CFD) simulations were performed, capturing the thermodynamic interactions between the test parameters, and providing predictions of the aero thermal and cloud conditions at the tunnel test section. Simulation predictions were compared with test data that were measured at the tunnel exit plane. Evaluations focused on the cloud concentration (total water content), humidity content, and air temperature. CFD simulation predictions showed areas of agreement and disagreement. Simulations showed that cloud concentration profiles at the test section are strongly related to the initial spray nozzle pattern used at the tunnel inlet. Experimental data suggest that greater dispersion of the cloud occurred as the simulated cloud predicted areas of high and low cloud concentration compared to test data profiles. Simulations, however, captured the magnitude and location of the change in humidity content and the change in air temperature due to the presence of the cloud reasonably well, when compared to test data. This result would suggest that while the ANSYS simulation did not fully predict the spreading of the cloud as measured during experiment, it did capture evaporation and the molecular movements of air and vapor relatively well.

CFD↗

An overview of cloud–radiation denial experiments for the Energy Exascale Earth System Model version 1

Abstract. The interaction between clouds and radiation is a key process within the climate system, and assessing the impacts of that interaction provides valuable insights into both the present-day climate and future projections. Many modeling experiments have been designed over the years to probe the impact of the cloud radiative effect (CRE) on the climate, including those that seek to disrupt the mean CRE effect and those that only disrupt the covariance of the CRE with the circulation. Seven such experimental designs have been added to the Energy Exascale Earth System Model version 1 (E3SMv1) of the US Department of Energy. These experiments include both the first and second iterations of the Clouds On/Off Klimate Intercomparison Experiment (COOKIE) experimental design, as well as the cloud-locking method. This paper documents the code changes necessary to implement such experiments and also provides detailed instructions for how to run them. Analyses across experiment types provide valuable insights and confirm the findings of prior studies, including the role of cloud radiative heating toward intensifying the monsoon, intensifying rain rates, and poleward expansion of the general circulation owing to cloud feedbacks.

Harrop, Bryce E. (ORCID:0000000339524525)↗

Artificial Neural Network (ANN) Surface Longwave and Shortwave Fluxes Trained on CERES Observations

The Clouds and Earth’s Radiant Energy System (CERES) project provides satellite-based observations of the radiative fluxes and clouds systems. CERES climate quality data products typically take several months of calibration and validation before release to the public. The Fast Longwave and Shortwave Radiative Flux (FLASHFlux) data product was developed to provide key data for the applied sciences and educational users within a week of observation. FLASHFlux achieves this by using simplified calibration, an operational meteorological product from Global Modeling and Assimilation Office (GMAO), and its own surface parameterizations model. The CERES FLASHFlux provides two data products: 1) an hourly Level 2 Single Scanner Footprint (SSF) data separately for Terra and NOAA-20 observations, and 2) a daily Level 3 Time Interpolated and Spatially Averaged (TISA) 1o x 1o gridded data that combines Terra and NOAA-20 observations. Currently, FLASHFlux uses the Langley Parameterized Shortwave Algorithm (LPSA) and Langley Parameterized Longwave Algorithm (LPLA) to derive its surface fluxes (Kratz et al., 2010; Gupta et al, 2001). A new Machine Learning (ML) based approach using Artificial Neural Networks to derive Surface Longwave (LW) & Shortwave (SW) fluxes based on training data from the CERES Clouds Radiative Swath (CRS) product is being investigated to replace LPSA and LPLA in the SSF surface flux products. One of the biggest hurdles in training ML model is model fitting. To overcome the problem of overfitting we use feature engineering that helps in finding the important feature and remove features that are irrelevant to the model. In our training we employed the Leave-One-Feature-Out Importance (LOFO) to evaluate the significance of each feature in our training. We intercompare ANN fluxes against surface fluxes produced from the Fu-Liou model in CRS and the LPSA/LPLA in FLASHFlux SSF. Furthermore, we validated ANN derived fluxes to the Baseline Surface Radiation Network (BSRN).

P C Sawaengphokhai↗

Use NASA Earthdata in the Cloud

With the impending arrival of new, high-data-volume Earth observation missions, NASA’s ability to effectively ingest, process, and archive large amounts of data requires the most cost-effective, flexible, and scalable data-management architectures and technologies. To meet these demands, NASA's Earth Science Data Systems (ESDS) Program is implementing a strategic vision to develop and operate multiple components of NASA's Earth Observing System Data and Information System (EOSDIS) in a commercial cloud environment. As more earth observing data is moved into the cloud, NASA EOSDIS wants to share our reasoning for moving data into the commercial cloud, as well as demonstrate how end-users can take advantage of both data in the cloud and cloud-deployed services. This presentation explains the enterprise reasons for moving data into the cloud, specifically the scalability of cloud systems, the flexibility to pivot to the most optimal language/system/architecture, and the reduced redundancy of a common architecture. Then we primarily focus on the user-driven reasons for moving to the cloud. Equal access to high performance computing helps all parties, especially users that don't have access to their own on-premise computing infrastructure. Rapid deployment allows users to spin up their own systems without needing the extensive platform previously required for large scale development. Cost effectiveness allows users a wide breadth of computing options, from super computer ability to small scale development, which can help underserved communities. Finally we link to internal resources that users can utilize to begin their cloud based development journey without having to be an expert in the field.

Nicholas Doty↗

TPSAS-NF1676L-10947-DND

There are large uncertainties in quantifying dust effects on the climate because of the limitations on the measurements and observations of dust-cloud-precipitation-dynamics interactions. As a major terrestrial source of atmospheric aerosols, dusts may serve as a significant climate forcing for the changing climate due to its effect on solar and thermal radiation as well as on clouds and precipitation processes. Latest satellites measurements enable us to determine dust loadings and cloud distributions and can potentially be used to reduce the uncertainties in the estimations of aerosol effects on climate. This study uses sensors on various satellites to investigate the impact of mineral dust on cloud microphysical and precipitation processes in convective systems. A trans-Atlantic dust outbreak of Saharan origin occurring in early March 2004 is considered. For the observed convective systems under a given convective strength, small hydrometeors were found more prevalent in the dusty stratiform regions than in those regions that were dust free. Evidence of abundant cloud ice particles in the dust regions, particularly at altitudes where heterogeneous nucleation of mineral dust prevails, further supports the observed changes of clouds and precipitation. These microphysical effects of the dusts on clouds are to shift the size spectrum of precipitation-sized hydrometeors from heavy precipitation to light precipitation and ultimately to suppress precipitation and increase the lifecycle of cloud systems, especially for stratiform clouds.

B Lin↗

Tightly-coupled camera/LiDAR integration for point cloud generation from GNSS/INS-assisted UAV mapping systems

Unmanned aerial vehicles (UAVs) equipped with integrated global navigation satellite systems/inertial navigation systems (GNSS/INS) together with cameras and/or LiDAR sensors are being widely used for topographic mapping in a variety of applications such as precision agriculture, coastal monitoring, and archaeological documentation. Integration of image-based and LiDAR point clouds can provide a comprehensive 3D model of the area of interest. For such integration, ensuring a good alignment between data from the different sources is critical. Although many works have been conducted on this topic, there is still a need for a rigorous integration approach that minimizes the discrepancy between camera and LiDAR data caused by inaccurate system calibration parameters and/or trajectory artifacts. This study proposes an automated tightly-coupled camera/LiDAR integration workflow for GNSS/INS-assisted UAV systems. The proposed strategy is conducted in three main steps. First, an image-based point cloud is generated using a LiDAR/GNSS/INS-assisted structure from motion (SfM) strategy. Then, feature correspondences between image-based and LiDAR point clouds are automatically identified. Finally, an integrated-bundle adjustment procedure including image points, LiDAR raw measurements, and GNSS/INS information is conducted to minimize the discrepancy between point clouds from different sensors while estimating system calibration parameters and refining the trajectory information. The proposed SfM strategy and integration framework are evaluated using five datasets. The SfM results show that using LiDAR data can facilitate feature matching and further increase the number of reconstructed 3D points. The experimental results also illustrate that the developed automated camera/LiDAR integration strategy is capable of accurately estimating system calibration parameters to achieve good alignment among camera/LiDAR data from single/multiple systems. Finally, an absolute accuracy in the range of 3–5 cm is achieved for the image/LiDAR point clouds after the integration process.

42 ENGINEERING↗

Performance Evaluation of Clouds and the Earth’s Radiant Energy System (CERES) Instruments in Generating A Stable Earth Radiation Budget Multi-Decadal Data Record

Clouds and the Earth’s Radiant Energy System (CERES) instrument is designed to measure the earth-reflected solar and earth-emitted longwave radiances, two components of the Earth Radiation Budget. CERES instrument measure radiances in 0.3 to 5.0 micron region with Shortwave (SW) sensor, 0.3 to >100 microns with Total (TOT) sensor, and either 8 - 12 micron with Window (WN) sensor or 5 – 35 micron with longwave (LW) sensor. The on-board internal calibration module (ICM) is used to monitor the stability of the sensors and to correct the pre-launch determined sensor gains for radiance calculations. Corrections for spectral changes occurring in different wavelength regions observed through vicarious studies were applied to sensor response function used in radiance determination. The resulting global flux long term trends from each instrument have shown consistent behavior and provided a stable global record of Top of the Atmosphere (TOA) shortwave and longwave fluxes for the Earth radiation budget climate data record.

Earth Radiation Budget↗

Deep learning tackles cloud detection

To better understand Earth systems, atmospheric scientists use cloud data collected by a remote sensing tool called lidar. These data are an important part of global forecasting, but analyzing lidar images by hand is time-consuming. Researchers at Pacific Northwest National Laboratory teamed up to see if a deep learning model could process lidar data better than current automatic detection techniques.

54 ENVIRONMENTAL SCIENCES↗

Aerosol Microphysical and Radiative Effects on Continental Cloud Ensembles

Aerosol-cloud-radiation interactions represent one of the largest uncertainties in the current climate assessment. Much of the complexity arises from the non-monotonic responses of clouds, precipitation and radiative fluxes to aerosol perturbations under various meteorological conditions. Here, an aerosol-aware Weather Research and Forecasting (WRF) model is used to investigate the microphysical and radiative effects of aerosols in three weather systems during the March 2000 Cloud Intensive Observational Period campaign at the Southern Great Plains site of the US Atmospheric Radiation Measurement Program. Three cloud ensembles with different meteorological conditions are simulated, including a low-pressure deep convective cloud system, a series of lessprecipitating stratus and shallow cumulus, and a cold frontal passage. The WRF simulations are evaluated by the available observations of cloud fraction, liquid water path, precipitation, and surface temperature. The microphysical properties of cloud hydrometeors, such as their mass and number concentrations, generally show monotonic trends as a function of cloud condensation nuclei concentrations. Aerosol radiative effects do not interfere the trends of cloud microphysics, except for the stratus and shallow cumulus cases where aerosol semi-direct effects are identified. The precipitation changes by aerosols vary with the cloud types and their evolving stages, with more prominent aerosol invigoration effect and associated enhanced precipitation from the convective sources. Furthermore, the simulated aerosol direct effect suppresses precipitation in all three cases but does not overturn the direction of precipitation changes by the aerosol indirect effect. Cloud fraction exhibits much smaller sensitivity (typically less than 2%) to aerosol perturbations than the cloud microphysics, and the responses vary with aerosol concentrations and cloud regimes. The surface shortwave radiation shows a monotonic decrease by increasing aerosols, while the magnitude of the decrease depends on the cloud type. Surface temperature changes closely follow the modulation of the surface radiation fluxes.

54 ENVIRONMENTAL SCIENCES↗