Search NASA⌕ Search

SEARCH · Search NASA

Results for “CLOUD COMPUTING”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Benchmarking Information Scrambling

Information scrambling refers to the rapid spreading of initially localized information over an entire system, via the generation of global entanglement. This effect is usually detected by measuring a temporal decay of the out-of-time order correlators. However, in experiments, decays of these correlators suffer from fake positive signals from various sources, e.g., decoherence due to inevitable couplings to the environment, or errors that cause mismatches between the purported forward and backward evolutions. Here, in this Letter, we provide a simple and robust approach to single out the effect of genuine scrambling. This allows us to benchmark the scrambling process by quantifying the degree of the scrambling from the noisy backgrounds. We also demonstrate our protocol with simulations on IBM cloud-based quantum computers.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2016

Impact of Data Placement on Resilience in Large-Scale Object Storage Systems

Distributed object storage architectures have become the de facto standard for high-performance storage in big data, cloud, and HPC computing. Object storage deployments using commodity hardware to reduce costs often employ object replication as a method to achieve data resilience. Repairing object replicas after failure is a daunting task for systems with thousands of servers and billions of objects, however, and it is increasingly difficult to evaluate such scenarios at scale on realworld systems. Resilience and availability are both compromised if objects are not repaired in a timely manner. In this work we leverage a high-fidelity discrete-event simulation model to investigate replica reconstruction on large-scale object storage systems with thousands of servers, billions of objects, and petabytes of data. We evaluate the behavior of CRUSH, a well-known object placement algorithm, and identify configuration scenarios in which aggregate rebuild performance is constrained by object placement policies. After determining the root cause of this bottleneck, we then propose enhancements to CRUSH and the usage policies atop it to enable scalable replica reconstruction. We use these methods to demonstrate a simulated aggregate rebuild rate of 410 GiB/s (within 5% of projected ideal linear scaling) on a 1,024-node commodity storage system. We also uncover an unexpected phenomenon in rebuild performance based on the characteristics of the data stored on the system.

Carns, Philip↗
DOE OSTI2022

Development and Validation of Southeast Asia Solar Resource Data [Slides]

Lack of access to high-quality, publicly available, time series solar data to inform decisions that will transform energy sectors in Southeast Asia is a challenge. The solution is to level the playing field by offering free, high-quality, robust solar data to inform private sector investment and policymaking. This is done by (1) leveraging deep NREL expertise in atmospheric science, solar resource assessment, high-performance computing, and cloud-based data dissemination, (2) producing and validating high spatial and temporal resolution solar resource data, (3) making data available on the USAID-funded global Renewable Energy Data Explorer platform, (4) providing capacity building for data and applications, and (5) informing future demand-driven tool development.

14 SOLAR ENERGY↗
DOE OSTI2024

GlideinBenchmark: collecting resource information to optimize provisioning

Choosing the right resource can speedup jobs completion, better utilize the available hardware and visibly reduce costs, especially when renting computers on the cloud. This was demonstrated in earlier studies on HEPCloud. But the benchmarking of the resources proved to be a laborious and time-consuming process. This paper presents GlideinBenchmark, a new Web application leveraging the pilot infrastructure of GlideinWMS to benchmark resources, and shows how to use the data collected and published by GlideinBenchmark to automate the optimal selection of resources. An experiment can select the benchmark or the set of benchmarks that most closely evaluate the performance of its workflows. With GlideinBenchmark and the help of the GldieinWMS Factory it controls the benchmark execution. Finally, a scheduler like HEPCloud’s Decision Engine can use the results to optimize resource provisioning.

Mambelli, Marco↗
DOE OSTI2025

GlideinBenchmark: collecting resource information to optimize provisioning

Choosing the right resource can speed up job completion, better utilize the available hardware, and visibly reduce costs, especially when renting computers in the cloud. This was demonstrated in earlier studies on HEPCloud. However, the benchmarking of the resources proved to be a laborious and time-consuming process. This paper presents GlideinBenchmark, a new Web application leveraging the pilot infrastructure of GlideinWMS to benchmark resources, and it shows how to use the data collected and published by GlideinBenchmark to automate the optimal selection of resources. An experiment can select the benchmark or the set of benchmarks that most closely evaluate the performance of its workflows. GlideinBenchmark, with the help of the GlideinWMS Factory, controls the benchmark execution. Finally, a scheduler like HEPCloud's Decision Engine can use the results to optimize resource provisioning.

Mambelli, Marco [Fermilab] (ORCID:0000000294892681↗
DOE OSTI2026

The remarkable inefficiency of stratocumulus

Marine stratocumulus clouds play a central role in Earth's climate system by reflecting incoming solar radiation and exerting a strong cooling effect. Their organization into open and closed mesoscale cellular morphologies can be thought of as an example of bistable dynamics driven by aerosol–cloud interactions and mesoscale processes. From the perspective of non-equilibrium thermodynamics, these structures are an example of a far-from-equilibrium open system that continuously produces and exports entropy. While entropy production has been studied in idealized deep convective systems, it has not yet been quantified for shallow clouds. Here, we compute and decompose the internal entropy production of open- and closed-cell stratocumulus using an ensemble of large-eddy simulations. We show that the overall entropy production of stratocumulus is low, reflecting the limited vertical extent and corresponding reduced ability to utilize the energy fluxes at the system's boundaries. Moist processes dominate the overall irreversibility, which, combined with their low entropy production, leads to a mechanical efficiency about an order of magnitude smaller than in deep convective systems. Although the dominant irreversible processes differ between open- and closed-cell regimes, the distributions of total entropy production largely overlap across the ensemble, limiting the ability to distinguish the dynamics of individual cases based solely on total entropy production.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

A geospatial risk analysis graphical user interface for identifying hazardous chemical emission sources

Background: Performing back trajectory and forward trajectory using the Hybrid Single-Particle Lagrangian Integrated Trajectory Model (HYSPLIT) is a reliable approach for assessing particle transport after release among mid-field atmospheric models. HYSPLIT has an externally facing online interface that allows non-expert users to run the model trajectories without requiring extensive training or programming. However, the existing HYSPLIT interface is limited if simulations have a large amount of meteorological data and timesteps that are not coincident. The objective of this study is to design and develop a more robust tool to rapidly evaluate hazard transport conditions and to perform risk analysis, while still maintaining an intuitive and user-friendly interface. Methods: HYSPLIT calculates forward and backward trajectories of particles based on wind speed, wind direction, and the corresponding location, timestamp, and Pasquill stability classes of the regions of the atmosphere in terms of the wind speed, the amount of solar radiation, and the fractional cloud cover. The computed particle transport trajectories, combined with the online Proton Transfer Reaction-Mass Spectrometry (PTR-MS) data (https://figshare.com/articles/dataset/ARL_Data_from_PROS_station_at_Hanford_site/19993964), can be used to identify and quantify the sources and affected area of the hazardous chemicals’ emission using the potential source distribution function (PSDF). PSDF is an improved statistical function based on the well-known potential source contribution function (PSCF) in establishing the air pollutant source and receptor relationship. Performing this analysis requires a range of meteorological and pollutant concentration measurements to be statistically meaningful. The existing HYSPLIT graphical user interface (GUI) does not easily permit computations of trajectories of a dataset of meteorological data in high temporal frequency. To improve the performance of HYSPLIT computations from a large dataset and enhance risk analysis of the accidental release of material at risk, a geospatial risk analysis tool (GRAT-GUI) is created to allow large data sets to be processed instantaneously and to provide ease of visualization. Results: The GRAT-GUI is a native desktop-based application and can be run in any Windows 10 system without any internet access requirements, thus providing a secure way to process large meteorological datasets even on a standalone computer. GRAT-GUI has features to import, integrate, and convert meteorological data with various formats for hazardous chemical emission source identification and risk analysis as a self-explanatory user interface. The tool is available at https://figshare.com/articles/software/GRAT/19426742.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1976

Extension of surface data by use of meteorological satellites

Ways of using meteorological satellite data to extend surface data are summarized. Temperature models are prepared from infrared data from ITOS/NOAA, NIMBUS, SMS/GOES, or future LANDSAT satellites. Using temperatures for surface meteorological stations as anchors, an adjustment is made to temperature values for each pixel in the model. The result is an image with an estimated temperature for each pixel. This provides an economical way of producing detailed temperature information for data-sparse areas, such as are found in underdeveloped countries. Related uses of these satellite data are also given, including the use of computer prepared cloud-free composites to extend climatic zones, and their use in discrimination of reflectivity-thermal regime zones.

Giddings, L. E.↗
NASA NTRS1977

Analysis of satellite derived winds for April 24, 1975

Cumulus cloud tracking based on short-interval GOES satellite imagery provided a representation of the low-level wind fields existing prior to the outbreak of severe thunderstorms. Through use of the satellite-derived winds and surface mixing ratios, moisture convergence fields were estimated. The effect of the spatial distribution of trackable clouds on the computed dynamic fields was also investigated.

Maddox, R. A.↗
NASA NTRS1985

Remote sensing and disaster monitoring - A review of applications in Indonesia

The role played by remote sensors on-board the Landsat and NOAA-7 satellites in monitoring and management of three catastrophic events that took place in 1982 and 1983 in Indonesia (two major volcanic eruptions and a large-scale forest fire) is assessed. The modes of operation of the satellite platforms, the types of data derived, and data availability to the users are described, and the sources of failures and delays (such as the presence of clouds, technical and computer errors, red-tape, etc.) are examined. The major drawbacks of the Landsat-supplied information for monitoring short-lived and fast-changing events were the insufficient frequency of data acquisition, delayed delivery of data, and extended times needed for data distribution and processing. Indonesia's NOAA-7 and GMS sensors, although of low spatial resolution, offered higher frequency of data collection, and profited from the existence of a local receiving station. The present value of the space-based imagery is seen mainly in the baseline assessment of the disaster-prone areas, which can assist in preparing these areas for the impending catastrophic events.

Malingreau, J. P.↗
NASA NTRS1989

Solar radiative transfer in cirrus clouds. I - Single-scattering and optical properties of hexagonal ice crystals. II - Theory and computations of multiple scattering in an anisotropic medium

The light scattering and absorption programs of Cai and Liou (1982) and Takano and Jaweera (1985) are extended to include hexagonal ice crystals randomly and horizontally oriented in space. The scattering and polarization results for the ice crystals are calculated. The results are compared with measurement data. The single-scattering properties for horizontally oriented columns and plates are presented and used to explain halos and arcs observed in the atmopshere. In the second section, the theory and computations for multiple scattering in cirrus clouds containing oriented ice crystals are presented. The radiative transfer in clouds composed of horizontally oriented ice crystals is formulated. Also, reflected and transmitted intensities, planetary albedo, and polarization in multiple scattering by ice crystals are discussed.

Takano, Yoshihide↗
NASA NTRS1991

The physics of the oscillating lightning

The lightning is proposed to start in a limited region of electric breakdown field. A growing charge pool in a cumulonimbus cloud is likely to produce such a field in its outer layers. When the field is not aligned with the potential surfaces, the electric force pushes positive charge in one direction and negative in the opposite. Self inductance develops and an embryo open electric circuit is born. Oscillations swiftly grow in strength when potential energy of the cloud is released. The channel extends in steps during those cycle stages where charge is crammed into the channel terminals. Electrostatic consequences of a narrow conductor among the cloud charges are computed. The conductor is charged by influence to such a degree that the charge is bound to leak out to the ambient air and appear as a charge sheath some distance off the channel. Ample energy is released to sustain the oscillations. The period increases with channel length and agrees well with observed time between steps. A ground strike leads to a shock pulse travelling up the channel.

Storebo, Per B.↗
NASA NTRS1996

A Near-Global Survey of Cirrus Particle Size Using ISCCP

Cirrus is the most frequently occurring and widely distributed cloud type. The average annual frequency of occurrence for cirrus is 34% and its global coverage is about 20-30% (Warren et al. 1985). It strongly influences weather and climate processes through its effects on the radiation budget of the earth and the atmosphere (Liou 1986). Microphysics of cirrus is a critical component in understanding cloud-climate radiative interactions. For example, ice water content feedback is positive from a 1-D model study. But the feedback is substantially reduced upon the inclusion of small ice crystals (Sinha and Shine 1994). Due to the complexity caused by the non-spherical shape of ice crystals in cirrus, retrievals of cirrus properties are difficult. In recent years, advances have been made both in models and in case studies (e.g., Takano and Liou 1989, Young et al. 1994), but no global scale survey has been conducted. Similar to our previous near-global survey of droplet sizes of liquid water clouds (Han et al. 1994), a survey of cirrus ice crystal sizes is conducted over both continental and oceanic areas. We describe a method for retrieving cirrus particle size information on a near-global scale 50 deg S to 50 deg N using currently available satellite data from ISCCP. To retrieve cirrus particle size, we use a radiative transfer model that includes all major absorbing gases and cloud scattering/absorption to compute synthetic radiances as a function of satellite viewing geometry. Ice crystal shapes are assumed to be hexagonal columns and plates. The model results have been validated against clear sky observations and are consistent with the observed radiance range under cloudy conditions.

Han, Qingyuan↗
NASA NTRS2002

Anomalous Heat Budgets in the Interior Pacific Ocean on Seasonal- to -Timescales and Gyre Spacescales

This study quantifies uncertainties in closing the seasonal cycle of diabatic heat storage over the Pacific Ocean from 20 degrees S to 60 degrees N through the synthesis of World Ocean Circulation Experiment (WOCE) products over 7 years from 1993-1999. We utilize WOCE reanalysis products from the following sources: diabatic heat storage (DHS) from the Scripps Institution of Oceanography (SIO); near-surface geostrophic and Ekman currents from the Earth and Space Research (ESR); and air-sea heat fluxes from Comprehensive Ocean-Atmosphere Data Set (COADS), National Centers for Environmental Prediction (NCEP), and European Center for Mid-Range Weather Forecasts (ECMWF). We interpolate these products onto a common grid, allowing the seasonal cycle of DHS to be modeled for comparison with that observed. Everywhere latent heat flux residuals dominate sensible heat flux residuals and shortwave heat flux residuals dominate longwave heat flux residuals, both comparable in magnitude to the residual horizontal heat advection. We find the root-mean-square (RMS) of the differences between observed and model residual DHS tendencies to be less than 15 W per square meters everywhere except in the Kuroshio extension. Comparable COADS and NCEP products perform better than ECMWF products in the extra-tropics, while the NCEP product performs best in the tropics. Radiative and turbulent air-sea heat flux residuals computed from ship-born measurements perform better than those computed from satellite cloud and wind measurements. Since the RMS differences derive largely from biases in measured wind speed and cloud fraction, least-squares minimization is used to correct the residual Ekman heat advection and air-sea heat flux. Minimization reduces RMS differences less than 5 W per square meters except in the Kuroshio extension, suggesting how winds, clouds, and exchange coefficients in the NCEP, ECMWF, and ESR products can be improved.

White, Warren↗
NASA NTRS2009

Multiscale Cloud System Modeling

The central theme of this paper is to describe how cloud system resolving models (CRMs) of grid spacing approximately 1 km have been applied to various important problems in atmospheric science across a wide range of spatial and temporal scales and how these applications relate to other modeling approaches. A long-standing problem concerns the representation of organized precipitating convective cloud systems in weather and climate models. Since CRMs resolve the mesoscale to large scales of motion (i.e., 10 km to global) they explicitly address the cloud system problem. By explicitly representing organized convection, CRMs bypass restrictive assumptions associated with convective parameterization such as the scale gap between cumulus and large-scale motion. Dynamical models provide insight into the physical mechanisms involved with scale interaction and convective organization. Multiscale CRMs simulate convective cloud systems in computational domains up to global and have been applied in place of contemporary convective parameterizations in global models. Multiscale CRMs pose a new challenge for model validation, which is met in an integrated approach involving CRMs, operational prediction systems, observational measurements, and dynamical models in a new international project: the Year of Tropical Convection, which has an emphasis on organized tropical convection and its global effects.

Tao, Wei-Kuo↗
NASA NTRS2016

An Assessment of New Satellite Data Products for the Development of a Long-Term Global Solar Resource at 10-100 km

A project representing an effort to reprocess the NASA based solar resource data sets is reviewed. The effort represented a collaboration between NASA, NOAA, NREL and the SUNY-Albany and aimed to deliver a 10 km resolution, 3-hourly data set spanning from 1983 through near-present. Part of the project was to transition project capability to NREL for annual processing to extend data set. Due to delays in the key input project called ISCCP, we evaluate only Beta versions of this data set and also introduce the potential use of another NASA Langley based cloud data set for the CERES project. The CERES project uses these cloud properties to compute global top-of-atmosphere and surface fluxes at the 1x1 degree resolution. Here, we also briefly discuss these data sets in potential usage for solar resource benchmarking.

Stackhouse, Paul W., Jr.↗
NASA NTRS2017

Simulation of the Ozone Monitoring Instrument Aerosol Index Using the NASA Goddard Earth Observing System Aerosol Reanalysis Products

We provide an analysis of the commonly used Ozone Monitoring Instrument (OMI) aerosol index (AI) product for qualitative detection of the presence and loading of absorbing aerosols. In our analysis, simulated top-of-atmosphere (TOA) radiances are produced at the OMI footprints from a model atmosphere and aerosol profile provided by the NASA Goddard Earth Observing System (GEOS-5) Modern-Era Retrospective Analysis for Research and Applications aerosol reanalysis (MERRAero). Having established the credibility of the MERRAero simulation of the OMI AI in a previous paper we describe updates in the approach and aerosol optical property assumptions. The OMI TOA radiances are computed in cloud-free conditions from the MERRAero atmospheric state, and the AI is calculated. The simulated TOA radiances are fed to the OMI aerosol retrieval algorithms, and its retrieved AI (OMAERUV AI) is compared to the MERRAero calculated AI. Two main sources of discrepancy are discussed: one pertaining the OMI algorithm assumptions of the surface pressure, which are generally different from what the actual surface pressure of an observation is, and the other related to simplifying assumptions in the molecular atmosphere radiative transfer used in the OMI algorithms. Surface pressure assumptions lead to systematic biases in the OMAERUV AI, particularly over the oceans. Simplifications in the molecular radiative transfer lead to biases particularly in regions of topography intermediate to surface pressures of 600hPa and 1013.25hPa. Generally, the errors in the OMI AI due to these considerations are less than 0.2 in magnitude, though larger errors are possible, particularly over land. We recommend that future versions of the OMI algorithms use surface pressures from readily available atmospheric analyses combined with high-spatial resolution topographic maps and include more surface pressure nodal points in their radiative transfer lookup tables.

remote sensing↗
NASA NTRS2017

Nominal 30-M Cropland Extent Map of Continental Africa by Integrating Pixel-Based and Object-Based Algorithms Using Sentinel-2 and Landsat-8 Data on Google Earth Engine

A satellite-derived cropland extent map at high spatial resolution (30-m or better) is a must for food and water security analysis. Precise and accurate global cropland extent maps, indicating cropland and non-cropland areas, is a starting point to develop high-level products such as crop watering methods (irrigated or rainfed), cropping intensities (e.g., single, double, or continuous cropping), crop types, cropland fallows, as well as assessment of cropland productivity (productivity per unit of land), and crop water productivity (productivity per unit of water). Uncertainties associated with the cropland extent map have cascading effects on all higher-level cropland products. However, precise and accurate cropland extent maps at high spatial resolution over large areas (e.g., continents or the globe) are challenging to produce due to the small-holder dominant agricultural systems like those found in most of Africa and Asia. Cloud-based Geospatial computing platforms and multi-date, multi-sensor satellite image inventories on Google Earth Engine offer opportunities for mapping croplands with precision and accuracy over large areas that satisfy the requirements of broad range of applications. Such maps are expected to provide highly significant improvements compared to existing products, which tend to be coarser in resolution, and often fail to capture fragmented small-holder farms especially in regions with high dynamic change within and across years. To overcome these limitations, in this research we present an approach for cropland extent mapping at high spatial resolution (30-m or better) using the 10-day, 10 to 20-m, Sentinel-2 data in combination with 16-day, 30-m, Landsat-8 data on Google Earth Engine (GEE). First, nominal 30-m resolution satellite imagery composites were created from 36,924 scenes of Sentinel-2 and Landsat-8 images for the entire African continent in 2015-2016. These composites were generated using a median-mosaic of five bands (blue, green, red, near-infrared, NDVI) during each of the two periods (period 1: January-June 2016 and period 2: July-December 2015) plus a 30-m slope layer derived from the Shuttle Radar Topographic Mission (SRTM) elevation dataset. Second, we selected Cropland/Non-cropland training samples (sample size 9791) from various sources in GEE to create pixel-based classifications. As supervised classification algorithm, Random Forest (RF) was used as the primary classifier because of its efficiency, and when over-fitting issues of RF happened due to the noise of input training data, Support Vector Machine (SVM) was applied to compensate for such defects in specific areas. Third, the Recursive Hierarchical Segmentation (RHSeg) algorithm was employed to generate an object-oriented segmentation layer based on spectral and spatial properties from the same input data. This layer was merged with the pixel-based classification to improve segmentation accuracy. Accuracies of the merged 30-m crop extent product were computed using an error matrix approach in which 1754 independent validation samples were used. In addition, a comparison was performed with other available cropland maps as well as with LULC maps to show spatial similarity. Finally, the cropland area results derived from the map were compared with UN FAO statistics. The independent accuracy assessment showed a weighted overall accuracy of 94, with a producers accuracy of 85.9 (or omission error of 14.1), and users accuracy of 68.5 (commission error of 31.5) for the cropland class. The total net cropland area (TNCA) of Africa was estimated as 313 Mha for the nominal year 2015.

Cropland mapping; cropland areas; 30-m; Landsat-8;↗