SEARCH · Search NASA

Results for “cloud computing, data cloud”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37

All sources NASA NTRS DOE OSTI

NASA NTRS2026

Hydrology Copilot: A Cloud-Native Ai System for Hydrological Data Analysis

The emergence of AI-driven Earth observation systems promises to broaden access to petabyte-scale geospatial data beyond domain specialists. However, translating this vision into operational scientific infrastructure requires addressing fundamental challenges in data virtualization, code transparency, and domain-specific reasoning. We present Hydrology Copilot, a cloud-native AI framework for natural-language-driven analysis of Earth observation data. To demonstrate operational capabilities at scale, we implement the system using NASA's North American Land Data Assimilation System version 3 (NLDAS-3), which provides surface meteorological forcing and land-surface model output across North and Central America at 1-km resolution, from which drought diagnostics are derived. The system integrates five core contributions: (1) scalable data virtualization using Kerchunk-based cloud optimized access, achieving a 1.5 to 4.6 times improvement in I/O latency across benchmark queries spanning regional single-day extractions (4.6 times speedup) to continental monthly aggregations (1.5 times speedup); (2) transparent code generation through Microsoft Azure AI Foundry agents that expose executable Python workflows for scientific verification; (3) persistent conversational memory enabling multi-turn analytical discourse across sessions; (4) intelligent query validation that enforces dataset boundaries and resolves ambiguous requests before execution; and (5) a multi-agent architecture coordinating query parsing, code generation, and visualization. We evaluate the system through drought-monitoring workflows, demonstrating reliable code generation, accurate results validated against reference computations and the operational U.S. Drought Monitor, and efficient operation across increasingly complex tasks. By bridging natural-language interfaces with rigorous hydrological analysis, Hydrology Copilot advances beyond proof-of-concept demonstrations to provide a deployable framework for operational Earth science applications.

Data virtualization↗

DOE OSTI2015

FACE-IT. A Science Gateway for Food Security Research

Progress in sustainability science is hindered by challenges in creating and managing complex data acquisition, processing, simulation, post-processing, and intercomparison pipelines. To address these challenges, we developed the Framework to Advance Climate, Economic, and Impact Investigations with Information Technology (FACE-IT) for crop and climate impact assessments. This integrated data processing and simulation framework enables data ingest from geospatial archives; data regridding, aggregation, and other processing prior to simulation; large-scale climate impact simulations with agricultural and other models, leveraging high-performance and cloud computing; and post-processing to produce aggregated yields and ensemble variables needed for statistics, for model intercomparison, and to connect biophysical models to global and regional economic models. FACE-IT leverages the capabilities of the Globus Galaxies platform to enable the capture of workflows and outputs in well-defined, reusable, and comparable forms. We describe FACE-IT and applications within the Agricultural Model Intercomparison and Improvement Project and the Center for Robust Decision-making on Climate and Energy Policy.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS2013

Recent Efforts to Improve the Near Real Time Forest Disturbance Monitoring Capabilities of the ForWarn System

This presentation discusses the development of anew method for computing NDVI temporal composites from near real time eMODIS data This research is being conducted to improve forest change products used in the ForWarn system for monitoring regional forest disturbances in the United States. ForWarn provides nation-wide NDVI-based forest disturbance detection products that are refreshed every 8 days. Current eMODIS and historical MOD13 24 day NDVI data are used to compute the disturbance detection products. The eMODIS 24 day NDVI data re-aggregated from 7 day NDVI products. The 24 day eMODIS NDVIs are generally cloud free, but do not necessarily use the freshest quality data. To shorten the disturbance detection time, a method has been developed that performs adaptive length/maximum value compositing of eMODIS NDVI, along with cloud and shadow "noise" mitigation. Tests indicate that this method can reduce detection rates by 8-16 days for known recent disturbance events, depending on the cloud frequencies and disturbance type. The noise mitigation in these tests, though imperfect, helped to improve quality of the resulting NDVI and forest change products.

Spruce, Joseph↗

NASA NTRS2019

Using Big Data Technologies with Earth Science Data in HDF5: HDF5 Scalable Solutions

HDF5 (Hierarchical Data Format 5) is open-source, high-performance software that consists of an abstract data model, library, and fileformat used for storing and managing extremely large and/or complex data collections. NASA Earth Observing System (EOS) Data and Information Systems use HDF5 as an archival format to store remote sensing data from EOS satellites. HDF5 is also used to store other types of Geoscience and Strophysical data, e.g., seismic data and data from Low-Frequency Array (LOFAR) radio telescopes. Data stored in HDF5 has reached tens of petabytes and is growing at an accelerated rate.With the growing amout of HDF5 Earth Science data to analyze and process, scientists need to adopt big data technologies including new storage paradigms such as cloud and object storage. To run models and perform data analysis they also need to utilizied efficient and diverse ways to access data, from high-performance computing's (HPC) Message Passing Interface (MPI) I/O and deep memory hierarchies (DMH) to non-HPC frameworks such as Apache Hadoop, Spark, and Drill. The HDF Group continually works to enable usage of big data technologies in HDF software.

Knox, Larry↗

NASA NTRS1989

The 27-28 October 1986 FIRE IFO cirrus case study: Cirrus parameter relationships derived from satellite and lidar data

Cirrus cloud radiative and physical characteristics are determined using a combination of ground-based, aircraft, and satellite measurements taken as part of the First ISCCP Regional Experiment (FIRE) Cirrus Intensive Field Observations (IFO) during October and November 1986. Lidar backscatter data are used to define cloud base, center, and top heights and the corresponding temperatures. Coincident GOES 4 km visible (0.65 microns) and 8 km infrared window (11.5 microns) radiances are analyzed to determine cloud emittances and reflectances. Infrared optical depth is computed from the emittance results. Visible optical depth is derived from reflectance using a theoretical ice crystal scattering model and an empirical bidirectional reflectance mode. No clouds with visible optical depths greater than 5 or infrared optical depths less than 0.1 were used in the analysis. Average cloud thickness ranged from 0.5 km to 8 km for the 71 scenes. An average visible scattering efficiency of 2.1 was found for this data set. The results reveal a significant dependence of scattering efficiency on cloud temperature.

Minnis, Patrick↗

NASA NTRS1990

The 27-28 October 1986 FIRE IFO cirrus case study - Cirrus parameter relationships derived from satellite and lidar data

Minnis, Patrick↗

NASA NTRS1991

Water droplet impingement on airfoils and aircraft engine inlets for icing analysis

This paper includes the results of a significant research program for verification of computer trajectory codes used in aircraft icing analysis. Experimental water droplet impingement data have been obtained in the NASA Lewis Research Center Icing Research Tunnel for a wide range of aircraft geometries and test conditions. The body whose impingement characteristics are required is covered at strategic locations by thin strips of moisture absorbing (blotter) paper and then exposed to an airstream containing a dyed-water spray cloud. Water droplet impingement data are extracted from the dyed blotter strips by measuring the optical reflectance of the dye deposit on the strips with an automated reflectometer. Impingement characteristics for all test geometries have also been calculated using two recently developed trajectory computer codes. Good agreement is obtained with experimental data. The experimental and analytical data show that maximum impingement efficiency and impingement limits increase with mean volumetric diameter for all geometries tested. For all inlet geometries tested, as the inlet mass flow is reduced, the maximum impingement efficiency is reduced and the location of the maximum impingement shifts toward the inlet inner cowl.

Papadakis, Michael↗

DOE OSTI2013

DID THE INFANT R136 AND NGC 3603 CLUSTERS UNDERGO RESIDUAL GAS EXPULSION?

Based on kinematic data observed for very young, massive clusters that appear to be in dynamical equilibrium, it has recently been argued that such young systems are examples of where the early residual gas expulsion did not happen or had no dynamical effect. The intriguing scenario of a star cluster forming through a single starburst has thereby been challenged. Choosing the case of the R136 cluster of the Large Magellanic Cloud, the most cited one in this context, we perform direct N-body computations that mimic the early evolution of this cluster including the gas-removal phase (on a thermal timescale). Our calculations show that under plausible initial conditions which are consistent with observational data, a large fraction (>60%) of a gas-expelled, expanding R136-like cluster is bound to regain dynamical equilibrium by its current age. Therefore, the recent measurements of velocity dispersion in the inner regions of R136, which indicate that the cluster is in dynamical equilibrium, are consistent with an earlier substantial gas expulsion of R136 followed by a rapid re-virialization (in Almost-Equal-To 1 Myr). Additionally, we find that the less massive Galactic NGC 3603 Young Cluster (NYC), with a substantially longer re-virialization time, is likely to be found to have deviated from dynamical equilibrium at its present age ( Almost-Equal-To 1 Myr). The recently obtained stellar proper motions in the central part of the NYC indeed suggest this and are consistent with the computed models. This work significantly extends previous models of the Orion Nebula Cluster which already demonstrated that the re-virialization time of young post-gas-expulsion clusters decreases with increasing pre-expulsion density.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2020

Mapping Vegetation at Species Level with High-Resolution Multispectral and Lidar Data Over a Large Spatial Area: A Case Study with Kudzu

Mapping vegetation species is critical to facilitate related quantitative assessment, and mapping invasive plants is important to enhance monitoring and management activities. Integrating high-resolution multispectral remote-sensing (RS) images and lidar (light detection and ranging) point clouds can provide robust features for vegetation mapping. However, using multiple sources of high-resolution RS data for vegetation mapping on a large spatial scale can be both computationally and sampling intensive. Here, we designed a two-step classification workflow to potentially decrease computational cost and sampling effort and to increase classification accuracy by integrating multispectral and lidar data in order to derive spectral, textural, and structural features for mapping target vegetation species. We used this workflow to classify kudzu, an aggressive invasive vine, in the entire Knox County (1362 km2) of Tennessee (U.S.). Object-based image analysis was conducted in the workflow. The first-step classification used 320 kudzu samples and extensive, coarsely labeled samples (based on national land cover) to generate an overprediction map of kudzu using random forest (RF). For the second step, 350 samples were randomly extracted from the overpredicted kudzu and labeled manually for the final prediction using RF and support vector machine (SVM). Computationally intensive features were only used for the second-step classification. SVM had constantly better accuracy than RF, and the producer’s accuracy, user’s accuracy, and Kappa for the SVM model on kudzu were 0.94, 0.96, and 0.90, respectively. SVM predicted 1010 kudzu patches covering 1.29 km2 in Knox County. We found the sample size of kudzu used for algorithm training impacted the accuracy and number of kudzu predicted. The proposed workflow could also improve sampling efficiency and specificity. Our workflow had much higher accuracy than the traditional method conducted in this research, and could be easily implemented to map kudzu in other regions as well as map other vegetation species.

59 BASIC BIOLOGICAL SCIENCES↗

NASA NTRS2001

A 3-Year Climatology of Cloud and Radiative Properties Derived from GOES-8 Data Over the Southern Great Plains

While the various instruments maintained at the Atmospheric Radiation Measurement (ARM) Program Southern Great Plains (SGP) Central Facility (CF) provide detailed cloud and radiation measurements for a small area, satellite cloud property retrievals provide a means of examining the large-scale properties of the surrounding region over an extended period of time. Seasonal and inter-annual climatological trends can be analyzed with such a dataset. For this purpose, monthly datasets of cloud and radiative properties from December 1996 through November 1999 over the SGP region have been derived using the layered bispectral threshold method (LBTM). The properties derived include cloud optical depths (ODs), temperatures and albedos, and are produced on two grids of lower (0.5 deg) and higher resolution (0.3 deg) centered on the ARM SGP CF. The extensive time period and high-resolution of the inner grid of this dataset allows for comparison with the suite of instruments located at the ARM CF. In particular, Whole-Sky Imager (WSI) and the Active Remote Sensing of Clouds (ARSCL) cloud products can be compared to the cloud amounts and heights of the LBTM 0.3 deg grid box encompassing the CF site. The WSI provides cloud fraction and the ARSCL computes cloud fraction, base, and top heights using the algorithms by Clothiaux et al. (2001) with a combination of Belfort Laser Ceilometer (BLC), Millimeter Wave Cloud Radar (MMCR), and Micropulse Lidar (MPL) data. This paper summarizes the results of the LBTM analysis for 3 years of GOES-8 data over the SGP and examines the differences between surface and satellite-based estimates of cloud fraction.

Khaiyer, M. M.↗

DOE OSTI2014

Characterizing and Modeling Cloud Applications/Jobs on a Google Data Center

In this paper, we characterize and model Google applications and jobs, based on a 1-month Google trace from a large-scale Google data center. We address four contributions: (1) we compute the valuable statistics about task events and resource utilization for Google applications, based on various types of resources and execution types; (2) we analyze the classification of applications via a K-means clustering algorithm with optimized number of sets, based on task events and resource usage; (3) we study the correlation of Google application properties and running features (e.g., job priority and scheduling class); (4) we finally build a model that can simulate Google jobs/tasks and dynamic events, in accordance with Google trace. Experiments show that the tasks simulated based on our model exhibit fairly analogous features with those in Google trace. 95+ % of tasks' simulation errors are 20 %, confirming a high accuracy of our simulation model.

Di, Sheng↗

NASA NTRS2015

Cloud-Based Numerical Weather Prediction for Near Real-Time Forecasting and Disaster Response

The use of cloud computing resources continues to grow within the public and private sector components of the weather enterprise as users become more familiar with cloud‐computing concepts, and competition among service providers continues to reduce costs and other barriers to entry. Cloud resources can also provide capabilities similar to high‐performance computing environments, supporting multi‐node systems required for near real‐time, regional weather predictions. Referred to as "Infrastructure as a Service", or IaaS, the use of cloud-based computing hardware in an on‐demand payment system allows for rapid deployment of a modeling system in environments lacking access to a large, supercomputing infrastructure. Use of IaaS capabilities to support regional weather prediction may be of particular interest to developing countries that have not yet established large supercomputing resources, but would otherwise benefit from a regional weather forecasting capability. Recently, collaborators from NASA Marshall Space Flight Center and Ames Research Center have developed a scripted, on‐demand capability for launching the NOAA/NWS Science and Training Resource Center (STRC) Environmental Modeling System (EMS), which includes pre‐compiled binaries of the latest version of the Weather Research and Forecasting (WRF) model. The WRF‐EMS provides scripting for downloading appropriate initial and boundary conditions from global models, along with higher‐resolution vegetation, land surface, and sea surface temperature data sets provided by the NASA Short‐term Prediction Research and Transition (SPoRT) Center. This presentation will provide an overview of the modeling system capabilities and benchmarks performed on the Amazon Elastic Compute Cloud (EC2) environment. In addition, the presentation will discuss future opportunities to deploy the system in support of weather prediction in developing countries supported by NASA's SERVIR Project, which provides capacity building activities in environmental monitoring and prediction across a growing number of regional hubs throughout the world. Capacity‐building applications that extend numerical weather prediction to developing countries are intended to provide near real‐time applications to benefit public health, safety, and economic interests, but may have a greater impact during disaster events by providing a source for local predictions of weather‐related hazards, or impacts that local weather events may have during the recovery phase.

Molthan, Andrew↗

DOE OSTI2024

Project Title: Adaptive Vertical Grid Enhancement for E3SM (Final Technical Report)

During the first phase of the project (2018/05-2021/05), we proved the hypothesis that, without tuning, high vertical resolution improves the representation of unresolved, parameterized low altitude clouds such as stratocumulus clouds in global climate models. We evaluated the effectiveness of the newly developed computational framework, Framework for Improvement by Vertical Enhancement (FIVE) by implementing it into E3SM. FIVE aims to improve representation of the target cloud, low level cloud for this project, with use of a locally high vertical resolution for computation of selected processes. FIVE was assessed via direct comparison among E3SM, E3SM-FIVE, and satellite data as well as a newly developed ensemble artificial neural network methodology. We demonstrated that E3SM-FIVE remarkably improves marine stratocumulus representation. To advance the FIVE methodology, we took a first step toward the adaptive vertical grid in the FIVE method by modifying the E3SM single column model. For future application of FIVE to the global storm resolving model with a few km horizontal grid resolution, we developed the vertical-meridional two-dimensional (2D) Hadley circulation model, which allows one to run simulations with much higher vertical resolution and significantly longer duration than current three-dimensional global storm resolving model. During the second phase of the project (2021/05-2023/11; period for this technical report), we sought a way to appropriately transform FIVE to a regionalized version of FIVE, which allows one to select locations with/without FIVE. In parallel, we demonstrated that E3SM-FIVE with a 25-km mesh significantly reduced the bias associated with coastal stratocumulus. Furthermore, we showed that the same improvement was able to be obtained with the use of both the Regional Refined Model (RRM) targeted to one of the stratocumulus regions with 25-km resolution and FIVE. We explored a new implementation strategy of FIVE with our 2D Hadley circulation model. In parallel we applied the 2D Hadley circulation model to study the double intertropical convergence zone bias with storm resolving model resolution and aerosol-cloud interactions within the Hadley circulation with near large eddy simulation resolution. Last, we have been investigating Arctic mixed-phase stratocumulus clouds with large eddy simulations in order to improve their representation in global models. During the course of the entire project, 6 journal articles were published, and 3 manuscripts are currently in preparation. We gave a total of 30 presentations at various domestic and international conferences. In addition we gave 6 seminar talks at universities and a national laboratory. E3SM- FIVE is available as a branch of E3SM.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS1997

Turbulence Measurements by the DC-8 Meteorological Measurement System

The instrumentation of a new MMS on the DC-8 aircraft is briefly described. Methods to compute and evaluate the turbulent dissipation rate epsilon, based on theory and MMS data, are discussed. Examples of turbulence measurements during encounters of a wake vortex, wave clouds, persistent contrails, mountain are gravity waves are illustrated.

Chan, K. R.↗

NASA NTRS2014

TPSAS-NF1676L-19238-DND

The 24-hour cycle of solar insolation drives diurnal cycles in Earth system processes critical to climate: radiation, convection, turbulence, and cloud processes. Cloud properties, temperature, radiative fluxes, and precipitation exhibit robust diurnal cycles as a result. The presence of these robust diurnal cycles fundamentally changes the time mean and variability of the TOA energy budget. Therefore, there is a need to understand the diurnal cycle contributions to the TOA energy budget in both observations and climate models. The first objective of this study is to quantify the diurnal cycle impact on the time mean and variability of the TOA energy budget in observations defined as the difference between TOA fluxes computed with diurnally uniform and diurnally varying cloud properties. The required observational input is observed from the combined Terra+Aqua Cloud and Earth's Radiant Energy System (CERES) data products ranging from June 2002 through October 2012. The second objective of this study is to evaluate the impact of known errors in the model diurnal cycle simulation on the time mean and variability of the TOA energy budget. The results indicate that (1) the diurnal cycle impacts on the regional time mean Tropical longwave and shortwave fluxes range from 1-3 W m 2 and 5 25 W m 2, respectively; (2) the diurnal cycle contributions to TOA flux variability exceeds 50% in land convective regions (e.g., central South America and central Africa);(3) the diurnal cycle contributions to the TOA shortwave and longwave flux time mean and variability in the CanAM4 GCM are too small in land convective regions due to errors in the diurnal distribution of convective clouds grid box errors exceed 100%.

Patrick C Taylor↗

DOE OSTI2024

A Comparison between Invariant and Equivariant Classical and Quantum Graph Neural Networks

Machine learning algorithms are heavily relied on to understand the vast amounts of data from high-energy particle collisions at the CERN Large Hadron Collider (LHC). The data from such collision events can naturally be represented with graph structures. Therefore, deep geometric methods, such as graph neural networks (GNNs), have been leveraged for various data analysis tasks in high-energy physics. One typical task is jet tagging, where jets are viewed as point clouds with distinct features and edge connections between their constituent particles. The increasing size and complexity of the LHC particle datasets, as well as the computational models used for their analysis, have greatly motivated the development of alternative fast and efficient computational paradigms such as quantum computation. In addition, to enhance the validity and robustness of deep networks, we can leverage the fundamental symmetries present in the data through the use of invariant inputs and equivariant layers. In this paper, we provide a fair and comprehensive comparison of classical graph neural networks (GNNs) and equivariant graph neural networks (EGNNs) and their quantum counterparts: quantum graph neural networks (QGNNs) and equivariant quantum graph neural networks (EQGNN). The four architectures were benchmarked on a binary classification task to classify the parton-level particle initiating the jet. Based on their area under the curve (AUC) scores, the quantum networks were found to outperform the classical networks. However, seeing the computational advantage of quantum networks in practice may have to wait for the further development of quantum technology and its associated application programming interfaces (APIs).

Forestano, Roy T. (ORCID:0000000203552076)↗

DOE OSTI2024

Quantum-parallel vectorized data encodings and computations on trapped-ion and transmon QPUs

Compact data representations in quantum systems are crucial for the development of quantum algorithms for data analysis. In this study, we present two innovative data encoding techniques, known as QCrank and QBArt, which exhibit significant quantum parallelism via uniformly controlled rotation gates. The QCrank method encodes a series of real-valued data as rotations on data qubits, resulting in increased storage capacity. On the other hand, QBArt directly incorporates a binary representation of the data within the computational basis, requiring fewer quantum measurements and enabling well-established arithmetic operations on binary data. We showcase various applications of the proposed encoding methods for various data types. Notably, we demonstrate quantum algorithms for tasks such as DNA pattern matching, Hamming weight computation, complex value conjugation, and the retrieval of a binary image with 384 pixels, all executed on the Quantinuum trapped-ion QPU. Furthermore, we employ several cloud-accessible QPUs, including those from IBMQ and IonQ, to conduct supplementary benchmarking experiments.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1986

The single scattering phase functions of Jupiter's clouds

The determination of the single scattering phase functions of Jupiter's clouds and a thin upper haze by Tomasko et al. was refined and extended to seven latitudes in blue and red light. The phase function is well-constrained by the Pioneer 10 and 11 photometric data sets. Multiple scattering models were computed to match the limb darkening at each latitude at up to 15 phase angles from 12 deg to 151 deg. Ground-based observations were used for absolute calibration and to extend the data to lower phase angles. The phase functions were parameterized using the double Henyey-Greenstein function. The three Henyey-Greenstein parameters and the single scattering albedo were determined using a non-linear least squares method for the haze and the clouds below. The phase functions derived for the northen zone and belt are remarkably similar to the phase functions of the corresponding regions in the south, with most of the differences in brightness of the northern and southern features resulting from minor differences in single scattering albedo. Analysis of the Equatorial Region is complicated by the presence of numerous small features, but the phase function required is generally similar to that seen in the more homogeneous regions. Details of the phase functions of the haze and clouds are presented, and the differences between the cloud phase functions at low and high latitudes in red and blue light are discussed.

Doose, L. R.↗