Search NASA⌕ Search

SEARCH · Search NASA

Results for “cloud computing, data cloud”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Proper Motions, Orbits, and Tidal Influences of Milky Way Dwarf Spheroidal Galaxies

We combine Gaia early data release 3 astrometry with accurate photometry and utilize a probabilistic mixture model to measure the systemic proper motion of 52 dwarf spheroidal (dSph) satellite galaxies of the Milky Way (MW). For the 46 dSphs with literature line-of-sight velocities we compute orbits in both a MW and a combined MW + Large Magellanic Cloud (LMC) potential and identify Car II, Car III, Hor I, Hyi I, Phx II, and Ret II as likely LMC satellites. 40% of our dSph sample has a >25% change in pericenter and/or apocenter with the MW + LMC potential. For these orbits, we use a Monte Carlo sample for the observational uncertainties for each dSph and the uncertainties in the MW and LMC potentials. We predict that Ant II, Boo III, Cra II, Gru II, and Tuc III should be tidally disrupting by comparing each dSph's average density relative to the MW density at its pericenter. dSphs with large ellipticity (CVn I, Her, Tuc V, UMa I, UMa II, UMi, Wil 1) show a preference for their orbital direction to align with their major axis even for dSphs with large pericenters. We compare the dSph radial orbital phase to subhalos in MW-like N-body simulations and infer that there is not an excess of satellites near their pericenter. With projections of future Gaia data releases, we find that dSph's orbital precision will be limited by uncertainties in the distance and/or MW potential rather than in proper motion precision. Finally, we provide our membership catalogs to enable community follow-up.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Improving the prediction of DNI with physics-based representation of all-sky circumsolar radiation

Direct normal irradiance (DNI) is often interpreted differently in ground measurements and forecasts using numerical weather prediction (NWP) models, leading to substantial bias in DNI forecasting especially under cloudy-sky conditions. To mitigate the bias, we use the Fast All-sky Radiation Model for Solar applications with DNI (FARMS-DNI) to conduct physics-based simulations of solar radiation in the circumsolar region. The DNI is quantified using the sum of the radiation along the sun direction and the scattered radiation within the circumsolar region. FARMS-DNI is coupled with the Weather Research and Forecasting model with solar extensions (WRF-Solar) to predict day-ahead DNI in 9-km pixels over an extended domain covering the contiguous United States. The DNI forecasts for the entire year of 2018 are validated using surface-based observations at the Atmospheric Radiation Measurement (ARM) and Surface Radiation Budget Network (SURFRAD) sites and a satellite-based solar radiation product developed by the procedure of the National Solar Radiation Data Base (NSRDB). The results show that the WRF-Solar coupled with the conventional Beer-Bouguer-Lambert law underestimes the overall DNI forecasts by 30%-60%, which is a joint effect of the uncertainties in computing the circumsolar radiation and forecasting cloud properties. This bias is significantly reduced by using FARMS-DNI.

14 SOLAR ENERGY↗
DOE OSTI2024

OpenCHAMI Developer Summit [Slides]

The mission of the OpenCHAMI consortium is to steward the collaborative development and continuous evolution of cloud-like software to manage High Performance Computing capacity regardless of the size or deployment platform. We are guided by the operators and practitioners who use modern tooling and concepts to address the needs of classical HPC applications and the growing AI/ML and Data Science community that wish to leverage HPC capacity within their own workflows, to meet their needs with their own tools.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

A Typology of Quantum-Classical Faults

This paper introduces an extended taxonomy of faults specific to hybrid quantum-classical systems, addressing the unique challenges that arise from integrating quantum accelerators into high-performance computing (HPC) infrastructures. Building on the foundational fault classification by Avizienis et al., we incorporate fault types unique to quantum computing-such as qubit decoherence, spontaneous gate errors, and photon loss-alongside traditional and human-induced faults including development errors, operational mistakes, and malicious attacks. Our taxonomy classifies faults by their origin (natural vs. human-made), intent (accidental, deliberate non-malicious, or malicious), system boundaries (internal vs. external), and persistence (transient to permanent). We also explore how different architectural integration patterns-ranging from tight coupling to loose on-premise and cloud-based configurations-shape the manifestation and propagation of faults. These scenarios are analyzed in terms of timing mismatches, interface inconsistencies, and security threats such as data tampering and denial-of-service attacks. Through this fault-centric lens, we aim to support the co-design of dependable quantum-classical systems and highlight the critical role that integration strategies play in ensuring reproducibility, resilience, and security across hybrid computing platforms.

Giusto, Edorado [University of Naples Federico II,↗
DOE OSTI2023

Cloud condensation nuclei activity of internally mixed particle populations at a remote marine free troposphere site in the North Atlantic Ocean

Here, this study reports results from research conducted at the Observatory of Mount Pico (OMP), 2225 m above mean sea level on Pico Island in the Azores archipelago in June and July 2017. We investigated the chemical composition, mixing state, and cloud condensation nuclei (CCN) activities of long-range transported free tropospheric (FT) particles. FLEXible PARTicle Lagrangian particle dispersion model (FLEXPART) simulations reveal that most air masses that arrived at the OMP during the sampling period originated in North America and were highly aged (average plume age > 10 days). We probed size-resolved chemical composition, mixing state, and hygroscopicity parameter ($\mathcal{κ}$) of individual particles using computer-controlled scanning electron microscopy with an energy-dispersive X-ray spectrometer (CCSEM-EDX). Based on the estimated individual particle mass from elemental composition, we calculated the mixing state index, $χ$. During our study, FT particle populations were internally mixed ($χ$ of samples are between 53% and 87%), owing to the long atmospheric aging time. We used data from a miniature Cloud Condensation Nucleus Counter (miniCCNC) to derive the hygroscopicity parameter, $\mathcal{κ}$ CCNC . Combining $\mathcal{κ}$ CCNC and FLEXPART, we found that air masses recirculated above the North Atlantic Ocean with lower mean altitude had higher $\mathcal{κ}$ CCNC due to the higher contribution of sea salt particles. We used CCSEM-EDX and phase state measurements to predict single-particle $\mathcal{κ}$ ($\mathcal{κ}$ CCSEM-EDX ) values, which overlap with the lower range of $\mathcal{κ}$ CCNC measured below 0.15 % SS. Therefore, CCSEM-EDX measurements can be useful in predicting the lower bound of $\mathcal{κ}$, which can be used in climate models to predict CCN activities, especially in remote locations where online CCN measurements are unavailable.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Watermarks in stream processing systems: semantics and comparative analysis of Apache Flink and Google cloud dataflow

Streaming data processing is an exercise in taming disorder: from oftentimes huge torrents of information, we hope to extract powerful and timely analyses. But when dealing with streaming data, the unbounded and temporally disordered nature of real-world streams introduces a critical challenge: how does one reason about the completeness of a stream that never ends? In this paper, we present a comprehensive definition and analysis of watermarks, a key tool for reasoning about temporal completeness in infinite streams.First, we describe what watermarks are and why they are important, highlighting how they address a suite of stream processing needs that are poorly served by eventually-consistent approaches:• Computing a single correct answer, as in notifications.• Reasoning about a lack of data, as in dip detection.• Performing non-incremental processing over temporal subsets of an infinite stream, as in statistical anomaly detection with cubic spline models.• Safely and punctually garbage collecting obsolete inputs and intermediate state.• Surfacing a reliable signal of overall pipeline health.Second, we describe, evaluate, and compare the semantically equivalent, but starkly different, watermark implementations in two modern stream processing engines: Apache Flink and Google Cloud Dataflow.

Akidau, Tyler↗
DOE OSTI2018

Internet-of-Things Hardware-in-the-Loop Simulation Architecture for Providing Frequency Regulation With Demand Response

Following recent advances in network infrastructure, cloud computing, and embedded systems, fascinating work is underway exploring the utility of demand response in increasing grid stability while permitting high penetration of intermittent renewable distributed generation resources. Although works have demonstrated diverse theoretical advantages of demand response programs, little real-world data are available and utilities generally remain reticent in moving forward with large-scale implementation due to risks inherent to any modification of the power system. Deciding that the next pertinent step in bringing demand response from theory to technology is developing an Internet-of-things hardware-in-the-loop simulation power system integrated device capable of empirically testing the theoretical mechanisms, this work presents an architecture testbed for providing demand response (telemetric monitoring and actuation of loads), which is real node in a power system simulation where virtual node's parameters derive real node data. Finally, we test a demand response algorithm, which provides frequency regulation services.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2013

Laboratory Studies of the Reactive Chemistry and Changing CCN Properties of Secondary Organic Aerosol, Including Model Development

The chemical evolution of secondary-organic-aerosol (SOA) particles and how this evolution alters their cloud-nucleating properties were studied. Simplified forms of full Koehler theory were targeted, specifically forms that contain only those aspects essential to describing the laboratory observations, because of the requirement to minimize computational burden for use in integrated climate and chemistry models. The associated data analysis and interpretation have therefore focused on model development in the framework of modified kappa-Koehler theory. Kappa is a single parameter describing effective hygroscopicity, grouping together several separate physicochemical parameters (e.g., molar volume, surface tension, and van't Hoff factor) that otherwise must be tracked and evaluated in an iterative full-Koehler equation in a large-scale model. A major finding of the project was that secondary organic materials produced by the oxidation of a range of biogenic volatile organic compounds for diverse conditions have kappa values bracketed in the range of 0.10 +/- 0.05. In these same experiments, somewhat incongruently there was significant chemical variation in the secondary organic material, especially oxidation state, as was indicated by changes in the particle mass spectra. Taken together, these findings then support the use of kappa as a simplified yet accurate general parameter to represent the CCN activation of secondary organic material in large-scale atmospheric and climate models, thereby greatly reducing the computational burden while simultaneously including the most recent mechanistic findings of laboratory studies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

A Multi-Instrument Cloud Condensation Nuclei Spectrum Product (Final Technical Report)

A wealth of observational data exists on the characteristics of atmospheric particulate matter, over multiple years, at the DOE ARM Southern Great Plains (SGP) Central Facility site. This site is located in a region of the country that frequently experiences weather extremes, and that is removed from many local sources of pollution but is affected by transported smoke, dust, and urban emissions. The relationships between particulate matter, cloud formation and evolution, and precipitation are therefore of strong interest, and are being explored via modeling on a variety of scales. These models require as input detailed information on the characteristics of particles capable of serving as the nuclei for cloud formation. Sufficient data exist to be able to put together a picture of the nature of the total aerosol and the cloud condensation nuclei (CCN) subset, and their variability, through merged data products. This study was aimed at exploiting the multiple measurement types at SGP to develop the first such multi-year estimates. Further, the resulting data were analyzed to understand temporal patterns ranging from hourly to seasonal, thereby gaining insights into the particle sources affecting the atmosphere in this region. DOE-funded datasets that were analyzed in this study include total particle number concentrations, submicron aerosol scattering coefficients, dry aerosol size distributions, and more recently, time-resolved submicron aerosol chemical composition. Data are also available for the number concentrations of particles that are activated in a cloud condensation nucleus instrument at a series of setpoint supersaturations, providing direct observations of the number concentrations of “CCN”. This variable is the quantity that is generally desired for inclusion in numerical models that seek to represent and predict the impacts of varying aerosol characteristics on the formation and microphysical properties of clouds. One limitation of the use of direct CCN observations is that they are not available for supersaturations larger than about 1%, which is insufficient for deep convection and may be insufficient even for shallow convection, depending on the nature of the available CCN and the dynamics of the cloud. We developed a data-based approach to representing the full aerosol size spectrum with size-dependent hygroscopicity, and used this to extrapolate CCN spectra beyond the limited measurements. Five years of SGP aerosol data (2009 -2013) were analyzed. As a side product of our work, we identified and communicated several previously-unflagged data quality issues. The resulting merged aerosol distributions, along with fits for seasonal averages, were published and submitted to the ARM archive as a special value-added product (VAP; submitted as a PI product). CCN spectra were computed for the same data period and will similarly be published and submitted to the archive for use by the community. We also note that our methodologies and findings have been discussed at several Joint ARM User Facility/Atmospheric System Research (ASR) Principal Investigators Meetings and that recent ARM/ASR aerosol data reporting strategies have included similar ideas for data merging, indicating that this work has had a lasting impact on ARM aerosol data acquisition and reporting. The proposed work advances the science of the interactions of aerosols, clouds and precipitation, with direct application to improve representation of such interactions for clouds in regional and global climate models. The archived data will continue to serve research studies in the future.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2013

Scientific Data Management Center for Enabling Technologies

Managing scientific data has been identified by the scientific community as one of the most important emerging needs because of the sheer volume and increasing complexity of data being collected. Effectively generating, managing, and analyzing this information requires a comprehensive, end-to-end approach to data management that encompasses all of the stages from the initial data acquisition to the final analysis of the data. Fortunately, the data management problems encountered by most scientific domains are common enough to be addressed through shared technology solutions. Based on community input, we have identified three significant requirements. First, more efficient access to storage systems is needed. In particular, parallel file system and I/O system improvements are needed to write and read large volumes of data without slowing a simulation, analysis, or visualization engine.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2022

BFSVBF (BatFinder Smart Video BioFilter) [SWR-22-87] and Multi-class BatFinder Smart Video BioFilter Keras

Bats are notoriously difficult to study, therefore, identifying specific behavioral trends and the precise environmental conditions at the time of collision requires a monitoring solution that can reliably collect relevant data. To date, thermal infrared video surveillance has been extensively applied to study bats and has proven to be a powerful yet cumbersome tool. Current analytical approaches are time consuming because data processing data has not been fully automated. In the past, steps have been taken to record avian and bat activity in conjunction with complicated image processing techniques that separate species from other moving objects within the field of view (i.e. clouds and portions of the wind turbine). Once the videos are collected, the post-processing does not allow real time monitoring and identification, leading to a delay in both studying the behavior of these species and determining the effectiveness of any impact reduction strategy being studied. Moreover, object identification capability is lacking, thus limiting the usefulness of video data. To resolve these issues, we are using open source computer vision and machine learning techniques allowing for automatic detection of objects in real-time with the ability to correlate these objects with environmental variables and recording the flight paths of each object. The code has gone through five rounds of development with images used to train the models. This advancement allows for automated real-time data collection, identification, and tracking, thereby eliminating the need for long and tedious post-analysis processing of the videos. We will discuss the two open source and publicly available machine learning models developed within this scope of this work: 1) a binary model with a 97.5% accuracy in identifying the difference between an object and an empty scene, including wind turbine and clouds; and 2) a multiple classification model with the capability of identifying the type of object detected: bats (90% accuracy), birds (83% accuracy), insects (69% accuracy) and non-biological (99% accuracy).

Yarbrough, John↗
DOE OSTI2017

Computing and visualizing time-varying merge trees for high-dimensional data

We introduce a new method that identifies and tracks features in arbitrary dimensions using the merge tree -- a structure for identifying topological features based on thresholding in scalar fields. This method analyzes the evolution of features of the function by tracking changes in the merge tree and relates features by matching subtrees between consecutive time steps. Using the time-varying merge tree, we present a structural visualization of the changing function that illustrates both features and their temporal evolution. We demonstrate the utility of our approach by applying it to temporal cluster analysis of high-dimensional point clouds.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

Design of Distributed Cyber-Physical Systems for Connected and Automated Vehicles with Implementing Methodologies

With the development of communication and control technology, intelligent transportation systems have received increasing attention from both industry and academia. Intelligent transportation systems are supported by the Internet of Things, Cyber-Physical System, Artificial Intelligence, Cloud Computing and many other technologies, which supply fundamental information for connected and automated vehicles. Although plenty of studies have provided different formulations for intelligent transportation systems, many of them depend on Master Control Center. However, a centralized control mode requires a huge amount of data transmission and high level of hardware configuration and may cause communication delay and privacy leak. Some distributed architectures have been proposed to overcome the above problems but systematized technologies to collect and exchange information, process large amounts of data, model the dynamics of vehicles, and safely control the connected and automated vehicles are not explored in detail. In this paper, we proposed a novel distributed cyber-physical system for connected and automated vehicles in which every vehicle is modeled as a double-integrator using edge computing to analyze information collected from its nearest neighbors. The vehicles are supposed to travel along a desired trajectory and to maintain a rigid formation geometry. Related methodologies for the proposed system are illustrated and experiments are conducted showing that the performance of the connected and automated vehicles matches very well with analytic predictions. Some design guidelines and open questions are provided for the future study.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

CoreMS AutoQC Uploader

The invention is a self contained software utility that is deployed on the computer controlling a mass spectrometer. The purpose of the software is to monitor a given directory for files matching a user specified criteria and automatically upload matching files to a remote server as well as trigger a request that the data be processed by the cloud based CoreMS software

Rabus, Jordan [Pacific Northwest National Laborato↗
DOE OSTI2023

Evaluation of Historic Nuclear Cloud Measurement for Entrainment Parameter Determination

We evaluated the uncertainties associated with the entrainment parameters computed from nuclear cloud measurements taken during historic weapon testing campaigns. This evaluation found that variations in the way cloud heights and diameters were defined during the analysis of film records result in very large uncertainties in the entrainment parameters, severely limiting the utility of these data. For the measurements of atmospheric conditions at the time of the tests, the main sources of error are associated with the differences in the location and timing of the soundings.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2017

Distributed wireless sensing for methane leak detection technology

Large scale environmental monitoring requires dynamic optimization of data transmission, power management, and distribution of the computational load. In this work, we demonstrate the use of a wireless sensor network for detection of chemical leaks on gas oil well pads. The sensor network consist of chemi-resistive and wind sensors and aggregates all the data and transmits it to the cloud for further analytics processing. The sensor network data is integrated with an inversion model to identify leak location and quantify leak rates. We characterize the sensitivity and accuracy of such system under multiple well controlled methane release experiments. It is demonstrated that even 1 hour measurement with 10 sensors localizes leaks within 1 m and determines leak rate with an accuracy of 40%. This integrated sensing and analytics solution is currently refined to be a robust system for long term remote monitoring of methane leaks, generation of alarms, and tracking regulatory compliance.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Edge-computing with enhanced standoff sensors

A system senses analytes through one or more sensors that detect or measure a physical characteristic. The one or more sensor generate a spectroscopic-data signal corresponding to the detection. An edge device communicatively couples the one or more sensors that communicatively couples a wide-area network coupling a cloud service. The edge device includes a data acquisition device that receives spectroscopic data signals from the one or more sensor and a processor that processes the spectroscopic-data signals to identify an analyte. The edge device also includes a transceiver that transmits data identifying the analytes to the cloud service.

Passian, Ali↗
DOE OSTI2020

Cloud based tool for analysis of chemical kinetic mechanisms

The size and complexity of chemical kinetic models used to simulate combustion of hydrocarbon fuels continue to increase with our improved understanding of the underlying physical mechanisms, along with the improved ability to utilize such models as the result of increased computational power and efficiency. As mechanisms grow beyond thousands of species and tens of thousands of reactions, it becomes increasingly difficult to manually check for errors and physical inconsistencies. In this work, we present several automated methods to check for such issues in the specification of chemical reaction models. First, we demonstrate how discontinuities in thermodynamic data can cause simulation difficulties manifested as long wall-clock times and convergence failures. To correct this type of problem, we describe an automated method for refitting thermodynamic parameters. We also outline several methods to check the timescales of reaction rate coefficients to ensure physical consistency. All the methods are made available through a web-based tool (https://combustiontools.llnl.gov) intended to aid mechanism developers and users to improve the accuracy and performance of fuel models used by the combustion community.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗