Search NASA⌕ Search

SEARCH · Search NASA

Results for “cloud computing, data cloud”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22
All sourcesNASA NTRSDOE OSTI
DOE OSTI2012

Final Report on HOLODEC 2 Technology Readiness Level

During the period of this project, the Holographic Detector for Clouds 2 (HOLODEC 2) instrument has advanced from a laboratory-proven instrument with some initial field testing to a fully flight-tested instrument capable of providing useful cloud microphysics measurements. This can be summarized as 'Technology Readiness Level 8: Technology is proven to work - Actual technology completed and qualified through test and demonstration.' As part of this project, improvements and upgrades have been made to the optical system, the instrument power control system, the data acquisition computer, the instrument control software, the data reconstruction and analysis software, and some of the basic algorithms for estimating basic microphysical variables like droplet diameter. Near the end of the project, the instrument flew on several research flights as part of the IDEAS 2011 project, and a small sample of data from the project is included as an example. There is one caveat in the technology readiness level stated above: the upgrades to the instrument power system were made after the flight testing, so they are not fully field proven. We anticipate that there will be an opportunity to fly the instrument as part of the IDEAS project in fall 2012.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2011

Evaluation of Water Permittivity Models From Ground-Based Observations of Cold Clouds at Frequencies Between 23 and 170 GHz

Accurate retrievals of liquid water path (LWP) from passive microwave radiometers rely on the use of radiative transfer models to describe the absorption of radiation by various atmospheric components. When clouds are present, atmospheric absorption is affected by the dielectric properties of liquid water. In this paper, we use measurements from four microwave radiometers to assess four models of the complex permittivity of water. The observations are collected at five frequencies between 23.8 and 170 GHz. The purpose of the study is to compare measurements of microwave absorption with model computations in supercooled liquid clouds that have temperatures between 0 °C and -30 °C. Models of liquid water permittivity in this temperature range suffer from a lack of laboratory measurements and are generally derived from the extrapolation of available data. An additional rationale for this work is to examine to what degree the use of different dielectric models affects the retrieval of LWP in supercooled liquid clouds. Inaccuracies in modeling the water permittivity at low temperatures are likely one of the largest sources of retrieval uncertainty in supercooled clouds, uncertainty that could offset the advantages offered by the enhanced sensitivity of channels at frequencies at and above 90 GHz relative to lower frequencies.

Clound liquid absorption models↗
DOE OSTI2021

Building an AI-enhanced modeling framework to address multiscale predictability challenges

Focal Area(s): Build an AI-enhanced modeling framework that integrates the three focus areas in the solicitation. Science Challenge: The 4M-2N complexities (Multiscale, Multiphysics, Multibody, Multidimension, Non-linearity, and Non-Gaussianality) of atmospheric aerosol-cloud-precipitation-turbulence-radiation system poses physical and computational challenges to further advance predictive models; We plan to address the challenges by developing an AI-enhanced modeling framework that facilitates automated calibration and improvement of subgrid parameterizations, enhance data assimilation of measurements to improve initial and boundary conditions used to drive the physical model, and optimally blends data-driven and physics-based forecasting models.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

An Update on the Geothermal Data Repository's Data Standards and Pipelines: Geospatial Data and Distributed Acoustic Sensing Data

The Department of Energy's (DOE) Geothermal Data Repository (GDR) team has implemented data standards and automated data pipelines for the following data types: 1) drilling data, 2) geospatial datasets, and 3) DAS data. An additional data pipeline is proposed for stimulation data. These data standards and pipelines are intended to improve the real-world applicability of geothermal machine learning outputs through improving the quality of data. More specifically, through standardizing high-value datasets, the GDR is reducing project-specific data curation requirements, allowing more time to be spent on actual research. By automating this process, the burden of standardization is taken off of the user, overall increasing the availability of standardized data. This paper provides an update on the GDR's transition toward data standardization through automated data pipelines and calls for feedback from the community on how we can improve this process.

cloud-optimized↗
DOE OSTI2021

Land cover change-induced decline in terrestrial gross primary production over the conterminous United States from 2001 to 2016

As one of the most dynamic aspects of global environmental change, land cover change (LCC) has a profound impact on terrestrial carbon sequestration. However, LCC-induced carbon fluxes are still the most uncertain terms in global and regional carbon budgets. Ecosystem gross primary production (GPP) is the total carbon uptake by vegetation through photosynthesis, serving as a major control on ecosystem function and land carbon balance during and after the modification of the land surface. However, accurately capturing LCC-induced GPP changes requires both high-quality land cover data and controlling for variation driven by other environmental factors such as climate. In this study, we comprehensively examined the effects of LCC on annual GPP trends over the conterminous United States (CONUS) from 2001 to 2016 using the USGS National Land Cover Database, a remote sensing-driven ecosystem model, and the Google Earth Engine cloud computing platform. We designed a series of model experiments to identify LCC effects on GPP by controlling climate effects. During the study period, LCC exerted a strong negative effect on total GPP across the CONUS ([-2.2, -1.8] Tg C yr -2 ), while climate had smaller positive effects ([0.17, 0. 92] Tg C yr -2 ). The LCC-induced reduction of GPP was mainly caused by net forest loss ([-1.98, -1.39] Tg C yr -2 ) and urban expansion ([-2.03, -1.92] Tg C yr -2 ), but was partially offset by increases in crop area ([+0.66, +0.79] Tg C yr -2 ). Ensemble simulations from TRENDY did not capture the strong negative LCC influences on GPP, likely due to limitations of the adopted land use/cover data. Overall, our study provides a novel perspective on LCC-induced GPP changes, which could help to improve our understanding of ecosystem function changes and constrain the estimation of land carbon balance in the context of anthropogenic activity and climate change.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Exploring Tradeoffs in Federated Learning on Serverless Computing Architectures

Federated learning is driving the development of new techniques to efficiently and securely use data across multiple sites while using diverse resources. One of these techniques is the use of the serverless computing paradigm to abstract away resource specific configurations, allowing federated learning across heterogeneous environments. However, deploying federated learning across edge resources, the cloud, and traditional HPC sites will require specialized approaches in order to best account for the weaknesses and strengths of each resource. In this work, we explore the new tradeoffs presented by managing a federated learning task across heterogeneous resources and demonstrate these tradeoffs with experiments using a serverless federated learning framework.

Baughman, Matt↗
DOE OSTI2015

Web-Based Computational Model Builder for Nuclear Energy Advanced Modeling & Simulation (Phase I Final Report)

Today, the importance of nuclear power in the US is a geopolitical matter as much as it is an economic one. This is due to the notion that increasing the use of nuclear power reduces the US's reliance on imported oil and gas. In order to design future systems and continue operational improvements at existing US plants, advanced modeling and simulation of nuclear power reactors is crucial. A variety of challenges exist to using advanced modeling and simulation in practice, especially for the nuclear energy community and other organizations with fewer computational resources and limited expertise. There is an increasing need of access to highly capable compute, data, and software resources from network systems, which are becoming more administratively restricted from access through installation of traditional client-server applications. The nuclear energy community is not capable of maintaining exponential growth of computing capability and data storage coupled with the necessary end-to-end network bandwidth improvements. Applications that provide higher fidelity with increased physics and decreased assumptions, by their very nature, require more and more computational resources. We believe Web-based, Cloud-enabled, end-to-end simulation software for nuclear energy advanced modeling and simulation to be the solution to these challenges.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2018

Intelligently-Automated Facilities Expansion with the HEPCloud Decision Engine

The next generation of High Energy Physics experiments are expected to generate exabytes of data---two orders of magnitude greater than the current generation. In order to reliably meet peak demands, facilities must either plan to provision enough resources to cover the forecasted need, or find ways to elastically expand their computational capabilities. Commercial cloud and allocation-based High Performance Computing (HPC) resources both have explicit and implicit costs that must be considered when deciding when to provision these resources, and to choose an appropriate scale. In order to support such provisioning in a manner consistent with organizational business rules and budget constraints, we have developed a modular intelligent decision support system (IDSS) to aid in the automatic provisioning of resources---spanning multiple cloud providers, multiple HPC centers, and grid computing federations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2026

YOLO11 to SAM2 pipeline for feature extraction from nuclear test films

The response to the effects of nuclear detonations is supported by models that describe the evolution of the nuclear fireball and cloud and the associated transport of active debris. Validation of those descriptions relies on data from the nuclear test operations. Video records of those events offer a rich source of information that was exploited to a limited extent in historic analyses. Computer vision and machine learning techniques are powerful tools that can be used to increase the number of measurements that can be obtained from those films. In this work, we apply computer vision techniques to automatically track the temporal evolution of the nuclear fireball. In particular, we apply You Only Look Once 11 (YOLO11) and Segment Anything Model 2 (SAM2) in combination with minimal human intervention to digitized versions of the original nuclear test films. As part of the proposed workflow, the YOLO11 model is applied to films to determine bounding boxes for the fireball within each frame. These are then used as inputs to SAM2, which uses image segmentation to determine the fireball boundaries and their temporal evolution. We assess the accuracy of our approach by using it to determine the energy released during the Trinity nuclear test and comparing the results with previous analyses based on manual measurements.

Van Exel, Kimberly [ORNL] (ORCID:0009000877463894)↗
DOE OSTI2020

Caerbannog Point Clouds

The Caerbannog Point Clouds provide point-sampled 3D models occluded in clouds of points. We synthesized the 3D point clouds from polygonal models, point-sampling the models and surrounding them in a point cloud such that the shape of the model is occluded in any 2D projection. We obscure our model-of-interest by repeatedly surrounding it with an amorphous cloud of points, giving the overall point cloud a structure of organic nature, like that of shrubbery. In a user study, participants were significantly better at identifying the models when visualized as 3D scatterplots under rotation than in axis-aligned 2D scatterplots. We provide three point-clouds, both occluded and unoccluded: the Stanford bunny, Utah Teapot, and OSG Cow.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2013

DOE Hanford Network Upgrades and Disaster Recovery Exercise Support the Cleanup Mission Now and into the Future

In 2013, the U.S. Department of Energy's (DOE) Hanford Site, located in Washington State, funded an update to the critical network infrastructure supporting the Hanford Federal Cloud (HFC). The project, called ET-50, was the final step in a plan that was initiated five years ago called "Hanford's IT Vision, 2015 and Beyond." The ET-50 project upgraded Hanford's core data center switches and routers along with a majority of the distribution layer switches. The upgrades allowed HFC the network intelligence to provide Hanford with a more reliable and resilient network architecture. The culmination of the five year plan improved network intelligence and high performance computing as well as helped to provide 10 Gbps capable links between core backbone devices (10 times the previous bandwidth). These improvements allow Hanford the ability to further support bandwidth intense applications, such as video teleconferencing. The ET-50 switch upgrade, along with other upgrades implemented from the five year plan, have prepared Hanford's network for the next evolution of technology in voice, video, and data. Hand-in-hand with ET-50's major data center outage, Mission Support Alliance's (MSA) Information Management (IM) organization executed a disaster recovery (DR) exercise to perform a true integration test and capability study. The DR scope was planned within the constraints of ET-50's 14 hour datacenter outage window. This DR exercise tested Hanford's Continuity of Operations (COOP) capability and failover plans for safety and business critical Hanford Federal Cloud applications. The planned suite of services to be tested was identified prior to the outage and plans were prepared to test the services ability to failover from the primary Hanford data center to the backup data center. The services tested were: Core Network (backbone, firewall, load balancers); Voicemail; Voice over IP (VoIP); Emergency Notification; Virtual desktops; and, Select set of production applications and data. The primary objective of the exercise was to test COOP around the emergency operations at Hanford to provide information on capabilities and dependencies of the current system to insure improved focus of emergency, safety and security capacity in a disaster situation. The integration of the DR test into the ET-50 project allowed the testing of COOP at Hanford and allowed the lessons learned to be defined. These lessons learned have helped improve the understanding of Hanford's COOP capabilities and will be critical for future planning. With the completion of the Hanford Federal Cloud network upgrades and the disaster recovery exercise, the MSA has a clearer path forward for future technology implementations as well as network improvements to help shape the usability and reliability of the Hanford network in support of the cleanup mission.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2014

Molecular cloud-scale star formation in NGC 300

We present the results of a galaxy-wide study of molecular gas and star formation in a sample of 76 H II regions in the nearby spiral galaxy NGC 300. We have measured the molecular gas at 250 pc scales using pointed CO(J = 2-1) observations with the Atacama Pathfinder Experiment telescope. We detect CO in 42 of our targets, deriving molecular gas masses ranging from our sensitivity limit of ∼10{sup 5} M {sub ☉} to 7 × 10{sup 5} M {sub ☉}. We find a clear decline in the CO detection rate with galactocentric distance, which we attribute primarily to the decreasing radial metallicity gradient in NGC 300. We combine Galaxy Evolution Explorer far-ultraviolet, Spitzer 24 μm, and Hα narrowband imaging to measure the star formation activity in our sample. We have developed a new direct modeling approach for computing star formation rates (SFRs) that utilizes these data and population synthesis models to derive the masses and ages of the young stellar clusters associated with each of our H II region targets. We find a characteristic gas depletion time of 230 Myr at 250 pc scales in NGC 300, more similar to the results obtained for Milky Way giant molecular clouds than the longer (>2 Gyr) global depletion times derived for entire galaxies and kiloparsec-sized regions within them. This difference is partially due to the fact that our study accounts for only the gas and stars within the youngest star-forming regions. We also note a large scatter in the NGC 300 SFR-molecular gas mass scaling relation that is furthermore consistent with the Milky Way cloud results. This scatter likely represents real differences in giant molecular cloud physical properties such as the dense gas fraction.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2013

PROBING PRIMORDIAL MAGNETIC FIELDS USING Ly{alpha} CLOUDS

From previous studies of the effect of primordial magnetic fields on early structure formation, we know that the presence of primordial magnetic fields during early structure formation could induce more perturbations at small scales (at present 1-10 h {sup -1} Mpc) as compared to the usual {Lambda}CDM theory. Matter power spectra over these scales are effectively probed by cosmological observables such as shear correlation and Ly{alpha} clouds. In this paper we discuss the implications of primordial magnetic fields on the distribution of Ly{alpha} clouds. We simulate the line-of-sight density fluctuation including the contribution coming from the primordial magnetic fields. We compute the evolution of Ly{alpha} opacity for this case and compare our theoretical estimates of Ly{alpha} opacity with the existing data to constrain the parameters of the primordial magnetic fields. We also discuss the case when the two density fields are correlated. Our analysis yields an upper bound of roughly 0.3-0.6 nG on the magnetic field strength for a range of nearly scale-invariant models, corresponding to a magnetic field power spectrum index n {approx_equal} -3.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Data Cards for Standardized Metadata Across DOE-Aligned Data Initiatives: Toward Transparent, Interoperable, and Governed Dataset Documentation

As data-intensive research, advanced computing, and artificial intelligence become increasingly central to scientific and operational workflows, the need for consistent, transparent, and machine-actionable documentation has grown correspondingly. Multiple DOE-aligned communities—including Office of Science, Genesis Mission, American Science Cloud (AmSC), National Nuclear Security Administration (NNSA) stewardship and governance, and related cross-laboratory collaborations—have independently developed metadata practices to support discovery, access, reuse, repository deposit, and compliance.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2017

EDGE COMPUTING AND CONTEXTUAL INFORMATION FOR THE INTERNET OF THINGS SENSORS

Interpreting sensor data require knowledge about sensor placement and the surrounding environment. For a single sensor measurement, it is easy to document the context by visual observation, however for millions of sensors reporting data back to a server, the contextual information needs to be automatically extracted from either data analysis or leveraging complimentary data sources. Data layers that overlap spatially or temporally with sensor locations, can be used to extract the context and to validate the measurement. To minimize the amount of data transmitted through the internet, while preserving signal information content, two methods are explored; computation at the edge and compressed sensing. We validate the above methods on wind and chemical sensor data (1) eliminate redundant measurement from wind sensors and (2) extract peak value of a chemical sensor measuring a methane plume. We present a general cloud based framework to validate sensor data based on statistical and physical modeling and contextual data extracted from geospatial data.

03 NATURAL GAS↗
DOE OSTI2017

EDGE COMPUTING AND CONTEXTUAL INFORMATION FOR THE INTERNET OF THINGS SENSORS

Interpreting sensor data require knowledge about sensor placement and the surrounding environment. For a single sensor measurement, it is easy to document the context by visual observation, however for millions of sensors reporting data back to a server, the contextual information needs to be automatically extracted from either data analysis or leveraging complimentary data sources. Data layers that overlap spatially or temporally with sensor locations, can be used to extract the context and to validate the measurement. To minimize the amount of data transmitted through the internet, while preserving signal information content, two methods are explored; computation at the edge and compressed sensing. We validate the above methods on wind and chemical sensor data (1) eliminate redundant measurement from wind sensors and (2) extract peak value of a chemical sensor measuring a methane plume. We present a general cloud based framework to validate sensor data based on statistical and physical modeling and contextual data extracted from geospatial data.

Klein, Levente↗
DOE OSTI2023

Advances in solar forecasting: Computer vision with deep learning

Renewable energy forecasting is crucial for integrating variable energy sources into the grid. It allows power systems to address the intermittency of the energy supply at different spatiotemporal scales. To anticipate the future impact of cloud displacements on the energy generated by solar facilities, conventional modeling methods rely on numerical weather prediction or physical models, which have difficulties in assimilating cloud information and learning systematic biases. Augmenting computer vision with machine learning overcomes some of these limitations by fusing real-time cloud cover observations with surface measurements acquired from multiple sources. This Review summarizes recent progress in solar forecasting from multisensor Earth observations with a focus on deep learning, which provides the necessary theoretical framework to develop architectures capable of extracting relevant information from data generated by ground-level sky cameras, satellites, weather stations, and sensor networks. Overall, machine learning has the potential to significantly improve the accuracy and robustness of solar energy meteorology; however, more research is necessary to realize this potential and address its limitations.

14 SOLAR ENERGY↗
DOE OSTI2023

Software Bill of Materials (SBOM) Sharing Lifecycle Report

As Software Bill of Materials (SBOM) adoption efforts mature, SBOM sharing continues to occur, but no single solution or set of solutions have become ubiquitous. The purpose of this report is to enumerate and describe the different parties and phases of the SBOM sharing lifecycle and assist readers in choosing suitable SBOM sharing solutions based on the amount of time, resources, subject-matter expertise, effort, and access to tooling that is available to the reader to implement a phase of the SBOM sharing lifecycle. The SBOM sharing lifecycle consists of the Discovery, Access, and Transport of an SBOM and this report details these individual phases and how an SBOM goes from author to the consumer. This report also details how potential enrichment activities may be performed on an SBOM to create a new product before or after it has been shared. The concept of a sophistication classification for SBOM sharing solutions is concurrently introduced with a focus on the inclusion or lack of certain features and effort associated with their implementation. Examples of low, medium, and high-sophistication solutions are provided; however, these examples and associated categorizations should not be seen as a qualitative judgment meant to push the reader towards a particular adoption strategy since sharing solutions are chosen based on the unique needs of the user. This report does recommend the SBOM community consider how to make current and future sharing solutions interoperable with each other as well as more automated methods to facilitate sharing and broader SBOM adoption. This report also highlights an SBOM sharing survey results obtained from interviews with stakeholders to understand the current SBOM sharing landscape. The categorized results of the survey suggest that SBOMs are currently transported directly to the receiver through email or similar informal communication mechanisms or alternatively the SBOM resides on a repository available to consumers. In addition to these transport methods, this report captures industry efforts to create private sharing solutions and services that can store and transport enrichment data and may use higher sophistication features that are cloud-based or using distributed ledger technologies.

97 MATHEMATICS AND COMPUTING↗