Search NASA⌕ Search

SEARCH · Search NASA

Results for “cloud computing, data cloud”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Description of the Three-Dimensional Large-Scale Forcing Data from the 3D Constrained Variational Analysis (VARANAL3D)

This technical report introduces a Three-Dimensional Constrained Variational Analysis (3DCVA) (Tang and Zhang 2015) and its product of three-dimensional large-scale forcing data to drive single-column models (SCM), cloud-resolving models (CRM), and large-eddy simulation (LES) models, and to evaluate model results. The 3DCVA algorithm is an extension of the original 1D constrained variational analysis (1DCVA) (Zhang and Lin 1997, Zhang et al. 2001). The three-dimensional structure of the forcing data allows studies of spatial variation of the large-scale forcing fields and tests of physical parameterizations across scales. In the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility, the 3D forcing data are assigned the datastream name varanal3d. In this technical report, 3DCVA will be used to refer to the algorithm, while VARANAL3D will be used to refer to the data product.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2012

Development of Ensemble Neural Network Convection Parametrizations for Climate Models Using ARM Data

The novel neural network (NN) approach has been formulated and used for development of a NN ensemble stochastic convection parametrization for climate models. This fast parametrization is built based on data from Cloud Resolving Model (CRM) simulations initialized with and forced by TOGA-COARE data. The SAM (System for Atmospheric Modeling), developed by D. Randall, M. Khairoutdinov, and their collaborators, has been used for CRM simulations. The observational data are also used for validation of model simulations. The SAM-simulated data have been averaged and projected onto the GCM space of atmospheric states to implicitly define a stochastic convection parametrization. This parametrization is emulated using an ensemble of NNs. An ensemble of NNs with different NN parameters has been trained and tested. The inherent uncertainty of the stochastic convection parametrization derived in such a way is estimated. Due to these inherent uncertainties, NN ensemble is used to constitute a stochastic NN convection parametrization. The developed NN convection parametrization have been validated in a diagnostic CAM (CAM-NN) run vs. the control CAM run. Actually, CAM inputs have been used, at every time step of the control/original CAM integration, for parallel calculations of the NN convection parametrization (CAM-NN) to produce its outputs as a diagnostic byproduct. Total precipitation (P) and cloudiness (CLD) time series, diurnal cycles, and P and CLD distributions for the large Tropical Pacific Ocean for the parallel CAM-NN and CAM runs show similarity and consistency with the NCEP reanalysis. The P and CLD distributions for the tropical area for the parallel runs have been analyzed first for the TOGA-COARE boreal winter season (November 1992 through February 1993) and then for the winter seasons of the follow-up parallel decadal simulations. The obtained results are encouraging and practically meaningful. They show the validity of the NN approach. This constitutes an important practical conclusion of the study: the obtained results on NN ensembles as a stochastic physics parametrization show a realistic possibility of development of NN convection parametrization for climate (and NWP) models based on learning cloud physics from CRM/SAM simulated data.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

Scalable pCT Image Reconstruction Delivered as a Cloud Service

We describe a cloud-based medical image reconstruction service designed to meet a real-time and daily demand to reconstruct thousands of images from proton cancer treatment facilities worldwide. Rapid reconstruction of a three-dimensional Proton Computed Tomography (pCT) image can require the transfer of 100 GB of data and use of approximately 120 GPU-enabled compute nodes. The nature of proton therapy means that demand for such a service is sporadic and comes from potentially hundreds of clients worldwide. We thus explore the use of a commercial cloud as a scalable and cost-efficient platform for pCT reconstruction. To address the high performance requirements of this application we leverage Amazon Web Services' GPU-enabled cluster resources that are provisioned with high performance networks between nodes. To support episodic demand, we develop an on-demand multi-user provisioning service that can dynamically provision and resize clusters based on image reconstruction requirements, priorities, and wait times. We compare the performance of our pCT reconstruction service running on commercial cloud resources with that of the same application on dedicated local high performance computing resources. We show that we can achieve scalable and on-demand reconstruction of large scale pCT images for simultaneous multi-client requests, processing images in less than 10 minutes for less than $10 per image.

Cloud computing↗
DOE OSTI2023

Report for the ASCR Workshop on Visualization for Scientific Discovery, Decision-Making, and Communication

Visualization—the use of visual elements to explore data, form hypotheses, or convey conclusions—is an integral part of the scientific process. Starting from an initial exploration of new data to illustrating outcomes for the general public, visualization is one of the most intuitive and powerful modes of communication. With the explosion of new data sources and types, unprecedented volumes of data, and new technologies, such as virtual reality (VR) and artificial intelligence (AI), visualization has become increasingly essential but also ever more challenging. The Department of Energy’s (DOE) Office of Advanced Scientific Computing Research (ASCR) sponsored a Basic Research Needs workshop in January 2022 to understand the major opportunities and grand challenges in visualization tools and technologies for scientific computing as well as for DOE-relevant applications and goals in general. The workshop identified five priority research directions (PRDs) for visualization to support scientific discovery, decision making, and communication. The first three PRDs describe interconnected research themes addressing the need for new techniques to deal with complex data, uncertainty, and interpretability (PRD 1); the need for scalable and interoperable software stacks (PRD 2); and the challenges and opportunities inherent in new technologies, such as VR, cloud, or exascale computing (PRD 3). The remaining two PRDs describe foundational research themes that recognize the potential of visualizations to provide equitable access to information and to strengthen the scientific discourse (PRD 4); and the need to consider human factors when designing visualizations (PRD 5). Collectively, these PRDs form the pillars for a coherent, long-term research and development strategy in Visualization for Scientific Discovery, Decision-Making, and Communication in the context of the Office of Science’s mission scope.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

INTEGRATED WORKFLOW MANAGEMENT FOR PARTICLE ACCELERATOR SIMULATION

Supercomputing systems are used for a wide range of computationally demanding tasks in many fields of science and engineering. They play a key role in numerical simulation, in which mathematical models are computed in order to simulate the behavior of physical systems. Scientists and engineers that use supercomputers for numerical simulation often have their productivity limited by the need to manually organize and manage extremely large amounts of data that are often produced and consumed by the software programs run on these systems. Recognizing these limitations, Kitware Inc. (Clifton Park, NY) and SLAC National Accelerator Laboratory (Menlo Park, CA) are developing an advanced software platform that can reduce the cognitive overhead required by knowledge workers when using supercomputers for numerical simulation. Phase I of the project is complete and includes the development of new capabilities for organizing simulation project files, improvements to the user interface and overall usability, and deployment of a “middle tier” server to sit between user desktop machines and supercomputers to offload much of the data management workload. The project also developed prototype software for executing sequences of numerical simulations, and a prototype for migrating supercomputing software to cloud-based computing systems to provide a potential alternative to supercomputers with different logistical and price-to-performance tradeoffs.

Tourtellott, John↗
DOE OSTI2023

Closed Loop Geothermal Working Group: GeoCLUSTER App, Subsurface Simulation Results, and Publications

To better understand the heat production, electricity generation performance, and economic viability of closed-loop geothermal systems in hot-dry rock, the Closed-Loop Geothermal Working Group -- a consortium of several national labs and academic institutions has tabulated time-dependent numerical solutions and levelized cost results of two popular closed-loop heat exchanger designs (u-tube and co-axial). The heat exchanger designs were evaluated for two working fluids (water and supercritical CO2) while varying seven continuous independent parameters of interest (mass flow rate, vertical depth, horizontal extent, borehole diameter, formation gradient, formation conductivity, and injection temperature). The corresponding numerical solutions (approximately 1.2 million per heat exchanger design) are stored as multi-dimensional HDF5 datasets and can be queried at off-grid points using multi-dimensional linear interpolation. A Python script was developed to query this database and estimate time-dependent electricity generation using an organic Rankine cycle (for water) or direct turbine expansion cycle (for CO2) and perform a cost assessment. This document aims to give an overview of the HDF5 database file and highlights how to read, visualize, and query quantities of interest (e.g., levelized cost of electricity, levelized cost of heat) using the accompanying Python scripts. Details regarding the capital, operation, and maintenance and levelized cost calculation using the techno-economic analysis script are provided. This data submission will contain results from the Closed Loop Geothermal Working Group study that are within the public domain, including publications, simulation results, databases, and computer codes. GeoCLUSTER is a Python-based web application created using Dash, an open-source framework built on top of Flask that streamlines the building of data dashboards. GeoCLUSTER provides users with a collection of interactive methods for streamlining the exploration and visualization of an HDF5 dataset. The GeoCluster app and database are contained in the compressed file geocluster_vx.zip, where the "x" refers to the version number. For example, geocluster_v1.zip is Version 1 of the app. This zip file also contains installation instructions. **To use the GeoCLUSTER app in the cloud, click the link to "GeoCLUSTER on AWS" in the Resources section below. To use the GeoCLUSTER app locally, download the geocluster_vx.zip to your computer and uncompress this file. When uncompressed this file comprises two directories and the geocluster_installation.pdf file. The geo-data app contains the HDF5 database in condensed format, and the GeoCLUSTER directory contains the GeoCLUSTER app in the subdirectory dash_app, as app.py. The geocluster_installation.pdf file provides instructions on installing Python, the needed Python modules, and then executing the app.

15 GEOTHERMAL ENERGY↗
DOE OSTI2023

TWST Cloud Properties (COD, droplet effective radius, and thermodynamic phase). SAIL, AMF2, 2022-2023.

The dataset consists of calibrated zenith shortwave spectral radiances (440-1700 nm) and cloud optical depth (COD) retrievals approximately every second. Retrievals of cloud droplet effective radius and thermodynamic phase are currently done offline, but some of these retrievals are included in the dataset. Effective radius and phase are included for days with periods of sufficiently high COD. Effective radius and phase retrievals in the data set were computed at approximately 5-10 second intervals to reduce computation time. The retrievals can be performed at the full sample rate. The field of view is 0.5 degree.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Recent advances in integrated hydrologic models: Integration of new domains

Over the past several decades, hydrologic models have advanced from independent models of the surface and subsurface to integrated models that can capture the terrestrial hydrologic cycle within one framework. In recent years, these coupled frameworks have seen the inclusion of biogeochemical processes, ecohydrology, sedimentation and erosion, cold region hydrology, anthropogenic activities, and atmospheric processes. This expansion is the result of increased computational, data, and modeling capabilities and capacities, as well as improved understanding of the processes that drive these integrated systems. Here, in this study, we review these recent advances to integrate new processes and systems into existing terrestrial hydrologic models and highlight the significant challenges and opportunities that remain. We identify that with so many models currently available and in development, selecting the most appropriate model is difficult, and we suggest a path for new or novice modelers to find the most appropriate code based on their needs. In addition, data required to parameterize and calibrate these models can often constrain their applicability and usefulness. However, advances in environmental sensors and measurement technology, in addition to data assimilation of non-traditional data (e.g. remote sensing, qualitative data) are providing new ways of addressing this issue. As we expand hydrologic models to integrate more processes and systems, our computational demands also increase. Recent and emerging advances in computational platforms, including cloud and quantum computing, in addition to the use of machine learning to capture some processes, will continue to support the use of increasingly larger and more complex, process-based models. Finally, we highlight that it is critical to develop state-of-the-science models that are accessible to all model users, not just those applied for research and development. We encourage continued development of diverse modeling platforms, considering the user needs, data availability, and computational resources.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Development of a Scalable Risk-informed Predictive Maintenance Cloud-based Strategy at Nuclear Power Plants

The fact that light-water reactor operation and maintenance costs are prohibitively expensive and contribute to the premature decommissioning of nuclear power plants is partly due to how the equipment is monitored. In recent years, cloud computing has emerged as a dominant technology, as its low cost, computing and storage adaptability, and ability to host applications across numerous virtual infrastructures potentially make it a cost-effective alternative to onsite storage and diagnostics. In this paper, a technological assessment is carried out on a provisional cloud deployment architecture for a nuclear power plant predictive monitoring system. This cloud-based monitoring system would enable maintenance and diagnostic analysts and other authorized plant users to remotely monitor equipment functionality, thus enabling early fault detection and effective predictive maintenance practices. To provide data processing and storage, sensor device networking, and database management, the Microsoft Azure cloud platform is utilized as part of the proposed cloud architecture; however, this analysis could be extended to other cloud computing service providers as well. The focus of this paper is on application of cloud resources for enabling predictive maintenance, identification of technological hurdles associated with moving to a cloud-computing-based architecture, and potential benefits from moving to a centralized cloud system.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2015

Two-stage atlas subset selection in multi-atlas based image segmentation

Purpose: Fast growing access to large databases and cloud stored data presents a unique opportunity for multi-atlas based image segmentation and also presents challenges in heterogeneous atlas quality and computation burden. This work aims to develop a novel two-stage method tailored to the special needs in the face of large atlas collection with varied quality, so that high-accuracy segmentation can be achieved with low computational cost. Methods: An atlas subset selection scheme is proposed to substitute a significant portion of the computationally expensive full-fledged registration in the conventional scheme with a low-cost alternative. More specifically, the authors introduce a two-stage atlas subset selection method. In the first stage, an augmented subset is obtained based on a low-cost registration configuration and a preliminary relevance metric; in the second stage, the subset is further narrowed down to a fusion set of desired size, based on full-fledged registration and a refined relevance metric. An inference model is developed to characterize the relationship between the preliminary and refined relevance metrics, and a proper augmented subset size is derived to ensure that the desired atlases survive the preliminary selection with high probability. Results: The performance of the proposed scheme has been assessed with cross validation based on two clinical datasets consisting of manually segmented prostate and brain magnetic resonance images, respectively. The proposed scheme demonstrates comparable end-to-end segmentation performance as the conventional single-stage selection method, but with significant computation reduction. Compared with the alternative computation reduction method, their scheme improves the mean and medium Dice similarity coefficient value from (0.74, 0.78) to (0.83, 0.85) and from (0.82, 0.84) to (0.95, 0.95) for prostate and corpus callosum segmentation, respectively, with statistical significance. Conclusions: The authors have developed a novel two-stage atlas subset selection scheme for multi-atlas based segmentation. It achieves good segmentation accuracy with significantly reduced computation cost, making it a suitable configuration in the presence of extensive heterogeneous atlases.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Detection of multi-modal Doppler spectra – Part 1: Establishing characteristic signals in radar moment data

Vertically pointing millimeter-wavelength radars provide a wealth of information about cloud and precipitation particle properties. Doppler spectral data can inform on how particles of varying vertical velocities contribute to the total backscattered power observed. It is more computationally cost effective to process moment data instead of spectra data, but doing so leaves valuable information on the cutting room floor. To confidently identify a multi-modal spectra event, in which two or more modes are present within a layer, Doppler spectral data are essential. This means long-term identification of layers featuring multi-modal spectra can be cost prohibitive. To address this, we explore three multi-modal spectra cases from winter precipitation events to determine characteristic signatures of these layers in the moment data averaged over short time periods (∼ 145 s) and explore how these layers differ from the rest of the vertical profiles. We find that the mean spectrum width and the standard deviation of mean Doppler velocity can be used to determine whether or not a layer is multi-modal. In particular, multi-modal layers in mixed-phase and ice clouds feature larger mean spectrum width (exceeding 0.17 m s −1 ) and smaller standard deviation of the mean Doppler velocity (below 0.1 m s −1 ). In Part 1 of this study, the identification criteria and methods are described. In Part 2 (Wugofski and Kumjian, 2025), we perform a verification of the method for three years of vertically pointing radar data, and explore the meteorological conditions associated with identified multi-modal spectral events.

Wugofski, Sarah [Pennsylvania State Univ., Univers↗
DOE OSTI2012

A Study of Cloud Processing of Organic Aerosols Using Models and CHAPS Data

The main theme of our work has been the identification of parameters that mostly affect the formation and modification of aerosol particles and their interaction with water vapor. Our detailed process model studies led to simplifications/parameterizations of these effects that bridge detailed aerosol information from laboratory and field studies and the need for computationally efficient expressions in complex atmospheric models. One focus of our studies has been organic aerosol mass that is formed in the atmosphere by physical and/or chemical processes (secondary organic aerosol, SOA) and represents a large fraction of atmospheric particulate matter. Most current models only describe SOA formation by condensation of low volatility (or semivolatile) gas phase products and neglect processes in the aqueous phase of particles or cloud droplets that differently affect aerosol size and vertical distribution and chemical composition (hygroscopicity). We developed and applied models of aqueous phase SOA formation in cloud droplets and aerosol particles (aqSOA). Placing our model results into the context of laboratory, model and field studies suggests a potentially significant contribution of aqSOA to the global organic mass loading. The second focus of our work has been the analysis of ambient data of particles that might act as cloud condensation nuclei (CCN) at different locations and emission scenarios. Our model studies showed that the description of particle chemical composition and mixing state can often be greatly simplified, in particular in aged aerosol. While over the past years many CCN studies have been successful performed by using such simplified composition/mixing state assumptions, much more uncertainty exists in aerosol-cloud interactions in cold clouds (ice or mixed-phase). Therefore we extended our parcel model that describes warm cloud formation by ice microphysics and explored microphysical parameters that determine the phase state and lifetime of Arctic mixed-phase clouds.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2017

Automated Blazar Light Curves Using Machine Learning

Every night in a remote clearing called Fenton Hill high in the Jemez Mountains of central New Mexico, a bank of robotically controlled telescopes tilt their lenses to the sky for another round of observation through digital imaging. Los Alamos National Laboratory’s Thinking Telescopes project is watching for celestial transients including high-power cosmic flashes called, and like all science, it can be messy work. To keep the project clicking along, Los Alamos scientists routinely install equipment upgrades, maintain the site, and refine the sophisticated machinelearning computer programs that process those images and extract useful data from them. Each week the system amasses 100,000 digital images of the heavens, some of which are compromised by clouds, wind gusts, focus problems, and so on. For a graduate student at the Lab taking a year’s break between master’s and Ph.D. studies, working with state-of-the-art autonomous telescopes that can make fundamental discoveries feels light years beyond the classroom.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2016

Data Provenance Hybridization Supporting Extreme-Scale Scientific WorkflowApplications

As high performance computing (HPC) infrastructures continue to grow in capability and complexity, so do the applications that they serve. HPC and distributed-area computing (DAC) (e.g. grid and cloud) users are looking increasingly toward workflow solutions to orchestrate their complex application coupling, pre- and post-processing needs To gain insight and a more quantitative understanding of a workflow’s performance our method includes not only the capture of traditional provenance information, but also the capture and integration of system environment metrics helping to give context and explanation for a workflow’s execution. In this paper, we describe IPPD’s provenance management solution (ProvEn) and its hybrid data store combining both of these data provenance perspectives.

provenance↗
DOE OSTI2011

STARLESS CLOUD CORE L1517B IN ENVELOPE EXPANSION WITH CORE COLLAPSE

Various spectral emission lines from the star-forming molecular cloud core L1517B manifest red asymmetric double-peaked profiles with stronger red peaks and weaker blue peaks, in contrast to the oft-observed blue-skewed molecular spectral line profiles with blue peaks stronger than red peaks. Invoking a spherically symmetric general polytropic hydrodynamic shock model for the envelope expansion with a core collapse (EECC) phase, we show the radial flow velocity, mass density, and temperature structures of a self-similar evolution for L1517B in a dynamically consistent manner. By prescribing simple radial profiles of abundance distribution for pertinent molecules, we perform molecular excitation and radiative transfer calculations using the publicly available RATRAN code set for the spherically symmetric case. Emphatically, the spectral profiles of line emissions from the same molecules but for different line transitions as well as spectra of closely pertinent isotopologues strongly constrain the self-similar hydrodynamics of a cloud core with prescribed abundances. Our computational results show that the EECC model reproduces molecular spectral line profiles in sensible agreement with the observational data of the Institut de Radioastronomie Millimetrique (IRAM), Five College Radio Astronomical Observatory, and Effelsberg 100 m telescopes for L1517B. We also report the spatially resolved observations of the optically thick line HCO{sup +}(1 - 0) using the Purple Mountain Observatory 13.7 m telescope at Delingha in China and the relevant fitting results. Hyperfine line structures of NH{sub 3} and N{sub 2}H{sup +} transitions are also fitted to consistently reveal the dynamics of the central core collapse. As a consistent model check, radial profiles of 1.2 mm and 850 {mu}m dust continua observed by the IRAM 30 m telescope and the Submillimeter Common-User Bolometer Array, respectively, are also fitted numerically using the same EECC model that produces the molecular line profiles. L1517B is likely undergoing an EECC shock phase. For future observational tests, we also predict several molecular line profiles with spatial distributions, the radial profile of the sub-millimeter continuum at wavelength 450 {mu}m, as well as the radial profiles of the column density and visual extinction for L1517B.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Edge at the Pier: EPCAPE Software-Defined Sensing Field Campaign Report

The Eastern Pacific Cloud Aerosol Precipitation Experiment (EPCAPE) was aimed to enhance the understanding of cloud and aerosol properties in the region surrounding La Jolla, California. To address challenges in data collection and processing from various instruments, an edge computing device known as Waggle Sage Node (WSN) was deployed at the Ellen Browning Scripps Memorial Pier. WSN is a distributed-sensing platform designed to collect and analyze environmental data at the edge. Sage is a multi-agency-supported project that designs and builds a new kind of national-scale reusable cyberinfrastructure to enable artificial intelligence (AI) at the edge based on the Waggle platform. Sponsors include the U.S. Department of Energy (DOE) Advanced Scientific Computing Research (ASCR), DOE National Nuclear Security Administration (NNSA), DOE Biological and Environmental Research (BER) through DOE Artificial Intelligence for Earth System Predictability (AI4ESP), Argonne Laboratory-Directed Research and Development (LDRD). Sage (https://sagecontinuum.org/) is funded as a National Science Foundation Mid-Scale Research Infrastructure (MSRI) project (https://www.nsf.gov/awardsearch/showAward?AWD_ID=1935984). This robust, multi-architecture edge computing platform facilitated environmental monitoring during the campaign. This report details the scientific objectives, deployment process, and key results of integrating Waggle into the EPCAPE field campaign.

54 ENVIRONMENTAL SCIENCES↗