Search NASA⌕ Search

SEARCH · Search NASA

Results for “cloud computing, data cloud”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33
All sourcesNASA NTRSDOE OSTI
DOE OSTI2017

H - photodetachment and radiative attachment for astrophysical applications

We combine R-matrix calculations, asymptotic relations, and comparison to available experimental data to construct an H- photodetachment cross section reliable over a large range of photon energies and take into account the series of auto-detaching shape and Feshbach resonances between 10.92 and 14.35 eV. The accuracy of the cross section is controlled by ensuring that it satisfies all known oscillator strength sum rules, including contributions from the resonances and single-photon double-electron photodetachment. From the resulting recommended cross section, spontaneous and stimulated radiative attachment rate coefficients are obtained. Photodetachment rates are also computed for the standard interstellar radiation field, in diffuse and dense interstellar clouds, for blackbody radiation, and for high redshift distortion photons in the recombination epoch. Implications are investigated for these astrophysical radiation fields and epochs.

Optics↗
DOE OSTI2025

Poplar: a phylogenomics pipeline

Motivation Generating phylogenomic trees from the genomic data is essential in understanding biological systems. Each step of this complex process has received extensive attention and has been significantly streamlined over the years. Given the public availability of data, obtaining genomes for a wide selection of species is straightforward. However, analyzing that data to generate a phylogenomic tree is a multistep process with legitimate scientific and technical challenges, often requiring a significant input from a domain-area scientist. Results We present Poplar, a new, streamlined computational pipeline, to address the computational logistical issues that arise when constructing the phylogenomic trees. It provides a framework that runs state-of-the-art software for essential steps in the phylogenomic pipeline, beginning from a genome with or without an annotation, and resulting in a species tree. Running Poplar requires no external databases. In the execution, it enables parallelism for execution for clusters and cloud computing. The trees generated by Poplar match closely with state-of-the-art published trees. The usage and performance of Poplar is far simpler and quicker than manually running a phylogenomic pipeline. Availability and implementation Freely available on GitHub at https://github.com/sandialabs/poplar. Implemented using Python and supported on Linux.

Koning, Elizabeth [Sandia National Laboratories (S↗
DOE OSTI2014

SU-E-T-53: Benchmarking a Monte Carlo Model for Patient Plane Leakage Calculations of Low Energy 6MV Unique Linacs

Purpose: To validate the physics parameters of a Monte Carlo model for patient plane leakage calculations on the 6MV Unique linac by comparing the simulations against IEC patient plane leakage measurements. The benchmarked model can further be used for shielding design optimization, to predict leakage in the proximity of intended treatment fields, reduce the system weight and cost, and improve components reliability. Methods: The treatment head geometry of the Unique linac was simulated in Geant4 (v9.4.p02 with “Opt3” standard electromagnetic physics list) based on CAD drawings of all collimation and shielding components projected from the target to the area within 2m from isocenter. A 4×4m2 scorer was inserted 1m from the target in the patient plane and multiple phase space files were recorded by performing a 40-node computing cluster simulation on the EC2 cloud. The photon energy fluence was calculated relative to the value at isocenter for a 10×10cm2 field using 10×10mm2 bins. Tungsten blocks were parked accordingly to represent MLC120. The secondary particle contamination to patient plane was eliminated by “killing” those particles prior to the primary collimator entrance using a “kill-plane”, which represented the upper head shielding components not being modeled. Both IEC patient-plane leakage and X/Y-jaws transmission were simulated. Results: The contribution of photons to energy fluence was 0.064% on average, in excellent agreement with the experimental data available at 0.5, 1.0, and 1.5m from isocenter, characterized by an average leakage of 0.045% and a maximum leakage of 0.085%. X- and Y-jaws transmissions of 0.43% and 0.44% were found in good agreement with measurements of 0.48% and 0.43%, respectively. Conclusion: A Geant4 model based on energy fluence calculations for the 6MV Unique linac was created and validated using IEC patient plane leakage measurements. The “kill-plane” has effectively eliminated electron contamination to patient plane in these simulations.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2017

SMASH: Survey of the MAgellanic Stellar History

The Large and Small Magellanic Clouds are unique local laboratories for studying the formation and evolution of small galaxies in exquisite detail. The Survey of the MAgellanic Stellar History (SMASH) is an NOAO community Dark Energy Camera (DECam) survey of the Clouds mapping 480 deg{sup 2} (distributed over ∼2400 square degrees at ∼20% filling factor) to ∼24th mag in ugriz . The primary goals of SMASH are to identify low surface brightness stellar populations associated with the stellar halos and tidal debris of the Clouds, and to derive spatially resolved star formation histories. Here, we present a summary of the survey, its data reduction, and a description of the first public Data Release (DR1). The SMASH DECam data have been reduced with a combination of the NOAO Community Pipeline, the PHOTRED automated point-spread-function photometry pipeline, and custom calibration software. The astrometric precision is ∼15 mas and the accuracy is ∼2 mas with respect to the Gaia reference frame. The photometric precision is ∼0.5%–0.7% in griz and ∼1% in u with a calibration accuracy of ∼1.3% in all bands. The median 5 σ point source depths in ugriz are 23.9, 24.8, 24.5, 24.2, and 23.5 mag. The SMASH data have already been used to discover the Hydra II Milky Way satellite, the SMASH 1 old globular cluster likely associated with the LMC, and extended stellar populations around the LMC out to R ∼ 18.4 kpc. SMASH DR1 contains measurements of ∼100 million objects distributed in 61 fields. A prototype version of the NOAO Data Lab provides data access and exploration tools.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2013

Empirical Evaluation of Conservative and Optimistic Discrete Event Execution on Cloud and VM Platforms

Virtual machine (VM) technologies, especially those offered via Cloud platforms, present new dimensions with respect to performance and cost in executing parallel discrete event simulation (PDES) applications. Due to the introduction of overall cost as a metric, the choice of the highest-end computing configuration is no longer the most economical one. Moreover, runtime dynamics unique to VM platforms introduce new performance characteristics, and the variety of possible VM configurations give rise to a range of choices for hosting a PDES run. Here, an empirical study of these issues is undertaken to guide an understanding of the dynamics, trends and trade-offs in executing PDES on VM/Cloud platforms. Performance results and cost measures are obtained from actual execution of a range of scenarios in two PDES benchmark applications on the Amazon Cloud offerings and on a high-end VM host machine. The data reveals interesting insights into the new VM-PDES dynamics that come into play and also leads to counter-intuitive guidelines with respect to choosing the best and second-best configurations when overall cost of execution is considered. In particular, it is found that choosing the highest-end VM configuration guarantees neither the best runtime nor the least cost. Interestingly, choosing a (suitably scaled) low-end VM configuration provides the least overall cost without adversely affecting the total runtime.

Yoginath, Srikanth B↗
DOE OSTI2016

Data centers as dispatchable loads to harness stranded power

Here, we analyze how traditional data center placement and optimal placement of dispatchable data centers affect power grid efficiency. We use detailed network models, stochastic optimization formulations, and diverse renewable generation scenarios to perform our analysis. Our results reveal that significant spillage and stranded power will persist in power grids as wind power levels are increased. A counter-intuitive finding is that collocating data centers with inflexible loads next to wind farms has limited impacts on renewable portfolio standard (RPS) goals because it provides limited system-level flexibility. Such an approach can, in fact, increase stranded power and fossil-fueled generation. In contrast, optimally placing data centers that are dispatchable provides system-wide flexibility, reduces stranded power, and improves efficiency. In short, optimally placed dispatchable computing loads can enable better scaling to high RPS. In our case study, we find that these dispatchable computing loads are powered to 60-80% of their requested capacity, indicating that there are significant economic incentives provided by stranded power.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

Experience in using commercial clouds in CMS

Historically high energy physics computing has been performed on large purpose-built computing systems. In the beginning there were single site computing facilities, which evolved into the Worldwide LHC Computing Grid (WLCG) used today. The vast majority of the WLCG resources are used for LHC computing and the resources are scheduled to be continuously used throughout the year. In the last several years there has been an explosion in capacity and capability of commercial and academic computing clouds. Cloud resources are highly virtualized and intended to be able to be flexibly deployed for a variety of computing tasks. There is a growing interest amongst the cloud providers to demonstrate the capability to perform large scale scientific computing. In this presentation we will discuss results from the CMS experiment using the Fermilab HEPCloud Facility, which utilized both local Fermilab resources and Amazon Web Services (AWS). The goal was to work with AWS through a matching grant to demonstrate a sustained scale approximately equal to half of the worldwide processing resources available to CMS. We will discuss the planning and technical challenges involved in organizing the most IO intensive CMS workflows on a large-scale set of virtualized resource provisioned by the Fermilab HEPCloud. We will describe the data handling and data management challenges. Also, we will discuss the economic issues and cost and operational efficiency comparison to our dedicated resources. At the end we will consider the changes in the working model of HEP computing in a domain with the availability of large scale resources scheduled at peak times.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Physics-Infused AI/ML Based Digital-Twin Framework for Flow-Induced-Vibration Damage Prediction in a Nuclear Reactor Heat Exchanger

This report summarizes some of the ongoing work related to the development of an expert-elicitation-digital-twin framework for real time damage state prediction in heat exchanger components of a nuclear reactor. The framework is targeted towards predicting damage associated with coupled low cycle fatigue (associated with regular heat-up, cool-down and power operation transients) and high cycle fatigue (associated with flow induced vibration transients). The overall framework will be based on a NoSQL based database, physics-infused-geometry-dependent virtual-sensor data, different AI/ML techniques-based data-driven-predictive-model applications (Apps) and real-time plant sensor measurements available through few existing sensors. Towards this overall goal, this report updates some of the ongoing work, such as on implementation of a NoSQL Database (such as MongoDB), FE based heat transfer analysis of a heat exchanger (e.g. of a PWR steam generator) for generating geometry-dependent virtual sensor data and evaluation of various AI/ML models such as based on multivariate linear regression, ensembled decision-tree based Random-Forest and Gradient-Boosting regression and high-dimensional-kernel-function-transformation based Support-Vector-Machine regression models. The AI/ML models were evaluated for predicting multi-time-series thermal states at thousands of 3D point-clouds

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2017

ACStor: Optimizing Access Performance of Virtual Disk Images in Clouds

In virtualized data centers, virtual disk images (VDIs) serve as the containers in virtual environment, so their access performance is critical for the overall system performance. Some distributed VDI chunk storage systems have been proposed in order to alleviate the I/O bottleneck for VM management. As the system scales up to a large number of running VMs, however, the overall network traffic would become unbalanced with hot spots on some VMs inevitably, leading to I/O performance degradation when accessing the VMs. Here, we propose an adaptive and collaborative VDI storage system (ACStor) to resolve the above performance issue. In comparison with the existing research, our solution is able to dynamically balance the traffic workloads in accessing VDI chunks, based on the run-time network state. Specifically, compute nodes with lightly loaded traffic will be adaptively assigned more chunk access requests from remote VMs and vice versa, which can effectively eliminate the above problem and thus improves the I/O performance of VMs. We also implement a prototype based on our ACStor design, and evaluate it by various benchmarks on a real cluster with 32 nodes and a simulated platform with 256 nodes. Experiments show that under different network traffic patterns of data centers, our solution achieves up to 2-8 performance gain on VM booting time and VM’s I/O throughput, in comparison with the other state-of-the-art approaches.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2018

The Modern Research Data Portal: a design pattern for networked, data-intensive science

We describe best practices for providing convenient, high-speed, secure access to large data via research data portals. Here, we capture these best practices in a new design pattern, the Modern Research Data Portal, that disaggregates the traditional monolithic web-based data portal to achieve orders-of-magnitude increases in data transfer performance, support new deployment architectures that decouple control logic from data storage, and reduce development and operations costs. We introduce the design pattern; explain how it leverages high-performance data enclaves and cloud-based data management services; review representative examples at research laboratories and universities, including both experimental facilities and supercomputer sites; describe how to leverage Python APIs for authentication, authorization, data transfer, and data sharing; and use coding examples to demonstrate how these APIs can be used to implement a range of research data portal capabilities. Sample code at a companion web site, https://docs.globus.org/mrdp , provides application skeletons that readers can adapt to realize their own research data portals.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Microsecond-latency feedback at a particle accelerator by online reinforcement learning on hardware

The commissioning and operation of future large-scale scientific experiments will challenge current tuning and control methods. Reinforcement learning (RL) algorithms are a promising solution due to their ability to dynamically adapt to changing environments and consider delayed consequences. In many real-world applications, RL policies must produce actions in real time, often within microseconds to milliseconds, imposing significant constraints on system latency and computational overhead that conventional machine learning libraries are not designed to handle. To control phenomena in real time at these timescales, RL needs to be deployed on-the-edge, namely on dedicated hardware located near the system it controls, without relying on a host CPU or cloud-based inference. In this work we present the design and deployment of an experience accumulator system in a particle accelerator. In this system, deep-RL algorithms run using hardware acceleration and act within a few microseconds, enabling the use of RL for control of phenomena like beam instabilities. The training uses the collected data offline to reduce the number of operations carried out on the acceleration hardware. The proposed architecture was tested in real experimental conditions at the Karlsruhe research accelerator, a synchrotron light source, where the system was used to control artificially induced horizontal betatron oscillations in real-time, with a control loop period of just 2.7 μs. The results showed a performance comparable to the commercial feedback system available at the accelerator, demonstrating the viability and potential of this approach. Due to the self-learning and reconfiguration capability of this implementation, a seamless application to other control problems is possible. Applications range from particle accelerators to large-scale research and industrial facilities.

FPGA↗
DOE OSTI2014

The properties and fate of the galactic center G2 cloud

The object G2 was recently discovered descending into the gravitational potential of the supermassive black hole (BH) Sgr A*. We test the photoionized cloud scenario, determine the cloud properties, and estimate the emission during the pericenter passage. The incident radiation is computed starting from the individual stars at the locations of G2. The radiative transfer calculations are conducted with CLOUDY code and 2011 broadband and line luminosities are fitted. The spherically symmetric, tidally distorted, and magnetically arrested cloud shapes are tested with both the interstellar medium dust and 10 nm graphite dust. The best-fitting magnetically arrested model has the initial density n {sub init} = 1.8 × 10{sup 5} cm{sup –3}, initial radius R {sub init} = 2.2 × 10{sup 15} cm = 17 mas, mass m {sub cloud} = 4 M {sub Earth}, and dust relative abundance A = 0.072. It provides a good fit to 2011 data, is consistent with the luminosities in 2004 and 2008, and reaches an agreement with the observed size. We revise down the predicted radio and X-ray bow shock luminosities to be below the quiescent level of Sgr A*, which readily leads to non-detection in agreement to observations. The magnetic energy dissipation in the cloud at the pericenter coupled with more powerful irradiation may lead to an infrared source with an apparent magnitude m{sub L{sup ′}}≈13.0. No shock into the cloud and no X-rays are expected from cloud squeezing by the ambient gas pressure. Larger than previously estimated cloud mass m {sub cloud} = (4-20) M {sub Earth} may produce a higher accretion rate and a brighter state of Sgr A* as the debris descend onto the BH.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2019

Characterization of Exoplanet Atmospheres with the Optical Coronagraph on WFIRST

Wide-Field Infrared Survey Telescope (WFIRST)-CGI is a NASA technology demonstration mission that is charged with demonstrating key technologies for future exo-Earth imaging missions in space. In the process, it will obtain images and low-resolution spectra of a handful to a dozen extrasolar planets and possibly protoplanetary disks. Its unprecedented contrast levels in the optical will provide astronomers’ with their first direct look at mature, Jupiter-sized planets at moderate separations. This paper addresses the question: what science can be done with such data? An analytic noise model, which is informed by the ongoing engineering developments, is used to compute maximum achievable signal-to-noise ratios and scientifically viable integration times for hypothetical star–planet systems, as well as to investigate the constraining power of various combinations of WFIRST-CGI photometric and spectral observations. This work introduces two simple models for planetary geometric albedos, which are inspired largely by the solar system’s gas giants. The first planet model is a hybrid Jupiter–Neptune model, which separately treats the short and long wavelengths where chromophores and methane dominate absorption, respectively. The second planet model fixes cloud and haze properties in CoolTLusty to match Jupiter’s albedo spectrum, it then perturbs only the metallicity. MCMC retrievals performed on simulated observations are used to assess the precision with which planet model parameters can be measured subject to different exposure times and observing cases. Planet radius is recovered within ±15% for all observing cases with both the hybrid model and the CoolTLusty metallicity grid. Fit results for both models’ parameterizations of geometric albedo spectra demonstrate that a rough indication of the metallicity or methane content should be possible for some WFIRST-CGI targets. We conclude that real observations will likely be able to differentiate between extreme cases using these models, but will lack the precision necessary to uncover subtle trends.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2017

FRIEDA: Flexible Robust Intelligent Elastic Data Management Framework

Scientific applications are increasingly using cloud resources for their data analysis workflows. However, managing data effectively and efficiently over these cloud resources is challenging due to the myriad storage choices with different performance, cost trade-offs, complex application choices and complexity associated with elasticity, failure rates in these environments. The different data access patterns for data-intensive scientific applications require a more flexible and robust data management solution than the ones currently in existence. FRIEDA is a Flexible Robust Intelligent Elastic Data Management framework that employs a range of data management strategies in cloud environments. FRIEDA can manage storage and data lifecycle of applications in cloud environments. There are four different stages in the data management lifecycle of FRIEDA – (i) storage planning, (ii) provisioning and preparation, (iii) data placement, and (iv) execution. FRIEDA defines a data control plane and an execution plane. The data control plane defines the data partition and distribution strategy, whereas the execution plane manages the execution of the application using a master-worker paradigm. FRIEDA also provides different data management strategies, either to partition the data in real-time, or predetermine the data partitions prior to application execution.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2014

Exercises in high-dimensional sampling: maximal poisson-disk sampling and k -d darts

In this paper, we review our recent progress on efficient algorithms for generating well-spaced samples of high dimensional data, and for exploring and characterizing these data, the underlying domain, and functions over the domain. To our knowledge, these techniques have not yet been applied to computational topology, but the possible connections are worth considering. In particular, computational topology problems often have difficulty in scaling efficiently, and these sampling techniques have the potential to drastically reduce the size of the data over which these computational topology algorithms must operate. Lastly, we summarize the definition of these sample distributions; algorithms for generating them in low, moderate, and high dimensions; and applications in mesh generation, rendering, motion planning and simulation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

ARMing the Edge: Designing Edge Computing–Capable Machine Learning Algorithms to Target ARM Doppler Lidar Processing

Abstract There is a need for long-term observations of cloud and precipitation fall speeds in validating and improving rainfall forecasts from climate models. To this end, the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility Southern Great Plains (SGP) site at Lamont, Oklahoma, hosts five ARM Doppler lidars that can measure cloud and aerosol properties. In particular, the ARM Doppler lidars record Doppler spectra that contain information about the fall speeds of cloud and precipitation particles. However, due to bandwidth and storage constraints, the Doppler spectra are not routinely stored. This calls for the automation of cloud and rain detection in ARM Doppler lidar data so that the spectral data in clouds can be selectively saved and further analyzed. During the ARMing the Edge field experiment, a Waggle node capable of performing machine learning applications in situ was deployed at the ARM SGP site for this purpose. In this paper, we develop and test four algorithms for the Waggle node to automatically classify ARM Doppler lidar data. We demonstrate that supervised learning using a ResNet50-based classifier will classify 97.6% of the clear-air images and 94.7% of cloudy images correctly, outperforming traditional peak detection methods. We also show that a convolutional autoencoder paired with k -means clustering identifies 10 clusters in the ARM Doppler lidar data. Three clusters correspond to mostly clear conditions with scattered high clouds, and seven others correspond to cloudy conditions with varying cloud-base heights.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Crowdsourcing the Frontier: Advancing Hybrid Physics‐ML Climate Simulation via a $\$$50,000 Kaggle Competition

Subgrid machine-learning (machine learning [ML]) parameterizations have the potential to introduce a new generation of climate models that incorporate the effects of higher-resolution physics without incurring the prohibitive computational cost associated with more explicit physics-based simulations. However, important issues, ranging from online instability to inconsistent online performance, have limited their operational use for long-term climate projections. To more rapidly drive progress in solving these issues, domain scientists and ML researchers opened up the offline aspect of this problem to the broader ML and data science community with the release of ClimSim, a NeurIPS Data sets and Benchmarks publication, and an associated Kaggle competition. This paper reports on the downstream results of the Kaggle competition by coupling emulators inspired by the winning teams' architectures to an interactive climate model (including full cloud microphysics, a regime historically prone to online instability) and systematically evaluating their online performance. Our results demonstrate that online stability in the low-resolution real-geography setting is reproducible across multiple diverse architectures, which we consider a key milestone. All tested architectures exhibit strikingly similar offline and online biases, though their responses to architecture-agnostic design choices (e.g., expanding the list of input variables) can differ significantly. Multiple Kaggle-inspired architectures achieve state-of-the-art results on certain metrics such as zonal mean bias patterns and global Root Mean Squared Error, indicating that crowdsourcing the essence of the offline problem is one path to improving online performance in hybrid physics-AI climate simulation.

Environmental sciences↗
DOE OSTI2025

E3SM‐Arctic: Regionally Refined Coupled Model for Advanced Understanding of Arctic Systems Interactions

Earth system models are essential tools for climate projections, but coarse resolutions limit regional accuracy, especially in the Arctic. Regionally refined meshes (RRMs) enhance resolution in key areas while maintaining computational efficiency. This paper provides an overview of the United States (U.S.) Department of Energy's (DOE's) Energy Exascale Earth System Model version 2.1 with an Arctic RRM, hereafter referred to as E3SMv2.1-Arctic, for the atmosphere (25 km), land (25 km), and ocean/ice (10 km) components. We evaluate the atmospheric component and its interactions with land, ocean, and cryosphere by comparing the RRM (E3SM2.1-Arctic) historical simulations (1950–2014) with the uniform low-resolution (LR) counterpart, reanalysis products, and observational data sets. The RRM generally reduces biases in the LR model, improving simulations of Arctic large-scale mean fields, such as precipitation, atmospheric circulation, clouds, atmospheric river frequency, and sea ice thickness. However, it introduces a seasonally dependent surface air temperature bias, reducing the LR cold bias in summer but enhancing the LR warm bias in winter, which contributes to the underestimated winter sea ice area and volume. Radiative feedback analysis shows similar climate feedback strengths in both model configurations, with the RRM exhibiting a more positive surface albedo feedback and contributing to a stronger surface warming than LR. These findings underscore the importance of high-resolution modeling for advancing our understanding of Arctic climate changes and their broader global impacts, although some persistent biases appear to be independent of model resolution at 10–100 km scales.

Energy Exascale Earth System Model (E3SM)↗