SEARCH · Search NASA

Results for “cloud computing, data cloud”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,117 records · Page 62

All sources NASA NTRS DOE OSTI

NASA NTRSDate not supplied

OpenNEX: An open collaboration platform for the earth science community

Satellite data from the past several decades provide the most consistent record of land-surface processes that form the basis for scientific assessments of the impacts of climate variations and changes on the environment and human social-economical activities. During this time, scientific research on the characterization and assessment of environmental changes had tended to focus on large-scale land-surface changes with significant social-economic impacts. Increasingly, attention is shifting toward changes that occur more locally and that most directly relate to the everyday life of the majority of the population. In addition, there has been needs to develop management and policy decision support systems that are based on local environmental information. Almost at the same time, the advancement in sensor technology has allowed us to collect an unprecedented volume of environmental data. These data must be curated and analyzed to extract useful information for research and decision support purposes. Established in 2013 and funded by NASA, the Open NASA Earth eXchange (OpenNEX; https://opennex.org/ , Jia et al., 2019 ) project partnered with Amazon Web Services (AWS) to make available a large amount of Earth observing data, modeling results, and analysis tools on the AWS. OpenNEX provides researchers, developers, educators, and ordinary users with easy access to an integrated Earth science computational and data platform, enabling citizen scientists and application developers to realize the full value of NASA data assets and software tools. To encourage the public's engagement in this project, NASA ran virtual workshops and prize competitions. The virtual workshops provided online lectures and tutorials about how prominent scientists used the data in their research and the tutorials gave examples how to use the tools to interrogate the data in the Amazon cloud. Finally, the prize competitions allowed much wider participation in the OpenNEX project and enable testing the non-traditional projects and out-of-box ideas. OpenNEX has continued to evolve and mature. Here, we highlight new features and functionalities available to the community.

Jian Zhang↗

DOE OSTI2016

Sirepo for Synchrotron Radiation Workshop

Sirepo is an open source framework for cloud computing. The graphical user interface (GUI) for Sirepo, also known as the client, executes in any HTML5 compliant web browser on any computing platform, including tablets. The client is built in JavaScript, making use of the following open source libraries: Bootstrap, which is fundamental for cross-platform web applications; AngularJS, which provides a model–view–controller (MVC) architecture and GUI components; and D3.js, which provides interactive plots and data-driven transformations. The Sirepo server is built on the following Python technologies: Flask, which is a lightweight framework for web development; Jinja, which is a secure and widely used templating language; and Werkzeug, a utility library that is compliant with the WSGI standard. We use Nginx as the HTTP server and proxy, which provides a scalable event-driven architecture. The physics codes supported by Sirepo execute inside a Docker container. One of the codes supported by Sirepo is the Synchrotron Radiation Workshop (SRW). SRW computes synchrotron radiation from relativistic electrons in arbitrary magnetic fields and propagates the radiation wavefronts through optical beamlines. SRW is open source and is primarily supported by Dr. Oleg Chubar of NSLS-II at Brookhaven National Laboratory.

Nagler, Robert↗

DOE OSTI2016

Sirepo - Warp

Sirepo is an open source framework for cloud computing. The graphical user interface (GUI) for Sirepo, also known as the client, executes in any HTML5 compliant web browser on any computing platform, including tablets. The client is built in JavaScript, making use of the following open source libraries: Bootstrap, which is fundamental for cross-platform web applications; AngularJS, which provides a model–view–controller (MVC) architecture and GUI components; and D3.js, which provides interactive plots and data-driven transformations. The Sirepo server is built on the following Python technologies: Flask, which is a lightweight framework for web development; Jin-ja, which is a secure and widely used templating language; and Werkzeug, a utility library that is compliant with the WSGI standard. We use Nginx as the HTTP server and proxy, which provides a scalable event-driven architecture. The physics codes supported by Sirepo execute inside a Docker container. One of the codes supported by Sirepo is Warp. Warp is a particle-in-cell (PIC) code de-signed to simulate high-intensity charged particle beams and plasmas in both the electrostatic and electromagnetic regimes, with a wide variety of integrated physics models and diagnostics. At pre-sent, Sirepo supports a small subset of Warp’s capabilities. Warp is open source and is part of the Berkeley Lab Accelerator Simulation Toolkit.

Nagler, Robert↗

DOE OSTI2015

Efficient Parallel Discrete Event Simulation on Cloud/Virtual Machine Platforms

Cloud and Virtual machine (VM) technologies present new challenges with respect to performance and monetary cost in executing parallel discrete event simulation (PDES) applications. Due to the introduction of overall cost as a metric, the traditional use of the highest-end computing configuration is no longer the most obvious choice. Moreover, the unique runtime dynamics and configuration choices of Cloud and VM platforms introduce new design considerations and runtime characteristics specific to PDES over Cloud/VMs. Here, an empirical study is presented to guide an understanding of the dynamics, trends, and trade-offs in executing PDES on Cloud/VM platforms. Performance and cost measures obtained from multiple PDES applications executed on the Amazon EC2 Cloud and on a high-end VM host machine reveal new, counterintuitive VM--PDES dynamics and guidelines. One of the critical aspects uncovered is the fundamental mismatch in hypervisor scheduler policies designed for general cloud workloads versus the virtual time ordering needed for PDES workloads. This insight is supported by experimental data revealing the gross deterioration in PDES performance traceable to VM scheduling policy. To overcome this fundamental problem, the design and implementation of a new deadlock-free scheduler algorithm are presented, optimized specifically for PDES applications on VMs. The scalability of our scheduler has been tested up to 128 VMs multiplexed on 32 cores, showing significant improvement in the runtime relative to the default Cloud/VM scheduler. The observations, algorithmic design, and results are timely for emerging cloud/VM-based installations, highlighting the need for PDES-specific support in high performance discrete event simulations on Cloud/VM platforms.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

AI as a Bridge between ARM Observationsand E3SM for improving Clouds and Precipitation

Focus area(s): How can AI deepen our physical understanding of turbulence and moist processes from ARM data (area 3), and improve E3SM global simulations of clouds and precipitation (area 2)?

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2026

Advanced Data Center Energy Opportunities: Cloud and Infrastructure CoP - Data Center Energy and Efficiency with AI Adoption

The NLR portion of the "Cloud & Infrastructure CoP - Data Center Energy and Efficiency with AI Adoption" web meeting will cover data center locations, energy use and load growth, best practices, performance metrics, transition to direct liquid cooled data center equipment, and NLR's approach to optimizing data center.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

NASA NTRSDate not supplied

Climate Fingerprinting Sounder Product (ClimFiSP) Skin Temperature Trends Analysis

Climate fingerprinting Sounder Product (ClimFiSP) has been developed at NASA Langley Research Center which includes daily skin temperature, surface emissivity, air temperature, H2O, trace gases, and cloud properties on 0.5x0.5 grid. Those properties are derived from IR hyper-spectral radiance measured by AIRS on Aqua and CrIS on SNPP and JPSS series. Global skin temperature trends have been derived using more than 20 years of monthly mean skin temperature data from ClimFiSP. The ClimFiSP algorithm use the spectral fingerprinting methodology that allows a low latency procession of more than two decades long satellite data record. The computational cost can be reduced by more than two orders of magnitude as compared with traditional Level-Level2-Level3 retrieval algorithms. In this presentation the global skin temperature trend from ClimFiSP will be compared with skin temperature trend derived from CLIMCAPS, ERA5, GISTEMP, HadCRUT5, and IASI data products, and the results show that pattern of ClimFiSP global skin temperature trends overall matches well with other datasets. The zonally averaged skin temperature anomaly will also be validated using those datasets. It is expected that ClimFiSP surface temperature data can serve as an important complement for surface-based estimates, especially in the regions where the spatial coverage of the surface-based observations is scarce.

Liqiao Lei↗

NASA NTRS1990

The analysis of polar clouds from AVHRR satellite data using pattern recognition techniques

The cloud cover in a set of summertime and wintertime AVHRR data from the Arctic and Antarctic regions was analyzed using a pattern recognition algorithm. The data were collected by the NOAA-7 satellite on 6 to 13 Jan. and 1 to 7 Jul. 1984 between 60 deg and 90 deg north and south latitude in 5 spectral channels, at the Global Area Coverage (GAC) resolution of approximately 4 km. This data embodied a Polar Cloud Pilot Data Set which was analyzed by a number of research groups as part of a polar cloud algorithm intercomparison study. This study was intended to determine whether the additional information contained in the AVHRR channels (beyond the standard visible and infrared bands on geostationary satellites) could be effectively utilized in cloud algorithms to resolve some of the cloud detection problems caused by low visible and thermal contrasts in the polar regions. The analysis described makes use of a pattern recognition algorithm which estimates the surface and cloud classification, cloud fraction, and surface and cloudy visible (channel 1) albedo and infrared (channel 4) brightness temperatures on a 2.5 x 2.5 deg latitude-longitude grid. In each grid box several spectral and textural features were computed from the calibrated pixel values in the multispectral imagery, then used to classify the region into one of eighteen surface and/or cloud types using the maximum likelihood decision rule. A slightly different version of the algorithm was used for each season and hemisphere because of differences in categories and because of the lack of visible imagery during winter. The classification of the scene is used to specify the optimal AVHRR channel for separating clear and cloudy pixels using a hybrid histogram-spatial coherence method. This method estimates values for cloud fraction, clear and cloudy albedos and brightness temperatures in each grid box. The choice of a class-dependent AVHRR channel allows for better separation of clear and cloudy pixels than does a global choice of a visible and/or infrared threshold. The classification also prevents erroneous estimates of large fractional cloudiness in areas of cloudfree snow and sea ice. The hybrid histogram-spatial coherence technique and the advantages of first classifying a scene in the polar regions are detailed. The complete Polar Cloud Pilot Data Set was analyzed and the results are presented and discussed.

Smith, William L.↗

NASA NTRSDate not supplied

Towards an Optimal Estimation Retrieval of Cirrus Cloud Optical and Microphysical Properties Using Hyperspectral Shortwave Instruments and A Fast Radiative Transfer Algorithm

Cirrus cloud retrieval products (here, cloud optical depth, effective particle size, and cloud top height) are important inputs into numerical weather and climate models. Uncertainties in such retrieval products, as a matter of course, propagate downstream, impacting model calculations. Improvements in high-quality global cirrus cloud optical and microphysical data products from satellite observations are needed to understand and reduce retrieval uncertainties. Hyperspectral shortwave instruments produce high-resolution and information-dense spectra, thus offering the opportunity to reduce uncertainties in retrieval products. We are in the process of developing a retrieval that uses the very fast Principal Component Radiative Transfer Model in the solar spectral region (PCRTM-Solar) in the forward model calculations. This retrieval will use measured reflectances from the NASA Earth Surface Mineral Dust Source Investigation (EMIT) and the forthcoming Climate Absolute Radiance and Refractivity Observatory Pathfinder (CLARREO-Pathfinder) instruments. In this manuscript we present progress towards a reference retrieval employing a widely used, verified, accurate, yet computationally slower radiative transfer modeling technique. The reference retrieval, while too slow for using the complete hyperspectral measurement, will allow us to study the behavior of retrieval products and help us verify results from our in-development fast retrieval. Both retrievals will use the optimal estimation retrieval framework. In this manuscript we present results from an uncertainty analysis considering three uncertainty sources for a cirrus cloud retrieval in the form of error covariance matrices: reflectance uncertainty due to water vapor, the reflectance uncertainty due to ice crystal scattering assumptions, and the instrument measurement uncertainty. Results show that the uncertainty due to habit selection is the largest, while that due to water vapor is at most 0.6% relative to channel reflectance. As a first step, the retrieval is being designed for single layer ice clouds over open ocean water.

Cirrus cloud↗

DOE OSTI2019

Directed Gas-Phase Synthesis of Triafulvene under Single-Collision Conditions

We report the triafulvene molecule (c-C 4 H 4 )—the simplest representative of the fulvene family—has been synthesized for the first time in the gas phase through the reaction of the methylidyne radical (CH) with methylacetylene (CH 3 CCH) and allene (H 2 CCCH 2 ) under single-collision conditions. The experimental and computational data suggest triafulvene is formed by the barrierless cycloaddition of the methylidyne radical to the π-electron density of either C 3 H 4 isomer followed by unimolecular decomposition through elimination of atomic hydrogen from the CH 3 or CH 2 groups of the reactants. The dipole moment of triafulvene of 1.90 D suggests that this molecule could represent a critical tracer of microwave-inactive allene in cold molecular clouds, thus defining constraints on the largely elusive hydrocarbon chemistry in low-temperature interstellar environments, such as that of the Taurus Molecular Cloud 1 (TMC-1).

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2016

Moving image analysis to the cloud: A case study with a genome-scale tomographic study

Over the last decade, the time required to measure a terabyte of microscopic imaging data has gone from years to minutes. This shift has moved many of the challenges away from experimental design and measurement to scalable storage, organization, and analysis. As many scientists and scientific institutions lack training and competencies in these areas, major bottlenecks have arisen and led to substantial delays and gaps between measurement, understanding, and dissemination. We present in this paper a framework for analyzing large 3D datasets using cloud-based computational and storage resources. We demonstrate its applicability by showing the setup and costs associated with the analysis of a genome-scale study of bone microstructure. We then evaluate the relative advantages and disadvantages associated with local versus cloud infrastructures.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

NASA NTRS1975

The McIDAS system

The man-computer interactive data access system (McIDAS) hardware and software design is outlined, with emphasis on meteorological applications. The McIDAS system features a flexible digital image enhancement device. Theory of operation, the McIDAS language, the McIDAS executive monitor, image acquisition, image parameters, image display, graphics, image navigation, and image massaging are explained. The WINDCO/CLDHGT system, developed to align time sequences of geosynchronous satellite pictures and to determine the motion and height of selected cloud targets, is also described.

Smith, E. A.↗

NASA NTRS2000

Clear-Sky Closure Studies of Lower Tropospheric Aerosol and Water Vapor During ACE-2 Using Airborne Sunphotometer, Airborne In-Situ, Space-Borne, and Ground-Based Measurements

We report on clear-sky column closure experiments (CLEARCOLUMN) performed in the Canary Islands during the second Aerosol Characterization Experiment (ACE-2) in June/July 1997. We present CLEARCOLUMN results obtained by combining airborne sunphotometer and in-situ (optical particle counter, nephelometer, and absorption photometer) measurements taken aboard the Pelican aircraft, space-borne NOAA/AVHRR data and ground-based lidar and sunphotometer measurements. During both days discussed here, vertical profiles flown in cloud-free air masses revealed 3 distinctly different layers: a marine boundary layer (MBL) with varying pollution levels, an elevated dust layer, and a very clean layer between the MBL and the dust layer. A key result of this study is the achievement of closure between extinction or layer aerosol optical depth (AOD) computed from continuous in-situ aerosol size-distributions and composition and those measured with the airborne sunphotometer. In the dust, the agreement in layer AOD (lambda = 380-1060 nm) is 3-8%. In the MBL there is a tendency for the in-situ results to be slightly lower than the sunphotometer measurements (10-17% at lambda = 525 nm), but these differences are within the combined error bars of the measurements and computations.

Schmid, Beat↗

NASA NTRS2000

Clear-Sky Closure Studies of Lower Tropospheric Aerosol and Water Vapor During ACE-2 Using Airborne Sunphotometer, Airborne In-Situ, Space-Borne, and Ground-Based Measurements

Schmid, Beat↗

DOE OSTI2014

Physics-Based GOES Product for Use in NREL's National Solar Radiation Database: Preprint

The Global Solar Insolation Project (GSIP) is an operational physical model from the National Oceanic and Atmospheric Administration (NOAA) that computes global horizontal radiation (GHI) using the visible and infrared channel measurements from geostationary operational environmental satellites (GOES). GSIP uses a two-stage scheme that retrieves cloud properties and uses those properties in the Satellite Algorithm for Surface Radiation Budget (SASRAB) model to calculate surface radiation. The National Renewable Energy Laboratory, University of Wisconsin, and NOAA have recently collaborated to adapt GSIP to create a high-temporal and spatial resolution data set. The data sets are currently being incorporated into the widely used National Solar Radiation Data Base.

14 SOLAR ENERGY↗

DOE OSTI2020

Sensitivity Study for Forecasting Variables of WRF-Solar Using a Tangent Linear Approach

Integrating solar generation in recent years has highlighted the need for improved accuracy in predicting solar power. Confidence in solar power forecasting can be achieved by designing an ensemble that provides reliable probabilistic information for solar radiation with reduced uncertainty and error. Ideally, ensemble members are created through the optimized perturbation of the initial conditions in numerical weather prediction (NWP) models. Tangent linear models are capable of efficiently investigating the sensitivity of solar radiation to model input parameters because they do not require individual perturbation of each variable. This sensitivity study using tangent linear models provide us the capability to identify the right variables to perturb in an ensemble prediction system. In this study, we developed tangent linear models for WRF-Solar modules that directly impact the computation of solar radiation and the simulation of cloud formation and dissipation including the Fast All-sky Model for Solar Applications (FARMS), the Noah land surface model (LSM), the Thompson microphysics, the Mello-Yamada-Nakanishi-Niino (MYNN) boundary layer parameterization, and the Deng scheme for a shallow-convection parameterization. A sensitivity analysis was conducted under various scenarios based on satellite observations and model simulations from the National Solar Radiation Data Base (NSRDB) and WRF-Solar, respectively. Critical forecasting variables that are highly sensitive to the forecasting of global horizontal irradiance (GHI), direct normal irradiance (DNI), cloud mixing ratio, cloud tendency, cloud fraction, and sensible and latent heat fluxes were determined using the relevant WRF-Solar module. This study will be used as a guidance on future research leading to high-quality probabilistic solar forecasting. In this presentation, we discuss the validation of tangent linear approach for WRF-Solar modules and illustrate how the sensitivity results are valuable in the improvement of probabilistic solar prediction.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2026

Two-stage formation-energy correction (NbZr, TaZr, VZr)

This bundle contains the scripts, the raw and corrected per-structure data, and the manuscript plots for the NbZr / TaZr / VZr BCC binary formation energies and the associated RMSDs. Why a two-stage correction is necessary: The "raw" formation energy of every relaxed VASP configuration is computed in the usual way, FE_raw(c) = E_alloy(c) - sum_i x_i * E_pure_i , where E_pure_i are the per-atom total energies of the pure-element reference structures (Nb, Ta, V, Zr in the same BCC supercell, with identical INCAR / KPOINTS / PAW choices). With perfectly consistent reference runs the raw FE should vanish at the two pure-element endpoints (x = 0 and x = 1) by construction. In practice this does not hold for two reasons that are present in our dataset: 1. Reference-energy inconsistency (composition-dependent bias). Even with identical input parameters, the pure-element runs (stored in `corrected_DFT_pure_element_runs/`) differ slightly from the values that would be implied by the alloy runs at near-pure compositions (a few meV/atom). This bias is approximately linear in concentration, because the residual error in E_pure_Nb (or E_pure_Ta / E_pure_V) propagates into FE_raw(c) as (1 - x) * dE_pure_1, and the corresponding error in E_pure_Zr propagates as x * dE_pure_2. Left uncorrected, this produces a non-physical "tilt" of FE_raw(x) and shifts the entire FE-vs-x cloud away from zero at the endpoints. 2. Endpoint anchoring against the audited true endpoints. The strict endpoint values (FE_x0_meVatom, FE_x1_meVatom in `corrected_fe_strict_endpoints_20260518/strict_endpoint_check_20260518.csv`) were re-derived from an independent cross-check of the pure-element runs. After stage 1 removes the linear bias, the near-pure compositions in the alloy dataset still extrapolate to values that differ slightly from these audited endpoints — because stage 1 is fit from a few near-end alloy bins, not from the audited pure-element references themselves. The README.txt file discusses how these issues are addressed by the two-stage correction, and describes folder layout, pipeline summary, and how to re-run.

36 MATERIALS SCIENCE↗

DOE OSTI2012

THE RESOLVED STRUCTURE AND DYNAMICS OF AN ISOLATED DWARF GALAXY: A VLT AND KECK SPECTROSCOPIC SURVEY OF WLM

We present spectroscopic data for 180 red giant branch (RGB) stars in the isolated dwarf irregular galaxy Wolf-Lundmark-Mellote (WLM). Observations of the calcium II triplet lines in spectra of RGB stars covering the entire galaxy were obtained with FORS2 at the Very Large Telescope and DEIMOS on Keck II, allowing us to derive velocities, metallicities, and ages for the stars. With accompanying photometric and radio data we have measured the structural parameters of the stellar and gaseous populations over the full galaxy. The stellar populations show an intrinsically thick configuration with 0.39 {<=} q{sub 0} {<=} 0.57. The stellar rotation in WLM is measured to be 17 {+-} 1 km s{sup -1}; however, the ratio of rotation to pressure support for the stars is V/{sigma} {approx} 1, in contrast to the gas, whose ratio is seven times larger. This, along with the structural data and alignment of the kinematic and photometric axes, suggests we are viewing WLM as a highly inclined oblate spheroid. Stellar rotation curves, corrected for asymmetric drift, are used to compute a dynamical mass of (4.3 {+-} 0.3) Multiplication-Sign 10{sup 8} M{sub Sun} at the half-light radius (r{sub h} = 1656 {+-} 49 pc). The stellar velocity dispersion increases with stellar age in a manner consistent with giant molecular cloud and substructure interactions producing the heating in WLM. Coupled with WLM's isolation, this suggests that the extended vertical structure of its stellar and gaseous components and increase in stellar velocity dispersion with age are due to internal feedback, rather than tidally driven evolution. These represent some of the first observational results from an isolated Local Group dwarf galaxy that can offer important constraints on how strongly internal feedback and secular processes modulate star formation and dynamical evolution in low-mass isolated objects.

79 ASTRONOMY AND ASTROPHYSICS↗