Search NASA⌕ Search

SEARCH · Search NASA

Results for “cloud applications”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54

MarFS, a Near-POSIX Interface to Cloud Objects

The engineering forces driving development of “cloud” storage have produced resilient, cost-effective storage systems that can scale to 100s of petabytes, with good parallel access and bandwidth. These features would make a good match for the vast storage needs of High-Performance Computing datacenters, but cloud storage gains some of its capability from its use of HTTP-style Representational State Transfer (REST) semantics, whereas most large datacenters have legacy applications that rely on POSIX file-system semantics. MarFS is an open-source project at Los Alamos National Laboratory that allows us to present cloud-style object-storage as a scalable near-POSIX file system. We have also developed a new storage architecture to improve bandwidth and scalability beyond what’s available in commodity object stores, while retaining their resilience and economy. Additionally, we present a scheme for scaling the POSIX interface to allow billions of files in a single directory and trillions of files in total.

97 MATHEMATICS AND COMPUTING↗

Performance Assessment of the NOAA-20 VIIRS RSB Using Deep Convective Clouds

The Visible Infrared Imaging Radiometer Suite (VIIRS) onboard the NOAA-20 (N20) satellite was launched on November 18, 2017. The N20 VIIRS reflective solar bands (RSBs) are calibrated on-orbit using a solar diffuser. An accurate on-orbit calibration is crucial to the high-quality downstream products facilitating atmosphere, ocean and land applications. In this study, the stability of the Level 1B (L1B) reflectance product is investigated using measurements over deep convective clouds (DCCs) for M-bands M1-M5, M7-M11, and I-bands I1-I3. The methodologies developed previously for Terra and Aqua Moderate Resolution Imaging Spectroradiometer (MODIS) sensors and Suomi National Polar-orbiting Partnership (SNPP) VIIRS are extended and applied to the N20 RSB to derive DCC-based trends. The Collection 2 L1B data produced by NASA Land Science Investigator-led Processing Systems (SIPS) is used to evaluate the performance of the N20 VIIRS RSB calibration. At nadir, the reflectance trends for M1, M5, M8-M11, and I3 are insignificant compared to their corresponding variations (STDs) except for bands M2-M4, M7, and I1-I2, whose trends are larger than or equivalent to their STDs. The reflectance is relatively stable compared to their STDs for all the study RSBs at six aggregation zones across the entire scan angle range. Also discussed in this paper are the detector-to-detector differences and half-angle mirror side differences using the DCCs. Future applications using DCCs, which include an intercomparison with SNPP VIIRS, are also discussed.

N20 VIIRS↗

The Impact of Circumsolar Diffuse Radiation on the Numerical Computation and Forecasting of DNI

Weather Research and Forecasting model with solar extensions (WRF-Solar) uses the Fast All-sky Radiation Model for Solar applications (FARMS) to predict solar radiation from the forecasted atmospheric gases, aerosols, and clouds. The Beer-Bouguer-Lambert law utilized by FARMS as well as other radiative transfer models assumes Direct Normal Irradiance (DNI) is a narrow beam only covering the sun disk. This assumption is interpreted differently in solar observations by pyrheliometers where the circumsolar diffuse radiation is accounted. This study precisely computes circumsolar diffuse radiation in all-sky conditions using a radiative transfer model based on a parameterization of precomputed cloud transmittance and reflectance. The model is implemented in WRF-Solar to provide day-ahead DNI forecast in the north America. The computation and forecasting of DNI is compared with the Beer-Bouguer-Lambert law to understand the impact of circumsolar diffuse radiation.

aerosols↗

An open source analysis framework for large-scale building energy modeling

Full integration of building energy modelling into the design and retrofit process has long been a goal of building scientists and practitioners. However, significant barriers still exist. Among them are the lack of available: (1) configurable technology stacks for performing both small- and large-scale analyses, (2) different classes of algorithms compatible with common design workflows, and (3) analysis tools for effectively visualizing large-scale simulation results. This article discusses the OpenStudio® Analysis Framework: a scalable analysis framework for building energy modelling that was developed to overcome the three barriers listed above. The framework is open-source and scalable to facilitate wider adoption and has a clearly defined application programming interface upon which other applications can be built. It runs on high-performance computing systems, within cloud infrastructure, and on laptops, and uses a common workflow to enable different classes of algorithms. Lessons learned from previous development efforts are also discussed.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

GERLUMPH DATA RELEASE 1: HIGH-RESOLUTION COSMOLOGICAL MICROLENSING MAGNIFICATION MAPS AND eResearch TOOLS

As synoptic all-sky surveys begin to discover new multiply lensed quasars, the flow of data will enable statistical cosmological microlensing studies of sufficient size to constrain quasar accretion disk and supermassive black hole properties. In preparation for this new era, we are undertaking the GPU-Enabled, High Resolution cosmological MicroLensing parameter survey (GERLUMPH). We present here the GERLUMPH Data Release 1, which consists of 12,342 high resolution cosmological microlensing magnification maps and provides the first uniform coverage of the convergence, shear, and smooth matter fraction parameter space. We use these maps to perform a comprehensive numerical investigation of the mass-sheet degeneracy, finding excellent agreement with its predictions. We study the effect of smooth matter on microlensing induced magnification fluctuations. In particular, in the minima and saddle-point regions, fluctuations are enhanced only along the critical line, while in the maxima region they are always enhanced for high smooth matter fractions (≈0.9). We describe our approach to data management, including the use of an SQL database with a Web interface for data access and online analysis, obviating the need for individuals to download large volumes of data. In combination with existing observational databases and online applications, the GERLUMPH archive represents a fundamental component of a new microlensing eResearch cloud. Our maps and tools are publicly available at http://gerlumph.swin.edu.au/.

79 ASTRONOMY AND ASTROPHYSICS↗

Opportunistic Resource Usage in CMS

CMS is using a tiered setup of dedicated computing resources provided by sites distributed over the world and organized in WLCG. These sites pledge resources to CMS and are preparing them especially for CMS to run the experiment's applications. But there are more resources available opportunistically both on the GRID and in local university and research clusters which can be used for CMS applications. We will present CMS' strategy to use opportunistic resources and prepare them dynamically to run CMS applications. CMS is able to run its applications on resources that can be reached through the GRID, through EC2 compliant cloud interfaces. Even resources that can be used through ssh login nodes can be harnessed. All of these usage modes are integrated transparently into the GlideIn WMS submission infrastructure, which is the basis of CMS' opportunistic resource usage strategy. Technologies like Parrot to mount the software distribution via CVMFS and xrootd for access to data and simulation samples via the WAN are used and will be described. We will summarize the experience with opportunistic resource usage and give an outlook for the restart of LHC data taking in 2015.

Kreuzer, Peter↗

The LCLStream Ecosystem for Multi-Institutional Dataset Exploration

We describe a new end-to-end experimental data streaming framework designed from the ground up to support new types of applications – AI training, extremely high-rate X-ray time-of-flight analysis, crystal structure determination with distributed processing, and custom data science applications and visualizers yet to be created. Throughout, we use design choices merging cloud microservices with traditional HPC batch execution models for security and flexibility. This project makes a unique contribution to the DOE Integrated Research Infrastructure (IRI) landscape. By creating a flexible, API-driven data request service, we address a significant need for high-speed data streaming sources for the X-ray science data analysis community. With the combination of data request API, mutual authentication web security framework, job queue system, high-rate data buffer, and complementary nature to facility infrastructure, the LCLStreamer framework has prototyped and implemented several new paradigms critical for future generation experiments.

Rogers, David [ORNL] (ORCID:0000000251871768)↗

Fast All-sky Radiation Model for Solar applications (FARMS) [SWR-16-18]

The Fast All-sky Radiation Model for Solar applications (FARMS) is used to compute cloudy irradiance. Radiative transfer (RT) models simulating broadband solar radiation have been widely used by atmospheric scientists to model solar resources for various energy applications such as operational forecasting. Due to the complexity of solving the RT equation, the computation under cloudy conditions can be extremely time consuming though many approximations (e.g. two-stream approach and delta-M truncation scheme) have been utilized. Thus, a more efficient RT model is crucial for model developers as a new option for approximating solar radiation at the land surface with minimal loss of accuracy. We have developed a fast all-sky radiation model for solar applications (FARMS) using the simplified clear-sky RT model, REST2, and simulated cloud transmittances and reflectances from the Rapid Radiation Transfer Model (RRTM) with a sixteen-stream Discrete Ordinates Radiative Transfer (DISORT). Simulated lookup tables (LUTs) of cloud transmittances and reflectances were created by varying cloud optical thicknesses, cloud particle sizes, and solar zenith angles. Equations with optimized parameters were fitted to the cloud transmittances and reflectances to develop the model. Using this model the all-sky solar irradiance at the land surface can be computed rapidly by combining REST2 with the cloud transmittances and reflectances. This new RT model is more than 1000 times faster than those currently utilized in solar resource assessment and forecasting since it does not explicitly solve the RT equation for each individual cloud condition. Our results indicate the accuracy of the fast radiative transfer model is comparable to or better than two-stream approximation in term of computing cloud transmittance and solar radiation.

Xie, Yu↗

Accelerating Control Systems with GitOps: A Path to Automation and Reliability

GitOps is a foundational approach for modernizing infrastructure by leveraging Git as the single source of truth for declarative configurations. The poster explores how GitOps transforms traditional control system infrastructure, services and applications by enabling fully automated, auditable, and version-controlled infrastructure management. Cloud-native and containerized environments are shifting the ecosystem not only in the IT industry but also within the computational science field, as is the case of CERN and Diamond Light Source among other Accelerator/Science facilities which are slowly shifting towards modern software and infrastructure paradigms. The ACORN project, which aims to modernize Fermilab’s control system infrastructure and software is implementing proven best-practices and cutting-edge technology standards including GitOps, containerization, infrastructure as code and modern data pipelines for control system data acquisition and the inclusion of AI/ML in our accelerator complex.

Gonzalez, M. [Fermilab]↗

Utility Solar Generation Valuation Methods

Tucson Electric Power (TEP) developed, tested and verified the results of a new and appropriate method for accurately evaluating the capacity credit of time variant solar generating sources and reviewed new methods to appropriately and fairly evaluate the value of solar generation to electric utilities. The project also reviewed general integrated approaches for adequately compensating owners of solar generation for their benefits to utilities. However, given the limited funding support and time duration of this project combined with the significant differences between utilities regarding rate structures, solar resource availability and coincidence of solar generation with peak load periods, it is well beyond the scope of this project to develop specific rate, rebate, and interconnection approaches to capture utility benefits for all possible utilities. The project developed computer software based evaluation method models to compare solar generation production data measured in very short term time increments called Sample Intervals over a typical utility Dispatch Cycle during an Evaluation Period against utility system load data. Ten second resolution generation production data from the SGSSS and actual one minute resolution TEP system load data for 2006 and 2007, along with data from the Pennington Street Garage 60 kW DC capacity solar unit installed in downtown Tucson will be applied to the model for testing and verification of the evaluation method. Data was provided by other utilities, but critical time periods of data were missing making results derived from that data inaccurate. The algorithms are based on previous analysis and review of specific 2005 and 2006 SGSSS production data. The model was built, tested and verified by in house TEP personnel. For this phase of the project, TEP communicated with, shared solar production data with and collaborated on the development of solar generation valuation tools with other utilities, including Arizona Public Service, Salt River Project, Xcel and Nevada Power Company as well as the Arizona electric cooperatives. In the second phase of the project, three years of 10 second power output data of the SGSSS was used to evaluate the effectiveness of frequency domain analysis, normal statistical distribution analysis and finally maximum/minimum differential output analysis to test the applicability of these mathematic methods in accurately modeling the output variations produced by clouds passing over the SGSSS array.

14 SOLAR ENERGY↗

USAID Haiti Training Session #1: Engage Orientation [Slides]

Welcome to Engage! Engage is a capacity expansion modeling tool supported by the National Renewable Energy Laboratory and based on the Calliope open-source capacity expansion model developed by the ETH Zurich University, maintained at the TU Delft University. Engage is an accessible (free, open-access, web-hosted) and flexible web-based energy system planning application for rapid multiple-energy-form energy system scenario exploration. Its cloud-based, collaborator-sharable data model, intuitive interface and visualization capabilities facilitate collaboration and communication among teams, with experts, and among diverse stakeholder groups exploring energy system implications at from district to national-scale models. This training series was developed under USAID to empower Haitian stakeholders to explore modeling scenarios in Engage to develop a Haiti Energy Master Plan. This training series includes a general overview of how Engage works along with tailored exercises that target Haiti's specific energy needs, such as modeling the capacity expansion of the bulk power system, fuel scarcity challenges, the development of microgrids, and the economic viability of transmission strategies. See NREL/PR-7A40-89366 for the French translation of this document.

24 POWER TRANSMISSION AND DISTRIBUTION↗

USAID Haiti Training Session #2: Introduction to Engage [Slides]

Welcome to Engage! Engage is a capacity expansion modeling tool supported by the National Renewable Energy Laboratory and based on the Calliope open-source capacity expansion model developed by the ETH Zurich University, maintained at the TU Delft University. Engage is an accessible (free, open-access, web-hosted) and flexible web-based energy system planning application for rapid multiple-energy-form energy system scenario exploration. Its cloud-based, collaborator-sharable data model, intuitive interface and visualization capabilities facilitate collaboration and communication among teams, with experts, and among diverse stakeholder groups exploring energy system implications from district to national-scale models. This training series was developed under USAID to empower Haitian stakeholders to explore modeling scenarios in Engage to develop a Haiti Energy Master Plan. This training series includes a general overview of how Engage works along with tailored exercises that target Haiti's specific energy needs, such as modeling the capacity expansion of the bulk power system, fuel scarcity challenges, the development of microgrids, and the economic viability of transmission strategies. See NREL/PR-7A40-89369 for the French translation of this document.

24 POWER TRANSMISSION AND DISTRIBUTION↗

USAID Haiti Training Session #3: Capacity Expansion [Slides]

Welcome to Engage! Engage is a capacity expansion modeling tool supported by the National Renewable Energy Laboratory and based on the Calliope open-source capacity expansion model developed by the ETH Zurich University, maintained at the TU Delft University. Engage is an accessible (free, open-access, web-hosted) and flexible web-based energy system planning application for rapid multiple-energy-form energy system scenario exploration. Its cloud-based, collaborator-sharable data model, intuitive interface and visualization capabilities facilitate collaboration and communication among teams, with experts, and among diverse stakeholder groups exploring energy system implications from district to national-scale models. This training series was developed under USAID to empower Haitian stakeholders to explore modeling scenarios in Engage to develop a Haiti Energy Master Plan. This training series includes a general overview of how Engage works along with tailored exercises that target Haiti's specific energy needs, such as modeling the capacity expansion of the bulk power system, fuel scarcity challenges, the development of microgrids, and the economic viability of transmission strategies. See NREL/PR-7A40-89365 for the French translation of this document.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Session de formation de l'USAID en Haiti n1: Orientation de l'outil Engage [Slides]

Welcome to Engage! Engage is a capacity expansion modeling tool supported by the National Renewable Energy Laboratory and based on the Calliope open-source capacity expansion model developed by the ETH Zurich University, maintained at the TU Delft University. Engage is an accessible (free, open-access, web-hosted) and flexible web-based energy system planning application for rapid multiple-energy-form energy system scenario exploration. Its cloud-based, collaborator-sharable data model, intuitive interface and visualization capabilities facilitate collaboration and communication among teams, with experts, and among diverse stakeholder groups exploring energy system implications at from district to national-scale models. This training series was developed under USAID to empower Haitian stakeholders to explore modeling scenarios in Engage to develop a Haiti Energy Master Plan. This training series includes a general overview of how Engage works along with tailored exercises that target Haiti's specific energy needs, such as modeling the capacity expansion of the bulk power system, fuel scarcity challenges, the development of microgrids, and the economic viability of transmission strategies. See NREL/PR-7A40-88835 for the English translation of this document.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Session de formation de l'USAID en Haiti n2: Introduction a l'outil Engage [Slides]

Welcome to Engage! Engage is a capacity expansion modeling tool supported by the National Renewable Energy Laboratory and based on the Calliope open-source capacity expansion model developed by the ETH Zurich University, maintained at the TU Delft University. Engage is an accessible (free, open-access, web-hosted) and flexible web-based energy system planning application for rapid multiple-energy-form energy system scenario exploration. Its cloud-based, collaborator-sharable data model, intuitive interface and visualization capabilities facilitate collaboration and communication among teams, with experts, and among diverse stakeholder groups exploring energy system implications from district to national-scale models. This training series was developed under USAID to empower Haitian stakeholders to explore modeling scenarios in Engage to develop a Haiti Energy Master Plan. This training series includes a general overview of how Engage works along with tailored exercises that target Haiti's specific energy needs, such as modeling the capacity expansion of the bulk power system, fuel scarcity challenges, the development of microgrids, and the economic viability of transmission strategies. See NREL/PR-7A40-88836 for the English translation of this document.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Seance de formation de l'USAID en Haiti n3: Expansion des capacites [Slides]

Welcome to Engage! Engage is a capacity expansion modeling tool supported by the National Renewable Energy Laboratory and based on the Calliope open-source capacity expansion model developed by the ETH Zurich University, maintained at the TU Delft University. Engage is an accessible (free, open-access, web-hosted) and flexible web-based energy system planning application for rapid multiple-energy-form energy system scenario exploration. Its cloud-based, collaborator-sharable data model, intuitive interface and visualization capabilities facilitate collaboration and communication among teams, with experts, and among diverse stakeholder groups exploring energy system implications from district to national-scale models. This training series was developed under USAID to empower Haitian stakeholders to explore modeling scenarios in Engage to develop a Haiti Energy Master Plan. This training series includes a general overview of how Engage works along with tailored exercises that target Haiti's specific energy needs, such as modeling the capacity expansion of the bulk power system, fuel scarcity challenges, the development of microgrids, and the economic viability of transmission strategies. See NREL/PR-7A40-88837 for the English translation of this document.

24 POWER TRANSMISSION AND DISTRIBUTION↗