Search NASA⌕ Search

SEARCH · Search NASA

Results for “cloud computing, data cloud”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40
All sourcesNASA NTRSDOE OSTI
DOE OSTI2012

Influence of Atmospheric Variations on Photovoltaic Performance and Modeling Their Effects for Days with Clear Skies: Preprint

Although variation in photovoltaic (PV) performance is predominantly influenced by clouds, performance variations also exist for days with clear skies with different amounts of atmospheric constituents that absorb and reflect different amounts of radiation as it passes through the earth's atmosphere. The extent of the attenuation is determined by the mass of air and the amounts of water vapor,aerosols, and ozone that constitute the atmosphere for a particular day and location. Because these constituents selectively absorb radiation of particular wavelengths, their impact on PV performance is sensitive to the spectral response of the PV device. The impact may be assessed by calculating the spectral mismatch correction. This approach was validated using PV module performance data atthe National Renewable Energy Laboratory (NREL) for summer, fall, and winter days with clear skies. The standard deviation of daily efficiencies for single-crystal Si, a-Si/a-Si/a-Si:Ge, CdTe, and CIGS PV modules were reduced to 0.4% to 1.0% (relative) by correcting for spectral mismatch, temperature, and angle-of-incidence effects.

14 SOLAR ENERGY↗
DOE OSTI2019

Remote sensing and geophysical characterization of a floodplain-hillslope system in the East River watershed, Colorado

This package is part of the Watershed Function SFA Data Collection and contains remote sensing data and geophysical measurements acquired at the Pumphouse hillslope-floodplain site, in the East River, Colorado. The remote sensing dataset includes: a) a WorldView-2 (WV-2) pan-sharpened multi-spectral remote sensing image, and b) LiDAR derived products. The WV-2 image was acquired on September 24th, 2015, and it is composed of eight spectral bands (coastal, blue, green, yellow, red, red edge, NIR1, and NIR2) with a spatial resolution of 0.5 m, covering an area of 750x750 m. The LiDAR products are a digital surface model (DSM), representing the top-of-canopy elevation, and a digital terrain model (DTM), representing the bare-ground elevation, at the spatial resolution of 0.5 m. Such data are extracted from the LiDAR point-cloud dataset acquired over the entire watershed on August 2015 (http://dx.doi.org/10.21952/WTR/1412542). The geophysical dataset is composed of the electrical resistivity tomography (ERT) data acquired along a 158.75 m long transect, spanning the hillslope topographical gradient with 1.25 m electrode spacing. The dataset also includes soil water content measured with a TDR system. The package provides also polygons of different vegetation communities, which were used as reference data for mapping plant community distributions. The spatial polygons are based on plant locations acquired during the field campaign of June-July 2017 using an RTK DGPS system. The reference dataset is composed by 11 vegetation classes, namely, deciduous forest, evergreen forest, riparian shrubland, sagebrush, shrubland, potentilla, frasera, lupine meadow, veratrum, bunchgrass meadow, and forb, as well as four non-vegetation classes, such as water-river, water-lake, man-made, bare area, and shadow. The vegetation classes are determined based on distinct spectral and/or structural signatures of dominant species. The package includes products derived by these datasets, such as: a) a plant height map, computed by subtracting the DTM from the DSM, and b) a plant community distribution map, obtained by using a data-fusion machine-learning-based framework that exploit the WV-2 image and plant height information.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Theoretical studies of chemical reactions related to the formation and growth of polycyclic aromatic hydrocarbons (PAH) and molecular properties of their key intermediates (Final Progress Report)

The formation mechanisms of polycyclic aromatic hydrocarbons, (PAHs) – organic molecules carrying fused benzene rings – are of great interest to scientists and engineers due to their importance in combustion chemistry and astrochemistry. On Earth, PAHs are largely produced in incomplete combustion of fossil fuel and are considered as critical precursors to unwanted soot particles leading to combustion inefficiency and causing air pollution along with detrimental health effects. Simple PAH molecules initially formed in the gas phase, are further involved in a build-up process in combustion flames leading to larger PAH, bowl-shaped nanostructures, fullerenes, and solid-phase species including carbonaceous dust, graphene particles, and soot. In deep space, PAH and their derivatives are potential key intermediates and nucleation sites leading eventually to carbonaceous nanoparticles (“interstellar grains”). Therefore, the understanding of the key processes in the synthesis of PAHs along with their precursors and their degradation mechanisms in combustion systems and in interstellar, circumstellar, and planetary atmospheric environments will provide critical insights into how complex aromatic structures, carbonaceous nanoparticles, and fullerenes are formed and destroyed. Achieving this understanding is an important step in the development of the efficient combustion processes and of the ecofriendly devices with reduced environmental pollution as well as technological strategies for the production of hydrogen and solid carbon through thermal or plasma-assisted pyrolysis of natural gas and biomass. Also, the understanding of the key processes of PAH and soot growth will help in our comprehension of chemical evolution in the universe. Detailed information on the mechanisms and reliable rate constants of the key elementary chemical reactions involved in PAH formation and destruction processes and in inception of soot particles is often missing, with the main deficiencies being the absence of temperature- and pressure-dependent rate constants for the broad range of conditions occurring in various terrestrial and interstellar processes and the lack of data on the reaction products and their branching ratios. Complementary to experimental studies, these gaps in knowledge can be filled by using quantum chemical calculations of reaction potential energy surfaces providing us with accurate energies of reaction products, intermediates, and transition states, revealing the reaction mechanism, and giving the molecular properties required to compute rate constants for relevant reaction steps and product branching ratios using the RRKM-Master Equation (ME) method. Molecular dynamics (MD) simulations can be used in cases when a reaction rate cannot be properly described by statistical theories. During the terminal renewal project period we employed these ab initio/RRKM-ME and MD approaches to complete our studies on several key reactions relevant to the formation/growth of PAH and inception of soot particles including (1) the reaction mechanism and kinetics of the resonance stabilized fulvenallenyl radical with propargyl and C 3 H 4 isomers; (2) the reaction mechanism and kinetics for the C + indene and C 2 + styrene reactions producing naphthyl or azulenyl radicals in low-temperature environments; (3) the MD study of non-equilibrium dimerization of acepyrene and coronene and its radical. The information derived from our theoretical calculations contributed to a better fundamental understanding of the reaction mechanisms and provide missing critical kinetic data to improve combustion models of hydrocarbon fuels and astrochemical models of the growth of carbonaceous molecules and particles in cold molecular clouds, circumstellar envelopes, and planetary atmospheres.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

An Adaptive Tracking Algorithm for Convection in Simulated and Remote Sensing Data

A robust and computationally efficient object tracking algorithm is developed by incorporating various tracking techniques. Physical properties of the objects, such as brightness temperature or reflectivity, are not considered. Therefore, the algorithm is adaptable for tracking convection-like features in simulated data and remotely sensed two-dimensional images. In this algorithm, a first guess of the motion, estimated using the Fourier phase shift, is used to predict the candidates for matching. A disparity score is computed for each target–candidate pair. The disparity also incorporates overlapping criteria in the case of large objects. Then the Hungarian method is applied to identify the best pairs by minimizing the global disparity. The high-disparity pairs are unmatched, and their target and candidate are declared expired and newly initiated objects, respectively. They are tested for merger and split on the basis of their size and overlap with the other objects. The sensitivity of track duration is shown for different disparity and size thresholds. The report highlights the algorithm’s ability to study convective life cycles using radar and simulated data over Darwin, Australia. The algorithm skillfully tracks individual convective cells (a few pixels in size) and large convective systems. The duration of tracks and cell size are found to be lognormally distributed over Darwin. The evolution of size and precipitation types of isolated convective cells is presented in the Lagrangian perspective. This algorithm is part of a vision for a modular platform [viz., TINT is not TITAN (TINT) and Tracking and Object-Based Analysis of Clouds (tobac)] that will evolve into a sustainable choice to analyze atmospheric features.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2018

Locality-aware and load-balanced static task scheduling for MapReduce

Task scheduling for MapReduce jobs has been an active area of research with the objective of decreasing the amount of data transferred during the shuffle phase via exploiting data locality. In the literature, generally only the scheduling of reduce tasks is considered with the assumption that scheduling of map tasks is already determined by the input data placement. However, in cloud or HPC deployments of MapReduce, the input data is located in a remote storage and scheduling map tasks gains importance. Here, we propose models for simultaneous scheduling of map and reduce tasks in order to improve data locality and balance the processors’ loads in both map and reduce phases. Our approach is based on graph and hypergraph models which correctly encode the interactions between map and reduce tasks. Partitions produced by these models are decoded to schedule map and reduce tasks. A two-constraint formulation utilized in these models enables balancing processors’ loads in both map and reduce phases. The partitioning objective in the hypergraph models correctly encapsulates the minimization of data transfer when a local combine step is performed prior to shuffle, whereas the partitioning objective in the graph models achieve the same feat when a local combine is not performed. Here, we show the validity of our scheduling on the MapReduce parallelizations of two important kernel operations – sparse matrix–vector multiplication (SpMV) and generalized sparse matrix–matrix multiplication (SpGEMM) – that are widely encountered in big data analytics and scientific computations. Compared to random scheduling, our models lead to tremendous savings in data transfer by reducing data traffic from several hundreds of megabytes to just a few megabytes in the shuffle phase and consequently leading up to 2.6x and 4.2x speedup for SpMV and SpGEMM, respectively.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

GRACC: New generation of the OSG accounting

Throughout the last decade the Open Science Grid (OSG) has been fielding requests from user communities, resource owners, and funding agencies to provide information about utilization of OSG resources. Requested data include traditional accounting - core-hours utilized - as well as users certicate Distinguished Name, their affiliations, and eld of science. The OSG accounting service, Gratia, developed in 2006, is able to provide this information and much more. However, with the rapid expansion and transformation of the OSG resources and access to them, we are faced with several challenges in adapting and maintaining the current accounting service. The newest changes include, but are not limited to, acceptance of users from numerous university campuses, whose jobs are flocking to OSG resources, expansion into new types of resources (public and private clouds, allocation-based HPC resources, and GPU farms), migration to pilot-based systems, and migration to multicore environments. In order to have a scalable, sustainable and expandable accounting service for the next few years, we are embarking on the development of the next-generation OSG accounting service, GRACC, that will be based on open-source technology and will be compatible with the existing system. It will consist of swappable, independent components, such as Logstash, Elasticsearch, Grafana, and RabbitMQ, that communicate through a data exchange. GRACC will continue to interface EGI and XSEDE accounting services and provide information in accordance with existing agreements. Lastly, we will present the current architecture and working prototype.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Cognitive IoT and Edge Computing for Intrusion Detection with Federated TinyML

Internet of Things (IoT) and Edge Computing (EC) are rapidly becoming an integral part of the modern society. By 2030, there is estimated to be over 40 billion active and connected IoT devices [1]. This rapid progress also comes with a significant implication on cybersecurity. Back-end infrastructure and systems have a much broader attack than they did previously due to vulnerable IoT/EC devices being connected to wireless networks. This expanding attack surface is a growing concern because IoT/EC are increasingly being used in critical systems such as power grids, health care, and smart homes. To effectively address a problem of this scale, cognitive cyber methods—which can autonomously detect and react to cyber attacks as they develop—are needed. To address this, we bring Artificial Intelligence (AI) and Machine Learning (ML) to IoT/EC devices, using tinyML to monitor voluminous IoT data against cyber threats, and using Federated Learning (FL) to share local detection knowledge across the system while preserving privacy. We propose a novel three-layer architecture: (1) an IoT layer for tinyML-based inference, (2) an edge layer for ML model training, and (3) a cloud layer for FL operations. Using the publicly available 11-class N-BaIoT dataset [2], we demonstrate that this architecture mitigates resource constraints at the IoT layer while improving detection accuracy over standard two-layer designs. An outlier-resistant scaler, feature reduction, and quantization enable the tinyML model to maintain detection accuracy with a reduced model size. Additionally, federated learning that only utilizes the intersection (across heterogenous devices) of the reduced feature set achieves superior detection accuracy compared to locally trained models.

Li, Mingyan [ORNL] (ORCID:0009000569532640)↗
DOE OSTI2022

Root system architecture and environmental flux analysis in mature crops using 3D root mesocosms

Current methods of root sampling typically only obtain small or incomplete sections of root systems and do not capture their true complexity. To facilitate the visualization and analysis of full-sized plant root systems in 3-dimensions, we developed customized mesocosm growth containers. While highly scalable, the design presented here uses an internal volume of 45 ft 3 (1.27 m 3 ), suitable for large crop and bioenergy grass root systems to grow largely unconstrained. Furthermore, they allow for the excavation and preservation of 3-dimensional root system architecture (RSA), and facilitate the collection of time-resolved subterranean environmental data. Sensor arrays monitoring matric potential, temperature and CO 2 levels are buried in a grid formation at various depths to assess environmental fluxes at regular intervals. Methods of 3D data visualization of fluxes were developed to allow for comparison with root system architectural traits. Following harvest, the recovered root system can be digitally reconstructed in 3D through photogrammetry, which is an inexpensive method requiring only an appropriate studio space and a digital camera. We developed a pipeline to extract features from the 3D point clouds, or from derived skeletons that include point cloud voxel number as a proxy for biomass, total root system length, volume, depth, convex hull volume and solidity as a function of depth. Ground-truthing these features with biomass measurements from manually dissected root systems showed a high correlation. We evaluated switchgrass, maize, and sorghum root systems to highlight the capability for species wide comparisons. We focused on two switchgrass ecotypes, upland (VS16) and lowland (WBC3), in identical environments to demonstrate widely different root system architectures that may be indicative of core differences in their rhizoeconomic foraging strategies. Finally, we imposed a strong physiological water stress and manipulated the growth medium to demonstrate whole root system plasticity in response to environmental stimuli. Hence, these new “3D Root Mesocosms” and accompanying computational analysis provides a new paradigm for study of mature crop systems and the environmental fluxes that shape them.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Ka-Band ARM Zenith Radar Corrections (KAZRCOR, KAZRCFRCOR) Value-Added Products

The KAZRCOR Value -added Product (VAP) performs several corrections to the ingested KAZR moments and also creates a significant detection mask for each radar mode. The VAP computes gaseous attenuation as a function of time and radial distance from the radar antenna, based on ambient meteorological observations, and corrects observed reflectivities for that effect. KAZRCOR also dealiases mean Doppler velocities to correct velocities whose magnitudes exceed the radar’s Nyquist velocity. Input KAZR data fields are passed through into the KAZRCOR output files, in their native time and range coordinates. Complementary corrected reflectivity and velocity fields are provided, along with a mask of significant detections and a number of data quality flags. This report covers the KAZRCOR VAP as applied to the original KAZR radars and the upgraded KAZR2 radars. Currently there are two separate code bases for the different radar versions, but once KAZR and KAZR2 data formats are harmonized, only a single code base will be required.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Comparing Mapper Graphs of Artificial Neuron Activations

The mapper graph is a popular tool from topological data analysis that provides a graphical summary of point cloud data. It has been used to study data from cancer research, sports analytics, neurosciences, and machine learning. In particular, mapper graphs have been used recently to visualize the topology of high-dimensional artificial neural activations from convolutional neural networks and large language models. However, a key question that arises from using mapper graphs across applications is how to compare mapper graphs to study their structural differences. In this paper, we introduce a distance between mapper graphs using tools from optimal transport. We demonstrate the utility of such a distance by studying the topological changes of neural activations across convolutional layers in deep learning, as well as by capturing the loss of structural information for multiscale mapper.

mapper graphs, computational topology, machine lea↗
DOE OSTI2023

A combined experimental and computational study on the reaction dynamics of the 1-propynyl (CH 3 CC, X 2 A 1 ) – propylene (CH 3 CHCH 2 , X 1 A') system: formation of 1,3-dimethylvinylacetylene (CH 3 CCCHCHCH 3 , X 1 A') under single collision conditions

The reaction of the 1-propynyl radical (CH 3 CC; X 2 A 1 ) with propylene (CH 3 CHCH 2 ; X 1 A') was studied in a crossed molecular beam machine at a collision energy of 37 ± 1 kJ mol –1 . Experimental data combined with high-level electronic structure (CCSD(T)-F12/cc-pVTZ-F12//ωB97X-D/6-311G(d,p)) and RRKM calculations reveal the reaction mechanism. Here, the overall barrierless and exoergic reaction involves indirect reaction dynamics and commences preferentially with addition of 1-propynyl with its radical centre to the carbon–carbon double bond at the terminal carbon atom of propylene. This work focuses on molecular mass growth process (hydrogen loss channels) although theory suggests methyl loss as a prevalent channel. In these processes, the C6H9 collision complexes either emit atomic hydrogen or undergo isomerisation followed by atomic hydrogen loss to preferentially yield the cis/trans isomers of 1,3-dimethylvinylacetylene (2-hexen-4-yne) as the primary product. Analysis of reaction dynamics of 1-propynyl and ethynyl radicals with propylene along with their fractional abundance in deep space suggests formation of methyl- and dimethyl derivatives of vinylacetylene in cold molecular clouds. Once formed they may engage in fundamental molecular mass growth processes via the barrierless Hydrogen Abstraction Vinylacetylene Addition mechanism that leads to the formation of methyl- and dimethylnaphthalenes thus providing a versatile route to methyl-substituted PAHs in interstellar medium.

1-propynyl↗
DOE OSTI2020

A2Cloud‐RF : A random forest based statistical framework to guide resource selection for high‐performance scientific computing on the cloud

Summary This article proposes a random‐forest based A2Cloud framework to match scientific applications with Cloud providers and their instances for high performance. The framework leverages four engines for this task: PERF engine, Cloud trace engine, A2Cloud‐ext engine, and the random forest classifier (RFC) engine. The PERF engine profiles the application to obtain performance characteristics, including the number of single‐precision (SP) floating‐point operations (FLOPs), double‐precision (DP) FLOPs, x87 operations, memory accesses, and disk accesses. The Cloud trace engine obtains the corresponding performance characteristics of the selected Cloud instances including: SP floating point operations per second (FLOPS), DP FLOPS, x87 operations per second, memory bandwidth, and disk bandwidth. The A2Cloud‐ext engine uses the application and Cloud instance characteristics to generate objective scores that represent the application‐to‐Cloud match. The RFC engine uses these objective scores to generate two types of random forests to assist users with rapid analysis: application‐specific random forests (ARF) and application‐class based random forests. The ARF consider only the input application's characteristics to generate a random forest and provide numerical ratings to the selected Cloud instances. To generate the application‐class based random forests, the RFC engine downloads the application profiles and scores of previously tested applications that perform similar to the input application. Using these data, the RFC engine creates a random forest for instance recommendation. We exhaustively test this framework using eight real‐world applications across 12 instances from different Cloud providers. Our tests show significant statistical agreement between the instance ratings given by the framework and the ratings obtained via actual Cloud executions.

Samuel, David↗
DOE OSTI2023

Pillars of Cloud-Based Earth Observation Science Education

Earth observation (EO) is undergoing a paradigm shift with the development of cloud-based analytical platforms supporting EO data collection and access, parallel processing, easier communication of results, and expanded accessibility. As the global community of users and the diversity of applications grow, there is a clear need for expanded educational capacity to leverage these developments and increase the impact of EO research and teaching. Drawing upon extensive conversations between educators, practitioners, and researchers, we propose three pillars that must be prioritized to prepare students, researchers, and professionals to take full advantage of the cloud-based EO paradigm and guide future growth.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Models, data, and scripts associated with “Prediction of Distributed River Sediment Respiration Rates using Community-Generated Data and Machine Learning”

This data package is associated with the publication “Prediction of Distributed River Sediment Respiration Rates using Community-Generated Data and Machine Learning’’ submitted to the Journal of Geophysical Research: Machine Learning and Computation (Scheibe et al. 2024). River sediment respiration observations are expensive and labor intensive to obtain and there is no physical model for predicting this quantity. The Worldwide Hydrobiogeochemisty Observation Network for Dynamic River Systems (WHONDRS) observational data set (Goldman et al.; 2020) is used to train machine learning (ML) models to predict respiration rates at unsampled sites. This repository archives training data, ML models, predictions, and model evaluation results for the purposes of reproducibility of the results in the associated manuscript and community reuse of the ML models trained in this project. One of the key challenges in this work was to find an optimum configuration for machine learning models to work with this feature-rich (i.e. 100+ possible input variables) data set. Here, we used a two-tiered approach to managing the analysis of this complex data set: 1) a stacked ensemble of ML models that can automatically optimize hyperparameters to accelerate the process of model selection and tuning and 2) feature permutation importance to iteratively select the most important features (i.e. inputs) to the ML models. The major elements of this ML workflow are modular, portable, open, and cloud-based, thus making this implementation a potential template for other applications. This data package is associated with the GitHub repository found at Please see the file level metadata (flmd; “sl-archive-whondrs_flmd.csv”) for a list of all files contained in this data package and descriptions for each. Please see the data dictionary (dd; “sl-archive-whondrs_dd.csv”) for a list of all column headers contained within comma separated value (csv) files in this data package and descriptions for each. The GitHub repository is organized into five top-level directories: (1) “input_data” holds the training data for the ML models; (2) “ml_models” holds machine learning models trained on the data in “input_data”; (3) “scripts” contains data preprocessing and postprocessing scripts and intermediate results specific to this data set that bookend the ML workflow; (4) “examples” contains the visualization of the results in this repository including plotting scripts for the manuscript (e.g., model evaluation, FPI results) and scripts for running predictions with the ML models (i.e., reusing the trained ML models); (5) “output_data” holds the overall results of the ML model on that branch. Each trained ML model resides on its own branch in the repository; this means that inputs and outputs can be different branch-to-branch. Furthermore, depending on the number of features used to train the ML models, the preprocessing and postprocessing scripts, and their intermediate results, can also be different branch-to-branch. The “main-*” branches are meant to be starting points (i.e. trunks) for each model branch (i.e. sprouts). Please see the Branch Navigation section in the top-level README.md in the GitHub repository for more details. There is also one hidden directory “.github/workflows”. This hidden directory contains information for how to run the ML workflow as an end-to-end automated GitHub Action but it is not needed for reusing the ML models archived here. Please the top-level README.md in the GitHub repository for more details on the automation.

13C↗
DOE OSTI2020

CACTI Radar b1 Processing: Corrections, Calibrations, and Processing Report

The U.S. Department of Energy’s (DOE) Atmospheric Radiation Measurement (ARM) user facility deployed a large number of instruments to a region nearby the Sierra de Córdobas mountains in Argentina as part of the Cloud, Aerosol, and Complex Terrain Interactions (CACTI) field campaign (1). During this campaign, four radars were installed at a site outside of Villa Yacanto as shown in Figure 1. As part of a post-campaign effort to improve the usability of these data, a significant activity was undertaken towards the calibration, correction, and improvement of the data quality of these radar datastreams. This process in ARM nomenclature is referred to as generating a “b1” datastream. While these “b1” standards may imply different corrections or standards for various ARM instruments, for radars it refers to a datastream that has been calibrated (and cross-calibrated), including a serious effort to deliver the highest-quality (well-characterized) data possible. This report details (i) the status/quality of the original “a1” (raw) data, (ii) the corrections and calibrations that are applied to generate these b1 datastreams, (iii) the details of the applied algorithms and how radar offset/calibration numbers were determined for the eventual corrections, and (iv) the new and flexible plug-in-based processing system designed during CACTI for radar b1 activities (current, future) that interfaces with ARM’s Data Integrator (ADI) and high-performance computing (HPC) system.

47 OTHER INSTRUMENTATION↗
DOE OSTI2016

A new subgrid-scale representation of hydrometeor fields using a multivariate PDF

Abstract. The subgrid-scale representation of hydrometeor fields is important for calculating microphysical process rates. In order to represent subgrid-scale variability, the Cloud Layers Unified By Binormals (CLUBB) parameterization uses a multivariate probability density function (PDF). In addition to vertical velocity, temperature, and moisture fields, the PDF includes hydrometeor fields. Previously, hydrometeor fields were assumed to follow a multivariate single lognormal distribution. Now, in order to better represent the distribution of hydrometeors, two new multivariate PDFs are formulated and introduced.The new PDFs represent hydrometeors using either a delta-lognormal or a delta-double-lognormal shape. The two new PDF distributions, plus the previous single lognormal shape, are compared to histograms of data taken from large-eddy simulations (LESs) of a precipitating cumulus case, a drizzling stratocumulus case, and a deep convective case. Finally, the warm microphysical process rates produced by the different hydrometeor PDFs are compared to the same process rates produced by the LES.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Integration of a physics-based direct normal irradiance ($\mathrm{DNI}$) model to enhance the National Solar Radiation Database ($\mathrm{NSRDB}$)

The National Solar Radiation Database (NSRDB) is an extensively used dataset that furnishes satellite-retrieved solar resource data across the United States and an expanding list of other countries. Although the NSRDB uses a physical model to compute global horizontal irradiance (GHI), it currently employs an empirical approach based on surface observations to estimate cloudy-sky direct normal irradiance (DNI). Recently, a new physics-based approach, known as the Fast All-sky Radiation Model for Solar applications with DNI (FARMS-DNI), was developed to improve DNI forecasting. FARMS-DNI integrates direct and scattered solar radiances within the circumsolar region, resulting in improved day-ahead forecasting of DNI by incorporating it into the Weather Research and Forecasting model with Solar extensions (WRF-Solar). This study incorporates FARMS-DNI into the NSRDB algorithm to produce high-spatiotemporal-resolution DNI data from satellite data. The accuracy of the NSRDB based on FARMS-DNI is analyzed using surface observations from 19 sites situated within the National Oceanic and Atmospheric Administration (NOAA) Surface Radiation Budget (SURFRAD) and Solar Radiation (SOLRAD) networks, the University of Oregon (UO) network, the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) network, and at the National Renewable Energy Laboratory (NREL). The results demonstrate that FARMS-DNI reduces the significant overestimation of DNI in the conventional NSRDB at all surface sites, particularly in cloud overcast conditions classified using both satellite retrievals and surface observations. Consequently, this new model can effectively improve the overall accuracy of the NSRDB. The results also suggest that further improvement of DNI estimates at individual time steps, however, requires advanced satellite techniques and precise identification of clouds and retrieval of cloud properties.

14 SOLAR ENERGY↗
DOE OSTI2024

Automated Approach to Accurate, Precise, and Fast Detector Simulation and Reconstruction

Detector simulation and reconstruction are a significant computational bottleneck in particle physics. Here, we develop particle-flow neural-assisted simulations (parnassus) to address this challenge. Our deep learning model takes as input a point cloud (particles impinging on a detector) and produces a point cloud (reconstructed particles). By combining detector simulations and reconstruction into one step, we aim to minimize resource utilization and enable fast surrogate models suitable for application both inside and outside large collaborations. We demonstrate this approach using a publicly available dataset of jets passed through the full simulation and reconstruction pipeline of the Compact Muon Solenoid (CMS) experiment. We show that parnassus accurately mimics the CMS particle flow algorithm on the (statistically) same events it was trained on and can generalize to jet momentum and type outside of the training distribution.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗