Search NASA⌕ Search

SEARCH · Search NASA

Results for “simulation evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

Evaluating Climate Model Simulations of the Radiative Forcing and Radiative Response at Earth’s Surface

In this work, we analyze the radiative forcing and radiative response at Earth’s surface, where perturbations in the radiation budget regulate the atmospheric hydrological cycle. By applying a radiative kernel-regression technique to CMIP5 climate model simulations where CO 2 is instantaneously quadrupled, we evaluate the intermodel spread in surface instantaneous radiative forcing, radiative adjustments to this forcing, and radiative responses to surface warming. The cloud radiative adjustment to CO 2 forcing and the temperature-mediated cloud radiative response exhibit significant intermodel spread. In contrast to its counterpart at the top of the atmosphere, the temperature-mediated cloud radiative response at the surface is found to be positive in some models and negative in others. Also, the compensation between the temperature-mediated lapse rate and water vapor radiative responses found in top-of-atmosphere calculations is not present for surface radiative flux changes. Instantaneous radiative forcing at the surface is rarely reported for model simulations; as a result, intermodel differences have not previously been evaluated in global climate models. We demonstrate that the instantaneous radiative forcing is the largest contributor to intermodel spread in effective radiative forcing at the surface. We also find evidence of differences in radiative parameterizations in current models and argue that this is a significant, but largely overlooked, source of bias in climate change simulations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2017

Using ARM Observations to Evaluate Climate Model Simulations of Land-Atmosphere Coupling on the U.S. Southern Great Plains

Several independent measurements of warm-season soil moisture and surface atmospheric variables recorded at the ARM Southern Great Plains (SGP) research facility are used to estimate the terrestrial component of land-atmosphere coupling (LAC) strength and its regional uncertainty. The observations reveal substantial variation in coupling strength, as estimated from three soil moisture measurements at a single site, as well as across six other sites having varied soil and land cover types. The observational estimates then serve as references for evaluating SGP terrestrial coupling strength in the Community Atmospheric Model coupled to the Community Land Model. These coupled model components are operated in both a free-running mode and in a controlled configuration, where the atmospheric and land states are reinitialized daily, so that they do not drift very far from observations. Although the controlled simulation deviates less from the observed surface climate than its free-running counterpart, the terrestrial LAC in both configurations is much stronger and displays less spatial variability than the SGP observational estimates. Preliminary investigation of vegetation leaf area index (LAI) substituted for soil moisture suggests that the overly strong coupling between model soil moisture and surface atmospheric variables is associated with too much evaporation from bare ground and too little from the vegetation cover. Lastly, these results imply that model surface characteristics such as LAI, as well as the physical parameterizations involved in the coupling of the land and atmospheric components, are likely to be important sources of the problematical LAC behaviors.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2018

Using the Atmospheric Radiation Measurement (ARM) Datasets to Evaluate Climate Models in Simulating Diurnal and Seasonal Variations of Tropical Clouds

We use the long-term Atmospheric Radiation Measurement (ARM) datasets collected at the three Tropical Western Pacific (TWP) sites as a tropical testbed to evaluate the ability of the Community Atmosphere Model (CAM5) to simulate the various types of clouds, their seasonal and diurnal variations, and their impact on surface radiation. We conducted a series of CAM5 simulations at various horizontal grid spacing (around 2°, 1°, 0.5°, and 0.25°) with meteorological constraints from reanalysis. Model biases in the seasonal cycle of cloudiness are found to be weakly dependent on model resolution. Positive biases (up to 20%) in the annual mean total cloud fraction appear mostly in stratiform ice clouds. Higher-resolution simulations do reduce the positive bias in the frequency of ice clouds, but they inadvertently increase the negative biases in convective clouds and low-level liquid clouds, leading to a positive bias in annual mean shortwave fluxes at the sites, as high as 65 W m-2 in the 0.25° simulation. Such resolution-dependent biases in clouds can adversely lead to biases in ambient thermodynamic properties and, in turn, feedback on clouds. Both the CAM5 model and ARM observations show distinct diurnal cycles in total, stratiform and convective cloud fractions; however, they are out-of-phase by 12 hours and the biases vary by site. Our results suggest that biases in deep convection affect the vertical distribution and diurnal cycle of stratiform clouds through the transport of vapor and/or the detrainment of liquid and ice. We also found that the modelled gridmean surface longwave fluxes are systematically larger than site measurements when the grid that the ARM sites reside in is partially covered by ocean. The modeled longwave fluxes at such sites also lack a discernable diurnal cycle because the ocean part of the grid is warmer and less sensitive to radiative heating/cooling compared to land. Higher spatial resolution is more helpful is this regard. Our testbed approach can be easily adapted for the evaluation of new parameterizations being developed for CAM5 or other global or regional model simulations at high spatial resolutions.

Wang, Hailong↗
DOE OSTI2022

Electromagnetic Transient (EMT) Simulation Algorithms for Evaluation of Large-Scale Extreme Fast Charging Systems (T&D Models)

Simulation of high-fidelity models of extreme fast charging (XFC) systems and large-area power grids with many XFCs can be time consuming in traditional simulators. Traditional simulators use a single method of discretization for all the components that results in imposing a large computational burden of inverting a large matrix as well as increased computations related to single method of discretization (that is typically a trapezoidal method). To overcome the problem of simulating large-area power grids with many XFCs, in this paper, advanced numerical simulation algorithms are applied for the first time together to reduce the dimension of matrix inversion. Here, the algorithms include numerical stiffness-based segregation, time constant-based segregation, clustering and aggregation on differential algebraic equations (DAEs), and multi-order integration approaches. These algorithms apply multiple discretization algorithms rather than a single discretization algorithm that further reduces the computational burden. The approaches mentioned here have resulted in speed-up of up to 18x in the simulation of a single distribution system with 15 XFCs and of up to 271x in the simulation of a transmission-distribution system with 300 XFCs in multiple distribution feeders with respect to conventional simulators (like power systems computer aided design [PSCAD]).

42 ENGINEERING↗
DOE OSTI2025

The Blending ToolKit: A simulation framework for evaluation of galaxy detection and deblending

We present an open source Python library for simulating overlapping (i.e., blended) images of galaxies and performing self-consistent comparisons of detection and deblending algorithms based on a suite of metrics. The package, named Blending Toolkit (BTK), serves as a modular, flexible, easy-to-install, and simple-to-use interface for exploring and analyzing systematic effects related to blended galaxies in cosmological surveys such as the Vera Rubin Observatory Legacy Survey of Space and Time (LSST). BTK has three main components: (1) a set of modules that perform fast image simulations of blended galaxies, using the open source image simulation package GalSim; (2) a module that standardizes the inputs and outputs of existing deblending algorithms; (3) a library of deblending metrics commonly defined in the galaxy deblending literature. In combination, these modules allow researchers to explore the impacts of galaxy blending in cosmological surveys. Additionally, BTK provides researchers who are developing a new deblending algorithm a framework to evaluate algorithm performance and make principled comparisons with existing deblenders. BTK includes a suite of tutorials and comprehensive documentation. The source code is publicly available on GitHub at https://github.com/LSSTDESC/BlendingToolKit.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2016

Use of Criticality Eigenvalue Simulations for Subcritical Benchmark Evaluations

Subcritical multiplication experiments and simulations are important for a variety of applications including nonproliferation, safeguards, and criticality safety monitoring. Recently, subcritical experiments have been evaluated for inclusion in the International Criticality Safety Benchmark Evaluation Process (ICSBEP). In addition, new subcritical experiments have recently been designed. In these experiments, list-mode data (a list of each absorption in the neutron detector) is recorded and neutron noise analysis is used to determine the leakage multiplication (ML) of each configuration. One downside to the simulation of these types of experiments is that they are computationally expensive. This is because analog Monte Carlo with no variance reduction must be performed in order to maintain the time accuracy required in the measurement analysis. This work demonstrates that criticality eigenvalue simulations can be used to estimate sensitivities and uncertainties for three parameters: singles count rate (R{sub 1}), doubles count rate (R{sub 2}), and leakage multiplication (M{sub L}). This will provide a useful aid both in the design and evaluation of new subcritical measurements. (authors)

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

A simulation framework for evaluating electronic order workflows in integrated health records

Electronic health record (EHR) systems are critical to modern healthcare delivery, yet the dynamic workflows that govern electronic order processing remain underexplored. Inefficiencies in these digital pathways can cause delays in care, repetitive workloads, and even patient harm. This study presents a discrete-event simulation framework used to reconstruct and evaluate EHR-based order workflows in a large integrated healthcare system. Using real-world data extracted from the Veterans Health Administration’s Corporate Data Warehouse, the authors mapped order events to standardized state transitions and modeled their progression across different facilities of varying complexity levels. After being calibrated with empirical distributions of transition times and validated against observed time-in-system metrics, the simulation demonstrates close alignment with historical performance. Scenario analyses reveal that resource capacity constraints significantly amplify the impact of electronic order surges, which are reflected in the disproportionate growth in backlogs and processing delays. Adjustments in transition probabilities further increased recirculation and extended workflow paths. Network-based analysis identified Reserved, InProgress, and Completed as structurally critical states that function as hubs within the process network but the transitions in-between also act as major bottlenecks. These results showcased the effectiveness of simulation-based approaches in monitoring EHR order processing performance and evaluating consequences of workflow changes on healthcare network resources planning. The proposed simulation framework provides a scalable data-driven tool to support operational decision-making and improve the efficiency of electronic order management in complex healthcare environments.

Engineering↗
DOE OSTI2019

Evaluation of global simulations of aerosol particle and cloud condensation nuclei number, with implications for cloud droplet formation

A total of 16 global chemistry transport models and general circulation models have participated in this study; 14 model shave been evaluated with regard to their ability to reproduce the near-surface observed number concentration of aerosol particles and cloud condensation nuclei (CCN), as well as derived cloud droplet number concentration (CDNC). Model results for the period 2011–2015 are compared with aerosol measurements(aerosol particle number, CCN and aerosol particle composition in the submicron fraction) from nine surface stations located in Europe and Japan.The evaluation focuses on the ability of models to simulate the average across time state in diverse environments and on the seasonal andshort-term variability in the aerosol properties. There is no single model that systematically performs best across all environments represented by the observations. Models tend to underestimate the observed aerosol particle and CCN number concentrations, with average normalized mean bias (NMB) of all models and for all stations, where dataare available, of –24% and –35% for particles with dry diameters <50 and <120 nm, as well as –36% and –34% for CCNat supersaturations of 0.2% and 1.0%, respectively. Yet, they seem to behave differently for particles activating at very low supersaturations (<0.1%) than at higher ones. A total of 15 models have been used to produce ensemble annual median distributions of relevant parameters. The model diversity (defined as the ratio of standard deviation to mean) is up to about 3 for simulated N 3 (number concentration of particles with dry diameters larger than 3 nm) and up to about 1 for simulated CCN in the extra-polar regions. A global mean reduction of a factor of about 2 is found in the model diversity for CCN at a supersaturation of 0.2% (CCN 0.2 ) compared to that for N 3 , maximizing over regions where new particle formation is important. An additional model has been used to investigate potential causes of model diversity in CCN and bias compared to the observations by performing a perturbed parameter ensemble (PPE) accounting for uncertainties in 26 aerosol-related model input parameters. This PPE suggests that biogenic secondary organic aerosol formation and the hygroscopic properties of the organic material are likely to be the major sources of CCN uncertainty in summer, with dry deposition and cloud processing being dominant in winter. Models capture the relative amplitude of the seasonal variability of the aerosol particle number concentration for all studied particle sizes with available observations (dry diameters larger than 50, 80 and 120 nm). The short-term persistence time (on the order of a few days) of CCN concentrations, which is a measure of aerosol dynamic behavior in the models, is underestimated o naverage by the models by 40% during winter and 20% in summer. In contrast to the large spread in simulated aerosol particle and CCN number concentrations, the CDNC derived from simulated CCN spectra is less diverse and in better agreement with CDNC estimates consistently derived from the observations (average NMB –13% and –22% for updraft velocities 0.3 and 0.6m s –1 , respectively). In addition, simulated CDNC is in slightly better agreement with observationally derived values at lower than at higher updraft velocities (index of agreement 0.64 vs. 0.65). The reduced spread of CDNC compared to that of CCN is attributed to the sublinear response of CDNC to aerosol particle number variations and the negative correlation between the sensitivities of CDNC to aerosol particle number concentration( ∂ N d / ∂ N a ) and to updraft velocity ( ∂ N d / ∂ w ). Overall, we find that while CCN is controlled by both aerosol particle number and composition, CDNC is sensitive to CCN at low and moderate CCN concentrations and to the updraft velocity when CCN levels are high. Discrepancies are found in sensitivities ∂ N d / ∂ N a and ∂ N d / ∂ w ; models may be predisposed to be too“aerosol sensitive” or “aerosol insensitive” in aerosol–cloud–climate interaction studies, even if they may capture average droplet numbers well.This is a subtle but profound finding that only the sensitivities can clearly reveal and may explain inter-model biases on the aerosol indirect effect.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2016

Energy deposition evaluation for ultra-low energy electron beam irradiation systems using calibrated thin radiochromic film and Monte Carlo simulations

For evaluation of on-site dosimetry and process design in industrial use of ultra-low energy electron beam (ULEB) processes, we evaluate the energy deposition using a thin radiochromic film and a Monte Carlo simulation. The response of film dosimeter was calibrated using a high energy electron beam with an acceleration voltage of 2 MV and alanine dosimeters with uncertainty of 11% at coverage factor 2. Using this response function, the results of absorbed dose measurements for ULEB were evaluated from 10 kGy to 100 kGy as a relative dose. The deviation between the responses of deposit energy on the films and Monte Carlo simulations was within 15%. As far as this limitation, relative dose estimation using thin film dosimeters with response function obtained by high energy electron irradiation and simulation results is effective for ULEB irradiation processes management.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

Evaluation of 3D Simulation Capabilities within xRAGE using a Suite of Test Problems

This presentation describes a 3D verification and validation suite for xRAGE. Three verification test problems for hydrodynamics are presented: the Kidder ball problem, the Verney shell problem, and a 5-material compression problem. There is excellent agreement between 2D and 3D XRAGE simulation results for these problems, and between the xRAGE results and the benchmark solutions. In addition, two 3D ICF test problems are presented, based on an OMEGA direct drive capsule experiment, and on a NIF indirect drive capsule experiment. These two ICF test problems are used to evaluate two hydrodynamic methods within xRAGE. In addition to hydrodynamics the simulations also include three temperature plasma physics, thermal conduction and radiation diffusion. When simulating either capsule in 3D the newer unsplit hydrodynamic method in xRAGE produces more vorticity relative to the older default method. For the indirect drive capsule the 3D simulations are in reasonable agreement with the experimental values of ion temperature and neutron production. Unstable 3D vortex rings are present near the DT ice/carbon interface which enhance the confinement of the DT ice.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Incorporation of aerosol into the COSPv2 satellite lidar simulator for climate model evaluation

Abstract. Atmospheric aerosol has substantial impacts on climate, air quality and biogeochemical cycles, and its concentrations are highly variable in space and time. A key variability to evaluate within models that simulate aerosol is the vertical distribution, which influences atmospheric heating profiles and aerosol–cloud interactions, to help constrain aerosol residence time and to better represent the magnitude of simulated impacts. To ensure a consistent comparison between modeled and observed vertical distribution of aerosol, we implemented an aerosol lidar simulator within the Cloud Feedback Model Intercomparison Project (CFMIP) Observation Simulator Package version 2 (COSPv2). We assessed the attenuated total backscattered (ATB) signal and the backscatter ratios (SRs) at 532 nm in the U.S. Department of Energy's Energy Exascale Earth System Model version 1 (E3SMv1). The simulator performs the computations at the same vertical resolution as the Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP), making use of aerosol optics from the E3SMv1 model as inputs and assuming that aerosol is uniformly distributed horizontally within each model grid box. The simulator applies a cloud masking and an aerosol detection threshold to obtain the ATB and SR profiles that would be observed above clouds by CALIOP with its aerosol detection capability. Our analysis shows that the aerosol distribution simulated at a seasonal timescale is generally in good agreement with observations. Over the Southern Ocean, however, the model does not produce the SR maximum as observed in the real world. Comparison between clear-sky and all-sky SRs shows little differences, indicating that the cloud screening by potentially incorrect model clouds does not affect the mean aerosol signal averaged over a season. This indicates that the differences between observed and simulated SR values are due not to sampling errors, but to deficiencies in the representation of aerosol in models. Finally, we highlight the need for future applications of lidar observations at multiple wavelengths to provide insights into aerosol properties and distribution and their representation in Earth system models.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

AutoBEM: A scalable framework for nationwide building energy simulation and retrofit evaluation in the United States

This paper presents AutoBEM, an integrated, automated framework for nationwide building energy modeling and retrofit evaluation in the United States. Unlike prior UBEM platforms that either rely primarily on representative stock sampling or operate at city scale, AutoBEM automates the generation of building-resolved, physics-based EnergyPlus/OpenStudio simulation models at national scale using GIS-derived geometry, prototype-based assumptions, and standardized scalable workflows. Leveraging the Model America dataset and high-performance computing, AutoBEM generates and simulates energy models for 122.9 million buildings, representing 97.8% of the U.S. building stock. These models are being made publicly and freely available as the Model America v1.0 (MAv1) dataset. AutoBEM supports detailed, building-level assessments of energy consumption, CO2 emissions, and post-processed anthropogenic heat emissions (AHE), and evaluates 151 energy conservation measures (ECMs) using localized utility pricing and building characteristics. In addition, AutoBEM incorporates both typical and future climate conditions through integration with Typical Meteorological Year (TMY) and Future TMY (fTMY) weather data derived from IPCC scenarios. In a case study of Phoenix, Arizona, AutoBEM identified several high-efficiency HVAC upgrades and selected envelope measures with short modeled payback periods (1.5 years) for certain building types and standards. Simulations under future climate scenarios (SSP5–RCP8.5) project an 11.3% increase in electricity use and a 32% reduction in natural gas demand by 2100, underscoring the need for climate-adaptive retrofit planning. By enabling reproducible, bottom-up, and location-specific analysis at scale, AutoBEM provides a step toward a national digital twin of the built environment and supports data-driven screening and planning for decarbonization, resilience, and energy equity.

Li, Hang [ORNL] (ORCID:0000000306001920)↗
DOE OSTI2018

Ionization electron signal processing in single phase LArTPCs. Part I. Algorithm Description and quantitative evaluation with MicroBooNE simulation

Here, we describe the concept and procedure of drifted-charge extraction developed in the MicroBooNE experiment, a single-phase liquid argon time projection chamber (LArTPC). This technique converts the raw digitized TPC waveform to the number of ionization electrons passing through a wire plane at a given time. A robust recovery of the number of ionization electrons from both induction and collection anode wire planes will augment the 3D reconstruction, and is particularly important for tomographic reconstruction algorithms. A number of building blocks of the overall procedure are described. The performance of the signal processing is quantitatively evaluated by comparing extracted charge with the true charge through a detailed TPC detector simulation taking into account position-dependent induced current inside a single wire region and across multiple wires. Some areas for further improvement of the performance of the charge extraction procedure are also discussed.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

Electromagnetic Transient (EMT) Simulation Algorithm for Evaluation of Photovoltaic (PV) Generation Systems

Use of inverter-based resources facilitating renewable energy resources such as photovoltaic (PV) generation is increasing rapidly with decreasing costs and reduced emissions associated. To accommodate such rapid growth of inverter-based resources like PV systems, electromagnetic transient (EMT) simulation models of both PV systems and grids are required to analyze the interaction of PVs in the grid (like the post-event analysis). In addition, the EMT simulation would help with the planning of future power grid with a large number of PVs as well as other inverter-based distributed generation systems. In this paper, the EMT simulation models of PV systems and grids are developed based on the differential algebraic equations (DAEs) representing their EMT dynamics. Furthermore, advanced simulation algorithms including numerical stiffness-based hybrid discretization, DAE clustering and aggregation, multi-order integration, and matrix splitting approaches are applied to accelerate the EMT simulation. The proposed algorithm was applied to 125 PV inverters within 52-bus medium-voltage (MV) distribution grid.

Choi, Jongchan↗
DOE OSTI2018

Developing a simulation tool for evaluating in-motion detector systems [Slides]

In order to combat the illicit trafficking of nuclear materials, Radiation Detection Systems (RDS) are used to scan pedestrians, vehicles, cargo, luggage, and other conveyances. Many of these systems are used in an “in-motion” configuration where the detector or target are moving past the other. Current modeling and simulation tools lack the ability to produce time-series detector response profiles for in-motion applications.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗