Search NASA⌕ Search

SEARCH · Search NASA

Results for “simulation evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Evaluation of simulated HPGe detector efficiencies in OpenMC compared to MCNP

In late 2023, the open-source radiation transport code OpenMC introduced a pulse-height tally (PHT) feature, enabling users to track the total energy deposited by individual photons in OpenMC cells. This function represents an important improvement of the OpenMC code because it allows users to simulate the response function of a gamma detector without relying on closed-source alternatives. Despite this, limited work has been published evaluating OpenMC as a radiation transport code for simulating gamma spectroscopy experiments. This study attempts to demonstrate the usefulness of OpenMC in this space by directly comparing its PHT output to MCNP (a trusted industry-standard Monte Carlo code). In the first half of this study, a radiation transport experiment is described in which a detector with a complex internal geometry is exposed to various gamma-emitting isotopes ( 133 Ba, 137 Cs, and 60 Co) over a range of distances. The setup of this experiment was modeled in MCNP with sufficient detail to capture the efficiency characteristics of a high purity germanium (HPGe) detector for the primary gammas of each isotope. After good agreement between the MCNP model and experiment was achieved, an identical model was produced in OpenMC to allow direct comparison between the full energy peak (FEP) values produced in OpenMC and MCNP. The results show strong agreement between OpenMC and MCNP across the full range of tested energies, with each model’s FEP values typically within 2% of each other and most FEP areas within 4% of experimental data. Worse agreement was seen between the Monte Carlo codes and experiment below 300 keV (an expected result). For the 662 keV line of 137 Cs, both codes were found in poor agreement with experiment and each other over the full range of distances tested (possibly indicating an error with the 137 Cs experimental data). Ignoring the anomalous results of the 662 keV line, all other data show good qualitative and quantitative agreement between MCNP and OpenMC. This result demonstrates the accuracy of OpenMC’s PHT feature for spectroscopic applications in which detector efficiency is a primary concern.

07 - ISOTOPES AND RADIATION SOURCES↗

Using Dynamic Simulation to Evaluate Attemperator Operation in a Natural Gas Combined Cycle With Duct Burners in the Heat Recovery Steam Generator

A generic training simulator of a natural gas combined cycle was modified to match operations at a real plant. The objective was to use the simulator to analyze cycling operations of the plant. Initial operation of the simulator revealed the potential for saturation conditions in the final high pressure superheater as the attemperator tried to control temperature at the superheater outlet during gas turbine loading and unloading. Subsequent plant operational data confirmed simulation results. Multiple simulations were performed during loading and unloading of the gas turbine to determine operational strategies that prevented saturation and increased the approach to saturation temperature. The solutions included changes to the attemperator temperature control setpoints and strategic control of the steam turbine inlet pressure control valve.

20 FOSSIL-FUELED POWER PLANTS↗

Advanced Terrestrial Simulator (ATS) evaluation dataset at 7 catchments across the continental United States

This dataset comprises of the input files and other files required for Advanced Terrestrial Simulator (ATS) simulations at 7 catchments across the continental United States. ATS is an integrated surface-subsurface hydrology model. We include Jupyter notebooks (within scripts folder) for individual catchments showing information (including data sources, river network, soil, geology, landuse types etc.) on preparing the machine readable input files. ATS observation output files are provided in the output folder. Figures and analyses (.xlsx sheets) are also provided. The catchments include, Taylor River Upstream (Colorado); (b) Cossatot River (Arkansas); (c) Panther Creek (Alabama); (d) Little Tennessee River (North Carolina and Georgia); (e) Mayo River (Virginia); (f) Flat Brook (New Jersey); (g) Neversink River headwaters (New York). Readme files are provided inside the directories providing more details. Files types include: .xml, .h5, .xlsx, .png, .ipynb, .py, .nc, .txt. All of the files types can be accessed by open source software, details on software requirements are following: .xml (any text editors including notepad and textedit), .h5 (in python using hdf libraries), .xlsx (WPS Office Spreadsheets, OpenOffice Calc, LibreOffice Calc, Microsoft Office etc.), .png (any image viewer), .ipynb (Jupyter notebook), .py (any text editors including notepad and textedit), .nc (using python or other open source software).

54 ENVIRONMENTAL SCIENCES↗

Evaluation of simulated soil carbon dynamics in Arctic-Boreal ecosystems

Given the magnitude of soil carbon stocks in northern ecosystems, and the vulnerability of these stocks to climate warming, land surface models must accurately represent soil carbon dynamics in these regions. We evaluate soil carbon stocks and turnover rates, and the relationship between soil carbon loss with soil temperature and moisture, from an ensemble of eleven global land surface models. We focus on the region of NASA's Arctic-Boreal vulnerability experiment (ABoVE) in North America to inform data collection and model development efforts. Models exhibit an order of magnitude difference in estimates of current total soil carbon stocks, generally under- or overestimating the size of current soil carbon stocks by greater than 50 PgC. We find that a model's soil carbon stock at steady-state in 1901 is the prime driver of its soil carbon stock a hundred years later—overwhelming the effect of environmental forcing factors like climate. The greatest divergence between modeled and observed soil carbon stocks is in regions dominated by peat and permafrost soils, suggesting that models are failing to capture the frozen soil carbon dynamics of permafrost regions. Using a set of functional benchmarks to test the simulated relationship of soil respiration to both soil temperature and moisture, we find that although models capture the observed shape of the soil moisture response of respiration, almost half of the models examined show temperature sensitivities, or Q10 values, that are half of observed. Significantly, models that perform better against observational constraints of respiration or carbon stock size do not necessarily perform well in terms of their functional response to key climatic factors like changing temperature. This suggests that models may be arriving at the right result, but for the wrong reason. The results of this work can help to bridge the gap between data and models by both pointing to the need to constrain initial carbon pool sizes, as well as highlighting the importance of incorporating functional benchmarks into ongoing, mechanistic modeling activities such as those included in ABoVE.

54 ENVIRONMENTAL SCIENCES↗

Evaluating the simulated mean soil carbon transit times by Earth system models using observations

One known bias in current Earth system models (ESMs) is the underestimation of global mean soil carbon (C) transit time ( τ soil ), which quantifies the age of the C atoms at the time they leave the soil. However, it remains unclear where such underestimations are located globally. Here, we constructed a global database of measured τ soil across 187 sites to evaluate results from 12 ESMs. The observations showed that the estimated τ soil was dramatically shorter from the soil incubation studies in the laboratory environment (median = 4 years; interquartile range = 1 to 25 years) than that derived from field in situ measurements (31; 5 to 84 years) with shifts in stable isotopic C( 13 C ) or the stock-over-flux approach. In comparison with the field observations, the multi-model ensemble simulated a shorter median (19 years) anda smaller spatial variation (6 to 29 years) of τ soil across the same site locations. We then found a significant and negative linear correlation between the in situ measured τ soil and mean annual air temperature. The underestimations of modeled τ soil are mainly located in cold and dry biomes, especially tundra and desert.Furthermore, we showed that one ESM (i.e., CESM) has improved its τ soil estimate by incorporation of the soil vertical profile. These findings indicate that the spatial variation of τ soil is a useful benchmark for ESMs, and we recommend more observations and modeling efforts on soil C dynamics in regions limited by temperature and moisture.

54 ENVIRONMENTAL SCIENCES↗

Non-equilibrium molecular dynamics simulation to evaluate the effect of confinement on fluid flow in silica nanopores

The flow of fluids in nano-confinement has applications in separations, water purification, medical systems and in the recovery of fluids in petroleum systems. It is believed that fluids do not obey continuum laws when flowing in nanopores (or in confinement). This paper attempts to shed light on various nano confinement effects such as fluid-wall interactions, pore size and molecular geometry, using molecular dynamic simulation. Here, water, hexane, and methanol flow behaviors were simulated for pore diameters ranging from 1 to 8 nm. In addition to the density analysis of the confined fluids, the fluid flows in saturated nanopores were simulated by the sectional flow method. Water and methanol molecules were completely stabilized in the 1 nm pore. Hexane molecules could not enter the 1 nm pore, due to geometric considerations. For the 2 – 8 nm pores, all fluids showed reduced flow rate compared to the Hagen–Poiseuille flow, due to an interfacial molecular layer stabilized at the pore surface. Flow reduction observed in these studies is contrary to significant flow enhancements observed for fluid flow in carbon nanotubes of similar dimensions. Water flow showed almost constant stick length for all the pore sizes. Methanol flow had the largest stick length. Hexane flow was reduced because of overcrowding of molecules at the pore surface. The effect of confinement diminished with an increase in pore diameter.

42 ENGINEERING↗

Method for Coupled Electromagnetic and Circuit Simulations to Evaluate Surge Arrester Performance in Protecting Equipment Against E1 HEMP

Surge arrester behavioral modeling for realistic systems embedded in an E1 high-altitude electromagnetic pulse environment inherently encompasses three interconnected complications: (1) the need to account for signal propagation across two domains, electromagnetics and electrical; (2) the need to include both linear and nonlinear circuit components in the analysis; and (3) the need to understand that the over-current and over-voltage mitigation performance is dependent not only on the properties of the surge arrester and protected load but also on the topology of the overall electrical network. This study presents a framework to address these challenges in a systematic manner to consider the effectiveness of protective measures for a common class of equipment in power generation facilities. Full-wave simulations were carried out to derive circuit-domain (i.e., lumped element–based) equivalent models for the excitation waveform and the physical components of the system. Then, these equivalent models were imported to a circuit solver and combined with a high-frequency surge arrester model to evaluate mitigation performance. The methodology outlined is general enough such that it can be applied for other electromagnetic interference problems that involve E2/E3 HEMP or microwave emissions.

42 ENGINEERING↗

Evaluation of E3SM Simulated Aerosols and Aerosol‐Cloud Interactions Across GCM and Convection‐Permitting Scales

This paper introduces an Earth system modeling testbed for predicting aerosols and aerosol‐cloud interactions (ACIs) at convection‐permitting scales. Using the Energy Exascale Earth System Model (E3SM) version 2 with a four‐mode Modal Aerosol Module, we conduct simulations at 3.25 km resolution on a regionally refined mesh (RRM) across four regions with distinct aerosol and cloud regimes. Results are compared with the standard 100 km E3SM configuration and evaluated against satellite, aircraft, and ground‐based observations. We find that increasing model resolution improves heavy precipitation simulation but amplifies positive bias in light drizzle at coarse resolution. These resolution‐induced changes affect cloud and aerosol properties to varying degrees across regions. Generally, cloud cover and liquid water path (LWP) show better agreement with satellite retrievals at 3.25 km, though surface‐based comparisons suggest otherwise. Aerosol composition remains poorly represented at both resolutions. The RRM increases Aitken mode aerosol number concentrations via enhanced new particle formation. However, accumulation mode aerosols are decreased at higher resolution as aerosol removals become more efficient. This partially contributes to fewer cloud condensation nuclei (CCN) and lower cloud droplet number concentrations (N d ), which produces larger model biases in some scenarios. These findings suggest that solely increasing horizontal resolution to kilometer scales is insufficient to broadly improve aerosol and cloud predictions without concurrent advancements in physical and chemical process representations. Nonetheless, the RRM moderately improves key ACI relationships such as CCN‐N d correlation, reflecting enhanced aerosol activation representation. The LWP‐N d relationship is also better captured by RRM, suggesting a better characterization of LWP adjustment.

Huang, Meng [Pacific Northwest National Laboratory↗

Simulating and Evaluating Atmospheric River-Induced Precipitation Extremes Along the U.S. Pacific Coast: Case Studies From 1980–2017

Atmospheric rivers (ARs) are responsible for a majority of extreme precipitation and floodevents along the U.S. West Coast. To better understand the present-day characteristics of AR-relatedprecipitation extremes, a selection of nine most intense historical AR events during 1980–2017 is simulatedusing a dynamical downscaling modeling framework based on the Weather Research and ForecastingModel. We find that the chosen framework and Weather Research and Forecasting Model configurationreproduces both large-scale atmospheric features—including parent synoptic-scale cyclones—as well asthe filamentary corridors of integrated vapor transport associated with the ARs themselves. The accuracyof simulated extreme precipitation maxima, relative to in situ and interpolated gridded observations,improves notably with increasing model resolution, with improvements as large as 40–60% for fine scale(3 km) relative to coarse-scale (27 km) simulations. A separate set of simulations using smoothedtopography suggests that much of these gains stem from the improved representation of complex terrain.Additionally, using the 12 December 1995 storm in Northern California as an example, we demonstratethat only the highest-resolution simulations resolve important fine-scale features—such as localizedorographically forced vertical motion and powerful near hurricane-force boundary layer winds. Given thedemonstrated ability of a targeted dynamical downscaling framework to capture both local extremeprecipitation and key fine-scale characteristics of the most intense ARs in the historical record, we arguethat such a configuration may be highly conducive to understanding AR-related extremes and associatedchanges in a warming climate

54 ENVIRONMENTAL SCIENCES↗

Testbed and Simulation-based Evaluation of Privacy-preserving Algorithms for Smart Grid AMI Networks

Although smart meters are deployed in a lot of countries as a result of aiming to make the power grid more resilient and efficient, the data collection process from smart meters in Smart Grid (SG) has still challenges that relate to consumer privacy. Referred to as Advanced Metering Infrastructure (AMI), the data collected and transmitted through this AMI can leak sensitive information about the consumers if it is sent as plaintext. While a number of solutions have been proposed in the past, the deployment of these solutions in real-life was not possible since the actual AMIs were not accessible to researchers. Therefore, a lot of solutions relied on simulations which may not be able to capture the performance of these solutions. In this paper, we pick a widely used homomorphic-based aggregation and implement it in a realistic testbed so that it can be compared with a simulation-based solution. Specifically, we develop a system that provides privacy with the Paillier cryptosystem and twofactor authentication with ECDSA and OpenSSL certificates. In order to test the system, an IEEE 802.11s-based SG AMI network testbed is constructed with Beaglebone Black boards that imitate the behavior of smart meters. The same network is also simulated in widely used ns-3. The results showed that ns-3 simulation and testbed results are parallel in most cases and the proposed system can perform effectively. However, there are still many differences that need to be taken into account in deploying real systems.

97 MATHEMATICS AND COMPUTING↗

Comparison of multiobjective optimization methods for the $\mathrm{LCLS-II}$ photoinjector

Particle accelerators are among some of the largest science experiments in the world and can consist of thousands of components with a wide variety of input ranges. These systems can easily become unwieldy optimization problems during design and operations studies. Starting in the early 2000s, searching for better beam dynamics configurations became synonymous with heuristic optimization methods in the accelerator physics community. Genetic algorithms and particle swarm optimization are currently the most widely used. These algorithms can take thousands of simulation evaluations to find optimal solutions for one machine prototype. For large facilities such as the Linac Coherent Light Source (LCLS) and others, this equates to a limited exploration of many possible design configurations. In this paper, the LCLS-II photoinjector is optimized with three optimization algorithms. All optimizations were started from both a uniform random and Latin hypercube sample. In all cases, the optimizations started from Latin hypercube samples outperformed optimizations started from uniform samples. All three algorithms were able to optimize the photoinjector, with the model-based methods approximating the Pareto front in fewer simulation evaluations. This work, in combination with previous optimization observations, indicates objective penalties have a strong impact on the efficiency of such methods. In general, we recommend heuristic methods for initial optimizations and model-based methods when information about the objective space is available.

43 PARTICLE ACCELERATORS↗

Evaluating the Simulation of CONUS Precipitation by Storm Type in E3SM

Abstract Conventional low‐resolution (LR) climate models, including the Energy Exascale Earth System Model (E3SMv1), have well‐known biases in simulating the frequency, intensity, and timing of precipitation. Approaches to next‐generation E3SM, whether the high‐resolution (HR) or multiscale modeling framework (MMF) configuration, improve the simulation of the intensity and frequency of precipitation, but regional and seasonal deficiencies still exist. Here we apply a methodology to assess the contribution of tropical cyclones (TCs), extratropical cyclones (ETCs), and mesoscale convective systems (MCSs) to simulated precipitation in E3SMv1‐HR and E3SMv1‐MMF relative to E3SMv1‐LR. Across the United States, E3SMv1‐MMF provides the best simulation in terms of precipitation accumulation, frequency and intensity from MCSs and TCs compared to E3SMv1‐LR and E3SMv1‐HR. All E3SMv1 configurations overestimate precipitation amounts from and the frequency of ETCs over CONUS, with conventional E3SMv1‐LR providing the best simulation compared to observations despite limitations in precipitation intensity within these events.

54 ENVIRONMENTAL SCIENCES↗

Yield degradation mechanisms for two-shock capsules evaluated through simulations

An investigation of twenty two-shock campaign indirectly driven capsules on the National Ignition Facility was conducted using the xRAGE computer code. The two-shock platform was developed to look at the sensitivity of fuel–ablator mix with shock timing, asymmetry, surface roughness, and convergence on roughly ignition size scale capsules. This platform used CH/CD (plastic/deuterated plastic) shell capsules that were about 685-μm outer radius and filled with D2 or hydrogen-tritium (HT) gas. The experimental radius and velocity vs time, neutron yield, burn averaged ion temperature (Tion), burn width, and self-emission image size were compared to one-dimensional (1D) and two-dimensional (2D) simulations. Our 2D simulations suggest that the mixing of glass from the fill tube was the dominant source of impurity in the gas region of the capsule during burn, along with fuel–ablator mix. The mass of glass mixed in is about 5–10 ng. Our 2D simulations capture most of the yield trends from different degradation mechanisms, and they match the observed burn width and Tion measurements. Our 2D models match all the available data to within 2.5 times the normalized experimental error for 19 of 20 capsules.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗