Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark Cases”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Phase 1 Specifications and preliminary sensitivity analyses of the OECD-NRC liquid metal fast reactor core thermal-hydraulics benchmark

The developments in wire-wrapped fuel bundle thermal-hydraulics research have become increasingly diverse and this makes comparisons across studies difficult. This paper describes an ongoing benchmark that will address this issue by directly comparing computational results with experimental data from two unique wire-wrapped thermal-hydraulic facilities. Preliminary subchannel sensitivity / uncertainty analyses show largely expected behavior for the presented cases, where rod diameter and friction factor show the greatest sensitivities to geometrical perturbations. Guidelines for computational fluid dynamics evaluations have been prepared and highlight the need for consolidated modeling strategies. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2023

Verification and validation of the open-source plasma fluid code: Zapdos

Zapdos is an open-source finite element plasma fluid solver based on the MOOSE multiphysics framework. This paper outlines Zapdos verification, benchmarking, and validation efforts for 1D and 2D RF capacitively coupled plasma discharge models for mid-range pressures (0.1 - 1 Torr). The verification process involved using the method of manufactured solutions to assess Zapdos spatial and temporal error convergence. L2 errors ranged from 10 -2 to 10 -4 , while the convergence’s slope were in agreement with the predicted slopes for the tested variable and time integration orders. The benchmarking process involved comparisons to previously results from the validated finite element code, LSODI. These works included 1D and 2D simulations for a range of plasma parameters (densities, temperatures, voltage, etc.). For the 1D cases, Zapdos and LSODI results were in very good agreement. In the 2D cases, variable behaviors matched, with slight discrepancies in peak values. The validation process involved comparisons to experimental works including electron density measurements by microwave interferometry and metastable density measurements by planar laser-induced fluorescence imaging. Results shown reasonable agreement at higher pressure, with results starting to diverge at low pressures. Furthermore, probable causes for this diverges are the limitation of the fluid assumption for plasmas at low pressure, or the need for more robust boundary conditions. Overall, Zapdos shown reasonable results for the verification, benchmarking, and validation efforts, and Zapdos can be downloaded at https://github.com/shannon-lab/zapdos.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Ligand-Binding-Site Refinement to Generate Reliable Holo Protein Structure Conformations from Apo Structures

The first important step in a structure-based virtual screening is the judicious selection of a receptor protein. In cases where the holo protein receptor structure is unavailable, significant reduction in virtual screening performance has been reported. In this work, we present a robust method to generate reliable holo protein structure conformations from apo structures using molecular dynamics (MD) simulation with restraints derived from holo structure binding-site templates. We perform benchmark tests on two different datasets: 40 structures from a directory of useful decoy-enhanced (DUD-E) and 84 structures from the Gunasekaran dataset. Our results show successful refinement of apo binding-site structures toward holo conformations in 82% of the test cases. In addition, virtual screening performance of 40 DUD-E structures is significantly improved using our MD-refined structures as receptors with an average enrichment factor (EF), an EF1% value of 6.2 compared to apo structures with 3.5. Docking of native ligands to the refined structures shows an average ligand root mean square deviation (RMSD) of 1.97 Å (DUD-E dataset and Gunasekaran dataset) relative to ligands in the holo crystal structures, which is comparable to the self-docking (i.e., docking of the native ligand back to its crystal structure receptor) average, 1.34 Å (DUD-E dataset) and 1.36 Å (Gunasekaran dataset). On the other hand, docking to the apo structures yields an average ligand RMSD of 3.65 Å (DUD-E) and 2.90 Å (Gunasekaran). These results indicate that our method is robust and can be useful to improve virtual screening performance of apo structures.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Verification of the AGREE and Serpent for the steady state HTR-10 benchmark problems

This paper provides results from steady state HTR-10 benchmark calculations performed using AGREE and Serpent that are compared to experimental results as well as calculations performed by INET. The purpose of completing this benchmark is to validate AGREE and Serpent for the prediction of HTGR operation so that they may ultimately be used to support licensing and deployment efforts of advanced reactors. The benchmark consists of several problems ranging from control rod worth calculations to k{sub eff} calculations at various temperatures. Overall, AGREE and Serpent show good agreement with the reference solutions and are effectively able to predict HTGR operation for a variety of steady state cases. The largest difference from the reference was for the initial core single rod worth, which is possibly due to the larger core helium cavity causing inaccuracies in the diffusion calculation whereas the control rod worth determined by Serpent and AGREE is much closer to the reference result for the full core loading. Moreover, in every benchmark problem, increasing the number of energy groups in the cross sections results in improved agreement of the AGREE result with the reference, although it also causes an increase in computation time. For problems with experimental data available, the accuracy of results generated by Serpent and AGREE is comparable to results obtained by other benchmark participants. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2022

A quantitative and holistic circular economy assessment framework at the micro level

Circular Economy (CE) aims to solve resource, waste, and emission challenges by creating a production-to-consumption supply chain that is restorative and environmentally benign. A variety of metrics has been developed with the focus mainly on the macro and meso levels. This work introduces a micro level CE assessment framework that provides i) a set of indicators and metrics with sector-specific dimensions, ii) quantitative and holistic CE overall and category-based metrics, iii) media for data visualization and analysis of CE indicators, and iv) an analytical tool to assess multi-national businesses and the multi-scale and interconnected CE supply chains. Using this quantitative tool, companies are able to track their transition towards CE, conduct temporal analysis, and benchmark their performance against their peers and industry’s standards. The applicability and the capabilities of the developed CE assessment framework is demonstrated through three case studies, with the results demonstrating a clear trend towards circularity.

42 ENGINEERING↗
DOE OSTI2025

Bayesian Optimized Deep Ensemble for Uncertainty Quantification of Deep Neural Networks: a System Safety Case Study on Sodium Fast Reactor Thermal Stratification Modeling

Deep neural networks (DNNs) are increasingly important to scientific computing and engineering system simulations. Accurate uncertainty quantification (UQ) for DNNs is critical in safety-sensitive engineering domains. Traditional Deep Ensemble (DE) methods, while easy to implement, frequently suffer from poorly calibrated uncertainty estimates and limited predictive accuracy due to reliance on fixed architectures with varied weight initializations. To address these issues, we introduce a workflow that combines Bayesian Optimization (BO) and DE. The workflow is modular, scalable, and integrates parallel BO initialized with Sobol sequences to individually optimize the hyperparameters of each ensemble member. This method enhances ensemble diversity, improves predictive accuracy, and provides reliable uncertainty estimates. We evaluate the proposed BODE approach in a sodium fast reactor thermal stratification modeling case study, where we used a densely connected convolutional neural network to predict turbulent viscosity during the reactor transient with consideration of data noise. We benchmark its performance against several optimization approaches, including baseline deep ensemble, evolutionary algorithm-optimized ensemble, ensemble formed via random search combined with greedy selection, and a BO ensemble using random initialization. Here, our results demonstrate superior performance of the developed BODE approach. In noise-free scenarios, BODE notably reduces incorrect aleatoric uncertainty and significantly enhances predictive accuracy. Under conditions of 5% and 10% Gaussian noise, BODE adaptively quantifies uncertainty proportional to data noise, achieving up to an 80% reduction in root mean square error compared to baseline methods and producing well-calibrated prediction intervals.

Bayesian optimization↗
DOE OSTI2020

A Viable New Strategy for the Discovery of Peptide Proteolytic Cleavage Products in Plant-Microbe Interactions

Small peptides that are proteolytic cleavage products (PCPs) of less than 100 amino acids are emerging as key signaling molecules that mediate cell-to-cell communication and biological processes that occur between and within plants, fungi, and bacteria. Yet, the discovery and characterization of these molecules is largely overlooked. Today, selective enrichment and subsequent characterization by mass spectrometry–based sequencing offers the greatest potential for their comprehensive characterization, however qualitative and quantitative performance metrics are rarely captured. Herein, we addressed this need by benchmarking the performance of an enrichment strategy, optimized specifically for small PCPs, using state-of-the-art de novo–assisted peptide sequencing. As a case study, we implemented this approach to identify PCPs from different root and foliar tissues of the hybrid poplar Populus × canescens 717-1B4 in interaction with the ectomycorrhizal basidiomycete Laccaria bicolor . In total, we identified 1,660 and 2,870 Populus and L. bicolor unique PCPs, respectively. Qualitative results supported the identification of well-known PCPs, like the mature form of the photosystem II complex 5-kDa protein (approximately 3 kDa). A total of 157 PCPs were determined to be significantly more abundant in root tips with established ectomycorrhiza when compared with root tips without established ectomycorrhiza and extramatrical mycelium of L. bicolor . These PCPs mapped to 64 Populus proteins and 69 L. bicolor proteins in our database, with several of them previously implicated in biologically relevant associations between plant and fungus.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Net Load Forecasting With Disaggregated Behind-the-Meter PV Generation

As worldwide use of residential photovoltaic (PV) systems grows, system operators and utilities will need to transition from forecasting pure demand to forecasting net load with behind-the-meter (BTM) PV generation. However, PV generation can be difficult to predict and the measurements of PV generation from BTM residential systems are often invisible behind a measurement of the net load, making net load forecasting challenging. This paper proposes a novel two-stage framework for net load forecasting in areas with limited observability and high BTM PV generation. First, the profiles of observable customers are used to disaggregate the net load measurements into the pure load and PV generation. Then, separate models are used to forecast the PV generation and pure load individually, and the results are combined for a net load forecast. Further, this paper also proposes a compensator for correcting the error of the net load forecast, using historical forecast errors of the PV generation, pure load, and net load. The proposed framework is tested through two case studies for areas with high BTM PV penetration and less than 10% observable customers. The two-stage forecasting model is compared to two benchmark methods - a time series forecasting model, and a model that forecasts the net load directly using historical net load measurements. Results show that the proposed disaggregation-forecasting framework reduces the error of the net load forecast compared to both benchmark models. In addition, when the net load forecast error is periodic, the compensator can correct the error to improve the forecast accuracy.

14 SOLAR ENERGY↗
DOE OSTI2022

Self-Organizing Map-Based Resilience Quantification and Resilient Control of Distribution Systems Under Extreme Events

Due to climate change, extreme weather events are occurring more frequently and with increasing impact. This trend poses a significant challenge for distribution system operators (DSO) to ensure that there is uninterrupted power supply to critical loads in their networks. To embed resilience into DSO's decision-making, resilience needs to be first quantified and then integrated into the system-level optimization. Therefore, this paper first develops a novel self-organizing map (SOM) based method (called SomRes) to quantify the time-varying resilience index of a system that can leverage the powerful classification property of SOMs and removes some of the disadvantages of subjective weight assignment methods. Using SomRes, a resilient resource allocation and operational dispatch algorithm is further developed to enhance system resilience against extreme events by considering the SomRes resilience index directly as the feedback. Here, the proposed resilience quantification approach is benchmarked with a state-of-the-art approach and the efficacy of the proposed resilient dispatch algorithm is demonstrated through several deterministic and statistical case studies on the IEEE 123-bus distribution system. Simulation studies show that the proposed SomRes quantification method is an appropriate indicator of system resilience, and the resilient resource allocation and dispatch strategy can significantly reduce critical load shedding under varying event propagation scenarios.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Coupling of Pronghorn and RELAP-7 for a Pebble Bed Reactor

High temperature gas cooled reactors (HTGR) are a candidate for timely Gen-IV reactor technology deployment because of high technology readiness and walk-away safety. Among HTGRs, pebble bed reactors (PBRs) have attractive features such as low excess reactivity and online refueling. Pebble bed reactors pose unique challenges to analysts and reactor designers such as continuous burnup distribution depending on pebble motion and recirculation, radiative heat transfer across a variety of gas-filled gaps, and long design basis transients such as pressurized and depressurized loss of forced circulation. Modeling and simulation is essential for both the PBR’s safety case and design process. In order to verify and validate the new generation codes the Nuclear Energy Agency (NEA) Data bank provide a set of benchmarks data together with solutions calculated by the participants using the state of the art codes of that time. An important milestone to test the new PBR simulation codes is the OECD NEA PBMR-400 benchmark which includes thermal hydraulic and neutron kinetic standalone exercises as well as coupled exercises and transients scenarios. In this work, the reactor multiphysics code MAMMOTH and the thermal hydraulics code Pronghorn, both developed by the Idaho National Laboratory (INL) within the multiphysics object-oriented simulation environment (MOOSE), have been used to solve Phase 1 exercises 1 and 2 of the PBMR-400 benchmark. The steady state results are in agreement with the other participants’ solutions demonstrating the adequacy of MAMMOTH and Pronghorn for simulating PBRs.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

An Updated Life Cycle Assessment of Utility-Scale Solar Photovoltaic Systems Installed in the United States

Given the high deployment targets for solar photovoltaics (PV) needed to meet U.S. decarbonization goals, and the limited carbon budget remaining to limit global temperature rise, accurate accounting of the energy-use and greenhouse-gas emissions over the life-cycle of PV systems is needed. In the United States, most PV systems are large utility-scale systems which use single-axis trackers and central inverters, which are not commonly examined in existing life-cycle assessment (LCA) literature. In this study, we present a cradle-to-grave LCA of a typical silicon U.S. utility PV (UPV) installation which is consistent with the utility system features documented in the annual NREL PV system cost benchmark reports. We analyze and present results for four main metrics: cumulative energy demand (CED), greenhouse gas (GHG) emissions, energy payback time (EPBT), and carbon payback time (CPBT). We consider six primary manufacturing options: three based on an imported PV module supply chain (comparing low-carbon imports, high-carbon imports, and average imports), and three based on a potential domestic PV module supply chain (comparing low-carbon U.S. regions, high-carbon U.S. regions, and average U.S. regions). These manufacturing options were then paired with installation locations to create six main cases: low-carbon options were installed in Phoenix (Arizona), high-carbon options were installed in Seattle (Washington), and average options were installed in Fredonia (Kansas). These locations were selected to represent a range of irradiance and grid mixes in the United States, in order to illustrate the likely range of EPBTs and CPBTs possible across the United States. For all six cases, a sensitivity analysis for end-of-life (EOL) handling was explored to capture current and future management options: landfilling, partial recycling, and high-quality recycling. For the purposes of this report, the benchmark system was defined to use an average imported supply chain with partial recycling, installed in Fredonia (Kansas). CED results show ratios at or below 0.1 MJ oil-eq /MJgenerated which demonstrates efficient use of primary energy resources (below a 1:1 ratio), and represents a slight improvement over previous results in literature. GHG emissions per kWh range from 10-36 g CO 2 e, which are consistent with or lower than previous results published by NREL and IEA-PVPS. We use a graphical approach for calculating EPBT and CPBT in this report, which improves upon methods typically used in literature by accounting for non-linearity and avoiding data quality issues associated with long-term projections. EPBT was determined to vary from 0.5 to 1.2 years, with a benchmark EPBT of 0.6 years; CPBT was shown to vary from 0.8 to 20 years, with benchmark CPBT of 2.1 years, which is lower than other estimates from recent literature (typically >2 years).

14 SOLAR ENERGY↗
DOE OSTI2020

Comparison of Modeled to Measured Spectra using MCNP and GADRAS to Benchmark and Contrast Modeling Limitations

The desire to improve nuclear material detection through portal monitors and other low resolution detectors has led to interest in benchmarking the performance of radiation transport codes. These codes can be used to generate a variety and quantity of spectra that may be cost prohibitive to measure directly. Particular characteristics of typical detection scenarios were isolated to compare the performance of radiation transport codes to laboratory experiments. These benchmark experiments were performed to validate simulations in a number of key areas. These experiments included high areal density configurations in both one- and three-dimensional configurations. In addition, off-angle measurements were conducted to investigate the impact of detector response assumptions on complex geometries, for example where an unknown source is not physically collocated with an apparent hot spot. Furthermore, by examining both simple shielding and backscatter configurations, isolation of the scatter emanating from the object and environmental background scatter contributions to the spectra could be elucidated. A series of experiments were performed in which the order of shielding layers and the thickness were evaluated to examine the ability of the simulations to address these variables. Experiments with increasing thickness of polyethylene around a neutron source also allows for examinations of the ability of the transport simulations to properly model n,γ reactions. Finally, depleted uranium (DU) measurements have more complicated spectra than the cobalt-60 and consequently allow for investigations into the ability of transport simulations to model self-shielding. In each case, the results of the experiments were compared to MCNP simulations to judge the performance of the code, as was done previously with GADRAS 18.7.9 simulations [7]. All of the benchmark measurements were taken with a liquid nitrogen cooled 140% high purity germanium (HPGe) detector with a bismuth collimator that had the front tin filter removed. The measurement location and detector configuration were subsequently used for all experimental configurations. The remainder of this report details the experimental measurements, Section 2 and the MCNP model, Section 3. Comparisons between the experimental results and MCNP-generated spectra are performed, Section 4. Section 5 compares the results obtained with MCNP with the previously reported results obtained with GADRAS [2]. Finally, Section 6 presents the conclusions.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2022

Benchmark of few-level quantum theory vs ab initio numerical solutions for the strong-field Autler–Townes effect in photoionization of hydrogen

Abstract The temporal and spectral consequences of an intermediate resonance en route to photoionization are investigated theoretically in two ways: by solving few-level model equations and by ab initio numerical solution of the time-dependent Schrödinger equation, in both cases for hydrogen in three dimensions. The model consists of atomic states resonantly field-dressed in a three-level reduction of the hydrogen atom that consists of the 2 p –3 d (Balmer) transition and one energetically-distant continuum state. The model’s level occupation probabilities are derived from three Schrödinger amplitude equations and are benchmarked against an ab initio numerical solution for the hydrogen electron’s wavefunction under the same field. We examine contrasts between the results of the two approaches with a particular focus on Autler–Townes doublets that appear in the photoelectron spectrum.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2026

The 0E2 benchmarks for PWR UO 2 decay heat: an analysis from the NEA WPNCS

This paper presents the work performed in the subgroup 16 of the Working Party for Nuclear Criticality Safety (WPNCS) of the OECD Nuclear Energy Agency. The main goal was to define two decay heat benchmarks for Spent Nuclear Fuel (one pincell and one assembly), perform calculations and compare and analyze the results in light of existing calorimetric measurements. The selected case is the PWR UO2 assembly 0E2, irradiated at the Ringhals-3 reactor and measured at the Clab facility in Sweden. In total, 21 institutes worldwide participated to the exercise, leading to 55 calculated results (named C). It was found that the measured decay heat values (E) can be satisfactorily reproduced with two-dimensional assembly calculations, leading to an average C/E value of 0.99, with an uncertainty (or one standard deviation) of ±0.01.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

The interplay of excitonic delocalization and vibrational localization in optical lineshapes: A variational polaron approach

The dynamics of molecular excitonic systems are complicated by a competition between electronic coupling (which drives delocalization) and vibrational-electronic (vibronic) interactions (which tend to encourage electronic localization). A particular challenge of molecular systems is that they typically possess a large number of independent vibrations, with frequencies often spanning the entire spectrum of relevant electronic energy gaps. Recent spectroscopic observations and numerical simulations on a water-soluble chlorophyll-binding protein (WSCP) reveal a transition between two regimes of vibronic behavior, a Redfield-like regime in which low-frequency vibrations respond to a delocalized excitonic state, and a Förster-like regime where high-frequency vibrations act as incoherent excitations on individual pigments. Although numerical simulations can reproduce these effects, there is a need for a simple, systematic theory that accurately describes the smooth transition between these two regimes in experimental spectra. Here we address this challenge by generalizing the variational polaron transform approach of [Bloemsma et al., Chem. Phys. 481, 250 (2016)] to include arbitrary bath densities for systems with or without symmetry. We benchmark this theory against both numerical matrix-diagonalization methods and experimental 77 K fluorescence spectra for two WSCP variants, obtaining quite satisfactory agreement in both cases. Here, we apply this theory to offer an explanation for the large loss in apparent electronic coupling in the WSCP Q57K mutant and to examine the likely impact of the interplay between excitonic delocalization and vibrational localization on vibrational sideband shapes and apparent coupling strengths in high-resolution optical spectra for chlorophyll-protein complexes such as WSCP.

14 SOLAR ENERGY↗
DOE OSTI2022

Manifold Learning-Based Polynomial Chaos Expansions for High-Dimensional Surrogate Models

In this work we introduce a manifold learning-based method for uncertainty quantification (UQ) in systems describing complex spatiotemporal processes. Our first objective is to identify the embedding of a set of high-dimensional data representing quantities of interest of the computational or analytical model. For this purpose, we employ Grassmannian diffusion maps, a two-step nonlinear dimension reduction technique which allows us to reduce the dimensionality of the data and identify meaningful geometric descriptions in a parsimonious and inexpensive manner. Polynomial chaos expansion is then used to construct a mapping between the stochastic input parameters and the diffusion coordinates of the reduced space. An adaptive clustering technique is proposed to identify an optimal number of clusters of points in the latent space. The similarity of points allows us to construct a number of geometric harmonic emulators which are finally utilized as a set of inexpensive pretrained models to perform an inverse map of realizations of latent features to the ambient space and thus perform accurate out-of-sample predictions. Thus, the proposed method acts as an encoder-decoder system which is able to automatically handle very high-dimensional data while simultaneously operating successfully in the small-data regime. The method is demonstrated on two benchmark problems and on a system of advection-diffusion-reaction equations which model a first-order chemical reaction between two species. In all test cases, the proposed method is able to achieve highly accurate approximations which ultimately lead to the significant acceleration of UQ tasks.

42 ENGINEERING↗
DOE OSTI2020

The Opus radiative opacity code, a new implementation of the super-transition array method

This report describes the development of our new radiative opacity code Opus, submitted as part of a 2020 Level 2 milestone requirement. This code aims to incorporate the capabilities in existing but separate opacity codes previously developed at LLNL (Opal, Topaz, and Tycho). The first phase in the development, which was to implement the super-transition (STA) method of Bar-Shalom and co-workers is now completed. In this work, we describe the underlying physics, implementation, usage, and regression testing as well as providing numerical examples for the opacity tables of boron, chromium, iron, and nickel. The latter are benchmarked against the LLNL legacy STA code Tycho, with an average absolute relative difference of ~1.5 and 0.5% for Planck and Rosseland opacity means, respectively. The cases where differences are larger are well understood in terms of numerical instabilities near discontinuities of the average degree of ionization inherent to the assumed opacity/equation-of-state model.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗