Search NASA⌕ Search

SEARCH · Search NASA

Results for “benchmark and validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Generation IV Benchmarking of TRISO Fuel Performance Models Under Accident Conditions Final Report

The Generation IV International Forum (GIF) is a co-operative international endeavor of fourteen members organized to carry out the research and development needed to establish the feasibility and performance capabilities of the next generation nuclear energy systems. GIF selected six reactor technologies, amongst which is the Very High Temperature Reactor (VHTR) that is primarily dedicated to the cogeneration of electricity and hydrogen. The technical basis for VHTR is the tristructural isotropic (TRISO)-coated particle fuel, the graphite as the core structure, helium coolant, as well as the dedicated core layout and lower power density to removal decay heat in a natural way. At the heart of safety features of the VHTR concept lie the TRISO fuel particles that are designed to keep their structural integrity and retain fission products at temperatures up to 1600°C. As part as the design and future operation of VHTRs, a key aspect is the accurate prediction of fuel performance under irradiation and accident conditions. Modeling and simulation allow prediction of TRISO fuel behavior when subject to neutron flux and in high temperature accident scenarios. The refinement of the fuel performance models and codes is performed by comparison to in-pile and out-of-pile experimental data that reproduce the expected irradiation conditions in high temperature gas-cooled reactors (HTGRs). Historically, the International Atomic Energy Agency (IAEA) developed a benchmark dedicated to the validation of predictive methods for fuel and fission product behavior through the Coordinated Research Program CRP-2 (IAEA, 1997). CRP-2 was later updated to cover fuel fabrication, quality assurance, irradiation performance, safety testing, and spent fuel. The scope of the resulting CRP-6 benchmarks focused on HTGR fuel performance and fission product release (IAEA, 2012). Taking advantage of additional TRISO fuel fabrication, irradiation, and safety testing campaigns, GIF launched a Generation IV Benchmarking of TRISO Fuel Performance Models under Accident Conditions in late 2015. This GIF benchmark is a three-year program steered by Idaho National Laboratory (INL, USA). The other participants include the Japan Atomic Energy Agency (JAEA, Japan) and the Korea Atomic Energy Research Institute (KAERI, Korea). The objectives of the benchmark are to: follow on the IAEA CRP benchmarks, (2) model fission product release under accident conditions, (3) compare results obtained by the fuel performance modeling codes of the benchmark participants, and (4) compare these code predictions to experimental data. Safety tests chosen for modeling include the first and second experiments of the Advanced Gas Reactor program (AGR-1 and AGR-2) and the High Flux Reactor (HFR) EU1bis experiment. This report presents the results obtained by the three research institutions using their respective fuel performance modeling codes. Comparisons of the corresponding fission product release predictions are made with experimental data from AGR-1, AGR-2, and HFR-EU1bis. The benchmark results show good agreements between all participants but also show a general trend of over-prediction of the experimental release data, which is mainly attributed to the use of over-estimated diffusion coefficients.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2021

Validation of KENO Delayed Neutron Fraction Capabilities

The delayed neutron fraction, which is necessary for the safe operation of reactors, varies by fissionable material and neutron spectrum. A prompt fission neutron spectrum has been included in the SCALE 6.2 release to account for the removal of delayed neutrons from precursor materials from the neutron balance. This paper describes how experimental measurements from criticality safety benchmarks were used to validate the SCALE calculational procedure for the delayed neutron fraction. Additionally, the effect of nuclear data uncertainty on the KENO calculation of β eff was examined with the SAMPLER sequence.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Model Development and Analysis of a High-Fidelity Neutron Transport Sensor: The Quadrupole Detector Concept for Measurement of the Neutron Flux Gradient

Accurate reconstruction of the neutron flux distribution within a reactor core is essential for safe and efficient reactor operation. Traditional power shape synthesis in Light Water Reactors relies on hundreds of in-core detectors. However, this approach becomes impractical for Advanced Reactors and Microreactors due to limited space and harsh environments. To address this challenge, we propose a data-driven methodology that combines high-fidelity modeling with real-time ex-core sensor measurements, enabling the reconstruction of core power distribution while minimizing the reliance on intrusive in-core instrumentation. This project began in FY24 and achieved two initial milestones: (1) the definition of a three-year development plan for a Digital Twin framework and (2) the development of high-fidelity neutronics models of the Purdue University Reactor One (PUR-1) using both MCNP6 and OpenMC. The PUR-1 reactor, a zero-power facility, was selected due to its suitability for neutronics-focused modeling and the availability of experimental data for validation. Both models were benchmarked using neutron flux measurements obtained from irradiated gold foils, which were strategically placed within the core during a dedicated campaign in July 2024. This report marks the continuation and completion of those foundational tasks. The OpenMC model has been refined (improved geometric accuracy, expanded cross-section libraries, and refined sampling) and validated using additional experimental data. An updated sensor design—based on quadrupole configuration—was designed to measure both ex-core flux and its spatial gradient. These measurements will serve as inputs to a neural network-based reconstruction algorithm. Finally, the methodology was demonstrated on a two-dimensional test case representative of the heterogeneous material composition of the PUR-1 reactor core. A neural network implementation of the Kirchhoff-Helmholtz integral equation was employed to solve the boundary value problem using peripheral sensor measurements. The preliminary results confirm the strong potential of the proposed approach for accurate and minimally invasive neutron flux reconstruction.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2020

Comparison Study of Upper Subcritical Limits Derived Using Sensitivity/Uncertainty Tools Case Studies of Benchmarks and Applications

Neutron transport methods used to establish subcriticality require validation by comparison to critical experiments considered to be benchmarks. Whisper is a sensitivity/uncertainty analysis tool developed to assist with the task of validation in nuclear criticality safety. Details on the Whisper methodology can be found in References 1-3 on the MCNP ® reference collection website at https://mcnp.lanl.gov. Whisper-1.0 was originally developed in 2014 and used to assist with nuclear criticality safety validation at Los Alamos National Laboratory. Whisper was upgraded in 2016 to Whisper-1.1 and prepared for release with MCNP6.2. Whisper contains a library of over 1100 critical experiment benchmarks and quantifies neutronic similarity of an application to benchmarks in the library. Using highest similarity benchmarks, Whisper computes a calculational margin (CM) encompassing of the worst-case bias and bias uncertainty at a 99% confidence level for each application. In addition, portions of the margin of subcriticality (MOS) for nuclear data uncertainty and potential code errors are computed. The baseline upper subcritical limit (USL) computed by Whisper is comprised of the CM, MOS nuclear data , and MOS code errors . The Whisper baseline USL is absent a portion of the MOS due to the area of application, which is applied based upon judgment by the criticality safety analyst. An objective of this paper is to present the baseline USL, CM and portions of the MOS as computed by Whisper for comparison with similar sensitivity/uncertainty tools, such as those used by IRSN and ORNL. The initial comparison involves four critical experiment benchmarks: HEU-MET-FAST-013-001, HEU-SOLTHERM-001-008, PU-MET-FAST-022-001, AND PU-SOL-THERM-001-001, which have been: 1. modeled independently by LANL, IRSN, and ORNL based upon information provided in the ICSBEP Handbook, 2. are common in S/U libraries for LANL, IRSN, and ORNL, 3. span a range of energy spectrum and fissile material, and 4. taken as applications for the purposes of this study and therefore excluded from use as a benchmark for calculating the upper subcritical limit. Results presented in this paper have been computed using covariance data for all isotopes in ENDF/BVII.0 using a 44-group energy structure. Benchmarks in the Whisper library were run in MCNP6.2 using 100,000 neutrons per cycle, skipping 100 cycles for 500 active cycles. Reference 10 also compares the results for baseline USL with an order of magnitude greater neutrons, using the same total number of cycles with 1,000,000 neutrons per cycle. Subsequent to the results presented in Reference 10 changes were made to the benchmark library, as discussed in Reference 11. Newer results using the revised benchmark library are presented herein.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Testing nuclear data libraries with burnup for reactor applications

Recently US and European nuclear data libraries have been released, namely ENDF/B-VIII.0 and JEFF-3.3 libraries, which are the result of years of evaluation and validation work in both communities. Consequently, efforts have been made to validate the evaluations in calculations of integral experiments (critical benchmarks, ..etc). Nevertheless, less stringent testing and validation efforts were performed on burnup applications before releasing the libraries. The presented work focusses on the testing of these recent nuclear data libraries for burnup calculations on two benchmarks at the pin and at the assembly level. Monte-Carlo depletion calculations were performed using the VESTA 2.2 code. The K{sub ∞} results between nuclear data libraries are compared. A strong k{sub ∞} bias is observed with burnup using both JEFF-3.3 and JEFF-4T0 compared to all other libraries, and especially ENDF/B-VIII.0, consisting in a strong k{sub ∞} over-estimation at low burnup and a high under-estimation at high burnup. JEFF-3.3 {sup 235}U and {sup 239}Pu evaluations mainly explain this result, as well as fission yields. New {sup 235}U and {sup 239}Pu evaluations were proposed for JEFF-4T0, but they do not address totally the bias issue, even if JEFF-4T0 {sup 239}Pu allows slightly reducing the k{sub ∞} underestimation at high burnup.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2026

Wire-arc Additive Manufacturing Benchmark

This is the dataset associated with the 2022 SRP Additive Manufacturing Prediction Challenge, originally hosted on Github at https://github.com/SRP-AM/SRP_AM_Prediction_Challenge. The benchmark was designed for validating prediction for the temperature history, residual stress, and distortion of an additively manufactured metal part with relatively simple geometry. A calibration problem with the same as-built geometry is provided with measured quantities of interest; including temperature histories at selective locations, post-build residual stress at selective locations, and overall distortion measurements. The challenge problem is presented with a different build sequence (i.e. thermal history). In this dataset, we include the actual recorded calibration and challenge measurements, as well as benchmark template files for testing predictions without incorporating the challenge data. Supplementary files around the materials and setup are available for transparency and reproducibility.

Bachus, Nicholas [UC Davis, Davis, CA]↗
DOE OSTI2023

ORNL’s Continuing Efforts in Evaluating and Validating TSLs [Slides]

This presentation finds that INS measurements are not as variable based on sample composition, because phonon spectra is a properly of the bulk material. Additionally, INS and transmission measurements are and should be the most significant part of TSL validation, as they are the fundamental quantities used by Monte Carlo neutronics codes. This presentation reasons that relaying solely on theoretical atomistic calculations for TSL evaluation is not enough, they are highly dependent on inter-atomic potentials (which are not the most accurate depending on the quantity trying to be reproduced) and evaluators knowledge and understanding of the material being studied. Finally on Critical benchmarks, while extremely useful for validation of nuclear data at all energies, critical benchmarks are not the best tool to provide a definitive answer on conflicting TSLs. The presentation concludes that INS and transmission measurements need to be the basis of validation of TSLs.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Advancements in Validation of TSLs through Inelastic Neutron Scattering and Transmission Measurements [Abstract]

Historically, the free gas approximation has been used to treat the thermal scattering of neutrons with energies below a few electron-volts (eV) in unevaluated materials. However, this method inadequately reproduces neutron scattering at these energies. Until recently, only a limited number of materials had available thermal scattering law (TSL) files/libraries in the ENDF nuclear data libraries in this energy range. With advancements in atomistic modeling techniques, such as molecular dynamics, ab-initio molecular dynamics, and density functional theory, TSL libraries have become available for many more materials. This is particularly relevant due to the rising interest in several advanced reactor systems that require novel moderator and reflector materials. While quasi-integral and integral benchmarks have been designed to validate historically important moderator materials (such as light water and polyethylene), there is currently a lack of standard validation methods for TSLs, especially when multiple conflicting TSLs exist. To address this issue, the Oak Ridge National Lab Nuclear Data group has been working on utilizing inelastic neutron scattering (INS) measurements combined with transmission (i.e., total cross section) measurements to evaluate and validate TSLs for different materials. We plan to demonstrate how this method has worked on materials such as polyethylene, lucite, and polystyrene. In addition, we will compare the newly created libraries to ENDF libraries for these materials and explain why integral benchmarks should not be used for validation when multiple TSLs exist.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Data from a multi-year targeted proteomics study of a longitudinal birth cohort of type 1 diabetes

The deployment of liquid chromatography-mass spectrometry-based plasma proteomics experiments in a large cohort is sparse, leading to a lack of data available for benchmarking, method development or validation. Comprised of 6,426 plasma analyses, The Environmental Determinants of Diabetes in the Young (TEDDY) proteomics validation study constitutes one of the largest targeted proteomics experiments in the literature to date. The proteomics data from this study were generated over the course of 2.5 years from over 900 study subjects, each providing up to 29 longitudinal samples. The data also includes 916 quality control samples. The targeted mass spectrometry assay was comprised of 694 peptides mapping to 167 proteins and the panel was measured in each subject and QC sample. The targeted proteomic dataset presented here can be used as a resource for new computational method development, such as for batch correction, as well as for benchmarking and comparing the performance of different methods/tools.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

AFRL Additive Manufacturing Modeling Series: Challenge 1, Characterization of Residual Strain Distribution in Additively-Manufactured Metal Parts Using Energy-Dispersive Diffraction

A machine component fabricated by additive manufacturing (AM) of metal powders often possesses steep residual stress gradients with significant magnitudes due to large temperature gradients that transpire within a localized area during fabrication. These processing-induced residual stresses can cause distortion of the part, and if they are of significant magnitude, they could induce cracking of the component, degrade printability, and/or diminish subsequent mechanical performance. The ability to predict these residual stresses imparted by AM is an important step in permeating AM technology for advanced manufacturing. Calibration and validation of AM process models used for prediction are, therefore, a critical step in understanding the origin and mitigating the challenges associated with residual stresses inherent to the AM process. In the present work, the residual strain distributions in components with simple geometries fabricated by a laser powder bed fusion (LBPF) process were characterized non-destructively using energy-dispersive X-ray diffraction in support of the US Air Force Research Laboratory Additive Manufacturing Modeling Challenge Series Groeber et al. (JOM 70:441-448, 2018). The measurement setup and approach are described in detail so that the data can be used as a benchmark to calibrate and validate models for the prediction of macro-scale residual stresses due to the LPBF process.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Simulation of the BEAVRS benchmark using VERA

The Virtual Environment for Reactor Applications (VERA) is being developed by the Consortium for the Advanced Simulation of Light Water Reactors (CASL). Here, VERA is used to perform the Benchmark for Evaluation and Validation of Reactor Simulations (BEAVRS), which provides two cycles’ worth of operating power history, along with a full, detailed description of the geometry, and measured data. Cycle 1 and 2 are simulated with VERA and the results are compared to the measured zero power physics tests, critical boron concentration, and flux maps.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Advancements in Validation of TSLs through Inelastic Neutron Scattering and Transmission Measurements [Slides]

This presentation finds that INS measurements are not as variable based on sample composition, because phonon spectra is a properly of the bulk material. Additionally, INS and transmission measurements are and should be the most significant part of TSL validation, as they are the fundamental quantities used by Monte Carlo neutronics codes. Relaying solely on theoretical atomistic calculations for TSL evaluation is not enough, they are highly dependent on inter-atomic potentials (which are not the most accurate depending on the quantity trying to be reproduced) and evaluators knowledge and understanding of the material being studied. When dealing with Crit. benchmarks - While extremely useful for validation of nuclear data at all energies, critical benchmarks are not the best tool to provide a definitive answer on conflicting TSLs. Finally, INS and transmission measurements need to be the basis of validation of TSLs.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Development of a Distribution Optimal Power Flow Federate for Open-Source OEDI-SI Platform

Increasing numbers of distributed generators in the electric power distribution networks require developing a control strategy to optimize solutions in real time. Linearized optimal distribution flow development has seen growth and acceptance in the distribution systems literature for efficiently modeling the \glspl{opf} for distribution systems. This paper examines the implementation and integration procedure for linearized optimal distribution flow federate to \gls{oedisi} platform. Specifically, we discuss i) the usage of the \gls{oedisi} platform, ii) obtaining a tractable solution using developed \gls{opf} federate, and iii) validation of solutions and bench-marking the \gls{oedisi} platform with developed \gls{opf} federate using OpenDSS. In brief, we demonstrate how a general linearized optimal distribution flow federate can be developed and integrated with a co-simulation environment to mimic real-world examples. The efficacy of the proposed method is demonstrated using the IEEE 123-bus test system under different scenarios to obtain a tractable solution and compare its results.

Sadnan, Rabayet↗
DOE OSTI2025

Ansatz-Free Hamiltonian Learning with Heisenberg-Limited Scaling

Learning the unknown interactions that govern a quantum system is crucial for quantum information processing, device benchmarking, and quantum sensing. The problem, known as Hamiltonian learning, is well understood under the assumption that interactions are local, but this assumption may not hold for arbitrary Hamiltonians. Previous methods all require high-order inverse polynomial dependency with precision, unable to surpass the standard quantum limit and reach the gold-standard Heisenberg-limited scaling. Whether Heisenberg-limited Hamiltonian learning is possible without prior assumptions about the interaction structures, a challenge we term ansatz-free Hamiltonian learning , remains an open question. In this work, we present a quantum algorithm to learn arbitrary sparse Hamiltonians without any structure constraints using only black-box queries of the system’s real-time evolution and minimal digital controls to attain Heisenberg-limited scaling in estimation error. Our method is also resilient to state-preparation-and-measurement errors, enhancing its practical feasibility. We numerically demonstrate our ansatz-free protocol for learning physical Hamiltonians and validating analog quantum simulations, benchmarking our performance against the state-of-the-art Heisenberg-limited learning approach. Moreover, we establish a fundamental trade-off between total evolution time and quantum control on learning arbitrary interactions, revealing the intrinsic interplay between controllability and total evolution-time complexity for any learning algorithm. These results pave the way for further exploration into Heisenberg-limited Hamiltonian learning in complex quantum systems under minimal assumptions, potentially enabling new benchmarking and verification protocols.

machine learning↗
DOE OSTI2021

MULTIPHYSICS-MODELING OF FIRE-INDUCED URANIUM AEROSOL FORMATION – A-POSTERIORI BENCHMARKING OF EXPERIMENTS

The formulation and solution of a model that properly described the temperature profiles of uranium in fire conditions was prepared, verified and validated, to support a-posteriori benchmarking of historical experiments. Data from the multi-physics model combined with data regression from the experiments provides a useful tool for exploring sources of potential bias in historical experiments. The approaches used are augmented by visual observations and photographic evidence allowing for correlations between various phenomena, independent of whether or not that specific phenomena are part of the validated model. In this manner, the validated model is a tool for a-posteriori benchmarking, and not a model designed to replicate the experimental output exactly for any specific experiment. For experiments like the Clark (2015) experiments, this integrated model (including chemistry) demonstrated that the largest bias was associated in the metallurgy of the coupons. The model developed does serve as a basis for defending which of the historical alloys tested are the most appropriate for any other alloy being considered (e.g., one that has not yet been tested). The model identifies key reactions that impact uranium chemistry and can significantly bias experimental results. Through use of the model and energy balances, data from historical experiments by Elder and Tinkle (1980) were regressed and benchmarked. This study identifies that all uranium alloys are not equal and that there are distinct differences between the dominant alloys representing distinct metallurgical phases.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

Multigroup Examination of Nickel-Reflected HEU System

Critical configurations of HEU-MET-FAST-003 (HMF-003) from the International Criticality Safety Benchmark Evaluation Project Handbook were modeled for addition into the Verified, Archived Library of Inputs and Data maintained at Oak Ridge National Laboratory. HMF-003 contains models of a highly enriched uranium sphere with a spherical metal reflector of natural uranium, tungsten carbide, or nickel. For these simple models, good agreement is expected between the k eff calculated with continuous-energy (CE) and multigroup (MG) transport. However, using the CSAS5 sequence of the SCALE 6.2.4 package, the 8 in. thick nickel reflector model resulted in a difference of around 1.2 % Δ k . Results presented a clear indication of poor performance for the SCALE 252-group based on ENDF/B-VII.1 cross section library for this model. The bias was investigated over a range of nickel thickness and then compared with other MG libraries available in SCALE 6.2.4. As the nickel thickness increases, the MG k eff deviates from the CE result, confirming a performance issue with the MG calculation. Additionally, the reactions were compared between the two libraries to help determine the cause of k eff bias. Finally, additional MG libraries within SCALE 6.3 and based on ENDF/B-VII.1 and ENDF/B-VIII were reviewed. The 302-group and 1597-group result in significant improvements compared with the 252-group library. Nickel cross sections were modified from ENDF/B-VII.1 to ENDF/B-VIII. For the ENDF/B-VIII library, the deviation between the CE libraries and MG libraries is less pronounced than for ENDF/VII.1, except for the 1597-group. This examination clearly indicates the importance of validating calculations with applicable benchmark experiments and caution when using MG libraries.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Validation of Jezebel Reactivity Coefficients and Sensitivity Analysis

Nuclear data validation is often performed today using criticality measurements. The gold standard for criticality measurements is the International Criticality Safety Benchmark Experiment Project (ICSBEP). The validation specifically focuses on the effective multiplication factor ($k_{eff}$). $K_{eff}$ is a relatively easy parameter to infer and has reduced uncertainty due to being at or above critical. However, while $k_{eff}$ is the most documented parameter and its uncertainties and sensitivities have been evaluated in great detail, it cannot be used as a standalone metric to determine inaccuracies in nuclear data (e.g., cross section data, PFNS, nu), which is based on theory, physics, and differential measurements. The Experiments Underpinned by Computational Learning for Improvements in nuclear Data (EUCLID) project aims to identify compensating errors in specific isotope nuclear data by optimally designing experiments that are, or are not sensitive to a suite of measurement parameters beyond $k_{eff}$. By identifying parameters that are sensitive to each other, oppositely sensitive, or have substantial magnitude differences in sensitivity, experiments can be designed to constrain questionable nuclear data. One sensitivity that is of particular interest to this project includes the sensitivity of reactivity coefficients. Reactivity coefficients compare reactivity, which is related to $k_{eff}$ at two different states therefore being sensitive to small changes in the system. The most common type of reactivity coefficient measurements is comparison to void for a small sample within the assembly. It is key that the sample sizes are small enough to not affect the flux of the full system. Reactivity coefficients were evaluated for many early experiments to better understand transport corrected cross sections. In fact, ICSBEP includes reactivity coefficient results as “Supplemental Measurements” in appendices for a handful of older benchmarks. One of those benchmarks is Jezebel, the bare Pu critical assembly. This paper compares new simulations of reactivity coefficients for Jezebel, and explores the sensitivity of reactivity coefficients to small changes in nuclear data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗