SEARCH · Search NASA

Results for “benchmark and validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Estimating List-Mode Data Sensitivities to Nuclear Data with MCNP6

Nuclear data are a vital component of predictive simulations used in applications like experiment design, stockpile stewardship, nuclear nonproliferation/safeguards, health physics, and criticality safety. A singular simulation requires the coalescence of different areas of nuclear data such as cross sections, angular distributions, and energy distributions of emitted neutrons for different materials and energy ranges. Improving nuclear data and thus reducing the uncertainty in simulated parameters could enable smaller, better-informed safety factors and ultimately reduce operational and procedural costs. There is a constant effort to garner a better understanding of the physical quantities represented by nuclear data through experiments. Integral experiment benchmarks use simulated and measured results to validate current nuclear data values. In the past, benchmarks primarily focused on the effective multiplication factor (k eff ); however, this limited scope has caused compensating errors and areas of nuclear data that lack validation. Compensating errors are inaccuracies in nuclear data that are obfuscated by cancellation when observing integrated values such as k eff . Diverse integral benchmark experiments that look for quantities of interest other than k eff and include multiple responses minimize the possibility of compensating errors and provides validation to areas of nuclear data previously lacking experimental validation. Benchmark experiments can be optimized during the design process to be highly dependent on specific areas of nuclear data. The dependence of a response in an experiment to a specific area/type of nuclear data is defined as sensitivity. A larger sensitivity means that nuclear data uncertainties will play a larger role in the response(s) resulting in larger bias. Currently, the sensitivity capabilities of the Monte Carlo N-Particle (MCNP ®1 ) transport code are limited to responses of k eff and tallied values (e.g., flux, surface current). As a part of the EUCLID project, this work explores estimating list-mode nuclear data sensitivities that can be used to design experiments aimed to constrain and reduce compensating errors in nuclear data by focusing on responses other than k eff . Tallied values are ideal quantities that are estimated with detectors during experiments. List-mode data (a list of neutron collection times) are the direct output of detector systems in subcritical neutron noise experiments. Expanding MCNP sensitivity capabilities to include the sensitivity of responses estimated from list-mode data, such as the prompt neutron decay constant (α) and multiplicity estimates (S and D), enables more direct comparison of simulated and measured experimental quantities. Additionally, deterministic tools such as SENSMG are capable of obtaining sensitivities to a wide variety of responses; however, these tools cannot handle complex geometries due to the assumptions made in discretizing the phase-space variables of the Boltzman transport equation.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2020

Availability of Shielding Benchmark Experiment Data in the ICSBEP Handbook

The International Criticality Safety Benchmark Evaluation Projects (ICSBEP) has over two decades of experience under the auspices of the Organisation for Economic Co-operation and Development (OECD) Nuclear Energy Agency (NEA) to identify, evaluate, and compile a comprehensive data set of criticality safety benchmark data [1]. The activities of the ICSBEP have led to the continued success of the International Handbook of Evaluated Criticality Safety Benchmark Experiments (ICSBEP Handbook) [2]. The contents of the ICSBEP Handbook include benchmark specifications derived from nuclear facilities around the world, which have been utilized to support criticality safety efforts and also integral testing of nuclear data [3]. The 2020 edition of the ICSBEP Handbook will include data from 582 evaluations containing benchmark specifications for 5,053 critical, subcritical, or near-critical configurations. There are seven criticality-alarm-placement/shielding evaluations containing a total of 45 benchmark configurations, and ten fundamental physics evaluations containing a total of 237 measurements relevant to criticality safety applications. The purpose of this paper is to summarize those benchmarks relative to validation needs in shielding applications currently found within the ICSBEP Handbook. The current and future plans of shielding benchmarks with regards to the ICSBEP will also be discussed.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2025

Development, validation, and verification of multi-pass thermo-mechanical welding simulations using the open-source MOOSE framework: NeT TG4 benchmark weldment

This study develops and validates a sequentially coupled thermo-mechanical welding simulation for the three-pass 316L stainless steel NeT TG4 benchmark weldment using the open-source Multiphysics Object-Oriented Simulation Environment (MOOSE) and the Nuclear Engineering Material model Library (NEML). A diffused ellipsoidal heat source was calibrated against thermocouple data and weld macrographs to accurately model the fusion zone geometry and transient thermal fields. Material hardening is represented using the Lemaitre-Chaboche mixed isotropic-kinematic hardening model, while four annealing models - no annealing, single-stage at 1050 °C and 1300 °C, and two-stage at 800 °C/1300 °C - were implemented to assess the impact of annealing models on the accuracy of the predicted welding-induced plasticity, distortions, and residual stresses. The predictions were validated against experimental measurements and benchmarked against results from commercial software, demonstrating that thermo-mechanical MOOSE welding simulations achieve comparable accuracy with enhanced computational efficiency. This work highlights the potential of using open-source finite element frameworks like MOOSE for advanced manufacturing simulations.

Ji, Wendy [Australian Nuclear Science and Technolo↗

DOE OSTI2022

Correlation Calculations for the Russian Pu Metal Fast Experiments

Nuclear criticality experiments are often conducted in campaigns with multiple variations. These experiments reuse the same basic components, like the fuel, moderator, or positioning machines. The components have uncertainties in their geometry and composition that propagate to models of the experiments. Shared components create shared uncertainty between the $k_{eff}$ of benchmarks. The shared uncertainty is commonly quantified with a covariance, or correlation coefficient. These covariances can impact criticality safety and nuclear data validation applications. While benchmark evaluations tabulate an experiment’s uncertainty, they often lack a detailed calculation of correlations between experiments. Even some very commonly used benchmarks, like the Russian Pu Metal Fast (PMF) experiments, have missing correlations. This paper presents our approach to calculate the correlations for five of the Russian PMF experiments. The experiments share hemispherical Pu shells that induce a correlation between modeled $k_{eff}$ values. We estimated the correlations with simplified and detailed models of the experiments through linear-perturbation theory. The correlations between the experiments vary significantly between the detailed vs. simplified models. We also investigate how the correlations affect validation metrics of the experiments.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2022

On the novel 3-D neutron transport kinetic tRAPID algorithm and its validation

The Real-time Analysis for Particle-transport and In-situ Detection (RAPID) Code System, based on the Multi-stage Response-function Transport (MRT) methodology, allows for real-time simulation of nuclear systems based on 3-D continuous-energy particle transport. RAPID's steady-state (criticality) neutron transport algorithm is based on the Fission Matrix (FM) method, and has been extensively verified and validated against computational benchmarks and experiments. This paper introduces the novel 3-D time-dependent transport algorithm that has been implemented into the code, tRAPID, and its validation using the JSI TRIGA Mark-II reactor. tRAPID accurately and efficiently calculates neutron kinetics parameters (such as β{sub eff}, l{sub eff} , Λ, α{sub Rossi}) and 3-D time-dependent neutron fission source distribution and neutron importances for both prompt and delayed neutrons. tRAPID is used to simulate a rod insertion experiment performed at the JSI TRIGA Mark-II reactor, during which signals from four fission chambers at four different locations in the core were collected. The results demonstrate how tRAPID is capable of calculating detailed and accurate results with only a minimal use computational resources and time.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2022

Verification of the AGREE and Serpent for the steady state HTR-10 benchmark problems

This paper provides results from steady state HTR-10 benchmark calculations performed using AGREE and Serpent that are compared to experimental results as well as calculations performed by INET. The purpose of completing this benchmark is to validate AGREE and Serpent for the prediction of HTGR operation so that they may ultimately be used to support licensing and deployment efforts of advanced reactors. The benchmark consists of several problems ranging from control rod worth calculations to k{sub eff} calculations at various temperatures. Overall, AGREE and Serpent show good agreement with the reference solutions and are effectively able to predict HTGR operation for a variety of steady state cases. The largest difference from the reference was for the initial core single rod worth, which is possibly due to the larger core helium cavity causing inaccuracies in the diffusion calculation whereas the control rod worth determined by Serpent and AGREE is much closer to the reference result for the full core loading. Moreover, in every benchmark problem, increasing the number of energy groups in the cross sections results in improved agreement of the AGREE result with the reference, although it also causes an increase in computation time. For problems with experimental data available, the accuracy of results generated by Serpent and AGREE is comparable to results obtained by other benchmark participants. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2021

Neutronic Characteristics of ENDF/B-VIII.0 Compared to ENDF/B-VII.1 for Light-Water Reactor Analysis

The Evaluated Nuclear Data File (ENDF)/B-VIII.0 data library was released in 2018. To assess the new data during development and shortly after release, many validation calculations were performed with static, room-temperature benchmarks. Recently, when performing validation of ENDF/B-VIII.0 for pressurized water reactor depletion calculations, a regression in performance compared to ENDF/B-VII.1 was observed. This paper documents extensive benchmark calculations for light-water reactors performed using continuous energy Monte Carlo code with ENDF/B-VII.1 and -VIII.0 and neutronic characteristics of ENDF/B-VIII.0 are discussed and compared to those of ENDF/B-VII.1. It is our recommendation that ENDF/B data library assessment should include reactor-specific benchmark assessments, including depletion cases, such that these types of regressions may be caught earlier in the data development cycle.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2022

Uncertainty Quantification of a Light Water Pulsed-Neutron Die-Away Experiment to Thermal Neutron Scattering Laws

Thermal neutron scattering laws are important nuclear data for many nuclear science and engineering applications. Validation helps to ensure that a thermal neutron scattering law has a high quality and often employs critical benchmarks as integral experiments. Recently, pulsed-neutron die-away benchmarks have been used as an experiment to validate thermal neutron scattering laws. Herein, we evidence how this alternative integral experiment has a high sensitivity to these nuclear data by performing an uncertainty quantification analysis. The analysis randomly sampled the nuclear model parameters associated with hydrogen bound in light water thermal neutron scattering law and sampled other nuclear data that influenced the experiment’s integral parameter (e.g., elastic scattering, absorption in hydrogen and oxygen) from their respective covariance matrices. The thermal neutron scattering law caused an uncertainty in the integral parameter that reached 2.67%, which exceeds by an order of magnitude the uncertainties induced in commonly used thermal solution critical benchmarks. The validation performed here, although limited due to a poor description of the historical experiment, indicated that the ENDF/B-VIII.0 thermal neutron scattering law well predicted the integral parameter. These results motivate further benchmark and validation efforts using pulsed-neutron die-away experiments.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2024

Progress in the HTTF Benchmark and RELAP5-3D Gas-Cooled Reactor Validation

This slide set presents results of analysis done in the first year after the kickoff of the HTTF benchmark. This work includes the development of a new RELAP5-3D model of the facility and collection and presentation of results from one of the exercises in the benchmark. Highlights include good agreement between the new and legacy models for full-power steady state and similar predictions of maximum block temperature during a pressurized conduction cooldown. Additionally, code-to-code comparisons of a full-power steady state and depressurized conduction cooldown (DCC) from full-power steady state as part of Problem 2 Exercises 1A and 1B show good agreement on temperatures predicted in the core but considerable spread in central reflector temperatures. During the DCC, temperature behavior is similar across all models, but cooldown rates are dictated by the performance of the reactor cavity cooling system

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2022

Benchmark Specification for Select Experiments Conducted at the University of Wisconsin-Madison Thermal Stratification Test Facility

The Department of Energy (DOE)-Nuclear Energy University Programs (NEUP) supported the creation and operation of the Thermal Stratification Test Facility (TSTF) at the University of Wisconsin Madison (UWM) as part of a larger effort to understand thermal stratification behavior in liquid-metal-cooled reactors. The TSTF was designed to simulate transients in a reactor plenum that are known to cause thermal stratification. High-reliability and high-resolution measurements of the flow and temperature were collected for use as experimental benchmarks to support validation efforts for computational models. The results of these tests contribute to the greater understanding of thermal stratification behavior of liquid sodium under various configurations and operating conditions. The six TSTF tests selected for benchmarking are a set of forced circulation tests at a fixed flow rate with different Upper Internal Structure (UIS) configurations in the test section (no UIS, solid UIS, and a UIS with flow area of 4, 8, 12, and 100%). This report provides a complete description of the benchmark problems, including all key test facility details, descriptions of each test condition, and measured data for comparison with modeled results.

42 ENGINEERING↗

DOE OSTI2026

Agentic Diagrammatica: Towards Autonomous Symbolic Computation in High Energy Physics

We present Diagrammatica, a symbolic computation extension to the HEPTAPOD agentic framework, which enables LLM agents to plan and execute multi-step theoretical calculations. Symbolic computation poses a distinctive reliability challenge for LLM agents, as correctness is governed by implicit mathematical conventions that are not encoded in a form that can be easily checked in the computational backend. We identify two complementary remedies, tool-constrained computation and targeted knowledge grounding, and pursue the first as the primary architecture. Concretely, we concentrate the agent's action distribution onto tool calls with convention-fixing semantics, in which the agent specifies a compact, human-auditable diagram specification and a trusted backend performs the symbolic or numerical manipulations exactly. The toolkit provides two complementary calculation paths consuming a shared diagram specification: Naive Dimensional Analysis (NDA) for order-of-magnitude rate estimates and Exact Diagrammatic Analysis (EDA) for tree-level symbolic calculations via automatic FeynCalc code generation, both supplemented by automatic Feynman diagram enumeration and a navigable theory knowledge base. The architecture is validated on two benchmarks: (1) an exhaustive catalog of all tree-level, single-vertex $1\to 2$ partial decay widths across scalar, fermion, and vector parents, with complete massless and threshold limits and Standard Model validation; and (2) an NDA sensitivity study of the muon decay multiplicity $μ^+ \to ν_μ\barν_e + n(e^+e^-) + e^-$, determining the maximum observable $n$ at current and planned muon experiments.

Menzo, Tony [Alabama U.; Fermilab] (ORCID:00000002↗

DOE OSTI2022

Evaluation of China Experimental Fast Reactor Start-up Tests (Final Report, Revision 1)

This report documents the results and observations on the Coordinated Research Project (CRP) of the International Atomic Energy Agency (IAEA) on “Neutronics Benchmark of CEFR Start-Up Tests.” The China Experimental Fast Reactor (CEFR) is a 65MWt sodium-cooled fast reactor with highly enriched uranium oxide fuel. The reactor achieved first criticality in 2010, and a series of start-up tests were conducted to measure various reactor physics parameters. In 2018, the IAEA launched the CRP for validation and qualification of member states' computation capabilities in the field of fast reactor simulation by utilizing the measured data in the CEFR start-up test. Twenty-nine international organizations from eighteen member countries, including Argonne National Laboratory, have participated in the CRP. The CEFR start-up tests offer a rare opportunity to validate U.S. nuclear engineering software because it is a well-specified benchmark with corresponding measurements for a recently built fast reactor starting up with a known fuel composition (fresh fuel). Previous fast reactor validation benchmarks frequently involve reactors that have already been started up and contain irradiated fuel that is difficult to characterize with high certainty.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2024

TEX-Hf Assemblies: Highly Enriched Uranium Plates with Hafnium Using Polyethylene Moderator and Polyethylene Reflector

This report documents the integral experiment evaluation and publication for IER-532 (TEX-Hf), Thermal/Epithermal eXperiments (TEX) with highly enriched uranium (HEU) fuel and hafnium (Hf), moderated and reflected by polyethylene. The design of TEX-Hf is a variation of IER-297 (TEX-HEU), with the inclusion of hafnium as a diluent material. The experiment and evaluation include seven configurations, all of which were acceptable as benchmark cases. These benchmark cases provide validation for hafnium in the thermal, intermediate, and fast neutron energy regimes by maximizing the sensitivity in k eff to the hafnium cross sections. The evaluation was reviewed and accepted by the International Criticality Safety Benchmark Evaluation Project (ICSBEP) Technical Review Group on April 17, 2024, and was submitted to the ICSBEP in August 2024 following subgroup approval.

42 ENGINEERING↗

DOE OSTI2022

Calculation of neutron flux spectra of the VVER-1000 mock-up shielding benchmark with Monte Carlo code MCS utilizing mesh-based weight window

The measurements of neutron spectra compiled inside the NEA-1517/82 package from the Shielding Integral Benchmark Archive and Database (SINBAD) are chosen as benchmark cases to validate the variance reduction technique based on weight window in Monte Carlo Code MCS. A full 3D model for fixed source mode calculation with hexagonal lattice source definition is developed to simulate total of 6 points of measurements at the vicinity of the reactor and the reactor pressure vessel region. A code/code comparison against MCNP6 code is first conducted as verification element for the mesh-based weight window capability in MCS. Finally, the validation results are presented against measurements. The verification against MCNP6 code gives good agreement in addition of the insight to the importance of user understanding to determine proper reference point and reference lower weight bound for scaling which is not required in MCS code due to its capability of automatic scaling. The comparison of neutron spectra between MCS and measurements shows good agreement within 3 standard deviations for all of six detector positions.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2022

Nuclide inventory validation: radiochemical assay data quality and modeling challenges in benchmark models development

Oak Ridge National Laboratory is conducting radiochemical assay experiments, using high-precision analytical protocols validated with a comprehensive quality assurance plan, to expand the nuclide inventory validation basis for high burnup spent nuclear fuel. Preliminary measurement data for key actinides and fission products in two pressurized water reactor spent fuel samples are being used to investigate the impact of measurement data uncertainty on the sample burnup estimation. These measurement data are also being used to examine the impact of assumptions applied when developing best-estimate computational models to simulate fuel irradiation history. The simulations are being performed using depletion capabilities in the SCALE code system. Comparison of calculated and measured nuclide concentrations shows good agreement for the considered nuclides. (authors)

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2025

Quantitative Encapsulation and Homogeneity Assessment of Sol–Gel Based Nuclear Explosive Debris Simulants

Nuclear explosive debris simulants are an important material in training and validating aspects of post-detonation nuclear forensic processes. Realistic simulants should replicate several aspects of nuclear explosive debris such as the size, shape, color, density, and chemical and radiological properties. Silica particles produced via sol-gel synthesis have recently been found to successfully reproduce many of these parameters including the controllable incorporation of radionuclide content. However, to be useful as a benchmarking material for validation and verification of laboratory methodologies, radionuclide content from batch-to-batch must be reproducible. Here, in this work, we explore the variance in radionuclide distribution incorporated into sol-gel benchmarking materials with respect to sample subdivision. Results will help inform the sample sizes required to minimize variance between samples.

36 - MATERIALS SCIENCE↗

DOE OSTI2023

Verifying MCNP Models of the TEX High 240 Plutonium Benchmark

Computational modeling programs are invaluable tools that allow us to understand systems, safely develop new processes, and make reliable predictions about future designs. However, the effectiveness of these codes is limited by the degree to which their parameters match the real world. In the field of nuclear engineering, cross section data is one of these vital parameters. Accurate cross section data on important fissile and fissionable isotopes promotes the design of safer and more efficient fabrication, transportation, storage, and stockpiling of nuclear fuel. Unfortunately, there are knowledge gaps in data on key isotopes. In 2011, a multinational meeting hosted by the US Department of Energy Nuclear Criticality Safety Program ranked the priority of certain cross section data needs. In response, Lawrence Livermore National Lab (LLNL) designed the Thermal and Epithermal eXperiment (TEX) series of benchmark experiments. Benchmark experiments are used to validate current cross section data. They validate data by comparing the results of an actual experiment to the predicted results from a computational model. The data a benchmark applies to depends on the isotope and energy range the experiment’s neutron multiplication factor ( k eff ) is most sensitive to. The development and testing of the TEX High 240 Plutonium Benchmark will help validate 240 Pu cross section data. The configuration and materials of this benchmark are designed to be most sensitive to 240 Pu's intermediate energy range (from 0.625 ev to 100 keV ). MCNP® models of the assembly have been developed by LLNL and the results have been written in the final design report. In order for the discrepancies between benchmark models and experiments to be attributed to cross section inaccuracies, the accuracy of the models needs to be verified. The goal of this project is to verify of the results of LLNL's modeling by creating a new set of MCNP models and comparing the results.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2023

Workshop on Addressing Rigor and Reproducibility in Thermal, Heterogeneous Catalysis

Heterogeneous catalysis has long served as the bedrock of the manufacturing of energy carriers, fuels and chemicals, and various technologies for pollution abatement. The significant complexity and variability spanning the entire breadth of catalyst material properties, synthesis methods, characterization techniques, and evaluation procedures, has focused attention on the need to establish community-accepted best practices for ensuring high-quality, benchmarked, and reproducible data. In addition, increased societal urgency to transition to clean energy and reduce greenhouse gas concentrations has incentivized interdisciplinary, convergent, and translational approaches to catalysis research in recent years. Research engineers and scientists with expertise cutting broadly across materials science, chemical synthesis, interfacial science, spectroscopy, and methods of data science and computational simulation, all bring diverse and important perspectives to catalysis research, but often with little awareness of the complexity of catalytic systems, especially in their working environment. As has already occurred in other scientific fields, there has been growing recognition and consensus in the heterogeneous catalysis research community that mechanisms are needed to improve the rigor and reproducibility (R&R) of experimental measurements, to ensure alignment of the broader research community with a common core of best practices specific to the realization of high-quality catalysis research. Similarly, the field is moving rapidly toward computationally informed and data science-driven catalyst design, but the success of implementing such predictive tools hinges on model training and validation rooted in rigorously obtained and reproducible experimental data that are benchmarked to common specifications. As such, this workshop was convened to prepare a report summarizing best practices for reporting data and performing experiments that researchers can use to benchmark, validate, and reproduce data in specific sub-fields of thermal, heterogeneous catalysis. Additionally, we discussed recommendations for future actions that may improve R&R in this field. The workshop organizers and participants include a diverse range of catalysis researchers from various employment sectors (e.g., academia, industry, national laboratory), institutional mission and resources (e.g., PhD-granting research universities, non-PhD-granting teaching universities), career stage (e.g., early, mid and late-career), technical expertise, and demographic background. This diverse group was involved in the discussion of workshop agenda items, writing this report, and discussing possible future action items for the community to consider, which helped ensure that a broad range of perspectives were captured in the description of the problems at hand and the creation of actionable solutions that may be effectively adopted by the diverse practitioners in catalysis research. Importantly, this group of workshop participants also included very early career researchers (e.g., senior PhD students, postdoctoral scholars) who will become the next generation of scientific leaders in various sectors, thus capturing emerging perspectives of newcomers to the field to shape its future while positively impacting the development of its future workforce. We envision that this effort will help advance the field of catalysis science by improving the rigor and reproducibility of experimental data collected by current researchers and future newcomers to the field, which is of broad importance to health and vitality of any scientific discipline. Therefore, best practices identified in this endeavor for thermal heterogeneous catalysis can be translated to such efforts in other areas of catalysis and other scientific fields involving the study of materials, and vice versa. We also envision this to be an ongoing effort, with future workshops that are convened to discuss issues of rigor and reproducibility on technical topics that were unable to be covered in this workshop due to its scope limitations, and as emerging methods and materials become more prevalent in the research community.

36 MATERIALS SCIENCE↗