Expanding Benchmarks for Nuclear Data Validation [Slides]
Abstract not provided.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
SEARCH · Search NASA
Results for “benchmark and validation”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Validation of MCNP Critical Benchmarks Models of Highly Enriched Uranium Cylinders
A new centralized repository of high-quality MCNP models of critical benchmark experiments is currently under development at Los Alamos National Laboratory (LANL). The benchmark experiments are described in the International Criticality Safety Benchmark Evaluation Project (ICSBEP) Handbook, and the initial set of benchmark models are derived from the Whisper Suite provided with MCNP6.2. This effort is a collaboration among the Nuclear Criticality Safety, Nuclear Data, and Monte Carlo code development/application organization at LANL. The objective is to create a current single LANL benchmark collection that includes the latest ICSBEP revision that has a formal review and revision process, is contained in an open- source repository, and utilizes new Python tools for improved input and output file review.
11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
Preliminary NoMAD Results of the MUSIC Experiment
The Measurement of Uranium Subcritical and Critical (MUSiC) experiment was carried out from December 2020 through April 2021 at the National Criticality Experiments Research Center (NCERC). This measurement campaign featured bare configurations of the Rocky Flats highly-enriched uranium (HEU) shells, with each configuration having different numbers of these shells. The goal of the experiment was to test multiple neutron multiplicity detectors and measurement methods for a large range of neutron multiplication values, to see when the combination of detectors and methods break down as the configurations reach the delayed supercritical window. Adding subcritical integral benchmarks gives additional validation to nuclear data. These benchmarks provide additional parameters against which to validate the data. While critical benchmarks have just a single value, $K_{eff}$ , subcritical benchmarks can be used to infer multiple parameters. As an example, recent subcritical benchmarks utilizing the Hage-Cifarelli formalism have three quantities of interest ($R_{1}$, $R_{2}$, and $M_{L}$). This gives nuclear data evaluators additional data to use when performing their evaluations, and allows for these benchmarks to be useful for additional types of nuclear data.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
OECD/NEA MPCMIV Benchmark - Preliminary fuel performance results
The on-going OECD/NEA Multi-physics Pellet Cladding Mechanical Interaction Validation (MPCMIV) benchmark aims to provide guidance on multi-physics validation through the modelling of two cold ramps. In this paper, the first results for the base irradiation of the father rod and fuel rodlet (refabricated from the father rod), and the first cold ramp are presented. The base irradiation consists of 3 years of irradiation in the Forsmark-2 reactor. The cold ramp encompasses a steady-state pre-ramp period of less than one hour at a low constant linear heat rate (LHR) followed by a ramp test (< 1 min) with a much higher maximal LHR. The base irradiation is modelled using the fuel performance codes FRAPCON and FAST, while the cold ramp modeling is using the fuel performance code FRAPTRAN. Several missing parameters for FRAPCON/FAST base irradiation models have been selected using multiple references such as the OECD/NEA light water reactor Uncertainty Analysis in Modelling (UAM) benchmark specifications and the FRAPCON Integral Assessment report. The obtained results for the base irradiation such as the cladding outer diameter show reasonable agreement with the experimental measurements. The results for the cold ramp show larger differences with the experimental measurements (e.g., cladding axial elongation). However, such differences have been observed as well in other studies involving pellet cladding mechanical interaction analyses and are attributed to the fuel performance modelling assumptions and to the tuned modelling parameters that were not covered by the specifications. Uncertainty and sensitivity analysis might allow a better quantification of these missing parameters. (authors)
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
Current Status of the HTGR T/H Benchmark and RELAP5-3D Validation Activities
These slides present a summary of the current status of the RELAP5-3D validation activities being performed based on the High Temperature Test Facility (HTTF) and the status of the corresponding HTGR T/H Benchmark
22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
Outcomes of WPEC SG47 on "Use of Shielding Integral Benchmark Archive and Database for Nuclear Data Validation"
The Working Party on International Nuclear Data Evaluation Co-operation Subgroup 47 (WPECSG47) entitled "Use of Shielding Integral Benchmark Archive and Database for Nuclear Data Validation" was organised from 2019 and 2022 with the objectives to promote more systematic and wider use of shielding benchmark experiments in nuclear data (ND) and transport code validation and development, to provide feedback on the Shielding Integral Benchmark Archive and Database (SINBAD), and to promote its further development in coordination with the Expert Group on Physics of Reactor Systems (EGPRS). Altogether 9 meetings, the large majority (8) held remotely, were organised during the past 3 years to discuss the experience on the use of SINBAD, evaluation of new benchmarks and improvements to be contributed to the database which was severely neglected and lacking maintenance over the past ← 10+ years. Several proposals for new or updated benchmark evaluation were presented and discussed, such as FNG copper, LLNL pulsed spheres, CIAE iron sphere, KFK 1977 gamma measurements, Rez Fe sphere, ASPIS, ORNL Oxygen broomstick, TIARA and others. Complementing the database with new features was also discussed, for example providing the nuclear data sensitivity profiles more systematically would facilitate and better guide the use of data. Information on the geometry, (radiation source) and materials available in CAD format is expected to allow an easier and less error prone reference for computational model preparation and a potential input to CAD based workflows. Inputs for various transport codes and other benchmark data from participants have been shared via the NEA GitLab which could hopefully in the future evolve and form a bases for critically checked and validated benchmark data. Future development of SINBAD will be monitored by EGPRS and the newly created SINBAD Task Force.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
Uniformly Ordered Binary Decision Algorithm for Benchmark Experiment Correlations in Whisper Validation
When performing a validation exercise for determining the upper subcritical limit of a nuclear criticality safety application, an analyst should select and perform a statistical analysis on a population of benchmark experiments that are neutronically similar to the application. The size of this population should be sufficiently large such that the statistical analysis has a high degree of confidence that the bias plus bias uncertainty (calculational margin) has been accurately quantified. A complication arises because many benchmark experiments share common components, leading to correlations in their measured effective multiplication factors. Correlations between benchmark experiments within the population reduces its predictive power. This motivates the need for methods that consider benchmark experiment correlations and ensure adequate statistical significance of results. The Whisper code is a statistical analysis pack- age that incorporates nuclear data sensitivity coefficients from MCNP to assess benchmark experiment similarity and then performs an extreme-value analysis to estimate the bias plus bias uncertainty. The original methodology in Whisper does not consider the effect of benchmark experiment correlations when making this estimation, and this summary proposes the uniformly ordered binary decision algorithm to address this shortcoming. The original methodology in Whisper computes similarity coefficients ck for an application compared to all benchmark experiments in its library and develops weighting factors for a selected population proportional to the ck values. The methodology can be interpreted as statistically emulating a validation exercise for a particular application where the weighting factors may be viewed as the likelihood that an analyst would include a particular benchmark experiment within the population. The effective sample size of the population is the expected or mean number of benchmark experiments in the population. The uniformly ordered binary decision algorithm identifies clusters of correlated benchmark experiments within the population and then computes adjusted weighting factors based on the magnitude of the correlation coefficients within the cluster to compute a reduced effective sample size accounting for the lower information content because of correlations. Benchmark experiments within the cluster are ordered randomly with equal probability and probabilistic decisions are made as to whether a benchmark. experiment within the cluster should treated as redundant with a previous one; if two redundant benchmark experiments are included, then the conservative worst case bias plus bias uncertainty is used and the pair is counted as a single benchmark experiment in the population. Results are provided for HEU solutions in a research version of the Whisper software using benchmark experiment correlations provided by DICE, the Database for the International Criticality Safety Benchmark Evaluation Project (ICSBEP). These show that there can be a significant increase in the bias plus bias uncertainty because the effective sample size is reduced, and therefore the algorithm, needing to meet sample size requirements, expands the benchmark experiment population by accepting less similar benchmark experiments that would have otherwise not been included.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
FORCE Development Status Update: Vertical Integration and Benchmarking of System Dynamics
Recent efforts to establish effective models for grid energy analysis, especially given the increase in variable renewable energy (VRE) sources and the economic challenges faced by traditional nuclear energy, have generated new technological considerations. One effort to improve the economic viability of nuclear power involves investigating integrated energy systems (IES) which include secondary energy systems that introduce flexibility and secondary market possibilities to existing and perceived future nuclear energy generation technologies. To analyze the technical and economic potential of IES, the Framework for Optimization of Resources and Economics (FORCE) tool suite was developed through a collaboration among national laboratories. Within the FORCE tool suite, the Holistic Energy Resource Optimization Network (HERON) provides algorithms for analyzing the long-term viability of potential IES technologies, while HYBRID provides algorithms and models to achieve high-resolution analysis of coupling physics over a short time period. Continued maturing of the FORCE tool suite requires further interconnections between the various tools in the suite in order to ensure consistent analysis. Analyses performed by applying HYBRID to transient process modeling should be easily harvestable as inputs to HERON analyses. The first item in this status update is a demonstration of an automated data pipeline for loading data from HYBRID into HERON analyses. Application of HYBRID results to HERON, as part of using the FORCE tool suite, relies on robust modeling assumptions for the various models included in HYBRID. The second result of this status update is the benchmarking and validation of cost and operational data, with a particular focus on natural gas energy generators. These generators are benchmarked with a focus on contrasting them with proposed thermal energy storage (TES) technologies.
29 ENERGY PLANNING, POLICY, AND ECONOMY↗
Verification and Validation Activities of Molten Salt Reactors Multiphysics Coupling Schemes at Idaho National Laboratory
This paper presents the latest verification and validation activities in molten salt reactor modeling and simulation performed at Idaho National Laboratory. Multiphysics solutions are obtained by coupling the neutronics code Griffin, the thermal hydraulics code Pronghorn, and the system analysis code SAM, under the MOOSE framework. We present various multiphysics coupling schemes with these codes for molten salt reactor problems and provide verification and validation results. First, we present verification test results of the Griffin-Pronghorn coupled scheme for the CNRS benchmark. Then validation test results are presented for the Griffin-SAM coupled scheme for the pump startup and coast down transients of the Molten Salt Reactor Experiment. Finally, the Griffin-Pronghorn-SAM coupled scheme is demonstrated for the Molten Salt Reactor Experiment reactivity insertion transient using a domain-overlapping coupling algorithm between Pronghorn and SAM. The results of these various coupling schemes demonstrate the ability to capture the effect of fuel flow and the various feedback mechanisms important to MSRs.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
Validation of New MCNP6.3 Features for Critical and Subcritical Benchmark Simulations [Slides]
A separate MCNP6.3 V&V document reports on all the default calculations for all test suites was introduced. Here, we look at new optional features of the MCNP6.3 code. Then, Fission-matrix-based options with Convergence and population testing and Automated acceleration of the fission source and Doppler Broadening Resonance Correction and HDF5 Particle Track Output (PTRAC) and Validation benchmarks: criticality, Rossi-α, and subcritical multiplication. All the new MCNP6.3 options give statistically equivalent results and should be considered for default usage in criticality and subcritical multiplication calculation work. Discussed are two separate papers at the upcoming 2023 International Conference on Nuclear Criticality Safety (ICNC 2023) that give more details on the results presented here.
97 MATHEMATICS AND COMPUTING↗
Monte Carlo neutronics benchmarks on nuclear fuel depletion: A review
Monte Carlo (MC) neutronics codes are used widely for academic and industrial needs. Several schemes of coupling MC neutronics code with isotope generation and depletion code exist, which are used for performing nuclear fuel depletion simulations. These simulations can estimate the inventory of isotopes in neutron irradiated nuclear reactor fuel. However, the accuracy of these simulations shall be validated through experiments. MC codes are seldom validated by isotopic benchmarks compared to criticality benchmarks. This work compiles and analyzes the fuel depletion benchmarks and validations used to analyze the performance of MC-based fuel depletion neutronics codes. Analyses of these benchmarks and validations showed that the computed concentrations of 133 Cs, 135 Cs, 137 Cs, 148 Nd, 239 Pu, 240 Pu, and 241 Pu in the irradiated fuel by the depletion codes agreed with the measured values within 10% error. However, the computed concentrations of 125 Sb, 242 Cm, 243 Cm, 244 Cm, 245 Cm, and 246 Cm had errors more than 15% compared to the measured values. As a result, Ventina depletion code showed the most accurate predictions for the greatest number of isotope concentrations compared to ORIGEN2 and CINDER90.
11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
The Verification and Validation of a Magnetic Plasma Fluid Model Utilizing the MOOSE (Multiphysics Object Oriented Simulation Environment) Framework
As the goal of achieving fusion power on the grid comes closer to fruition, fully coupled multiphysics models of fusion devices will be crucial. Currently, there are two main approaches to developing these platforms: (1) loosely coupled, where one couples existing codes and solvers together through input and output parameters and data, and (2) tightly coupled, where one develops the necessary models within a singular, integrated framework. This work focuses on the latter approach for magnetically confined fusion devices by developing a fluid-based plasma-edge model within the Multiphysics Object Oriented Simulation Environment (MOOSE) Framework. This effort is coordinated with other efforts to develop, test, demonstrate, and deploy fusion relevant multiphysics capabilities including electromagnetics, particle-in-cell plasma, tritium transport, and fusion blanket design. This new model is an expansion of the MOOSE-based plasma application, Zapdos, which was originally formulated to model low-temperature, non-magnetized plasma processes. Verification, benchmarking, and validation studies have been conducted. Verification studies involved utilizing the method of manufactured solutions and comparing the convergence slope of a known solution to the theoretical slope. Benchmarking consists of comparisons to existing edge codes, namely BOUT++ and SOLEDGE3X. Validation efforts focused on comparisons against open-source data from the TCV tokamak.
70 - PLASMA PHYSICS AND FUSION TECHNOLOGY↗
Initial steady-state core simulation capability or thermal and pool-type molten salt reactors, coupling reactor physics, thermal-hydraulics, and evolving chemistry
This report presents the development and validation of an initial steady-state multiphysics capability for molten salt reactors (MSRs) under the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program in Fiscal Year 2025. The framework integrates neutronics, thermal-hydraulics, species transport, and thermochemistry to capture the coupled dynamics of liquid-fueled systems. Implementation and testing were performed on two representative designs: the Molten Salt Reactor Experiment (MSRE), a thermal-spectrum, channeled-flow reactor, and the Lotus Molten Salt Reactor (L-MSR), a fast-spectrum, pool-type reactor. The modeling suite employs Griffin for reactor physics and depletion, Pronghorn and SAM for thermal-hydraulics, Thermochimica for chemistry, and Saline for thermophysical properties, with benchmarking and validation carried out against historical MSRE data, experimental flow-loop measurements, and reference depletion calculations from Monte Carlo codes. The framework demonstrated the ability to reproduce key reactor behaviors including temperature feedback, reactivity losses, delayed neutron precursor transport, xenon poisoning, and redox potential evolution. The results confirm the feasibility and accuracy of the coupled models in predicting steady-state and selected transient MSR behaviors. This latter ones are used in this report as a proxy indicating that the steady-state models from which the transient starts are accurate. For MSRE, validation showed good agreement with pump start-up and natural circulation tests, while for the L-MSR, benchmarking confirmed hydraulic calibration and consistency of neutronics–thermal coupling. The tools also provided new insights into species transport, noble metal deposition, and salt solidification dynamics. On the Xenon transport front, the code is validated against the steady state Xenon poisoining measurement and showed good agreement with the experimental value. Identified areas for future work include advanced void transport modeling, three-dimensional simulations, improved alloy corrosion models, and tighter integration with high-fidelity Monte Carlo codes. These developments provide a foundation for high-fidelity MSR simulations that can support reactor design optimization, safety assessments, and long-term operational strategies.
42 - ENGINEERING↗
Benchmark Specifications for Select Experiments Conducted at the Kansas State University Gallium Thermal-hydraulic Experiment Facility
The Department of Energy (DOE) – Nuclear Energy University Programs (NEUP) supported the creation and operation of the Gallium Thermal-hydraulic Experiment (GaTE) facility at Kansas State University (KSU) as part of a larger effort to understand thermal stratification behavior in liquid-metal-cooled reactors. GaTE was designed to simulate transients in a reactor plenum that are known to cause thermal stratification. High-reliability and high-resolution measurements describing stratification behavior in the coolant were collected for use as experimental benchmarks in validation efforts for computational models. The results of these tests contribute to a greater understanding of thermal stratification behavior of liquid metal under various configurations and operating conditions. This report provides a complete description of the benchmark problem, including all necessary details and description of a set of four forced flow and four natural circulation tests and measured data for comparison with model results.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
Applicability of the Sum-of-Fractions for Moderated Systems [Slides]
This presentation is for addressing the presence of multiple fissionable nuclides in a moderated system and validation with benchmarking gaps. The presentation finds: no instances of the use of the Sum-of-Fractions (SoF) method resulted in k eff values exceeding the calculational margin, when utilizing the SoF include all fissile nuclides, provides additional flexibility than 8.15 for mixtures, extend area of applicability by extending validation.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
Transfer learning-based soybean LAI estimations by integrating PROSAIL, UAV, and PlanetScope imagery
Accurate Leaf Area Index (LAI) estimations at the soybean plot scale is achievable using high-resolution Unmanned Aerial Vehicle (UAV) imagery and field measurement samples. However, the limited coverage of UAV flights restricts large-scale remote sensing monitoring in expansive soybean fields. This study leverages the broad coverage and 3-m resolution of PlanetScope satellite imagery to extend LAI prediction from UAV to satellite scales through transfer learning, using UAV-scale LAI estimates as a benchmark to validate cross-scale consistency. To address this challenge, this study proposed the LAI-TransNet, a two-stage transfer learning framework designed for precise and scalable soybean LAI prediction across large areas, demonstrating its effectiveness in cross-scale monitoring. In Stage 1, a UAV-scale benchmark is established using PROSAIL-simulated UAV reflectance data (UAV-Sim) and field-measured soybean LAI. Traditional machine learning, deep learning, and transfer learning models are trained on a hybrid UAV-Sim and field-measured dataset (UAV-Sim_Measured), with the transfer learning model CNN-TL, fine-tuned using pre-trained weights derived from UAV-Sim, achieving the highest accuracy (R 2 = 0.81, RMSE = 0.64 m 2 /m 2 , rRMSE = 11.5 %). In Stage 2, LAI-TransNet is developed by fine-tuning the CNN-TL model on PlanetScope simulated data (PS-Sim), preprocessed via cross-domain mapping to align UAV and satellite spectral features. Real PlanetScope imagery is corrected for reflectance consistency with reference to UAV imagery spectral profiles. LAI-TransNet outperforms other deep learning models trained directly on PS-Sim (R 2 = 0.69 vs. 0.60–0.63), ensuring robust cross-scale consistency. In conclusion, by bridging UAV and satellite scales, LAI-TransNet enables large-scale soybean LAI monitoring, enhancing precision agriculture management through improved monitoring with the PlanetScope imagery.
Leaf area index (LAI)↗
Verification and Validation of MFiX-PIC
This work is aimed at verification and validation (V&V) of particle-in-cell (PIC) approach in the National Energy Technology Laboratory’s (NETL) Multiphase Flow with Interphase eXchanges (MFiX-PIC) which was officially released in April 2019. Under verification, the results from MFiX-PIC are compared with exact or analytical solutions, while experimental results are used for benchmarking under validation. The test suite consists of the following cases: Terminal velocity. Particle advection in time-varying flow field. Particle settling in a dense medium. Evaporation. Rayleigh-Taylor instability. Minimum fluidization. Mini-circulating fluidized bed. The cases reported in a format consistent with the existing Verification and Validation Manual (Musser et al., 2018) explore a wide range of flow velocities and concentration regimes. Only one case considered in this work verifies the implementation of heat and mass transfer routines in MFiX-PIC, while a few other studies are currently underway to further expand the validation space in reacting flows. This study highlights the need for a rigorous analysis to objectively quantify the effect of model parameters. In addition, there is a scarcity of high-quality experimental data in the literature suitable for validating PIC methodology. Future efforts would include performing experiments which provide results for a valuable database. While designing such experiments, particle count should be significant to have sufficient particles per parcel while maintaining an optimal parcel to cell volume ratio. Also, datasets should have objectively assessed experimental uncertainty whereby confidence interval in those measurements become more explicit.
42 ENGINEERING↗
Generating Models of the Flattop Critical Assembly for Benchmark Experiments with Python
Los Alamos National Laboratory has been performing nuclear criticality experiments since 1946 at the Pajarito site, starting the Los Alamos Critical Experiments Facility in 1948. A transition period occurred between 2004 and 2011 as operations moved to the National Criticality Experiments Research Center (NCERC), where criticality experiments are now performed. Criticality experiments are essential for determination and verification of nuclear data used in calculations and modeling—such as radiation transport codes—throughout the industry, enhancing nuclear criticality safety. In addition to nuclear data validation and benchmarking, the remotely operated critical assemblies at NCERC are used for a variety of experiments and training classes supporting criticality safety.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗