Search NASA⌕ Search

SEARCH · Search NASA

Results for “benchmark and validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

ExaAM: Metal additive manufacturing simulation at the fidelity of the microstructure

Additive manufacturing (AM), or 3D printing, of metals is transforming the fabrication of components, in part by dramatically expanding the design space, allowing optimization of shape and topology. However, although the physical processes involved in AM are similar to those of welding, a field with decades of experimental, modeling, simulation, and characterization experience, qualification of AM parts remains a challenge. The availability of exascale computational systems, particularly when combined with data-driven approaches such as machine learning, enables topology and shape optimization as well as accelerated qualification by providing process-aware, locally accurate microstructure and mechanical property models. We describe the physics components comprising the Exascale Additive Manufacturing simulation environment and report progress using highly resolved melt pool simulations to inform part-scale finite element thermomechanics simulations, drive microstructure evolution, and determine constitutive mechanical property relationships based on those microstructures using polycrystal plasticity. We report on implementation of these components for exascale computing architectures, as well as the multi-stage simulation workflow that provides a unique high-fidelity model of process–structure–property relationships for AM parts. In addition, we discuss verification and validation through collaboration with efforts such as AM-Bench, a set of benchmark test problems under development by a team led by the National Institute of Standards and Technology.

3D printing↗

Nek5000 developments in support of industry and the NRC

This year, the Nuclear Energy Advanced Modeling Simulation program (NEAMS) thermal-hydraulics verification and validation (V&V) work has focused in three areas of Nek5000 V&V-driven development. First, in a close collaborative effort with the U. S. Nuclear Regulatory Commission (NRC) staff, we have continued V&V efforts for the HYMERES-2 project using the OECD/NEA sponsored testing in the PSI PANDA facility. This year’s focus of ANL-NRC collaboration involves Nek5000 setups and validation for a range of problems relevant to and including the HYMERES-2 benchmark from PSI. The primary outcome of this year efforts is a more efficient geometry and inlet modeling simplification after a careful sensitivity study of the inlet profiles and pipe geometries. The resulting modeling choice of a short recycling/fully-developed turbulent inlet is within the experimental uncertainty estimate. This finding simplifies the next step of the cross-V&V HYMERES-2 project. In addition, the ANL team continue to provide assistance to the NRC staff in the form of Nek5000 application support in general and on the use of the HPC platforms of ALCF and INL in particular. This supports the NRC’s assessment of Nek5000 for use with the NRC Blue CRAB code suite. Second, we have implemented and tested more robust model of URANS, namely the k – τ model, a variant of the k-ω model, along with other improvements to RANS Nek5000 modeling in general. Because of its demonstrated robustness and stability, the k – τ model is the only RANS model that has been implemented in the new GPU version of the Nek5000 code, nekRS. Lastly, we report the initial implementation of Jacobian-free Newton Krylov approach to the direct Newton method for steady fluid solvers aimed at acceleration of RANS modeling and at IC improvement for LES campaigns. Also leveraging the Exascale Computing Project (ECP) ANL/CEED & SMR team’s software development effort to support NEAMS problems at large scale of the advanced computing architectures, NekRS, a GPU variant of Nek5000, built on top of kernels from libParanumal using OCCA for portability, has been successfully run on the full system of Summit (4608 nodes, 27648 GPUs).

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Neutron Absorber Plate Characterization Plan for Criticality Experiments Design [Slides]

The goal of this presentation is to show the feasibility of performing a critical experiment with a B 4 C/Aluminum alloy neutron absorber plate. The motivation of this experiment is to provide integral data on modern neutron absorber product “Boralcan” by Rio Tinto. In 2020, used in about 20% of spent fuel pools in the US, and in casks for storage and transportation in the US and in Europe. The added value of this experiment: Neutron absorber plate modeling method verification: homogeneous or not, a lot of potential savings by relaxing boron loading credit limits. No available critical benchmark involving Boralcan, other boron-related experiments are relatively old. Nuclear data validation for B, C, and Al in the form of B 4 C in Al matrix.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

TEAMER Technical Support of Ramboll's for Numerical Modeling of WECs to Support OES Task 10: Cooperative Research and Development (Final Report)

National Technology & Engineering Solutions of Sandia, LLC (NTESS) in collaboration with the National Renewable Energy Laboratory (NREL), and with guidance from Ramboll, will perform fluid dynamics simulations to support of The Ocean Energy Systems (OES) Energy Technology Collaboration Program Task 10 Wave Energy Converters (WEC) Modelling Verification and Validation effort. Specific numerical simulations include the fixed device wave impingement studies to benchmark the performance of simulation techniques against physical testing results.

16 TIDAL AND WAVE POWER↗

Exxon Mobil-NETL Testing of DAC Materials

This joint initiative is aimed at extending our understanding of real DAC testing conditions at the NETL DAC testbed facility. Of particular focus will be: • Small Scale testing of powdered and formulated materials (supplied by ExxonMobil) to evaluate various performance metrics under DAC process cycles • Pilot scale testing of formulated materials at larger scales ExxonMobil will work with NETL to shake down equipment, validate testing methods, and define best practices for data analysis. Three tasks are proposed: 1. Validation of multi-cycle test data on powdered and formulated materials to benchmark various performance metrics of these materials. 2. Steam regeneration of powdered samples at small scale to define baseline performance under commercially relevant conditions. 3. Pilot scale testing of larger formulated materials to test commercially relevant samples under actual process cycles.

36 MATERIALS SCIENCE↗

Pile Oscillator Evaluation for Flattop [Poster]

Useful method for high-precision measurements of integral cross section in various samples. The availability of benchmark-quality effective delayed neutron fraction (ßeff) values for nuclear data and code validation remains limited.

MCNP↗

Enabling the Broader Use of MOOSE for Nuclear Energy and Other Simulation

This Final Scientific and Technical Report summarizes work performed under the Phase IIA SBIR project “Enabling the Broader Use of MOOSE for Nuclear Energy and Other Simulation” (DE-SC0020906) from August 2023 through August 2025. The objective of the Phase IIA effort was to mature and harden capabilities developed during Phase II, with the goal of enabling practical interoperability between Coreform’s isogeometric analysis (IGA) technologies and the Multiphysics Object-Oriented Simulation Environment (MOOSE), while improving robustness, performance, and scalability for complex, nuclear-relevant geometries. Over the course of Phase IIA, the project established and validated an extraction-based interoperability pathway between Coreform tools and MOOSE. A combined mesh and matrix format was defined collaboratively with MOOSE developers and integrated into the solver, enabling standard MOOSE workflows to operate on data exported from Coreform’s IGA and Flex Representation Method (FRM) pipelines. Early demonstrations validated architectural compatibility using linear solid mechanics problems, while later efforts focused on benchmark testing and external use. By the end of the project period, engineers at BWXT were able to independently set up and execute a simulation using the Coreform–MOOSE workflow and provide direct feedback that informed further refinement. In parallel, substantial effort was devoted to improving the robustness of trimmed U-spline construction for complex CAD geometries. A growing test suite of nuclear-relevant models was compiled through collaboration with multiple stakeholders and used to drive extensive bug fixing and reliability improvements. These efforts resulted in improved robustness and performance, including the addition of fallback capabilities that enhance reliability when the underlying commercial CAD kernel fails. Performance-oriented work progressed later in the project, with the development and demonstration of methods to decompose complex geometries into structured subregions and updated data representations to support more efficient solver processing. Additionally, extensive enhancements to threadsafe parallel data structures and trimming operations established a foundation for scalable processing of large assemblies. Collaboration with Sandia National Laboratories on the SGM geometric modeling kernel advanced to a functioning interface test case, positioning the workflow for future kernel integration. Overall, the Phase IIA effort successfully transitioned the project from architectural proof-of-concept to externally exercised, solver-integrated capability, while clarifying remaining technical challenges related to standardization, performance optimization, and kernel integration.

42 ENGINEERING↗

Benchmarking near-term quantum devices with the variational quantum eigensolver and the Lipkin-Meshkov-Glick model

The variational quantum eigensolver is a promising algorithm for noisy intermediate scale quantum (NISQ) computation. Verification and validation of NISQ algorithms' performance on NISQ devices is an important task. Here, we consider the exactly diagonalizable Lipkin-Meshkov-Glick (LMG) model as a candidate for benchmarking NISQ computers. We use the Bethe Ansatz to construct eigenstates of the trigonometric LMG model using quantum circuits inspired by the LMG's underlying algebraic structure. We construct circuits with depth $\mathcal{O}$(N) and $\mathcal{O}$(log 2 N) that can prepare any trigonometric LMG eigenstate of N particles. The number of gates required for both circuits is $\mathcal{O}$(N). The energies of the eigenstates can then be measured and compared to the exactly known answers.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Benchmark for Fuel Shuffling and Depletion for Pebble-Bed Reactors

Pebble bed reactors have specific operational characteristics when their fuel-cycle and fueling operations are considered. They are specifically distinguished by other type of nuclear reactor designs by their online fuel recycling scheme, where the fuel elements that have not yet reached discharge burnup can be reloaded and recycled continuously during normal operation. The fuel in a pebble bed reactor is not stationary and stochastically moves through the core once or several times during its lifetime, which allows them to operate without requiring a large excess reactivity hold for the burnup. However, this characteristic of pebble bed reactors introduces challenges in simulation, as each pebble can take many different trajectories through the core, its composition depends on the details of the irradiation history that is unique to its aggregated path through the core. For predicting the safety performance characteristics, such as source term, maximum fuel temperatures and fuel failure rates, etc., it is important to accurately incorporate the movement of pebbles through the core during their lifetime in a multi-physics simulation together with other phenomena. The equilibrium core analysis for pebble bed reactors are performed with multi-physics tools including fuel depletion in a multi pass reload coupled to the fuel movement. Currently, there are only a few legacy multi-physics simulation tools that can implement the pebble flow characteristics and perform equilibrium core analysis for pebble bed reactors. However, there are development efforts on-going under Department of Energy's Nuclear Energy Advanced Modelling and Simulation program and also in private industry for including these capabilities into their modelling and simulation tools. Any new development in the modelling and simulation tools needs to be validated by using tools such as experiments, analytical solutions or code-to-code benchmarks. In this work, a code-to-code benchmark for the equilibrium core analysis capability of pebble bed reactors was developed. Multiple cases were identified to capture different fuel cycle strategies that can be used in PBRs. The results of each case are presented in terms of overall equilibrium core characteristics: the discharge burnup; spatial burnup distribution; spatial isotopic distributions; axial and radial neutron flux distributions and power history of fuel elements per pass through the core for both a prototypical pebble bed High Temperature Gas-cooled Reactor and a prototypical pebble bed Fluoride-salt cooled High temperature Reactor.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Progress Report on Model Development for Aerosol Transport through Divergent Cracks Paths

This report summarizes the progress in developing a phenomenological model of aerosol transport, deposition, and plugging through microchannels. The purpose of this effort is to introduce to a user community—involving researchers, regulators, and industry—a generic, reliable numerical model for the prediction of aerosol transport while accounting for potential deposition and plugging of the leak paths to model spent nuclear fuel (SNF) release from postulated Stress Corrosion Cracks in canisters under storage or transportation. Current work focuses on expanding the model to predict aerosol (and gas) flow through complex microchannel (nozzle) geometries in addition to the rectangular and cylindrical geometries, as we approach more realistic Stress Corrosion Crack conditions. In this regard, a divergent nozzle geometry, used at Sandia National Laboratories (SNL) for testing aerosol release and retention (Durbin et al. 2021), was added to the model. The model was then validated with blowdown data for the particular microchannel, from experiments conducted at SNL. The report also presents preliminary non-benchmarked aerosol penetration fraction and mass flow rate for a monodisperse 10-micron (AED) particle concentration of 1.7e-08 kg/m 3 being released through the divergent microchannel geometry from the SNL’s aerosol experimental tank setup.Future work will involve validating the aerosol model and updating the model’s Graphical User Interface (GUI) to include the divergent nozzle geometry. This is expected to help stakeholders perform quick and easy first principles calculations without needing to understand the underlying MATLAB script.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Modeling Approach to Critical in the Upcoming CERBERUS Experiment

The planned Critical Experiment Reflected By coppEr to betteR Understand Scattering (CERBERUS) seeks to maximize sensitivity to elastic neutron scattering in the intermediate energy region (0.625 eV to 100 keV). It will be performed near the end of FY 2023 at the National Criticality Experiments Research Center (NCERC). Very few International Criticality Safety Benchmark Evaluation Project (ICSBEP) benchmarks are sensitive to copper in this region. Creating a benchmark sensitive in this area will make the Zeus benchmark series, an intermediate benchmark evaluation that uses a copper reflector, more useful for code and nuclear data validation. Approaching criticality in a safe manner is of utmost importance to avoid a criticality accident, which would present a safety concern and could cause damage to equipment. The two rules that are followed closely to ensure that a criticality accident does not occur are the 3/4 rule and the 1/2 rule. The 3/4 rule states that no more than 3/4 of a critical mass can be assembled by hand, and the 1/2 rule states that no more than 1/2 of the material expected to reach criticality, or 1/2 the distance needed to reach criticality, can be added before another measurement of the count rate has been taken. This work will discuss the approach to criticality as modeled in MCNP6® 1 particle transport code with the ENDF/B- VIII.0 cross-section library and the .00c data library.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Heterogeneous Multi-Domain Dataset Synthesis to Facilitate Privacy and Risk Assessments in Smart City IoT

The emergence of the Smart Cities paradigm and the rapid expansion and integration of Internet of Things (IoT) technologies within this context have created unprecedented opportunities for high-resolution behavioral analytics, urban optimization, and context-aware services. However, this same proliferation intensifies privacy risks, particularly those arising from cross-modal data linkage across heterogeneous sensing platforms. To address these challenges, this paper introduces a comprehensive, statistically grounded framework for generating synthetic, multimodal IoT datasets tailored to Smart City research. The framework produces behaviorally plausible synthetic data suitable for preliminary privacy risk assessment and as a benchmark for future re-identification studies, as well as for evaluating algorithms in mobility modeling, urban informatics, and privacy-enhancing technologies. As part of our approach, we formalize probabilistic methods for synthesizing three heterogeneous and operationally relevant data streams—cellular mobility traces, payment terminal transaction logs, and Smart Retail nutrition records—capturing the behaviors of a large number of synthetically generated urban residents over a 12-week period. The framework integrates spatially explicit merchant selection using K-Dimensional (KD)-tree nearest-neighbor algorithms, temporally correlated anchor-based mobility simulation reflective of daily urban rhythms, and dietary-constraint filtering to preserve ecological validity in consumption patterns. In total, the system generates approximately 116 million mobility pings, 5.4 million transactions, and 1.9 million itemized purchases, yielding a reproducible benchmark for evaluating multimodal analytics, privacy-preserving computation, and secure IoT data-sharing protocols. To show the validity of this dataset, the underlying distributions of these residents were successfully validated against reported distributions in published research. We present preliminary uniqueness and cross-modal linkage indicators; comprehensive re-identification benchmarking against specific attack algorithms is planned as future work. This framework can be easily adapted to various scenarios of interest in Smart Cities and other IoT applications. By aligning methodological rigor with the operational needs of Smart City ecosystems, this work fills critical gaps in synthetic data generation for privacy-sensitive domains, including intelligent transportation systems, urban health informatics, and next-generation digital commerce infrastructures.

IoT↗

Procedure for Creating, Reviewing, and Submitting Input Files into the Benchmark Library

Los Alamos National Laboratory (LANL) has a number of criticality benchmark input files, modeled for use with MCNP, developed and maintained by various organizations including the Nuclear Criticality Safety (NCS) Division, XCP-3, and XCP-5. The purpose of this procedure is to standardize input file creation, review, and maintenance. This procedure incorporates existing practices used by IRSN as documented in the original report and the translation from French in addition to practices used by the LANL NCS Division as documented in. The report relates to input files used for the validation of the continuous energy Monte Carlo code MCNP6 but is general enough to be extended to other codes. This report describes the procedure on how to prepare and use benchmarks (taken mainly from the ICSBEP Handbook) for the validation of calculation routes. In particular, this report describes the procedure to follow in the creation of the input files and their integration in the experimental validation databases.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Experiment Design and Preparation for a Shielding Benchmark Utilizing Godiva-IV

An experiment is currently being designed to provide a high-quality shielding benchmark for Criticality Accident Alarm System (CAAS) modeling. Previous benchmarks have suffered from uncertainty primarily due to two factors. The first factor is radiation that is not directly coming from the source, also known as room return. Room return is notoriously difficult to account for in experimental data and to model in benchmarks. The second factor is uncertainty associated with the source term itself. In order to reduce these two sources of uncertainty, this experiment will utilize a room return shield [1] that will reduce the effect of room return and previous work performed to ensure the reproducibility of the source term. The experiment will use the Godiva IV [2] assembly located at the National Criticality Experiments Research Center (NCERC) to provide a neutron source representative of a criticality accident. Previous experiments [3]-[4] have shown that Godiva IV is capable of producing both bursts and steady-state emissions of equal magnitude which will allow for reduced uncertainty in the source term. The room return shield will house and isolate the shielding samples, neutron activation foils, and other detectors. Data collected will provide a comparison of the neutron and gamma dose for shielded and unshielded configurations. This data will be used to validate shielding data used for modeling criticality accident alarm systems. Shielding samples included in this benchmark are C, Fe, NaCl, Pb, high density polyethylene, and SiO 2 . This paper details the design of the room return shield, the experimental plan, challenges, and mitigation strategies.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Assessing and benchmarking the fidelity of posterior inference methods for astrophysics data analysis

In this era of large and complex astronomical survey data, interpreting, validating, and comparing inference techniques becomes increasingly difficult. This is particularly critical for emerging inference methods like Simulation-Based Inference (SBI), which offer significant speedup potential and posterior modeling flexibility, especially when deep learning is incorporated. We present a study to assess and compare the performance and uncertainty prediction capability of Bayesian inference algorithms – from traditional MCMC sampling of analytic functions to deep learning-enabled SBI. We focus on testing the capacity of hierarchical inference modeling in those scenarios. Before we extend this study to cosmology, we first use astrophysical simulation data to ensure interpretability. We demonstrate a probabilistic programming implementation of hierarchical and non-hierarchical Bayesian inference using simulations derived from the DeepBench software library, a benchmarking tool developed by our group that generates simple and controllable astrophysical objects from first principles. This study will enable astronomers and physicists to harness the inference potential of these methods with confidence.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Transport in Stochastic Media with Random Chord Length Distributions

Thermal radiation transport computations in binary Markovian random mixtures rely almost exclusively on the Levermore-Pomraning (LP) model which is obtained by applying a heuristic closure to the ensemble averaged random medium transport equation. The validity of this model has been extensively tested by comparing numerical results over a broad parameter range (material types and mixing parameters) against benchmark solutions in planar geometry. The conditions under which the LP-model provides useful results and when it breaks down are now well established, but work to date has been largely restricted to homogeneous mixing statistics, i.e., the mean chord lengths of both materials are taken to be spatially constant. In recent work, this limitation was relaxed by allowing the mean chord lengths and, in a consistent fashion, the volume fractions in the LP-model to vary spatially and in a follow-up investigation benchmark solutions were obtained by ensemble averaging results over material realizations sampled from a nonhomogeneous Poisson process (NHPP). Numerical experiments in rod geometry with specifically linear and quadratic spatial dependence of chord lengths showed that the material averaged radiation intensities vary nonmonotonically with depth into the medium, in stark contrast to solutions obtained assuming uniform chord lengths. Moreover, depending on the local optical thickness and strength of scattering, the LP-model results showed locally more nuanced deviations from the benchmark solutions than was the case with constant chord lengths. These limited numerical investigations highlight the nontrivial qualitative and quantitative consequences of nonhomogeneous mixing statistics, in particular that closure approximations may not be uniformly valid or invalid over the problem domain.

42 ENGINEERING↗

Jemima Plate Characterization

The HEU Jemima plates have been utilized in numerous International Criticality Safety Benchmark Evaluation Project (ICSBEP) evaluations. ICSBEP evaluations are a vital com ponent of nuclear data validation for applications across the nuclear community. In the past, different combinations of mass, caliper measurements, and drawing dimensions have been used to define the HEU Jemima plates in ICSBEP evaluations. Some of these combinations result in large density ranges (17 g/cm 3 to 19 g/cm 3 ) or unrealistic densities (greater than 19 g/cm 3 ). Additionally, oxidation of the plates has led to questioning the flatness of each plate, which can add additional gaps in experiment configurations. This work proposes a standardized method of defining the commonly used HEU Jemima plates across different experiments.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

ENDF/B-VIII.1 Validation (Preliminary Release 2 + New 239 Pu)

This document should serve as a reference for validation testing of nuclear data files included in the second preliminary release of ENDF/B-VIII.1 and the newly evaluated 239 Pu nuclear data file to be included in the third preliminary release of ENDF/B-VIII.1. Experiment names listed in this report are based on International Criticality Safety Benchmark Evaluation Project (ICSBEP) Handbook designations. Additional information on ICSBEP handbook designations can be found at https://www.oecd-nea.org/jcms/pl_20291/icsbep-handbook. The validation metrics used in this report include the effective neutron multiplication factor, k eff , and tritium production. All validation metrics were calculated using the radiation transport code Monte Carlo N-Particle (MCNP).

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗