Search NASA⌕ Search

SEARCH · Search NASA

Results for “benchmark and validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Benchmark Specification for Select Experiments Conducted at the University of Wisconsin-Madison Thermal Stratification Test Facility

The Department of Energy (DOE)-Nuclear Energy University Programs (NEUP) supported the creation and operation of the Thermal Stratification Test Facility (TSTF) at the University of Wisconsin Madison (UWM) as part of a larger effort to understand thermal stratification behavior in liquid-metal-cooled reactors. The TSTF was designed to simulate transients in a reactor plenum that are known to cause thermal stratification. High-reliability and high-resolution measurements of the flow and temperature were collected for use as experimental benchmarks to support validation efforts for computational models. The results of these tests contribute to the greater understanding of thermal stratification behavior of liquid sodium under various configurations and operating conditions. The six TSTF tests selected for benchmarking are a set of forced circulation tests at a fixed flow rate with different Upper Internal Structure (UIS) configurations in the test section (no UIS, solid UIS, and a UIS with flow area of 4, 8, 12, and 100%). This report provides a complete description of the benchmark problems, including all key test facility details, descriptions of each test condition, and measured data for comparison with modeled results.

42 ENGINEERING↗

Agentic Diagrammatica: Towards Autonomous Symbolic Computation in High Energy Physics

We present Diagrammatica, a symbolic computation extension to the HEPTAPOD agentic framework, which enables LLM agents to plan and execute multi-step theoretical calculations. Symbolic computation poses a distinctive reliability challenge for LLM agents, as correctness is governed by implicit mathematical conventions that are not encoded in a form that can be easily checked in the computational backend. We identify two complementary remedies, tool-constrained computation and targeted knowledge grounding, and pursue the first as the primary architecture. Concretely, we concentrate the agent's action distribution onto tool calls with convention-fixing semantics, in which the agent specifies a compact, human-auditable diagram specification and a trusted backend performs the symbolic or numerical manipulations exactly. The toolkit provides two complementary calculation paths consuming a shared diagram specification: Naive Dimensional Analysis (NDA) for order-of-magnitude rate estimates and Exact Diagrammatic Analysis (EDA) for tree-level symbolic calculations via automatic FeynCalc code generation, both supplemented by automatic Feynman diagram enumeration and a navigable theory knowledge base. The architecture is validated on two benchmarks: (1) an exhaustive catalog of all tree-level, single-vertex $1\to 2$ partial decay widths across scalar, fermion, and vector parents, with complete massless and threshold limits and Standard Model validation; and (2) an NDA sensitivity study of the muon decay multiplicity $μ^+ \to ν_μ\barν_e + n(e^+e^-) + e^-$, determining the maximum observable $n$ at current and planned muon experiments.

Menzo, Tony [Alabama U.; Fermilab] (ORCID:00000002↗

Evaluation of China Experimental Fast Reactor Start-up Tests (Final Report, Revision 1)

This report documents the results and observations on the Coordinated Research Project (CRP) of the International Atomic Energy Agency (IAEA) on “Neutronics Benchmark of CEFR Start-Up Tests.” The China Experimental Fast Reactor (CEFR) is a 65MWt sodium-cooled fast reactor with highly enriched uranium oxide fuel. The reactor achieved first criticality in 2010, and a series of start-up tests were conducted to measure various reactor physics parameters. In 2018, the IAEA launched the CRP for validation and qualification of member states' computation capabilities in the field of fast reactor simulation by utilizing the measured data in the CEFR start-up test. Twenty-nine international organizations from eighteen member countries, including Argonne National Laboratory, have participated in the CRP. The CEFR start-up tests offer a rare opportunity to validate U.S. nuclear engineering software because it is a well-specified benchmark with corresponding measurements for a recently built fast reactor starting up with a known fuel composition (fresh fuel). Previous fast reactor validation benchmarks frequently involve reactors that have already been started up and contain irradiated fuel that is difficult to characterize with high certainty.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

TEX-Hf Assemblies: Highly Enriched Uranium Plates with Hafnium Using Polyethylene Moderator and Polyethylene Reflector

This report documents the integral experiment evaluation and publication for IER-532 (TEX-Hf), Thermal/Epithermal eXperiments (TEX) with highly enriched uranium (HEU) fuel and hafnium (Hf), moderated and reflected by polyethylene. The design of TEX-Hf is a variation of IER-297 (TEX-HEU), with the inclusion of hafnium as a diluent material. The experiment and evaluation include seven configurations, all of which were acceptable as benchmark cases. These benchmark cases provide validation for hafnium in the thermal, intermediate, and fast neutron energy regimes by maximizing the sensitivity in k eff to the hafnium cross sections. The evaluation was reviewed and accepted by the International Criticality Safety Benchmark Evaluation Project (ICSBEP) Technical Review Group on April 17, 2024, and was submitted to the ICSBEP in August 2024 following subgroup approval.

42 ENGINEERING↗

Importance of inlet boundary conditions for numerical simulation of combustor flows

Fluid dynamic computer codes for the mathematical simulation of problems in gas turbine engine combustion systems are required as design and diagnostic tools. To eventually achieve a performance standard with these codes of more than qualitative accuracy it is desirable to use benchmark experiments for validation studies. Typical of the fluid dynamic computer codes being developed for combustor simulations is the TEACH (Teaching Elliptic Axisymmetric Characteristics Heuristically) solution procedure. It is difficult to find suitable experiments which satisfy the present definition of benchmark quality. For the majority of the available experiments there is a lack of information concerning the boundary conditions. A standard TEACH-type numerical technique is applied to a number of test-case experiments. It is found that numerical simulations of gas turbine combustor-relevant flows can be sensitive to the plane at which the calculations start and the spatial distributions of inlet quantities for swirling flows.

Sturgess, G. J.↗

Calculation of neutron flux spectra of the VVER-1000 mock-up shielding benchmark with Monte Carlo code MCS utilizing mesh-based weight window

The measurements of neutron spectra compiled inside the NEA-1517/82 package from the Shielding Integral Benchmark Archive and Database (SINBAD) are chosen as benchmark cases to validate the variance reduction technique based on weight window in Monte Carlo Code MCS. A full 3D model for fixed source mode calculation with hexagonal lattice source definition is developed to simulate total of 6 points of measurements at the vicinity of the reactor and the reactor pressure vessel region. A code/code comparison against MCNP6 code is first conducted as verification element for the mesh-based weight window capability in MCS. Finally, the validation results are presented against measurements. The verification against MCNP6 code gives good agreement in addition of the insight to the importance of user understanding to determine proper reference point and reference lower weight bound for scaling which is not required in MCS code due to its capability of automatic scaling. The comparison of neutron spectra between MCS and measurements shows good agreement within 3 standard deviations for all of six detector positions.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Benchmarks of simple, generic, shaped plates for validation of low-frequency electromagnetic computational codes

The validation of low-frequency measurements and electromagnetic (EM) scattering computations for several simple, generic shapes, such as an equilateral-triangular plate, an equilateral-triangular plate with a concentric equilateral-triangular hole, and diamond- and hexagonal-shaped plates, is discussed. The plates were constructed from a thin aluminum sheet with a thickness of 0.08 cm. EM scattering by the planar plates was measured in the experimental test range (ETR) facility of NASA Langley Research Center. The dimensions of the plates were selected such that, over the frequency range of interest, the dimensions were in the range of lambda0 to 3(lambda0). In addition, the triangular plate with a triangular hole was selected to study internal-hole resonances.

Deshpande, M. D.↗

Nuclide inventory validation: radiochemical assay data quality and modeling challenges in benchmark models development

Oak Ridge National Laboratory is conducting radiochemical assay experiments, using high-precision analytical protocols validated with a comprehensive quality assurance plan, to expand the nuclide inventory validation basis for high burnup spent nuclear fuel. Preliminary measurement data for key actinides and fission products in two pressurized water reactor spent fuel samples are being used to investigate the impact of measurement data uncertainty on the sample burnup estimation. These measurement data are also being used to examine the impact of assumptions applied when developing best-estimate computational models to simulate fuel irradiation history. The simulations are being performed using depletion capabilities in the SCALE code system. Comparison of calculated and measured nuclide concentrations shows good agreement for the considered nuclides. (authors)

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Quantitative Encapsulation and Homogeneity Assessment of Sol–Gel Based Nuclear Explosive Debris Simulants

Nuclear explosive debris simulants are an important material in training and validating aspects of post-detonation nuclear forensic processes. Realistic simulants should replicate several aspects of nuclear explosive debris such as the size, shape, color, density, and chemical and radiological properties. Silica particles produced via sol-gel synthesis have recently been found to successfully reproduce many of these parameters including the controllable incorporation of radionuclide content. However, to be useful as a benchmarking material for validation and verification of laboratory methodologies, radionuclide content from batch-to-batch must be reproducible. Here, in this work, we explore the variance in radionuclide distribution incorporated into sol-gel benchmarking materials with respect to sample subdivision. Results will help inform the sample sizes required to minimize variance between samples.

36 - MATERIALS SCIENCE↗

An Experimental Study of Characteristic Combustion-Driven Flow for CFD Validation

A series of uni-element rocket injector studies were completed to provide benchmark quality data needed to validate computational fluid dynamic models. A shear coaxial injector geometry was selected as the primary injector for study using gaseous hydrogen/oxygen and gaseous hydrogen/liquid oxygen propellants. Emphasis was placed on the use of nonintrusive diagnostic techniques to characterize the flowfields inside an optically-accessible rocket chamber. Measurements of the velocity and species fields were obtained using laser velocimetry and Raman spectroscopy, respectively. Qualitative flame shape information was also obtained using laser-induced fluorescence excited from OH radicals and laser light scattering studies of aluminum oxide particle seeded combusting flows. The gaseous hydrogen/liquid oxygen propellant studies for the shear coaxial injector focused on breakup mechanisms associated with the liquid oxygen jet under subcritical pressure conditions. Laser sheet illumination techniques were used to visualize the core region of the jet and a Phase Doppler Particle Analyzer was utilized for drop velocity, size and size distribution characterization. The results of these studies indicated that the shear coaxial geometry configuration was a relatively poor injector in terms of mixing. The oxygen core was observed to extend well downstream of the injector and a significant fraction of the mixing occurred in the near nozzle region where measurements were not possible to obtain. Detailed velocity and species measurements were obtained to allow CFD model validation and this set of benchmark data represents the most comprehensive data set available to date. As an extension of the investigation, a series of gas/gas injector studies were conducted in support of the X-33 Reusable Launch Vehicle program. A Gas/Gas Injector Technology team was formed consisting of the Marshall Space Flight Center, the NASA Lewis Research Center, Rocketdyne and Penn State. Injector geometries studied under this task included shear and swirl coaxial configurations as well as an impinging jet injector.

Santoro, Robert J.↗

An Experimental Study of Characteristic Combustion-Driven Flow for CFD Validation

A series of uni-element rocket injector studies were completed to provide benchmark quality data needed to validate computational fluid dynamic models. A shear coaxial injector geometry was selected as the primary injector for study using gaseous hydrogen/oxygen and gaseous hydrogen/liquid oxygen propellants. Emphasis was placed on the use of non-intrusive diagnostic techniques to characterize the flowfields inside an optically-accessible rocket chamber. Measurements of the velocity and species fields were obtained using laser velocimetry and Raman spectroscopy, respectively Qualitative flame shape information was also obtained using laser-induced fluorescence excited from OH radicals and laser light scattering studies of aluminum oxide particle seeded combusting flows. The gaseous hydrogen/liquid oxygen propellant studies for the shear coaxial injector focused on breakup mechanisms associated with the liquid oxygen jet under sub-critical pressure conditions. Laser sheet illumination techniques were used to visualize the core region of the jet and a Phase Doppler Particle Analyzer was utilized for drop velocity, size and size distribution characterization. The results of these studies indicated that the shear coaxial geometry configuration was a relatively poor injector in terms of mixing. The oxygen core was observed to extend well downstream of the injector and a significant fraction of the mixing occurred in the near nozzle region where measurements were not possible to obtain Detailed velocity and species measurements were obtained to allow CFD model validation and this set of benchmark data represents the most comprehensive data set available to date As an extension of the investigation, a series of gas/gas injector studies were conducted in support of the X-33 Reusable Launch Vehicle program. A Gas/Gas Injector Technology team was formed consisting of the Marshall Space Flight Center, the NASA Lewis Research Center, Rocketdyne and Penn State. Injector geometries studied under this task included shear and swirl coaxial configurations as well as an impinging jet injector.

Santoro, Robert J.↗

Verifying MCNP Models of the TEX High 240 Plutonium Benchmark

Computational modeling programs are invaluable tools that allow us to understand systems, safely develop new processes, and make reliable predictions about future designs. However, the effectiveness of these codes is limited by the degree to which their parameters match the real world. In the field of nuclear engineering, cross section data is one of these vital parameters. Accurate cross section data on important fissile and fissionable isotopes promotes the design of safer and more efficient fabrication, transportation, storage, and stockpiling of nuclear fuel. Unfortunately, there are knowledge gaps in data on key isotopes. In 2011, a multinational meeting hosted by the US Department of Energy Nuclear Criticality Safety Program ranked the priority of certain cross section data needs. In response, Lawrence Livermore National Lab (LLNL) designed the Thermal and Epithermal eXperiment (TEX) series of benchmark experiments. Benchmark experiments are used to validate current cross section data. They validate data by comparing the results of an actual experiment to the predicted results from a computational model. The data a benchmark applies to depends on the isotope and energy range the experiment’s neutron multiplication factor ( k eff ) is most sensitive to. The development and testing of the TEX High 240 Plutonium Benchmark will help validate 240 Pu cross section data. The configuration and materials of this benchmark are designed to be most sensitive to 240 Pu's intermediate energy range (from 0.625 ev to 100 keV ). MCNP® models of the assembly have been developed by LLNL and the results have been written in the final design report. In order for the discrepancies between benchmark models and experiments to be attributed to cross section inaccuracies, the accuracy of the models needs to be verified. The goal of this project is to verify of the results of LLNL's modeling by creating a new set of MCNP models and comparing the results.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Workshop on Addressing Rigor and Reproducibility in Thermal, Heterogeneous Catalysis

Heterogeneous catalysis has long served as the bedrock of the manufacturing of energy carriers, fuels and chemicals, and various technologies for pollution abatement. The significant complexity and variability spanning the entire breadth of catalyst material properties, synthesis methods, characterization techniques, and evaluation procedures, has focused attention on the need to establish community-accepted best practices for ensuring high-quality, benchmarked, and reproducible data. In addition, increased societal urgency to transition to clean energy and reduce greenhouse gas concentrations has incentivized interdisciplinary, convergent, and translational approaches to catalysis research in recent years. Research engineers and scientists with expertise cutting broadly across materials science, chemical synthesis, interfacial science, spectroscopy, and methods of data science and computational simulation, all bring diverse and important perspectives to catalysis research, but often with little awareness of the complexity of catalytic systems, especially in their working environment. As has already occurred in other scientific fields, there has been growing recognition and consensus in the heterogeneous catalysis research community that mechanisms are needed to improve the rigor and reproducibility (R&R) of experimental measurements, to ensure alignment of the broader research community with a common core of best practices specific to the realization of high-quality catalysis research. Similarly, the field is moving rapidly toward computationally informed and data science-driven catalyst design, but the success of implementing such predictive tools hinges on model training and validation rooted in rigorously obtained and reproducible experimental data that are benchmarked to common specifications. As such, this workshop was convened to prepare a report summarizing best practices for reporting data and performing experiments that researchers can use to benchmark, validate, and reproduce data in specific sub-fields of thermal, heterogeneous catalysis. Additionally, we discussed recommendations for future actions that may improve R&R in this field. The workshop organizers and participants include a diverse range of catalysis researchers from various employment sectors (e.g., academia, industry, national laboratory), institutional mission and resources (e.g., PhD-granting research universities, non-PhD-granting teaching universities), career stage (e.g., early, mid and late-career), technical expertise, and demographic background. This diverse group was involved in the discussion of workshop agenda items, writing this report, and discussing possible future action items for the community to consider, which helped ensure that a broad range of perspectives were captured in the description of the problems at hand and the creation of actionable solutions that may be effectively adopted by the diverse practitioners in catalysis research. Importantly, this group of workshop participants also included very early career researchers (e.g., senior PhD students, postdoctoral scholars) who will become the next generation of scientific leaders in various sectors, thus capturing emerging perspectives of newcomers to the field to shape its future while positively impacting the development of its future workforce. We envision that this effort will help advance the field of catalysis science by improving the rigor and reproducibility of experimental data collected by current researchers and future newcomers to the field, which is of broad importance to health and vitality of any scientific discipline. Therefore, best practices identified in this endeavor for thermal heterogeneous catalysis can be translated to such efforts in other areas of catalysis and other scientific fields involving the study of materials, and vice versa. We also envision this to be an ongoing effort, with future workshops that are convened to discuss issues of rigor and reproducibility on technical topics that were unable to be covered in this workshop due to its scope limitations, and as emerging methods and materials become more prevalent in the research community.

36 MATERIALS SCIENCE↗

Experimental validation of the mechanistic scale-up methodology of gas–solid spouted beds using radioactive particle tracking (RPT)

The very high-temperature reactors (VHTRs) are highly ranked among candidates of Generation IV of nuclear reactors due to their high efficiency, safety, the resistance to proliferation, and reliability. The VHTRs are preferentially fueled by Tristructural-isometric (TRISO) coated fuel particles which has fuel kernels of fissile material coated by four coating layers: a porous buffer pyrolysis carbon layer (buffer PyC), an inner dense pyrolysis carbon layer (IPyC), a silicon carbide layer (SiC) and an outer dense pyrolysis carbon layer (OPyC). The heart of the operation and safety of the VHTRs significantly depends on the reliability of the coating layers of TRISO particles to retain metallic and gaseous fission products within the particles. The technique used for coating TRISO particles are gas-solids spouted beds via chemical vapor deposition (CVD). Fabrication of high-quality low-defect TRISO fuel particles fuel at larger scale spouted beds is required to support the commercialization of the VHTRs. In this work, our new developed mechanistic scale-up methodology of gas-solids spouted beds based on matching the radial profile of gas-holdup has been demonstrated and validated using radioactive particle tracking (RPT). Two spouted beds of small and larger scales were used in the study. Three sets of conditions were carried out which include the conditions of the reference case in the large scale, conditions that provide similar gas holdup radial profile to that of the reference case and conditions that provided dissimilar gas holdup radial in the small-scale spouted beds. The results confirm the validation of the scale-up methodology in terms of the dimensionless values of the spout diameter, cumulative probability distribution of the solids particles penetration into the spout, fraction of cycle time in each region of the bed, the radial profiles of the dimensionless values of the root-mean-square particle velocities and solids eddy diffusivity. Finally, the results further advance the knowledge and understanding of the gas-solids spouted beds provide deeper insight into their solids dynamics and presenting important benchmarking data for validating computational fluid dynamics codes and models. At last, procedures are established for the implementation of the new scale-up methodology.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Development of a high fidelity model of the CROCUS experimental reactor

Measurements of scalar flux distributions with fine spatial and energy resolutions are needed to remedy one of the validation shortcomings of the novel neutronics full core solvers, such as MPACT and nTRACER. While a very detailed resolution of the flux can be calculated with such codes, only a limited experimental data set is available to check their accuracy. Such type of measurements are on-going at the zero power reactor CROCUS, operated at the Laboratory for Reactor Physics and System Behaviours of the EPFL, thanks to the development of advanced miniature neutron detection systems. This kind of experimental data would provide the community with a suitable benchmark for the validation of high fidelity neutronics solvers. In parallel, a multi-physics solver for steady-state and transient analysis of nuclear reactors, named GeN-Foam, has been developed. Based on the finite-volume OpenFOAM library, GeN-Foam provides us with enough flexibility to analyze non-conventional reactor geometries such as that of CROCUS. While CROCUS heterogeneities cannot be modeled by MPACT and nTRACER for the moment, GeN-Foam offers a unique opportunity to build a high fidelity model which mimics these codes' method to reach sub-pin simulation resolution. This document aims at describing the work achieved to get from the existing GeN-Foam model of the CROCUS reactor based on a structured mesh and using the neutron diffusion, the first high-fidelity model using discrete ordinates method as an approximation to neutron transport and an unstructured mesh for inter lattice water gap description and sub-pin heterogeneous modeling. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

On Integral Benchmarks for Resolving TSL Conflicts for ENDF/B-VIII.1 Release [Slides]

This presentation touches on polystyrene ORNL evaluation in TSL review process for ENDF/B-VIII.1. the presentation found excellent agreement with INS and transmission measurements. Additionally, PS and PE evaluations with different phonon spectra, similar total xs., calculate keff similarly. This presentation found for critical benchmarks. While extremely useful for validation of nuclear data at all energies, critical benchmarks are not the best tool to provide a definitive answer on conflicting TSLs. In conclusion this presentation found INS and transmission measurements need to be the basis of validation of TSLs.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Validating ENDF/B-VIII.1beta3 with LLNL Pulsed-Sphere Experiments and ICSBEP Benchmarks [Slides]

LPS experiments are not benchmarks but can provide valuable input. 22/1/24 LPS experiments are not benchmarks but can provide valuable input. LPS (run by Denise) help validate nuclear data up to 15 MeV. They test scattering and fission data. They have incomplete uncertainties from 2-8%. I take note when: (1) I see C/E differences above the peak and before late times => 20%. (2) Simulated results between libraries change by => 20% without a good explanation.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Gamma-ray Measurements from Neutron Pulsed Die-Away Experiments

Pulsed-neutron die-away experiments are a promising experimental method that complement criticality benchmarks for nuclear data validation. The experiments have several advantages that include compatibility with non-fissile material, low benchmark uncertainties, and high sensitivity to absorption and scattering cross sections. When validating thermal neutron scattering laws, small targets are desirable for their large sensitivity to the scattering cross section and angular distribution. Unfortunately, room return or scattering from a shielding box limits the use of the very small targets needed to maximize sensitivity to thermal scattering laws. To address this problem, we propose changing the observable of the experiment from leaked thermal neutrons to γ-rays produced by (n, γ) reactions in the target. If feasible, this change allows removal of the shielding box, achieving higher sensitivity to thermal neutron scattering laws. This study focuses on replicating benchmark pulsed-neutron die-away experiments with γ-rays. We compare the integral parameters with γ-rays to those obtained with neutrons. We also discuss experimental design choices such as detector placement, shielding, and the presence of Cd. The results show the integral parameter with γ-rays is sensitive to detector location with respect to the target when Cd shielding is present. In addition, while Pb shielding around the γ-ray detectors do not seem to affect the integral parameter, the presence of Cd shielding does and adds background γ-rays to the die-away curves making it difficult to calculate the integral parameter.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗