Search NASA⌕ Search

SEARCH · Search NASA

Results for “benchmark and validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

AGR 1 and 2 Isotopic Depletion Validation

This presentation includes work performed developing a computational benchmark for the AGR 1 and 2 experiments. These experiments involve irradiation of TRISO particle compact in the Advanced Test Reactor (ATR). Many post-irradiation measurements were made from these experiments, including isotopic concentrations of fission products. The benchmark involves a MCNP-ORIGEN coupled model of the ATR and AGR experiment capsules to calculate a comprehensive inventory of fission product and actinide concentrations in the compacts. This presentation describes the experiments, the measurements obtained, the benchmark model, and results of the model evaluation.

97 - MATHEMATICS AND COMPUTING↗

A fully ro-vibrationally resolved corona model for the molecular hydrogen Fulcher-𝛼 system

A ro-vibrationally resolved corona model for the molecular hydrogen Fulcher-𝛼 transition based on the Yacora solver is introduced. The model couples 1365 ro-vibrational levels of the 𝑋 1 ⁢𝛴$^+_𝑔$, 𝑑 3⁢ 𝛱 𝑢 and 𝑎 3 ⁢𝛴$^+_𝑔$ states via electron impact excitation from the ground state into the 𝑑 3⁢ 𝛱 𝑢 state and subsequent spontaneous emission into the 𝑎 3 ⁢𝛴$+_𝑔$ state. For the process of electron impact excitation a set of 45260 fully ro-vibrationally resolved cross sections calculated with the molecular convergent close-coupling (MCCC) method in the adiabatic-nuclei formulation is applied. The MCCC cross sections are compared with results of a scaling method used in other works, demonstrating the need for dedicated ro-vibrationally resolved cross sections. By post-processing the model output, entire Fulcher spectra can be simulated. These spectra are benchmarked with measurements from an inductively coupled plasma discharge at a pressure between 1.1–10 Pa and a RF power of 700 W. The model results agree very well with the experiment both in relative shape and in absolute value. A non-ro-vibrationally resolved, purely electronically resolved collisional radiative model for molecular hydrogen (including further states and reaction channels) is applied to investigate the validity of the corona approximation for the benchmark plasmas and the relevance of possible process extensions of the corona model. Furthermore, the influence of collisional quenching, autoionization and predissociation is discussed.

74 ATOMIC AND MOLECULAR PHYSICS↗

Generation of group constants at GRS for the Rostov-2 benchmark

The OECD/NEA benchmark entitled 'Reactivity compensation of boron dilution by stepwise insertion of control rod cluster into the VVER-1000 core' aims at validating and assessing high fidelity multi-physics simulation code capabilities by comparison with the high-quality measurements performed at the nuclear power plant Rostov unit 2. The benchmark is divided into 2 phases: assembly wise and pin-by-pin resolution of the multi-physics problems. Multi-physics simulation requires the generation of an accurate parametrized few-group cross-section library, and so this benchmark offers an opportunity to validate the methodology for their generation. Based on the specifications of the benchmark, the core simulator KMACS developed at GRS was used to generate a library of cross-sections as well as the burnup distribution required to model the transient scenario of the benchmark at the assembly level. The assessment of the library is performed through comparison with measured values obtained at the initial state of the transient. Good agreement was obtained in terms of critical boron concentration, peaking factors and power profiles. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Integral Experiment Final Design for Thermal/Epithermal eXperiments (TEX) using Highly Enriched Uranium with Polyethylene at Low Temperature (IER-479 CED-2 Report)

The goal of IER-479 is to design uranium critical experiments that can be used to validate low temperature cross sections and criticality safety analyses over multiple neutron energy regimes. Currently, there are no benchmarks in the International Criticality Safety Benchmark Evaluation Project (ICSBEP) handbook at temperatures lower than room temperature (International Criticality Safety Benchmark Evaluation Project Handbook, 2019). However, there are many needs for validation of criticality safety analysis at lower temperatures, including meeting transportation requirements and operations conducted outside or in unheated facilities. Additionally, NCSP has funded North Carolina State (NCSU) to generate new thermal scattering laws, including at lower temperatures, and the lack of integral benchmarks impedes data testing of these new cross sections. To address these needs, this report will present a critical experiment design covering various fission energy regimes with a goal temperature of -40°C (-40°F), which is based on the lower bound of expected non-cryogenic operational temperatures. The goal of the U.S. Nuclear Criticality Safety Program’s (NCSP) Thermal/Epithermal eXperiments (TEX) is to design and conduct new critical experiments to address high priority nuclear data needs from the nuclear criticality safety and nuclear data communities. The TEX program includes two series of baseline experimental configurations, one based on plutonium fuel (plutonium-aluminum Zero Power Physics Reactor (ZPPR) plates) and the other based on uranium fuel (highly enriched uranium (HEU) plates), that are moderated with varying thickness of polyethylene to create assemblies which span the thermal, intermediate, and fast fission energy regimes. The configurations are designed to be easily modified (for example, to add diluent materials of interest) to allow for efficient generation of additional benchmark configurations and allow for added nuclear data testing utility when comparing modified configurations to baseline configurations. The goal of IER-479 is to use the TEX-HEU concept (stack of HEU plates and polyethylene moderators) to design a critical experiment that can be used to validate low temperature cross sections and criticality safety analyses.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Expanded Validation of Uranium Systems with the KENO Monte Carlo Codes and SCALE 6.2.4

The development of accident-tolerant fuel and advanced reactors fueled with high-assay low-enriched uranium has created an increased focus on systems with uranium enrichments between 5 and 20 wt % 235 U. SCALE criticality safety validation reports generated at Oak Ridge National Laboratory contain very few benchmark experiments in this range. The work presented herein is an initial investigation of expanded validation of the entire range of enrichments for uranium-fueled systems, including consideration of over 300 newly developed KENO models. The vast majority of the new models are between 4.4 wt % and 37.5 wt % enrichment and include a variety of thermal, intermediate, and mixed neutron spectra. This work finds no strong evidence of an enrichment-dependent bias, but there are indications of a spectrum-dependent bias. There are, however, only a limited number of independent experiments included at this time to distinguish intermediate enrichment effects from intermediate spectrum effects. Further work in this area is ongoing for intermediate enrichment systems. In the long run, the addition of these models to the Verified, Archived Library and Inputs and Data is planned, as funding and staff availability allow.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Validation of Numerical Tools for Calculating Reactivity Feedback in Sodium Fast Reactors Using SEFOR Experimental Data

The Southwest Experimental Fast Oxide Reactor (SEFOR) was an experimental sodium-cooled fast breeder reactor operated from 1969 to 1972 with experiments designed to measure Doppler reactivity feedback in a wide temperature range from around 350 °F to temperatures approaching the melting point of mixed oxide fuel of around 5000 °F, providing valuable data for code validations. Co-supported by the Department of Energy (DOE) Fast Reactor Program (FRP) and the DOE Nuclear Energy Advanced Modeling and Simulation (NEAMS) program, the SEFOR benchmark project focused on using the experimental data to validate numerical tools that are used in industry and academia to design and license sodium-cooled fast reactors (SFRs). By the end of FY-25, substantial progress was achieved in the SEFOR benchmark study. A variety of numerical tools commonly used for modeling SFRs were applied to develop models for SEFOR core configurations I-D, I-E, I-I, and I-J. These included Monte Carlo codes such as MCNP, Serpent, and Shift; deterministic codes such as the legacy Argonne Reactor Computation (ARC) suite and the high-fidelity NEAMS code Griffin; and the system analysis code SAS4A/SASSYS-1 (SAS). Using these models, both SEFOR zero-power experiments and power-ascending tests were successfully simulated. Comparisons were performed against experimental measurements of core criticalities, reflector worth, kinetics parameters (Λ/βeff), isothermal reactivity feedback (from 350 °F to 760 °F at zero power), and power-ascending reactivity feedback (as power increased from 0.4 MW to 17 MW). In general, these comparisons demonstrated very good agreement between numerical results and experimental data. In Fiscal Year 26 (FY-26), the SEFOR benchmark project will continue to address the modeling issues identified in FY-25. Effort will focus on the simulation of reactivity insertion transients in SEFOR core II using the ARC/SAS model. Future work will also focus on incorporating BISON into the SEFOR core modeling process to enable the first Multiphysics simulations of the isothermal tests based on the MOOSE framework.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Contribution to the IRPHEP handbook since Physor 2018

The Organisation for Economic Co-operation and Development (OECD), the Nuclear Energy Agency (NEA), the International Reactor Physics Experiment Evaluation Project (IRPhEP) continue to preserve and evaluate integral reactor physics experiment data to support nuclear energy and technology needs. International contributions are collated within the International Handbook of Evaluated Reactor Physics Benchmark Experiments (IRPhEP Handbook). The 2021 edition of the IRPhEP Handbook now contains data for 57 unique nuclear facilities with benchmark specifications for 169 experimental series, of which four are draft evaluations. Distributed with the IRPhEP Handbook and available online is the IRPhEP Database and Analysis Tool (IDAT), allowing users to search and interrogate the data. Since Physor 2018, there have been 11 minor revisions to existing benchmark evaluations, significant revisions to two evaluations, one draft evaluation, and nine new evaluations. The corona virus pandemic has delayed international activities supporting the production of additional content for the IRPhEP Handbook. However, efforts continue for numerous endeavors to complete new reactor physics benchmark evaluations to support current and future validation needs. Those interested in serving as evaluators and/or reviewers are strongly encouraged to participate. This paper provides a summary of IRPhEP content and activities since Physor 2018. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Validation of SAS4A/SASSYS-1 for predicting steady-state single-phase natural circulation

The validation of system analysis codes for nuclear reactor systems is required for the development and application of these computational tools. Designed as a comprehensive system analysis code for advanced nuclear reactors, SAS4A/SASSYS-1 requires validation of its physics model for capturing single-phase natural circulation behavior. To support the validation of SAS4A/SASSYS-1, high-precision experiments are performed capturing steady-state single-phase natural circulation on a scaled facility with comprehensive instrumentation. In this work, dedicated tests are performed quantifying the critical modeling parameters, and a single-phase natural circulation benchmark dataset is obtained with well-documented uncertainty and comprehensive facility description. The validation is then performed against the dataset examining the capability of SAS4A/SASSYS-1 in simulating steady-state single-phase natural circulation. The experimental facility is modeled in the candidate code. Solution verification is performed using Richardson-extrapolation-based estimators which quantify and restrict numerical errors from discretization. Input uncertainty provided by the benchmark dataset is forward propagated through the candidate code, quantifying the output uncertainty in a Monte Carlo approach. The composition of the output uncertainty is also quantified through a variance-based sensitivity analysis. With the uncertainty quantified for each individual condition, a detailed comparison between the simulation results and experimental data is performed covering the whole dataset. The results show consistent agreement for all primary parameters. The current validation activity provides a valuable benchmark dataset for the validation of system analysis codes in capturing single-phase natural circulation and demonstrates satisfactory prediction capability of SAS4A/SASSYS1 for steady-state single-phase natural circulation.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Preliminary verification of the MCNP perturbation and fixed-source tally sensitivity tools

Integral benchmark experiments are vital in the adjustment and validation of the nuclear data that govern predictive simulations across the nuclear community. The nuclear data sensitivity capabilities of the Monte Carlo N-Particle (MCNP ®) transport code are currently limited; however, expanding sensitivity capabilities will allow benchmark experiments to be designed to resolve compensating errors and adjust nuclear data where previously prohibitively difficult. This paper provides details of a preliminary verification for the use of (i.) the recently revised perturbation and (ii.) developmental fixed-source sensitivity tools within MCNP to calculate sensitivities of tallied responses (such as current integrated over a surface, F1, and flux averaged over a cell, F4) to nuclear data in fixed-source simulations. Energy-binned and energy-integrated sensitivities calculated with these tools are compared against sensitivities calculated using a central-difference approximation. Here, the verification is completed for four configurations of a benchmarked system using a 4.5-kg plutonium sphere surrounded by varying amounts of copper and/or polyethylene. The results show that sensitivities calculated with the perturbation and fixed-source sensitivity tools agree with the central-difference-based approach.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Simulation of mineral dissolution at the pore scale with evolving fluid-solid interfaces: review of approaches and benchmark problem set

This manuscript presents a benchmark problem for the simulation of single-phase flow, reactive transport, and solid geometry evolution at the pore scale. The problem is organized in three parts that focus on specific aspects: flow and reactive transport (part I), dissolution-driven geometry evolution in two dimensions (part II), and an experimental validation of three-dimensional dissolution-driven geometry evolution (part III). Five codes are used to obtain the solution to this benchmark problem, including Chombo-Crunch, OpenFOAM-DBS, a lattice Boltzman code, Vortex, and dissolFoam. These codes cover a good portion of the wide range of approaches typically employed for solving pore-scale problems in the literature, including discretization methods, characterization of the fluid-solid interfaces, and methods to move these interfaces as a result of fluid-solid reactions. A short review of these approaches is given in relation to selected published studies. Results from the simulations performed by the five codes show remarkable agreement both quantitatively--based on upscaled parameters such as surface area, solid volume, and effective reaction rate--and qualitatively--based on comparisons of shape evolution. This outcome is especially notable given the disparity of approaches used by the codes. Therefore, these results establish a strong benchmark for the validation and testing of pore-scale codes developed for the simulation of flow and reactive transport with evolving geometries. They also underscore the significant advances seen in the last decade in tools and approaches for simulating this type of problem.

58 GEOSCIENCES↗

BuildingQA: A Benchmark for Natural Language Question Answering over Building Knowledge Graphs

Graph-based representations of building metadata using ontologies like Brick are vital for smart building applications, but querying them remains a challenge for practitioners. Knowledge Graph Question Answering (KGQA) systems, meant to retrieve answers from natural language questions, traditionally require large-scale training data, making them ill-suited for the specialized and data-scarce building domain. The advent of Large Language Models (LLMs) offers a paradigm shift, enabling zero-shot natural language querying without building/domain-specific training. Yet, there is no standardized benchmark for building-specific KGQA which can guide and validate research in this area. To address this gap, our work makes three primary contributions. First, we introduce the BuildingQA Benchmark Dataset, constructed through a multi-stage process of collecting practitioner data, augmenting it with LLMs for linguistic diversity, and curating a final set of 188 questions across 4 buildings. Second, we characterize the benchmark's complexity and ambiguity, introducing a novel method to quantify its "lexical gap" and providing a four-stage diagnostic framework for analyzing how systems fail. Third, we benchmark zero-shot LLM-powered KGQA systems to establish baseline performance and analyze their failure modes. Our evaluation reveals that top-performing systems achieve a maximum F1 score of only 0.38. This result does not indicate a failure of these powerful systems, but rather underscores the unique challenges posed by our benchmark. It demonstrates a critical performance gap, showing that current methods successful on general KGs struggle with the specific lexical and structural nuances of the building domain. BuildingQA1 thus provides the benchmark dataset and foundational analysis needed to drive the development of novel, domain-aware methods required to unlock the use of semantic data in buildings.

Mulayim, Ozan Baris↗

A Summary of Validation Studies for the Integrated TIGER Series Performed on ACORN Plus-up 218468/99

The Integrated TIGER Series (ITS) transport code is a valuable tool for photon-electron transport. A seven-problem validation suite exists to make sure that the ITS transport code works as intended. It is important to ensure that data from benchmark problems is correctly compared to simulated data. Additionally, the validation suite did not previously make use of a consistent quantitative metric for comparing experimental and simulated datasets. To this end, the goal of this long-term project was to expand the validation suite both in problem type and in the quality of the error assessment. To accomplish that, the seven validation problems in the suite were examined for potential drawbacks. When a drawback was identified, the problems were ranked based on severity of the drawback and approachability of a solution. We determined that meaningful improvements could be made to the validation suite by improving the analysis for the Lockwood Albedo problem and by introducing the Ross dataset as an eighth problem to the suite. The Lockwood error analysis has been completed and will be integrated in the future. The Ross data is unfinished, but significant progress has been made towards analysis.

97 MATHEMATICS AND COMPUTING↗

Chlorine Validation through Critical Integral Experiments

An increased interest in the validation of chlorine nuclear data, specifically 35Cl, in recent years has led to the prioritization of conducting chlorine critical experiments for nuclear data validation and criticality safety evaluations. A previous experiment was conducted with PVC and CPVC (chlorinated polyvinyl chloride) to reduce the margin of subcriticality for PF-4 operations with aqueous plutonium chloride solutions. Challenges in determining the composition of specific polymers, namely the CPVC, made it difficult to characterize, and therefore benchmark. Additional materials that were utilizable for chlorine validation were not immediately clear, as form, strength, purity, and composition are all important. A series of possible absorber materials were identified and studied, but ultimately granular sodium chloride was chosen. In addition to the needs of LANL’s PF-4 other industry collaborators have brought attention to the need for chlorine validation. Specifically, the need for HEU electrorefining with LiCl salts at Y-12 was taken into consideration for this experiment, with the experimental configurations being finely tuned to best meet their needs. Needs for validation were also presented by Idaho National Lab (INL) and TerraPower for validation of their Molten Chloride Reactor Experiment (MCRE) and Molten Chloride Fast Reactor (MCFR) and have also been considered.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Integrated Molten Salt Reactor Modeling Capabilities in NEAMS Thermal Hydraulics Tools

The DOE neams program supports a full range of computational thermal fluids analysis capabilities and code developments for a broad range of advanced reactor concepts. The research and development approach under the thermal fluids technical area synergistically combines three length and time scales in a hierarchical multi-scale approach. To enable multi-scale thermal fluids capability using these codes, a key joint effort has been underway to develop an integrated system- and engineering-scale thermal fluids analysis capability, through integration of SAM and Pronghorn codes, both based on the MOOSE framework. This report summarizes recent advances in developing an integrated system- and engineering-scale modeling capability for the msr concept, which has gained significant interest in recent years. A consistent framework was established by coupling Pronghorn and SAM through the Saline interface, with thermophysical properties provided by the Molten Salt Thermal Property Database (MSTDB-TP). Further improvements were made to the coupling schemes and domain-overlapping strategies, enhancing the stability and robustness of multi-code simulations. Verification and validation efforts demonstrate the accuracy of this integration across a range of benchmark problems, including one-dimensional heated pipe flows, three-dimensional natural convection loops with evolving isotopic compositions, and \gls{msre} demonstration cases. Within Pronghorn, new capabilities were introduced to model corrosion and noble-metal plating phenomena, supported by an extended thermal-hydraulics framework and refined turbulence treatments. To capture two-phase flow behavior, a multiphase Euler–Euler model was implemented in Pronghorn, including advanced closure relations, high-resolution advection techniques, and capillary force reconstruction. Preliminary verification cases confirm the fidelity of the approach, while planned validation efforts target canonical multiphase benchmarks and application to msr components such as the msre pump bowl. Finally, updates to SAM’s msr mass transfer modeling were extended to consider noble gas migration into porous structures like graphite. The point kinetics model was updated to include reactivity feedback contributions from any defined species, such as xenon. The gas transport model was expanded for applicability to gas mixtures, bubble efflux phenomena, and species transport between liquid and gas phases. A selection of multi-scale Sherwood number correlations from MOSCATO/NekRS and multi-phase correlations from literature have been added for improved accuracy in calculating mass transfer coefficients. A companion effort on developing system-level redox corrosion has also been incorporated into SAM. Collectively, these enhancements strengthen the predictive capability of SAM and Pronghorn for simulating MSR thermal-hydraulics, corrosion, multiphase behavior, and fission-product transport, providing a more complete toolset for design, safety analysis, and licensing support of next-generation \gls{msr}s.

42 - ENGINEERING↗

Involute Working Group – Validation of CFD Turbulence Models for Steady-State Safety Analysis

There are three research reactors in the world having fuel plates curved as circle-involute (a spiral generated around a circle): The Oak Ridge National Laboratory (ORNL) High Flux Isotope Reactor (HFIR) located in Tennessee, U.S.A. [ORNL, 2018]; The Laue-Langevin Institute (ILL) High Flux Reactor (RHF) located in Grenoble, France [ILL, 2018]; and, The Technical University of Munich (TUM) Research Neutron Source Heinz Maier-Leibnitz (FRM II) located in Garching, Germany [TUM, 2018]. All three reactors are currently using Highly Enriched Uranium (HEU, 235U/U ≥ 20 wt. %) as fuel and all three are actively engaged in activities to convert to Low Enriched Uranium (LEU, 235U/U < 20 wt. %) fuel. More information on these reactors can be found in Section two. For various reasons, these reactors have expressed interest in using Computational Fluid Dynamics (CFD) tools to perform their Steady-State Thermal-Hydraulic (SSTH) safety calculations. Using CFD tools for SSTH analysis represents generally a significant departure from traditional methods and requires thorough verification and validation (V&V) to be accepted by regulators. This is why Argonne National Laboratory (ANL) and the involute reactors formed an informal group to help each other in this endeavor. This so-called Involute Working Group (IWG) aims at supporting the qualification of CFD tools for SSTH safety calculations. Activities include benchmarking, code-to-code comparison, Verification and Validation (V&V) as well as technical support. More information on the IWG and the reasons why involute-plate reactors are interested in CFD can be found in Section three. The present study aims at testing three turbulence models commonly implemented in commercial software (namely K-Epsilon, K-Omega and Reynolds-Stress) and assessing their relevance for involute-plate reactor application. An experiment performed by Gambill and Bundy in 1961 was performed to measure heat transfer coefficients in conditions prototypic of the HFIR reactor [Gambill, 1961]. More details on this experiment are provided in Section four. Based on the information available, CFD models of this experiment have been created and the experimental results have been compared to the ones obtained with these CFD models. CFD models and the results of this comparison are provided in Section five.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Update on the Benchmark Analysis of the Jupiter Experiments: Plutonium Moderated by Lead

The Jupiter experiment was a series of measurements in the summer of 2017 to analyze the effects of voids in lead moderated plutonium assemblies. This experiment was part of a larger campaign that took place at the National Criticality Experiments Research Center (NCERC) in collaboration with the Japan Atomic Energy Agency (JAEA) that also investigated assemblies with differing uranium enrichments. The purpose for this campaign was to provide data useful for a potential lead-bismuth cooled accelerator driven system. This data is needed due to the low number of benchmarks involving lead. Given the wide use of lead for shielding in addition to new reactor designs, there is a need for further benchmarking that this experiment could help fulfill. In addition, adding more benchmarks to the International Criticality Safety Benchmark Evaluation Project (ICSBEP) is helpful for further validation of simulation methods used for criticality safety. This summary is an update on the current progress of this analysis, and all results shown are preliminary.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗