Search NASA⌕ Search

SEARCH · Search NASA

Results for “benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24

Evaluating the Practicability of Multiphase CFD for BWR Fuel Assembly Analysis

Multiphase computational fluid dynamics (M-CFD) models of a boiling water reactor (BWR) fuel assembly have been generated in the commercial CFD code, STAR-CCM+ Ver.11.04.010-R8. The Eulerian multiphase approach was employed, in combination with a baseline ‘Zero Closure model’ for two-phase flow boiling, applicable to high void fraction regimes. The capability and practicability of MCFD for BWR fuel assembly were evaluated against the international OECD/NRC BWR Full-size Finemesh Bundle Test (BFBT) benchmark data. The benchmark selected, BFBT-4101-61, is a steady-state full power case, with high void fraction conditions. Geometrical modeling and mesh construction of BWR assemblies introduce challenges in generating high quality computational meshes, while retaining a low cell count to allow acceptable runtimes. In order to evaluate the scalability of the CFD code, parallel CFD simulations were carried out with the High Performance Computing (HPC) system of the Idaho National Laboratory. M-CFD results display good agreement with the experimental data for both local void fraction distribution and exit quality. The parallel speedup factor is linearly proportional to the number of processors up to 500 cores, and retains over 92% efficiency with 1000 cores. The execution time of the simulation decreased exponentially with increasing number of processors while the cost of the simulation increased linearly. The proposed baseline closure, in combination with the parallel performance of the STAR-CCM+ code demonstrated promising capabilities for analyzing BWR fuel assemblies.

97 MATHEMATICS AND COMPUTING↗

Krylov subspace iteration for eigenvalue response matrix calculations

Recent work has revisited the eigenvalue response matrix method as an approach for reactor core analyses. In its most straightforward form, the method consists of a two-level Eigen problem. An outer Picard iteration updates the k-eigenvalue, while the inner Eigen problem imposes current continuity between coarse meshes. In this paper, several Eigen solvers are evaluated for this inner problem, using several 2-D diffusion benchmarks as test cases. The results indicate both the explicitly-restarted Arnoldi and the Krylov-Schur methods are up to an order of magnitude more efficient than power iteration. This increased efficiency makes the nested eigenvalue formulation more effective than the ILU-preconditioned Newton-Krylov formulation previously studied. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Implementation and validation of a fully implicit accumulator model in RELAP-7

This paper presents the implementation and validation of an accumulator model in RELAP-7 under the framework of preconditioned Jacobian free Newton Krylov (JFNK) method, based on the similar model used in RELAP5. RELAP-7 is a new nuclear reactor system safety analysis code being developed at the Idaho National Laboratory (INL). RELAP-7 is a fully implicit system code. The JFNK and preconditioning methods used in RELAP-7 is briefly discussed. The slightly modified accumulator model is summarized for completeness. The implemented model was validated with LOFT L3-1 test and benchmarked with RELAP5 results. RELAP-7 and RELAP5 had almost identical results for the accumulator gas pressure and water level, although there were some minor difference in other parameters such as accumulator gas temperature and tank wall temperature. One advantage of the JFNK method is its easiness to maintain and modify models due to fully separation of numerical methods from physical models. It would be straightforward to extend the current RELAP-7 accumulator model to simulate the advanced accumulator design. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Predicting Future Solar Modulation and Implementation in MCNP6

The application of detecting low level radiation in the field requires quantification of the natural radiation background specific to that location. This background is made up two primary components: naturally decaying radionuclides in the soil and atmosphere known as terrestrial background, and the particle cascades caused by high energy cosmic radiation interacting within the earth's atmosphere known as cosmic background. The terrestrial component dominates the background spectrum below approximately 2 MeV, however, the cosmic component comprises the entirety of the high-energy spectrum. Furthermore, the terrestrial component is relatively constant for a given location while the cosmic component is heavily dependent on solar activity, an effect known as solar modulation. Annual values of the solar modulation parameter, φ, have been determined since 1936, and their fluctuations are seen to be roughly sinusoidal over time. If one wished to predict or simulate the outcome of an experiment in the future, a prediction for the solar modulation would be necessary to accurately determine the cosmic background contribution. The previous version 6.1.1 of MCNP contained solar modulation data for 46 years between 1960 and 2005. This data was updated with newer solar modulation data, from I. G. Usoskin et al., which reports solar modulation data for an additional 33 years between 1936 and 2014. In order to use past solar modulation data to predict cosmic background radiation fluctuations for dates beyond 2014 an algorithm was developed to forecast future solar modulation data based on the sinusoidal behavior exhibited in recorded data. This algorithm was implemented into MCNP 6.1.2 to be used for cosmic background simulations and tested against benchmark data to assess its accuracy. (authors)

54 ENVIRONMENTAL SCIENCES↗

Updates to the HTR-PROTEUS HALEU Benchmark Using Modern Analysis Methodologies

The HTR-PROTEUS IRPhEP Handbook benchmarks represent some of the highest quality benchmarks available for systems with TRISO-HALEU fuel, graphite pebbles, graphite reflector, and high neutron leakage. Nevertheless, significant variability in computed eigenvalue results was encountered in HTR-PROTEUS configurations that are relevant for transportation configurations. The team will investigate the source of these variabilities in the original benchmark. In addition, the team will investigate the HTR-PROTEUS subcritical measurements, kinetics data, and potential criticality effects from the introduction of hydrogen in the system (water ingress). The project will generate a benchmark evaluation of additional HTR-PROTEUS measurements that can significantly increase the value of these criticality benchmarks in testing nuclear codes and data to support transportation validation needs for industry and the U.S. NRC.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Long-range and head-on beam-beam compensation studies in RHIC with lessons for the LHC

Long-range as well as head-on beam-beam effects are expected to limit the LHC performance with design parameters. They are also important consideration for the LHC upgrades. To mitigate long-range effects current carrying wires parallel to the beam were proposed. Two such wires are installed in RHIC where they allow studying the effect of strong long-range beam-beam effects, as well as the compensation of a single long-range interaction. The tests provide benchmark data for simulations and analytical treatments. To reduce the head-on beam-beam effect electron lenses were proposed for both RIDC and the LHC. We present the experimental long-range beam-beam program at RHIC and report on head-on compensations studies based on simulations.

43 PARTICLE ACCELERATORS↗

Long-range and head-on beam-beam compensation studies in RHIC with lessons for the LHC

Long-range as well as head-on beam-beam effects are expected to limit the LHC performance with design parameters. They are also important consideration for the LHC upgrades. To mitigate long-range effects, current carrying wires parallel to the beam were proposed. Two such wires are installed in RHIC where they allow studying the effect of strong long-range beam-beam effects, as well as the compensation of a single long-range interaction. The tests provide benchmark data for simulations and analytical treatments. Electron lenses were proposed for both RHIC and the LHC to reduce the head-on beam-beam effect. We present the experimental long-range beam-beam program at RHIC and report on head-on compensations studies based on simulations.

43 PARTICLE ACCELERATORS↗

LHC beam-beam compensation studies at RHIC

Long-range and head-on beam-beam effects are expected to limit the LHC performance with design parameters. To mitigate long-range effects current carrying wires parallel to the beam were proposed. Two such wires are installed in RHIC where they allow studying the effect of strong long-range beam-beam effects, as well as the compensation of a single long-range interaction. The tests provide benchmark data for simulations and analytical treatments. To reduce the head-on beam-beam effect electron lenses were proposed for both the LHC and RHIC. We present the experimental long-range beam-beam program and report on head-on compensations studies at RHIC, which are based on simulations.

43 PARTICLE ACCELERATORS↗

Results of the 2013 UT modeling benchmark obtained with models implemented in CIVA

The 2013 Ultrasonic Testing (UT) modeling benchmark concerns direct echoes from side drilled holes (SDH), flat bottom holes (FBH) and corner echoes from backwall breaking artificial notches inspected with a matrix phased array probe. This communication presents the results obtained with the models implemented in the CIVA software: the pencilmodel is used to compute the field radiated by the probe, the Kirchhoff approximation is applied to predict the response of FBH and notches and the SOV (Separation Of Variables) model is used for the SDH responses. The comparison between simulated and experimental results are presented and discussed.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Spin Splitting Energy of Transition Metals: A New, More Affordable Wave Function Benchmark Method and Its Use to Test Density Functional Theory

Accurately predicting the spin splitting energy of chemical species is important for understanding their reactivity and magnetic properties, but it is very challenging, especially for molecules containing transition metals. One impediment to progress is the scarcity of accurate benchmark data. Here we report a set of calculations designed to yield reliable benchmarks for simple transition-metal complexes that can be used to test density functional methods that are affordable for large systems of more practical interest. Various wave function methods are tested against experiment for Fe 2+ , Fe 3+ , and Co 3+ , including CASSCF, CASPT2, CASPT3, MRCISD, MRCISD+Q, ACPF, AQCC, CCSD(T), and CASPT2/CCSD(T) and also a new method called CASPT2.5, which is performed by taking the average of the CASPT2 and CASPT3 energies. Furthermore, we find that MRCISD+Q, ACPF, and AQCC require smaller active spaces for good accuracy than are required by CASPT2 and CASPT3, and this aspect may be important for calculations on larger molecules; here we find that CASPT2.5 extrapolated to a complete basis set is the most suitable method—in terms of computational cost and in terms of accuracy on monatomic systems—and therefore we chose this method for molecular benchmarks. Then Kohn–Sham density functional calculations with 60 exchange-correlation functionals are tested for FeF 2 , FeCl 2 , and CoF 2 . We find that MN15-L, M06-SX, and revM06 have very good agreement with CASPT2.5 benchmarks in terms of both the spin splitting energy and the optimized geometry for each spin state. In addition, we recommend def2-TZVP as the most suitable basis set to perform density functional calculations for molecular spin splitting energies; extra polarization functions in the basis set do not help to increase the accuracy of the spin splitting energy in KS calculations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Application of the Hybrid Diffusion-Transport Spatial Homogenization Method to a Pressurized Water Reactor Benchmark Problem - Paper 70

The recently developed Hybrid Diffusion-Transport Spatial Homogenization (DTH) method was previously tested on a benchmark problem typical of a boiling water reactor. In this summary, the DTH method is tested in a 1-D benchmark problem typical of a pressurized water reactor. The method recreates the heterogeneous flux to within 1% average flux error and 34 pcm eigenvalue error in half the time as a heterogeneous transport calculation. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Neutronics Benchmark Specifications for EBR-II Shutdown Heat Removal Test SHRT-45R - Revision 1

A neutronics benchmark specification was developed to support the analysis of SHRT-45R test, which was conducted in April 1986 using Experimental Breeder Reactor II (EBR-II) to demonstrate that a sodium-cooled fast reactor (SFR) with a sodium-bonded metallic fuel could be designed such that passive phenomena, as opposed to active electromechanical systems, are effective in protecting the reactor against the potentially adverse consequences of unprotected accidents.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

TRIPOLI-4 neutronics calculations for IAEA-CRP benchmark of CEFR start-up tests using new libraries JEFF-3.3 and ENDF/B-VIII

Sodium-cooled Fast Reactors (SFR) are one of the promising Generation IV fast reactors. The China Experimental Fast Reactor (CEFR) is a 65 MWth pool-type SFR with a high neutron leakage core using high enriched uranium oxide fuel. The CEFR start-up tests in 2010 consist of series of neutronics experiments. Essential experimental data are available from the 2018 IAEA-CEFR-CRP benchmark document and useful for the validation of neutron transport codes and nuclear data libraries. The TRIPOLI-4 Monte Carlo transport code is a general-purpose neutronics code using continuous-energy nuclear data libraries. It has a rich validation database covering different computational and experimental benchmark data sets to assure the accuracy and credibility of numerical studies. Previous TRIPOLI-4 SFR core physics calculations used mainly MOX fuels. SFR control rod worth studies with TRIPOLI-4 were mainly on big-size cores. To test the modeling capability of TRIPOLI-4 on fuel loading patterns and on variable control rods positions for SFRs and to check recent nuclear data libraries, it is interesting to investigate the CEFR start-up tests in this work, including core states from subcritical to supercritical, control rods and rod group worth, point kinetics parameters, and radial foil activation measurements. TRIPOLI-4 calculation results using new data libraries JEFF-3.3, ENDF/B-VIII, and those of ENDF/B-VII.1 for different CEFR core states are reported here. By means of different options of TRIPOLI-4, control-rod SAs reactivity worth, point kinetics parameters, and radial {sup 237}Np(n,f) fission rate distribution were successfully evaluated. Both ENDF/B-VIII and JEFF-3.3 nuclear data libraries provided reliable results with a difference of 170 +/- 11 pcm in k{sub eff}.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

ON THE EFFECTIVENESS OF LLMS IN UNIT TEST GENERATION FOR STRUCTURED TEXT PROGRAMS

The reliability of industrial automation systems heavily depends on the correctness of Programmable Logic Controller (PLC) programs, which are often written in Structured Text (ST). While Large Language Models (LLMs) have shown promise in automating test generation for mainstream programming languages, their effectiveness for the syntactically strict ST language remains underexplored. This thesis presents a systematic empirical evaluation of three state-of-the-art LLMs—GPT-4o, Gemini 2.5 Pro, and Claude Sonnet 4.5—for generating ST unit tests. We examine three prompting strategies: Natural Language (NL), Code Language (CL), and Chain-of-Thought (CoT), across a curated set of 11 ST function blocks. The quality of the generated tests is assessed using Compilation Success Rate (CSR), Statement Coverage (SC), and Branch Coverage (BC). In the zero-shot setting, Claude Sonnet 4.5 achieves the highest CSR, while Gemini 2.5 Pro consistently delivers the best statement and branch coverage, particularly under CL prompts. By incorporating a one-shot CL prompt, all models exhibit substantial improvements—most notably GPT-4o, whose CSR increases from 45.45% to 90.91%, with substantial gains in both SC and BC. To further contextualize these findings, we compare GPT-4o’s one-shot results with PLCAutoTester, a state-ofthe- art ST unit test generation tool, on an additional benchmark dataset. While LLMgenerated tests approach competitive coverage levels, PLCAutoTester maintains significantly higher and more stable coverage across programs. This study provides the first comprehensive benchmark of modern LLMs for ST unit testing, highlighting their strengths, limitations, and improvements through one-shot prompting, and positioning their performance relative to specialized automated testing tools in industrial automation.

42 ENGINEERING↗

Testing (Validating?) Cross Sections with ICSBEP Benchmarks [Slides]

We discuss how to use critical benchmarks from the International Handbook of Evaluated Criticality Safety Benchmark Experiments to determine the applicability of specific cross sections to the end-user's problem of interest. Particular attention is paid to making sure the selected suite of benchmarks includes the user's range of applicability (ROA).

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Exploring Hilbert space on a budget: Novel benchmark set and performance metric for testing electronic structure methods in the regime of strong correlation

This work explores the ability of classical electronic structure methods to efficiently represent (compress) the information content of full configuration interaction (FCI) wave functions. We introduce a benchmark set of four hydrogen model systems of different dimensionalities and distinctive electronic structures: a 1D chain, a 1D ring, a 2D triangular lattice, and a 3D close-packed pyramid. To assess the ability of a computational method to produce accurate and compact wave functions, we introduce the accuracy volume, a metric that measures the number of variational parameters necessary to achieve a target energy error. Using this metric and the hydrogen models, we examine the performance of three classical deterministic methods: (i) selected configuration interaction (sCI) realized both via an a posteriori (ap-sCI) and variational selection of the most important determinants, (ii) an a posteriori singular value decomposition (SVD) of the FCI tensor (SVD-FCI), and (iii) the matrix product state representation obtained via the density matrix renormalization group (DMRG). We find that the DMRG generally gives the most efficient wave function representation for all systems, particularly in the 1D chain with a localized basis. For the 2D and 3D systems, all methods (except DMRG) perform best with a delocalized basis, and the efficiency of sCI and SVD-FCI is closer to that of DMRG. For larger analogs of the models, the DMRG consistently requires the fewest parameters but still scales exponentially in 2D and 3D systems, and the performance of SVD-FCI is essentially equivalent to that of ap-sCI.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Benchmark specifications for EBR-II shutdown heat removal tests

Argonne National Laboratory (ANL) is hosting an IAEA-coordinated research project on benchmark analyses of sodium-cooled fast reactor passive safety tests performed at the Experimental Breeder Reactor-II (EBR-II). The benchmark project involves analysis of a protected and an unprotected loss of flow tests conducted during an extensive testing program within the framework of the U.S. Integral Fast Reactor program to demonstrate the inherently safety features of EBR-II as a pool-type, sodium-cooled fast reactor prototype. The project is intended to improve the participants' design and safety analysis capabilities for sodium-cooled fast reactors through validation and qualification of safety analysis codes and methods. This paper provides a description of the EBR-II tests included in the program, and outlines the benchmark specifications being prepared to support the IAEA-coordinated research project. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗