Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Krylov subspace iteration for eigenvalue response matrix calculations

Recent work has revisited the eigenvalue response matrix method as an approach for reactor core analyses. In its most straightforward form, the method consists of a two-level Eigen problem. An outer Picard iteration updates the k-eigenvalue, while the inner Eigen problem imposes current continuity between coarse meshes. In this paper, several Eigen solvers are evaluated for this inner problem, using several 2-D diffusion benchmarks as test cases. The results indicate both the explicitly-restarted Arnoldi and the Krylov-Schur methods are up to an order of magnitude more efficient than power iteration. This increased efficiency makes the nested eigenvalue formulation more effective than the ILU-preconditioned Newton-Krylov formulation previously studied. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Implementation and validation of a fully implicit accumulator model in RELAP-7

This paper presents the implementation and validation of an accumulator model in RELAP-7 under the framework of preconditioned Jacobian free Newton Krylov (JFNK) method, based on the similar model used in RELAP5. RELAP-7 is a new nuclear reactor system safety analysis code being developed at the Idaho National Laboratory (INL). RELAP-7 is a fully implicit system code. The JFNK and preconditioning methods used in RELAP-7 is briefly discussed. The slightly modified accumulator model is summarized for completeness. The implemented model was validated with LOFT L3-1 test and benchmarked with RELAP5 results. RELAP-7 and RELAP5 had almost identical results for the accumulator gas pressure and water level, although there were some minor difference in other parameters such as accumulator gas temperature and tank wall temperature. One advantage of the JFNK method is its easiness to maintain and modify models due to fully separation of numerical methods from physical models. It would be straightforward to extend the current RELAP-7 accumulator model to simulate the advanced accumulator design. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Predicting Future Solar Modulation and Implementation in MCNP6

The application of detecting low level radiation in the field requires quantification of the natural radiation background specific to that location. This background is made up two primary components: naturally decaying radionuclides in the soil and atmosphere known as terrestrial background, and the particle cascades caused by high energy cosmic radiation interacting within the earth's atmosphere known as cosmic background. The terrestrial component dominates the background spectrum below approximately 2 MeV, however, the cosmic component comprises the entirety of the high-energy spectrum. Furthermore, the terrestrial component is relatively constant for a given location while the cosmic component is heavily dependent on solar activity, an effect known as solar modulation. Annual values of the solar modulation parameter, φ, have been determined since 1936, and their fluctuations are seen to be roughly sinusoidal over time. If one wished to predict or simulate the outcome of an experiment in the future, a prediction for the solar modulation would be necessary to accurately determine the cosmic background contribution. The previous version 6.1.1 of MCNP contained solar modulation data for 46 years between 1960 and 2005. This data was updated with newer solar modulation data, from I. G. Usoskin et al., which reports solar modulation data for an additional 33 years between 1936 and 2014. In order to use past solar modulation data to predict cosmic background radiation fluctuations for dates beyond 2014 an algorithm was developed to forecast future solar modulation data based on the sinusoidal behavior exhibited in recorded data. This algorithm was implemented into MCNP 6.1.2 to be used for cosmic background simulations and tested against benchmark data to assess its accuracy. (authors)

54 ENVIRONMENTAL SCIENCES↗

Updates to the HTR-PROTEUS HALEU Benchmark Using Modern Analysis Methodologies

The HTR-PROTEUS IRPhEP Handbook benchmarks represent some of the highest quality benchmarks available for systems with TRISO-HALEU fuel, graphite pebbles, graphite reflector, and high neutron leakage. Nevertheless, significant variability in computed eigenvalue results was encountered in HTR-PROTEUS configurations that are relevant for transportation configurations. The team will investigate the source of these variabilities in the original benchmark. In addition, the team will investigate the HTR-PROTEUS subcritical measurements, kinetics data, and potential criticality effects from the introduction of hydrogen in the system (water ingress). The project will generate a benchmark evaluation of additional HTR-PROTEUS measurements that can significantly increase the value of these criticality benchmarks in testing nuclear codes and data to support transportation validation needs for industry and the U.S. NRC.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Results of the 2013 UT modeling benchmark obtained with models implemented in CIVA

The 2013 Ultrasonic Testing (UT) modeling benchmark concerns direct echoes from side drilled holes (SDH), flat bottom holes (FBH) and corner echoes from backwall breaking artificial notches inspected with a matrix phased array probe. This communication presents the results obtained with the models implemented in the CIVA software: the pencilmodel is used to compute the field radiated by the probe, the Kirchhoff approximation is applied to predict the response of FBH and notches and the SOV (Separation Of Variables) model is used for the SDH responses. The comparison between simulated and experimental results are presented and discussed.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Spin Splitting Energy of Transition Metals: A New, More Affordable Wave Function Benchmark Method and Its Use to Test Density Functional Theory

Accurately predicting the spin splitting energy of chemical species is important for understanding their reactivity and magnetic properties, but it is very challenging, especially for molecules containing transition metals. One impediment to progress is the scarcity of accurate benchmark data. Here we report a set of calculations designed to yield reliable benchmarks for simple transition-metal complexes that can be used to test density functional methods that are affordable for large systems of more practical interest. Various wave function methods are tested against experiment for Fe 2+ , Fe 3+ , and Co 3+ , including CASSCF, CASPT2, CASPT3, MRCISD, MRCISD+Q, ACPF, AQCC, CCSD(T), and CASPT2/CCSD(T) and also a new method called CASPT2.5, which is performed by taking the average of the CASPT2 and CASPT3 energies. Furthermore, we find that MRCISD+Q, ACPF, and AQCC require smaller active spaces for good accuracy than are required by CASPT2 and CASPT3, and this aspect may be important for calculations on larger molecules; here we find that CASPT2.5 extrapolated to a complete basis set is the most suitable method—in terms of computational cost and in terms of accuracy on monatomic systems—and therefore we chose this method for molecular benchmarks. Then Kohn–Sham density functional calculations with 60 exchange-correlation functionals are tested for FeF 2 , FeCl 2 , and CoF 2 . We find that MN15-L, M06-SX, and revM06 have very good agreement with CASPT2.5 benchmarks in terms of both the spin splitting energy and the optimized geometry for each spin state. In addition, we recommend def2-TZVP as the most suitable basis set to perform density functional calculations for molecular spin splitting energies; extra polarization functions in the basis set do not help to increase the accuracy of the spin splitting energy in KS calculations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Application of the Hybrid Diffusion-Transport Spatial Homogenization Method to a Pressurized Water Reactor Benchmark Problem - Paper 70

The recently developed Hybrid Diffusion-Transport Spatial Homogenization (DTH) method was previously tested on a benchmark problem typical of a boiling water reactor. In this summary, the DTH method is tested in a 1-D benchmark problem typical of a pressurized water reactor. The method recreates the heterogeneous flux to within 1% average flux error and 34 pcm eigenvalue error in half the time as a heterogeneous transport calculation. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Neutronics Benchmark Specifications for EBR-II Shutdown Heat Removal Test SHRT-45R - Revision 1

A neutronics benchmark specification was developed to support the analysis of SHRT-45R test, which was conducted in April 1986 using Experimental Breeder Reactor II (EBR-II) to demonstrate that a sodium-cooled fast reactor (SFR) with a sodium-bonded metallic fuel could be designed such that passive phenomena, as opposed to active electromechanical systems, are effective in protecting the reactor against the potentially adverse consequences of unprotected accidents.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

TRIPOLI-4 neutronics calculations for IAEA-CRP benchmark of CEFR start-up tests using new libraries JEFF-3.3 and ENDF/B-VIII

Sodium-cooled Fast Reactors (SFR) are one of the promising Generation IV fast reactors. The China Experimental Fast Reactor (CEFR) is a 65 MWth pool-type SFR with a high neutron leakage core using high enriched uranium oxide fuel. The CEFR start-up tests in 2010 consist of series of neutronics experiments. Essential experimental data are available from the 2018 IAEA-CEFR-CRP benchmark document and useful for the validation of neutron transport codes and nuclear data libraries. The TRIPOLI-4 Monte Carlo transport code is a general-purpose neutronics code using continuous-energy nuclear data libraries. It has a rich validation database covering different computational and experimental benchmark data sets to assure the accuracy and credibility of numerical studies. Previous TRIPOLI-4 SFR core physics calculations used mainly MOX fuels. SFR control rod worth studies with TRIPOLI-4 were mainly on big-size cores. To test the modeling capability of TRIPOLI-4 on fuel loading patterns and on variable control rods positions for SFRs and to check recent nuclear data libraries, it is interesting to investigate the CEFR start-up tests in this work, including core states from subcritical to supercritical, control rods and rod group worth, point kinetics parameters, and radial foil activation measurements. TRIPOLI-4 calculation results using new data libraries JEFF-3.3, ENDF/B-VIII, and those of ENDF/B-VII.1 for different CEFR core states are reported here. By means of different options of TRIPOLI-4, control-rod SAs reactivity worth, point kinetics parameters, and radial {sup 237}Np(n,f) fission rate distribution were successfully evaluated. Both ENDF/B-VIII and JEFF-3.3 nuclear data libraries provided reliable results with a difference of 170 +/- 11 pcm in k{sub eff}.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

ON THE EFFECTIVENESS OF LLMS IN UNIT TEST GENERATION FOR STRUCTURED TEXT PROGRAMS

The reliability of industrial automation systems heavily depends on the correctness of Programmable Logic Controller (PLC) programs, which are often written in Structured Text (ST). While Large Language Models (LLMs) have shown promise in automating test generation for mainstream programming languages, their effectiveness for the syntactically strict ST language remains underexplored. This thesis presents a systematic empirical evaluation of three state-of-the-art LLMs—GPT-4o, Gemini 2.5 Pro, and Claude Sonnet 4.5—for generating ST unit tests. We examine three prompting strategies: Natural Language (NL), Code Language (CL), and Chain-of-Thought (CoT), across a curated set of 11 ST function blocks. The quality of the generated tests is assessed using Compilation Success Rate (CSR), Statement Coverage (SC), and Branch Coverage (BC). In the zero-shot setting, Claude Sonnet 4.5 achieves the highest CSR, while Gemini 2.5 Pro consistently delivers the best statement and branch coverage, particularly under CL prompts. By incorporating a one-shot CL prompt, all models exhibit substantial improvements—most notably GPT-4o, whose CSR increases from 45.45% to 90.91%, with substantial gains in both SC and BC. To further contextualize these findings, we compare GPT-4o’s one-shot results with PLCAutoTester, a state-ofthe- art ST unit test generation tool, on an additional benchmark dataset. While LLMgenerated tests approach competitive coverage levels, PLCAutoTester maintains significantly higher and more stable coverage across programs. This study provides the first comprehensive benchmark of modern LLMs for ST unit testing, highlighting their strengths, limitations, and improvements through one-shot prompting, and positioning their performance relative to specialized automated testing tools in industrial automation.

42 ENGINEERING↗

Testing (Validating?) Cross Sections with ICSBEP Benchmarks [Slides]

We discuss how to use critical benchmarks from the International Handbook of Evaluated Criticality Safety Benchmark Experiments to determine the applicability of specific cross sections to the end-user's problem of interest. Particular attention is paid to making sure the selected suite of benchmarks includes the user's range of applicability (ROA).

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Exploring Hilbert space on a budget: Novel benchmark set and performance metric for testing electronic structure methods in the regime of strong correlation

This work explores the ability of classical electronic structure methods to efficiently represent (compress) the information content of full configuration interaction (FCI) wave functions. We introduce a benchmark set of four hydrogen model systems of different dimensionalities and distinctive electronic structures: a 1D chain, a 1D ring, a 2D triangular lattice, and a 3D close-packed pyramid. To assess the ability of a computational method to produce accurate and compact wave functions, we introduce the accuracy volume, a metric that measures the number of variational parameters necessary to achieve a target energy error. Using this metric and the hydrogen models, we examine the performance of three classical deterministic methods: (i) selected configuration interaction (sCI) realized both via an a posteriori (ap-sCI) and variational selection of the most important determinants, (ii) an a posteriori singular value decomposition (SVD) of the FCI tensor (SVD-FCI), and (iii) the matrix product state representation obtained via the density matrix renormalization group (DMRG). We find that the DMRG generally gives the most efficient wave function representation for all systems, particularly in the 1D chain with a localized basis. For the 2D and 3D systems, all methods (except DMRG) perform best with a delocalized basis, and the efficiency of sCI and SVD-FCI is closer to that of DMRG. For larger analogs of the models, the DMRG consistently requires the fewest parameters but still scales exponentially in 2D and 3D systems, and the performance of SVD-FCI is essentially equivalent to that of ap-sCI.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Benchmark specifications for EBR-II shutdown heat removal tests

Argonne National Laboratory (ANL) is hosting an IAEA-coordinated research project on benchmark analyses of sodium-cooled fast reactor passive safety tests performed at the Experimental Breeder Reactor-II (EBR-II). The benchmark project involves analysis of a protected and an unprotected loss of flow tests conducted during an extensive testing program within the framework of the U.S. Integral Fast Reactor program to demonstrate the inherently safety features of EBR-II as a pool-type, sodium-cooled fast reactor prototype. The project is intended to improve the participants' design and safety analysis capabilities for sodium-cooled fast reactors through validation and qualification of safety analysis codes and methods. This paper provides a description of the EBR-II tests included in the program, and outlines the benchmark specifications being prepared to support the IAEA-coordinated research project. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Performance Assessment of a New Gamma Spectroscopy Toolkit: Peak Doctor and the Spectral Nondestructive Assay Platform (SNAP) - 17397

High resolution gamma spectroscopy (HRGS) is a widely used technique for non-destructive characterization of nuclear materials, and assay of radioactive waste. The ability to accurately evaluate raw spectral data is an important step in producing high-quality results. A spectral analysis application known as Peak Doctor has been developed under a Cooperative Research and Development Agreement (CRADA) between LANL and Pajarito Scientific Corporation (PSC). The software has undergone several years of testing and validation by the Radioactive Waste Characterization Team of the LANL Waste Management Services Group (WM-SVS). PeakDoctor is designed to work with the Spectral Nondestructive Assay Platform (SNAP{sup TM}) to provide a complete HRGS analysis engine. SNAP{sup TM} performs model specific corrections for attenuation and geometry. These applications are the major components of a new toolkit designed primarily for portable far-field non-destructive assay. Peak Doctor performs a very accurate peak fit analysis with the goal of improving upon the capabilities of existing commercially available routines. It is designed to be user-configurable and can be customized to any given type of detector and any given type of spectrum. Peak Doctor was developed to resolve many of the inherent complexities in gamma ray spectra including overlapping peaks, complex multiplet regions, large step peaks, backscatter regions and Compton edges. Unlike most spectral analysis platforms, Peak Doctor does not rely on the energy calibration and detector resolution parameters that are saved by the operator in the spectrum file. Instead, key parameters are pre-defined for individual detectors. The software fits a continuum using a series of splines between a series of junctions or 'knots'. Fitting techniques are used to join the splines together to create a near-continuous multi-element curve. Optimizing the location of the knots is one of Peak Doctor's most powerful features. The knots are initially configured using a pre-defined list and are removed or added automatically during the fitting process. Knots are also created when new features are identified such as Step Peaks and Compton Edges. The user can also manually specify knots in order to improve the continuum fit. The initial fit is improved on by removing any outlier regions (which are converted to peaks) and the continuum fitting process is repeated. At this stage, an experienced user can work interactively with the fit by manually converting peak regions to continuum or vice versa. The final step is to fit a series of peaks above the continuum based on detector parameters. Single and multiplet peaks are then processed by either the tailing (piecewise) or non-tailing (Gaussian) Levenberg Marquardt non-linear peak fitting routine depending on the user defined selection. Only a rough knowledge of the detector characteristics (energy calibration and resolution) is required for the fitting process to proceed with good accuracy. Any peaks that are missed can be manually added by the user and will also be fitted. Discontinuities in the peak / continuum fit can be rapidly identified by reviewing the 'residuals scale' plot. For waste streams that are well characterized, it is often the case that routinely encountered spectra will have similar peaks and continuum features. For these cases a handy 'One Step' method is available that proceeds in an automated fashion without user interaction. Peak Doctor has been configured with a set of default spectrum types including plutonium / transuranic waste (including Weapons Grade Pu, Heat Source Pu, Am-241, Am-243 and Np-237), depleted or enriched uranium, nuclear power plant / intermediate level waste (with fission and activation products such as Cs-137 and Co-60) as well as Naturally Occurring Radioactive Materials (NORM). The user can easily add new spectrum types for specific waste streams or other types of radiological / special nuclear materials. The output from PeakDoctor (including net peak area, centroid energy and a list of minimum detectable activity levels at pre-defined regions) is used by SNAP{sup TM} to complete the data analysis process. Isotope activities are calculated using configurable template-driven geometry and attenuation correction methods. The software accounts for matrix and container wall effects, collimator / angular corrections, detector efficiency (based on calibration curves) and stand-off distance. SNAP{sup TM} uses published algorithms incorporating a series of decision points during its operation to allow the analyst to provide logical input to guide the software during the analysis of each unique spectrum. The Peak Doctor / SNAP{sup TM} toolkit has been extensively tested and validated under a variety of conditions using 'benchmark' reference spectra. Test scenarios reported include HPGe-based measurements of well characterized uranium and plutonium standards and radioactive sources with a variety of different geometries and matrix materials including surrogate drums and boxes. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

RELAP5-3D Solutions to Exercise 1 of the OECD-NEA HTTF Benchmark

Discussion of RELAP5-3D solutions to Exercise 1 of the OECD-NEA High Temperature Test Facility (HTTF) Benchmark. Results from ongoing benchmark activities supported by the Advanced Reactor Technologies - Gas-Cooled Reactor Program with use of the High Performance Computing Center at Idaho National Laboratory. Also discussion of Ultra Safe Nuclear Corporation and BWXT plans for the decade, and issues of modern thermal hydraulic tools for prismatic HTGR modeling. Open discussion of verification and validation and ART-GCR campaign to spearhead the development of an HTGR thermal hydraulics benchmark based on the HTTF.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Beam-target double-spin asymmetry in quasielastic electron scattering off the deuteron with CLAS

The deuteron plays a pivotal role in nuclear and hadronic physics, as both the simplest bound multinucleon system and as an effective neutron target. Quasielastic electron scattering on the deuteron is a benchmark reaction to test our understanding of deuteron structure and the properties and interactions of the two nucleons bound in the deuteron. The experimental data presented here can be used to test state-of-the-art models of the deuteron and the two-nucleon interaction in the final state after two-body breakup of the deuteron. Focusing on polarization degrees of freedom, we gain information on spin-momentum correlations in the deuteron ground state (due to the D-state admixture) and on the limits of the impulse approximation (IA) picture as it applies to measurements of spin-dependent observables like spin structure functions for bound nucleons. Information on this reaction can also be used to reduce systematic uncertainties on the determination of neutron form factors or deuteron polarization through quasielastic polarized electron scattering. Furthermore, we measured the beam-target double-spin asymmetry (A || ) for quasielastic electron scattering off the deuteron at several beam energies (1.6–1.7, 2.5, 4.2, and 5.6–5.8GeV), using the CEBAF Large Acceptance Spectrometer (CLAS) at the Thomas Jefferson National Accelerator Facility. The deuterons were polarized along (or opposite to) the beam direction. The double-spin asymmetries were measured as a function of photon virtuality Q 2 (0.13–3.17(GeV/c) 2 ), missing momentum (p m =0.0–0.5GeV/c), and the angle between the (inferred) spectator neutron and the momentum transfer direction (θ nq ). We compare our results with a recent model that includes final-state interactions (FSI) using a complete parametrization of nucleon-nucleon scattering, as well as a simplified model using the plane wave impulse approximation (PWIA). We find overall good agreement with both the PWIA and FSI expectations at low to medium missing momenta (p m ≤0.25GeV/c), including the change of the asymmetry due to the contribution of the deuteron D state at higher momenta. At the highest missing momenta, our data clearly agree better with the calculations including FSI. Final-state interactions seem to play a lesser role for polarization observables in deuteron two-body electrodisintegration than for absolute cross sections. Our data, while limited in statistical power, indicate that PWIA models work reasonably well to understand the asymmetries at lower missing momenta. In turn, this information can be used to extract the product of beam and target polarization (P b P t ) from quasielastic electron-deuteron scattering, which is useful for measurements of spin observables in electron-neutron inelastic scattering. But, at the highest missing (neutron) momenta, FSI effects become important and must be accounted for.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

THE BENCHMARK ULTRACOOL SUBDWARF HD 114762B: A TEST OF LOW-METALLICITY ATMOSPHERIC AND EVOLUTIONARY MODELS

We present a near-infrared spectroscopic study of HD 114762B, the latest-type metal-poor companion discovered to date and the only ultracool subdwarf with a known metallicity, inferred from the primary star to be [Fe/H] = -0.7. We obtained a medium-resolution (R approx 3800) Keck/OSIRIS 1.18-1.40 mum spectrum and a low-resolution (R approx 150) Infrared Telescope Facility/SpeX 0.8-2.4 mum spectrum of HD 114762B to test atmospheric and evolutionary models for the first time in this mass-metallicity regime. HD 114762B exhibits spectral features common to both late-type dwarfs and subdwarfs, and we assign it a spectral type of d/sdM9 +- 1. We use a Monte Carlo technique to fit PHOENIX/GAIA synthetic spectra to the observations, accounting for the coarsely gridded nature of the models. Fits to the entire OSIRIS J-band and to the metal-sensitive J-band atomic absorption features (Fe I, K I, and Al I lines) yield model parameters that are most consistent with the metallicity of the primary star and the high surface gravity expected of old late-type objects. The effective temperatures and radii inferred from the model atmosphere fitting broadly agree with those predicted by the evolutionary models of Chabrier and Baraffe, and the model color-absolute magnitude relations accurately predict the metallicity of HD 114762B. We conclude that current low-mass, mildly metal-poor atmospheric and evolutionary models are mutually consistent for spectral fits to medium-resolution J-band spectra of HD 114762B, but are inconsistent for fits to low-resolution near-infrared spectra of mild subdwarfs. Finally, we develop a technique for estimating distances to ultracool subdwarfs based on a single near-infrared spectrum. We show that this 'spectroscopic parallax' method enables distance estimates accurate to approx<10% of parallactic distances for ultracool subdwarfs near the hydrogen burning minimum mass.

79 ASTRONOMY AND ASTROPHYSICS↗