Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark Experiments”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

Application of the Rossi-alpha method to simulations of HEU and organic scintillators

The International Criticality Safety Benchmark Evaluation Project (ICSBEP) Handbook contains thousands of high-quality benchmark measurements that include detailed descriptions of experiment designs and exhaustive accounting of uncertainties. These benchmarks are used extensively by the criticality safety and nuclear data communities. A subcritical benchmark involving bare, highly enriched uranium (HEU) has yet to be accepted to the handbook. The Measurement of Uranium Subcritical and Critical (MUSiC) was proposed to address this gap. MUSiC will be performed at the National Criticality Experiments Research Center (NCERC) and will leverage bare HEU hemisphere shells that can be assembled in a variety of configurations. The measurement has the following key benefits: it will be the first set of fast, subcritical measurements of HEU to be submitted to ICSBEP; ten configurations will be measured spanning from nearly no multiplication to critical (e.g., it is a measurement of similar systems with different re activities); measurements of an all-HEU system will be of value for nuclear data validation, providing results that assist in determining biases in both measurements and simulations. A variety of detector systems will be used including a Neutron Multiplicity Array Detector (NoMAD) system (similar to the MC-15), four small volume 0.635 cm (#8960;) × 7.59 cm 3He detectors (ideal for measuring prompt neutron decay constants due to their fast recovery speed), and an array of eight 5.08 cm (#8960;) × 5.08 cm EJ-309 organic scintillator detectors. The focus of this work is the simulation of the subcritical MUSiC configurations including the EJ-309 detectors and the application of the Rossi-α method. The EJ-309 organic scintillator detector array is a new detection system that will be deployed at NCERC. Organic scintillators are ideal for measurements of fast, subcritical systems due to their short time response on the order of nanoseconds.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Update on NNL TSL Evaluations and Validation [Slides]

12 new/revised TSL evaluations were contributed to ENDF/B-VIII.1. The thermal diffusion length $L$ is an integral property of a single material’s absorption and scattering cross sections (both differential and integral). No other neutron reactions or materials are involved. The MC21-calculated $L$ for water is consistent with the spread of experimental data and is sufficiently sensitive to different H-H 2 O TSL physics models to use the method as a TSL integral performance benchmark. Modern high-quality diffusion experiments at elevated $T$ would allow direct low-cost physics benchmarking of water TSLs when public elevated-$T$ critical benchmarks are limited. NNL is working with LLNL and RPI to develop experimental PNDA capability. An ICSBEP Fundamental Physics benchmark of the Nassar and Murphy PNDA experiment is being developed to provide an example of how to evaluate these type of benchmarks.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Bayesian estimation of cross-section and errors of experiment and calculation for accurate prediction of neutronic characteristics

In some experiments, there might be a correlation of experimental errors such as an error caused by fabrication. The correlation of calculation errors also might exist among analyses of experiments. In the present study, considering these correlations, the cross-section and errors of experiment and calculation are adjusted for the accurate prediction of neutronic characteristics. The adjustment method is derived based on Bayesian theory. The 'a posteriori' distributions of cross-section and errors of experiment and calculation are obtained by the derivation. The case study is performed by using the benchmarks of light-water moderated experiments reported in ICSBEP. The error from fuel rod fabrication and measurement are included in the experiment error, and the error from the simplification of the benchmark model is included in the calculation error. Since these errors have a positive correlation among the benchmarks, the prediction accuracy is expected to be improved by considering these correlations. For the sensitivity analysis of the correlation among benchmarks, the correlation coefficient of experiment error and that of calculation error is assumed from 0.0 to 0.9. The results indicate that the prediction accuracy of the multiplication factor can be improved by increasing the correlation coefficient of experiment error and that of calculation error. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

TEX-Chlorine Assemblies: Highly Enriched Uranium Plates with Sodium Chloride Absorbers Using Polyethylene Moderator and Polyethylene Reflector

This evaluation documents highly enriched uranium (HEU) experimental critical configurations with polyethylene moderators and sodium chloride absorbers conducted as part of the United States Nuclear Criticality Safety Program’s Thermal/Epithermal eXperiments (TEX) program. HEU-MET-MIXED-021 provides the benchmark evaluation of five TEX experiments designed to establish baseline configurations with HEU Jemima plates moderated by high density polyethylene (HDPE). The TEX-HEU experiments were designed to cover five different fission energy regimes by varying the thickness of the interstitial HDPE moderator, with varying fractions of thermal, intermediate, and fast fissions, and to be easily modified to accommodate test materials of interest. HEU-MET-INTER-013 documents the first TEX-HEU variation, incorporating hafnium in seven different experimental configurations. This evaluation covers an additional variant that incorporates absorber plates of compacted high-purity sodium chloride salt. These experiments were motivated by a criticality safety need for validation data for uranium purification by means of electrorefining with chloride salts, especially thermal and intermediate energy configurations resulting from moderator upset conditions, and their design was optimized by matching sensitivity profiles from application cases. All three experimental configurations are judged to be acceptable as benchmark cases. The main parameter varied between the configurations is the thickness of the polyethylene moderators and the sodium chloride absorbers between the HEU plates. Varying the thickness of the polyethylene tunes the neutron energy spectrum between majority thermal (Case 1 and 2) and intermediate (Case 3). The fission fractions, presented in Table 1, are determined calculationally. Case 3 is cross listed as HEU-MET-INTER-014.

42 ENGINEERING↗

Parallelization of NAS Benchmarks for Shared Memory Multiprocessors

This paper presents our experiences of parallelizing the sequential implementation of NAS benchmarks using compiler directives on SGI Origin2000 distributed shared memory (DSM) system. Porting existing applications to new high performance parallel and distributed computing platforms is a challenging task. Ideally, a user develops a sequential version of the application, leaving the task of porting to new generations of high performance computing systems to parallelization tools and compilers. Due to the simplicity of programming shared-memory multiprocessors, compiler developers have provided various facilities to allow the users to exploit parallelism. Native compilers on SGI Origin2000 support multiprocessing directives to allow users to exploit loop-level parallelism in their programs. Additionally, supporting tools can accomplish this process automatically and present the results of parallelization to the users. We experimented with these compiler directives and supporting tools by parallelizing sequential implementation of NAS benchmarks. Results reported in this paper indicate that with minimal effort, the performance gain is comparable with the hand-parallelized, carefully optimized, message-passing implementations of the same benchmarks.

Waheed, Abdul↗

Thermal Neutron Scattering Law Benchmark and Validation at NCSU [Slides]

The presentation discusses how the NCSU graphite SDT ORELA experiment is under development as a benchmark. It discusses the testing of various ENDF/B-VII.1 and ENDF/B-VIII.0 graphite libraries that have been performed using the PROTEUS benchmark. The presentation demonstrates that the NSCU Polyethylene ENDF/B-VIII.0 TSL improves agreement with total cross section measurements. The presentation concludes by stating that the NCSU single crystal sapphire TSL library is based on realistic data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

The AWAKEN wind farm benchmark, Part 2: Modeling results

Accurately modeling wind farm performance in complex atmospheric flows remains a challenge. This paper presents the modeling results of the American WAKE experimeNt (AWAKEN) wind farm benchmark, a collaborative effort involving 16 research groups from academia and industry within the International Energy Agency Wind Technology Collaboration Programme Task 57. The study evaluates a diverse suite of simulation tools, ranging from fast-running engineering wake models to high-fidelity large-eddy simulations, against a diurnal case study observed during the AWAKEN campaign. The benchmark utilized a three-phase structure to progressively assess model performance as observational data availability increased. Initial blind predictions showed that higher-fidelity models did not uniformly outperform simpler simulation tools. A distinct spatial bias was observed where models struggled to resolve the interplay between a low-level jet, wakes, and terrain-induced flow acceleration. In subsequent phases, leveraging additional measurements for model improvement led to a reduction in mean absolute error across the model ensemble; however, this effect was most pronounced in engineering wake models, where targeted calibration reduced error by up to 40~\%. Overall, the study demonstrates that inflow characterization remains a primary prerequisite for accuracy, particularly for models relying on coarse forcing datasets. While the limited ability to resolve local terrain-flow interactions under single-day conditions represent a recognized constraint, the overall findings on wake modeling and real-world validation still provide valuable guidance for model application and for mitigating this limitation.

Bodini, Nicola↗

NCSP Integral Experiments at Sandia in FY21 [Slides]

This presentation provides details regarding integral experiments at Sandia National Laboratory for fiscal year 2021. The experiments discussed are as follows: IER 230: Characterize the Thermal Capabilities of the 7uPCX; IER 304: Temperature Dependent Critical Benchmarks; IER 305: Critical Experiments with UO 2 Rods and Molybdenum Foils; IER 306: Critical Experiments with UO 2 Rods and Rhodium Foils ; IER 441: Epithermal HEX Lattices with SNL 7uPCX Fuel for Testing Nuclear Data; IER 452: Inversion Point of the Isothermal Reactivity Coefficient; and IER 523: Critical Experiments with ACRR UO 2 -BeO Fuel.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Structural Benchmark Creep Testing for Microcast MarM-247 Advanced Stirling Convertor E2 Heater Head Test Article SN18

This report provides test methodology details and qualitative results for the first structural benchmark creep test of an Advanced Stirling Convertor (ASC) heater head of ASC-E2 design heritage. The test article was recovered from a flight-like Microcast MarM-247 heater head specimen previously used in helium permeability testing. The test article was utilized for benchmark creep test rig preparation, wall thickness and diametral laser scan hardware metrological developments, and induction heater custom coil experiments. In addition, a benchmark creep test was performed, terminated after one week when through-thickness cracks propagated at thermocouple weld locations. Following this, it was used to develop a unique temperature measurement methodology using contact thermocouples, thereby enabling future benchmark testing to be performed without the use of conventional welded thermocouples, proven problematic for the alloy. This report includes an overview of heater head structural benchmark creep testing, the origin of this particular test article, test configuration developments accomplished using the test article, creep predictions for its benchmark creep test, qualitative structural benchmark creep test results, and a short summary.

life (durability)↗

GlideinBenchmark: collecting resource information to optimize provisioning

Choosing the right resource can speedup jobs completion, better utilize the available hardware and visibly reduce costs, especially when renting computers on the cloud. This was demonstrated in earlier studies on HEPCloud. But the benchmarking of the resources proved to be a laborious and time-consuming process. This paper presents GlideinBenchmark, a new Web application leveraging the pilot infrastructure of GlideinWMS to benchmark resources, and shows how to use the data collected and published by GlideinBenchmark to automate the optimal selection of resources. An experiment can select the benchmark or the set of benchmarks that most closely evaluate the performance of its workflows. With GlideinBenchmark and the help of the GldieinWMS Factory it controls the benchmark execution. Finally, a scheduler like HEPCloud’s Decision Engine can use the results to optimize resource provisioning.

Mambelli, Marco↗

GlideinBenchmark: collecting resource information to optimize provisioning

Choosing the right resource can speed up job completion, better utilize the available hardware, and visibly reduce costs, especially when renting computers in the cloud. This was demonstrated in earlier studies on HEPCloud. However, the benchmarking of the resources proved to be a laborious and time-consuming process. This paper presents GlideinBenchmark, a new Web application leveraging the pilot infrastructure of GlideinWMS to benchmark resources, and it shows how to use the data collected and published by GlideinBenchmark to automate the optimal selection of resources. An experiment can select the benchmark or the set of benchmarks that most closely evaluate the performance of its workflows. GlideinBenchmark, with the help of the GlideinWMS Factory, controls the benchmark execution. Finally, a scheduler like HEPCloud's Decision Engine can use the results to optimize resource provisioning.

Mambelli, Marco [Fermilab] (ORCID:0000000294892681↗

Sensitivity-based Experiment Design Optimization for a Molybdenum Critical Experiment

A lack of intermediate molybdenum benchmarks in the ICSBEP has been identified by LANL, Y-12, and IRSN. This lacking adversely effects criticality safety operations and leaves new differential molybdenum data unvalidated. NCERC is proposing a series of intermediate integral experiments to better the understanding of molybdenum systems. Using MCNP6.2 with the ENDF/B-VIII.0 nuclear data library a single unmoderated and four moderated system designs were identified using a sensitivity optimization method. Each proposed system was found to be at least twice as sensitive to the 95 Mo capture cross section in the URR as the sole existing intermediate molybdenum benchmark in the ISCBEP handbook. The addition of a new molybdenum sensitive intermediate system would improve future nuclear data evaluations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

AI Benchmark Democratization and Carpentry

Benchmarks are a cornerstone of modern machine learning, enabling reproducibility, comparison, and scientific progress. However, AI benchmarks are increasingly complex, requiring dynamic, AI-focused workflows. Rapid evolution in model architectures, scale, datasets, and deployment contexts makes evaluation a moving target. Large language models often memorize static benchmarks, causing a gap between benchmark results and real-world performance. Beyond traditional static benchmarks, continuous adaptive benchmarking frameworks are needed to align scientific assessment with deployment risks. This calls for skills and education in AI Benchmark Carpentry. From our experience with MLCommons, educational initiatives, and programs like the DOE's Trillion Parameter Consortium, key barriers include high resource demands, limited access to specialized hardware, lack of benchmark design expertise, and uncertainty in relating results to application domains. Current benchmarks often emphasize peak performance on top-tier hardware, offering limited guidance for diverse, real-world scenarios. Benchmarking must become dynamic, incorporating evolving models, updated data, and heterogeneous platforms while maintaining transparency, reproducibility, and interpretability. Democratization requires both technical innovation and systematic education across levels, building sustained expertise in benchmark design and use. Benchmarks should support application-relevant comparisons, enabling informed, context-sensitive decisions. Dynamic, inclusive benchmarking will ensure evaluation keeps pace with AI evolution and supports responsible, reproducible, and accessible AI deployment. Community efforts can provide a foundation for AI Benchmark Carpentry.

von Laszewski, Gregor [Virginia U.]↗

Final Design of a New Pulsed-Neutron Die-Away Experimental Testbed for Thermal Scattering Law Benchmarks (PNDA) (IER-501 CED-2)

This report presents the final design (CED-2) of IER-501, a testbed for pulsed-neutron die-away (PNDA) experiments at Lawrence Livermore National Laboratory (LLNL). The PNDA experiments will be high-quality benchmarks that serve to optimize and validate thermal neutron scattering laws (TSLs), which are high-priority nuclear data for the Department of Energy’s Nuclear Criticality Safety Program (NCSP). This CED-2 was guided by experimental results gathered from a prototype experimental set-up rather than with detailed simulations as is typically done for criticality experiments. The report presents the PNDA design and its equipment, and it documents the methodology used to postprocess the measured data. It discusses how experimental configurations influenced the decay-constant eigenvalue, or the integral parameter, of the experiment. The studied variations included the distance from the target to the generator, the orientation of the generator relative to the box, the orientation of the target to the generator, the effect of HDPE lining in the shielding box, the settings of the generator, and finally the benefits of using a low-scatter facility. From these results, a final configuration for the target, detectors, shielding box, and neutron generator was chosen. Two factors particularly influenced the chosen configuration: the reproducibility of the experiment’s geometry for benchmark modeling, and the minimization of measured neutrons scattered off the shielding box.

42 ENGINEERING↗

The Need for a New LLNL Pulsed Sphere Neutron Leakage Spectra Series

Here, it is shown that spectra measured as part of the Lawrence Livermore National Laboratory Pulsed Sphere (LPS) program offer decisive information to locate formatting or physics issues in nuclear data of key interest for fusion reactor simulations. However, experiments from this measurement series are not benchmarks. For instance, their uncertainties are incomplete. There are also many open questions—e.g., on the setup, the detector response, and whether LPS are accurately modeled—that cannot be answered anymore given the limited documentation and that many of the experimenters are no longer actively working. This limited knowledge has implications when one tries to adjust nuclear data to LPS spectra. Usually, one adjusts to benchmarks representing an application with the hope to get more precise nuclear data for the application of interest where differential data might be scarce and/or to reduce nuclear data uncertainties in the application simulations. However, it is demonstrated that adjustment with LPS spectra without accounting for missing uncertainties and modeling potential biases in the experimental data leads to adjusted data that are highly unphysical. That means adjusted data differ significantly from evaluated data based on information from differential experiments; also, application quantities predicted with the adjusted data deviate distinctly from experimental ones. While we can approximate our limited knowledge on these experiments with Gaussian processes in the adjustment process, this modeling of bias is arbitrary rather than based on a physics explanation, calling into doubt the validity of resulting adjusted data. Thus, we discuss here the need for a new measurement series, learning from the strengths and weaknesses of the LPS program, to yield decisive and well-benchmarked integral experiments to support fusion reactor research.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Pulsed-Neutron Die-Away Response of H 2 O Targets to a D-T Generator Pulse

Pulsed-neutron die-away (PNDA) experiments were completed at Lawrence Livermore National Laboratory (LLNL). The goal of these experiments was to provide a benchmark to validate thermal neutron scattering laws of H 2 O. The experiment was conducted with a deuterium-tritium (D-T) neutron generator producing pulses of 14.1 MeV neutrons that impinged on a moderating target. The neutrons scattered and thermalized within the target and were counted as a function of time using Helium-3 ( 3 He) detectors that surrounded the target. These data provide a time-decay profile of the neutron population from which the time eigenvalue of the experiment is calculated. The time eigenvalue quantity α represents the integral parameter of interest. This report describes the measurements for H 2 O targets. The measurements were conducted over several days beginning on October 23rd, 2023. All measurements were completed at the low-scatter facility at LLNL. The evaluation identifier is FUND-LLNL-DT-H2O-PNDA-001.

3He Detectors↗

Pulsed-Neutron Die-Away Response of H 2 O Targets to a D-T Neutron Generator Pulse

Pulsed-neutron die-away (PNDA) experiments were completed at Lawrence Livermore National Laboratory (LLNL). The goal of these experiments was to provide a benchmark to validate thermal neutron scattering laws of H 2 O. The experiment was conducted with a deuterium-tritium (D-T) neutron generator producing pulses of 14.1 MeV neutrons that impinged on a moderating target.

3He Detectors↗