SEARCH · Search NASA

Results for “Benchmark Experiments”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Pebble Tanker Model for Nuclear Criticality Safety Needs

This report documents a study performed to investigate the requirements for criticality safety benchmark experiments for high-assay, low-enriched uranium (HALEU) fuel in transportation applications. In this work, an exploratory application model, the “Pebble Tanker,” was developed to represent TRISO fuel in a transportation scenario for an analysis of the validation basis in industrial quantities. An aspect of the criticality validation process involves assessing the “similarity” between application and experimental benchmark systems through an integral index parameter evaluation. Here, this includes propagating nuclear data uncertainties and calculating a correlation coefficient (hereinafter referred to as “c k ”) to evaluate the similarity of benchmark experiments compared with the application Pebble Tanker model. Finding sufficient critical benchmark experiments allows for the evaluation of bias and bias uncertainty, thus determining the upper subcritical limit (USL) of the transportation package. A target k eff of ~0.94 was used in this work to establish appropriate modeling conditions, reflecting a reasonable estimate for a USL. Two container models were investigated: one with the Hermes-type pebble and one with the Pebble Bed Modular Reactor (PBMR)–type pebble. The models were simplified, considering only fuel, containment structure, and either water or air. This allows a focus on the underlying physics of applications involving TRISO fuel pebbles using the Pebble Tanker model. A crucial consideration is the transport package's ability to safely hold pebbles while flooded, maintaining subcritical conditions. Tools available in the SCALE 6.3.1 suite—the CSAS6-Shift, TSUNAMI-3D-Shift, and TSUNAMI-IP sequences—were employed for neutronics and sensitivity and uncertainty (S/U) analysis of the Pebble Tanker. Findings demonstrated sufficient available critical experiment benchmarks to perform a validation of the Pebble Tanker in the most reactive state, i.e., when the Tanker is flooded.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2021

Modeling of the Molten Salt Reactor Experiment with SCALE

A SCALE model was developed for the Molten Salt Reactor Experiment (MSRE) benchmark that was recently added to the International Handbook of Evaluated Reactor Physics Benchmark Experiments. This SCALE model served as a basis for criticality calculations and nuclear data sensitivity and uncertainty analyses with the Monte Carlo code Shift and the TSUNAMI computational capabilities in the SCALE code system. The focus of this work is the assessment of the impact of nuclear data on the calculated eigenvalue results in support of the discussion of differences between the calculated and the experimental eigenvalue result. The differences in the eigenvalues obtained using the ENDF/B-VII.0, ENDF/B-VII.1, and ENDF/B-VIII.0 nuclear data libraries cover a relatively small range of ~230 pcm. Since eigenvalue sensitivity of the MSRE is dominated by the neutron multiplicity and neutron capture of 235 U and elastic scattering in graphite, relevant changes in the ENDF/B libraries for nuclear reactions (such as carbon capture) that caused large differences in other graphite-moderated systems did not have a significant impact. Propagation of nuclear data uncertainty results in an eigenvalue uncertainty of ~700 pcm with the major contributors being 235 U neutron multiplicity, graphite elastic scattering, and 7Li neutron capture. All calculations resulted in large differences of ~2000 pcm in eigenvalue compared to the benchmark experimental value. Several potential contributors to this difference—including uncertainties and gaps in the knowledge of the material, geometry, and nuclear data—were identified. Simplified models of the full MSRE core were developed, and similarity assessments were conduced with the full MSRE core model. It was found that simplified models can serve as adequate surrogates of the full-core model such that they can be used for performing selected nuclear data performance assessments with a lower computational burden.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2025

Preliminary Comparison of Neutron Detector Sensitivities [Poster]

Nuclear data (ND) is vital to predictive simulations such as those completed with MCNP®. ND sensitivities are used to optimize the design of benchmark experiments. Diverse benchmarks (including neutron noise) are required to further our understanding of ND. Measured and simulated data of a 4.5-kg Pu sphere was used to calculate neutron noise parameters and associated ND Sensitivities

Nuclear Criticality Safety Program (NCSP)↗

NASA NTRS2019

The Arctic-Boreal vulnerability experiment model benchmarking system

NASA's Arctic-Boreal Vulnerability Experiment (ABoVE) integrates field and airborne data into modeling and synthesis activities for understanding Arctic and Boreal ecosystem dynamics. The ABoVE Benchmarking System (ABS) is an operational software package to evaluate terrestrial biosphere models against key indicators of Arctic and Boreal ecosystem dynamics, i.e.: carbon biogeochemistry, vegetation, permafrost, hydrology, and disturbance. The ABS utilizes satellite remote sensing data, airborne data, and field data from ABoVE as well as collaborating research networks in the region, e.g.: the Permafrost Carbon Network, the International Soil Carbon Network, the Northern Circumpolar Soil Carbon Database, AmeriFlux sites, the Moderate Resolution Imaging Spectroradiometer, the Orbiting Carbon Observatory 2, and the Soil Moisture Active Passive mission. The ABS is designed to be interactive for researchers interested in having their models accurately represent observations of key Arctic indicators: a user submits model results to the system, the system evaluates the model results against a set of Arctic-Boreal benchmarks outlined in the ABoVE Concise Experiment Plan, and the user then receives a quantitative scoring of model strengths and deficiencies through a web interface. This interactivity allows model developers to iteratively improve their model for the Arctic-Boreal Region by evaluating results from successive model versions. We show here, for illustration, the improvement of the Lund–Potsdam–Jena-Wald Schnee und Landschaft (LPJwsl) version model through the ABoVE ABS as a new permafrost module is coupled to the existing model framework. The ABS will continue to incorporate new benchmarks that address indicators of Arctic-Boreal ecosystem dynamics as they become available.

ABoVE↗

DOE OSTI2024

Validating ENDF/B-VIII.1beta3 with LLNL Pulsed-Sphere Experiments and ICSBEP Benchmarks [Slides]

LPS experiments are not benchmarks but can provide valuable input. 22/1/24 LPS experiments are not benchmarks but can provide valuable input. LPS (run by Denise) help validate nuclear data up to 15 MeV. They test scattering and fission data. They have incomplete uncertainties from 2-8%. I take note when: (1) I see C/E differences above the peak and before late times => 20%. (2) Simulated results between libraries change by => 20% without a good explanation.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2021

MULTIPHYSICS-MODELING OF FIRE-INDUCED URANIUM AEROSOL FORMATION – A-POSTERIORI BENCHMARKING OF EXPERIMENTS

The formulation and solution of a model that properly described the temperature profiles of uranium in fire conditions was prepared, verified and validated, to support a-posteriori benchmarking of historical experiments. Data from the multi-physics model combined with data regression from the experiments provides a useful tool for exploring sources of potential bias in historical experiments. The approaches used are augmented by visual observations and photographic evidence allowing for correlations between various phenomena, independent of whether or not that specific phenomena are part of the validated model. In this manner, the validated model is a tool for a-posteriori benchmarking, and not a model designed to replicate the experimental output exactly for any specific experiment. For experiments like the Clark (2015) experiments, this integrated model (including chemistry) demonstrated that the largest bias was associated in the metallurgy of the coupons. The model developed does serve as a basis for defending which of the historical alloys tested are the most appropriate for any other alloy being considered (e.g., one that has not yet been tested). The model identifies key reactions that impact uranium chemistry and can significantly bias experimental results. Through use of the model and energy balances, data from historical experiments by Elder and Tinkle (1980) were regressed and benchmarked. This study identifies that all uranium alloys are not equal and that there are distinct differences between the dominant alloys representing distinct metallurgical phases.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2022

Nuclear data covariances are critical input to determine upper sub-critical limits and to design experiments to increase it [Slides]

This presentation discusses how Upper Subcritical Limits (USL) are key parameters to determine operational limits in nuclear criticality safety evaluations. It also discusses an example of plutonium casting operation using tantalum at LANL PF-4. The Whisper tool at Los Alamos relies on many inputs, including covariance data, leading the presentation to ask if an existing benchmark data be used in Whisper to adjust nuclear data and covariances to justify a higher USL. If not, Whisper can be used to help design an optimal new benchmark experiment. The presentation also seeks to determine what the possible impacts are on USL and operational limits for plutonium casting. In conclusion, nuclear data covariances are used for by Whisper for: GSSL adjustment of nuclear data and covariances, identification of most similar existing benchmark experiments to application, simulation of Upper Subcritical Limit of application, and input to optimization techniques for designing most appropriate new benchmark experiment(s) to meet requirements. This requires a complete set of nuclear data covariances, benchmarks and k-effective sensitivity profiles (for both benchmarks and applications). The presentation concludes by asking if end users should trust results that depend on current covariance data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2020

Enhancing nuclear data validation analysis by using machine learning

In this work, we demonstrate how machine learning (ML) techniques can be used as an auxiliary tool for nuclear data validation analysis. The output of the ML analysis can inform evaluators and validators on the quality, or lack thereof, of specific nuclear data and benchmark experiments with respect to simulating these experimental benchmark values. To this end, measured and simulated effective neutron multiplication factors, k eff , of 875 selected ICSBEP critical assemblies and the latter's sensitivities with respect to nuclear data as well as benchmarks' features (e.g., material nuclide, core geometry) are used as input for a random forest (RF) regression model. The RF is used to encode the complex inter-dependencies between thousands of nuclear data features (i.e., sensitivity profiles and aspects describing the measurements) and 875 simulated and experimental k eff values in order to understand what nuclear data features are most informative for predicting bias. The complexity of relationships and high-dimensional space is difficult-to-impossible to search fully using simply expert judgment. As a first proof-of-concept—step, it is demonstrated that this technique is able to correctly trace large discrepancies between simulated and experimental k eff back to fabricated shortcomings in nuclear data that were perturbed to simulated k eff values. In a second, real-case scenario, step, the RF algorithm is used to validate the ENDF/B-VIII.0 library in comparison to ENDF/B-VII.1 nuclear data. One case is showcased where the chosen ML algorithms highlighted nuclear data (the 19 F(n,inl) cross section from 0.4–0.9 MeV) that are shown to be problematic by comparing them to associated differential experimental data and nuclear data from other libraries. In addition to that, it is shown that the RF results point towards poor benchmark experiments and associated underestimated uncertainties (e.g., the PU-SOL-THERM-028 series). However, using the RF algorithm for validating nuclear data with respect to k eff is currently limited to pinpointing groups of questionable nuclear data due to the inherent correlations between features introduced by the nuclear data themselves and how k eff is simulated. Due to this, we recommend that the ML methods presented be used to augment—rather than replace—the expert knowledge of evaluators and validators.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

DOE OSTI2020

Validation of MCNP Critical Benchmark Models of Moderated Highly Enriched Uranium Slabs

A new centralized repository of high-quality MCNP models of critical benchmark experiments is currently under development at Los Alamos National Laboratory (LANL). The benchmark experiments are described in the International Criticality Safety Benchmark Evaluation Project (ICSBEP) Handbook, and the initial set of benchmark models are derived from the Whisper Suite provided with MCNP6.2. This effort is a collaboration among the Nuclear Criticality Safety, Nuclear Data, and Monte Carlo code development/application organizations at LANL. The goal is to build a single LANL benchmark collection that is up to date with the latest ICSBEP revision, has a formal review and revision process, is contained in an open-source repository, and utilizes new Python tools for improved input and output file review. This paper describes the validation of the models associated with HEU-MET-FAST-007, “Uranium Metal Slabs Moderated with Polyethylene, Plexiglas, and Teflon”. The Monte Carlo n-Particle (MCNP) models were compared to the second revision of HEU-MET-FAST-007. The experiment considered critical configurations of highly enriched uranium (HEU) metal slabs and various moderators in 43 unique cases. The slabs of uranium were separated by layers of moderating material, forming an assembly. The assembly was separated in two halves with one half placed on a stationary table and the other attached to a moveable table that could be raised and lowered via pulleys connected to the ceiling of the shielded room. To reach criticality, the two halves were brought together with a negligible gap between the assemblies.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2020

Validation of MCNP Critical Benchmark Models of PU-MET-FAST-016

A new centralized repository of high-quality MCNP models of critical benchmark experiments is currently under development at Los Alamos National Laboratory (LANL). The repository is the combined effort of the Nuclear Criticality Safety, Nuclear Data, and Monte Carlo code development/application organizations at LANL. The initial set of benchmark models in the repository are derived from the Whisper Suite provided with MCNP6.2 and are evaluated against the benchmark experiments described in the International Criticality Safety Benchmark Evaluation Project (ICSBEP) Handbook. The goal is to build a single LANL benchmark collection that is up to date with the latest ICSBEP revision, has a formal review and revision process, is contained in an open-source repository, and utilizes new Python tools for improved input and output file review. This paper describes the validation of the models associated with PU-MET-FAST-016, “Flooded 3X3X3 Arrays of 3-kg Plutonium (Pu) Metal Cylinders – Phase I”. In this critical experiment, twenty-seven 3-kg Pu metal cylinders with a height of 46.33 ± 0.15 mm and diameter of 65.25 ± 0.05 mm were arranged in a cubic array. The Pu cylinders were sealed in aluminum cans, and three cans were placed in each of nine perforated aluminum sleeves, as shown in Fig. 1. The nine sleeves were supported by an aluminum frame that allowed for control of the lateral spacing of the cylinders, both in the X and Y directions. The benchmark experiment measured thirteen configurations. Of these configurations, six were modeled using MCNP.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2022

SCALE 6.2.4 Validation: Nuclear Criticality Safety

The computational bias of criticality safety computer codes must be established through the validation of the codes to critical experiments. A large collection of suitable experiments has been vetted by the International Criticality Safety Benchmark Evaluation Project (ICSBEP) and made available in the International Handbook of Evaluated Criticality Safety Benchmark Experiments (ICSBEP Handbook). More than 600 cases from this handbook have been prepared and reviewed within the Verified, Archived Library of Inputs and Data (VALID), which is maintained by the Reactor and Nuclear Systems Division at Oak Ridge National Laboratory. The performance of the KENO V.a and KENO-VI Monte Carlo codes within the SCALE 6.2.4 code system is assessed using the VALID models of benchmark experiments. A range of nuclear cross section libraries based on Evaluated Nuclear Data File (ENDF)/B-VII.1 in both multigroup (MG) and continuous energy (CE) formats is considered. The critical experiments available to validate the KENO V.a code cover 15 broad categories of systems. These systems use a range of fissile materials, including a range of uranium enrichments, various plutonium isotopic vectors, and some mixed uranium/plutonium oxides. The physical forms of the fissile material also vary and are represented as metal, solutions, or arrays of rods or plates in a water moderator. The neutron energy spectra of the systems also vary and cover fast, intermediate, mixed, and thermal spectra. Over 550 of the total cases use the KENO V.a code for the four nuclear data libraries considered in this report.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2022

Validation of MCNP Critical Benchmarks Models of Highly Enriched Uranium Cylinders

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2025

ORNL Testing of Multiple Graphite Benchmarks [Slides]

Integral criticality safety and reactor physics benchmark experiments from the International Handbook of Evaluated Criticality Safety Benchmark Experiments (ICSBEP Handbook) and the International Handbook of Reactor Physics Experiments (IRPhE Handbook) are essential for nuclear data validation and testing

ENDF↗

NASA NTRS2022

Uncertainty Estimation for SMAP Level-1 Brightness Temperature Assimilation at Different Timescales

Soil Moisture Active Passive (SMAP) mission brightness temperature (T(b) ) observations are assimilated into NASA’s Catchment Land Surface Model using an Ensemble Kalman filter to update simulations of surface and root-zone soil moisture. Different time series components of the T(b) observations are assimilated including anomalies, inter-annual variations, and high frequency variations. To optimize the weights that the data assimilation (DA) puts on the observations, the ratio between the uncertainties of modeled and observed T(b) is approximated using modeled and observed soil moisture uncertainties estimated using triple collocation analysis. In a benchmark experiment, T(b) observations are assimilated using a spatially constant 4 Kelvin (K) observation uncertainty, as in the operational SMAP Level-4 algorithm. All DA experiments exhibit notable skill improvements in most regions. Improvements are largest for the inter-annual variations in the simulations of both surface and root-zone soil moisture (mean improvements in terms of Pearson correlation (-) are 0.08 and 0.06, respectively). Anomaly simulations improve similarly (0.07), and improvements in the high-frequency variations are only observed for surface soil moisture simulations (0.06). No notable difference in skill - neither improvement nor deterioration - is observed between the experiments that use optimized observation uncertainty parameters and the 4 K benchmark experiment. This may be explained by the presence of large observation operator errors, which are analytically shown to have the potential to render post-update uncertainty insensitive to inaccuracies in estimates of the Kalman gain. These results have important implications for the design of soil moisture DA systems, in particular for parameterizing model and observation uncertainties.

Hydrology↗

NASA NTRSDate not supplied

Uncertainty Estimation for SMAP Level-1 Brightness Temperature Assimilation at Different Timescales

In this study, we assimilate Soil Moisture Active Passive (SMAP) mission brightness temperature (Tb) observations into NASA’s Catchment Land Surface Model using an Ensemble Kalman filter to update surface and root-zone soil moisture simulations. Different time series components of the Tb observations are assimilated including anomalies, inter-annual variations, and high-frequency variations. To optimize the weights that the data assimilation (DA) puts on the observations, the ratio between the un-certainties of modeled and observed Tb is approximated using modeled and observed soil moisture uncertainties estimated using triple collocation analysis. Results are compared to a benchmark experiment that mimics the operational SMAP Level-4 algorithm, which assimilates Tb observations using a spatially-constant 4 Kelvin (K) observation uncertainty. All DA experiments exhibit notable skill improvements in most regions. Improvements are greatest for the inter-annual variations in the simulations of both surface and root-zone soil moisture (mean improvements in terms of Pearson correlation (-) are 0.08 and 0.06, respectively). Anomaly simulations improve similarly (0.07), and improvements in the high-frequency variations are only observed for sur-face soil moisture simulations (0.06). Strikingly, however, no notable difference in skill—neither improvement nor deterioration—is observed between the experiments that use optimized observation uncertainty parameters and the 4 K benchmark experiment. We show, analytically, that this may be explained by the presence of large observation operator errors, which have the potential to render post-update uncertainty insensitive to inaccuracies in the Kalman gain.

Alexander Gruber↗

DOE OSTI2020

Assessment of Existing Transportation Packages for Use with HALEU

Commercial light water reactor operators and fuel vendors in the United States are pursuing changes to fuel that include increased 235 U enrichment. Economic studies generally anticipate maximum near-term fuel assembly designs with up to 8 wt.% 235 U. Many next-generation nuclear reactor designs require high-assay low-enriched uranium (HALEU) (19.75 wt.% > 235 U > 5 wt.%) fuel. One necessary element for the commercial-scale use of HALEU is the ability to safely transport large quantities of enriched fuel material in multiple forms. However, there is uncertainty as to whether subcriticality requirements can be satisfied with existing package designs and whether existing critical benchmark experiment data are sufficient to support criticality safety code validation for HALEU transportation applications. This study assesses the potential to use currently licensed transportation packages for the transportation of increased enrichment unirradiated U fuel forms. The assessment uses selected package designs that represent the five categories of fuel form-boiling water reactor pins and assemblies, pressurized water reactor pins and assemblies, UF 6 , U-metal and tristructural isotropic (TRISO) particles, and UO 2 pellets or powder-and focuses on demonstrating subcriticality and identifying benchmark critical experiments appropriate for use in criticality computer code validation. Key quantities of interest that relate to subcriticality are limiting conditions (e.g., optimum moderation), package or package array k eff , package capacity, and package transportation array size. The SCALE TSUNAMI-3D and TSUNAMI Indices and Parameters codes are used for sensitivity and uncertainty calculations and for identification of candidate critical benchmark experiments for code validation. The primary metric for identifying candidate benchmarks is the similarity coefficient, c k . For each fuel form category, a representative package is evaluated. Results provided for each package evaluation include enrichment and packaging limits (e.g., maximum transportation array size as a function of enrichment) and benchmark critical experiment similarity coefficients. Results indicate that there are viable means for increasing enrichments into the HALEU range across the spectrum of fuel forms with differing increase amounts available for different packages. Sources of subcriticality margin to offset increased enrichment reactivity include reduced transportation array size, reduced fissile mass, burnable absorber credit, and safety analysis margin harvesting. For all packages except the DN-30, numerous critical benchmark experiment candidates for validation were identified.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2024

Expanding Scientific Horizons Through High Field Dynamic Nuclear Polarization with Advanced Organic BiRadicals

This project aimed to advance the capabilities of high-field Dynamic Nuclear Polarization (DNP) Nuclear Magnetic Resonance (NMR) spectroscopy at 800 MHz through the synthesis and evaluation of novel biradicals. While the targeted HyTEK biradical synthesis faced significant challenges, alternative efforts focused on synthesizing intermediate compounds and exploring alternative biradicals. A portion of the BDPA precursor was successfully converted into BDPA-TEMPO, though further DNP testing could not be completed within the project timeline. Benchmarking experiments with existing biradicals, including TEKPol and M-TinyPol, were conducted to evaluate their performance under high-field conditions. These efforts provided valuable insights into DNP enhancements, refined operational protocols for high-field experiments, and established benchmarks for future polarizing agent development.

36 MATERIALS SCIENCE↗

DOE OSTI2021

Evaluation of Oak Ridge National Laboratory Health Physics Research Reactor Operation Data for Criticality Accident Alarm System Benchmark Creation

Over the last few decades, the International Criticality Safety Benchmark Evaluation Project (ICSBEP) Working Group has focused on gathering critical and subcritical benchmark experiment data from different facilities around the world for inclusion in the International Handbook of Evaluated Criticality Safety Benchmark Experiments (ICSBEP Handbook). The compiled data can be used by criticality safety analysts to help validate their calculation tools and cross-section libraries for a variety of applications.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗