Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark Experiments”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Bayesian Monte Carlo Evaluation Framework for Cross Sections Nuclear Data and Integral Benchmark Experiments

The new Bayesian Monte Carlo (MC) evaluation framework described in this abstract has been conceived as an attempt to improve nuclear data evaluations of differential crosssection data by removing the following two approximations conventionally employed for nuclear data evaluations: all probability density functions (PDFs) of all data and model parameters, both prior and posterior, are assumed to be normal (i.e., Gaussian) PDFs, and all uncertainties and covariances are propagated using a linear approximation. With these approximations removed, the Bayesian MC (BMC) framework could be used to account for nonlinear effects and would enable improved evaluations of differential cross sections and IBE data that are presently performed based on the assumptions itemized above. The BMC would also improve upon the uniform sampling of IBE parameters from within ranges defined by their evaluated uncertainties.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Increased Fidelity and Associated Computational cost of Detailed Integral Experiment Benchmarks [Slides]

It does not seem like the system is significantly more sensitive to diameters of components near the center of the core. Intuitively it is, but was not detectable with simulations run to a Monte Carlo k eff uncertainty of 0.00002. The system is more sensitive to heights of components near the center of the core. Most (if not all) Zeus style benchmarks have perturbed core component heights individually.

42 ENGINEERING↗
DOE OSTI2025

Cerberus and the Zeus Suite of Critical Experiment Benchmarks [Slides]

This presentation finds that as it was designed, Cerberus is extremely sensitive to copper nuclear data. Just changing copper nuclear data to another library can swing simulated keff by >1000 pcm. ENDF/B-VIII.1 and JENDL-5.0 both show large downward trends in keff as copper interstitial thickness is increased

ENDF/B-VIII.1↗
NASA NTRS1988

Accuracy requirements and benchmark experiments for CFD validation

The role of experiment in the development of Computation Fluid Dynamics (CFD) for aerodynamic flow prediction is discussed. The CFD verification is a concept that depends on closely coordinated planning between computational and experimental disciplines. Because code applications are becoming more complex and their potential for design more feasible, it no longer suffices to use experimental data from surface or integral measurements alone to provide the required verification. Flow physics and modeling, flow field, and boundary condition measurements are emerging as critical data. Four types of experiments are introduced and examples given that meet the challenge of validation: flow physics experiments; flow modeling experiments; calibration experiments; and verification experiments. Measurement and accuracy requirements for each of these differ and are discussed. A comprehensive program of validation is described, some examples given, and it is concluded that the future prospects are encouraging.

Marvin, Joseph G.↗
NASA NTRS1988

Accuracy requirements and benchmark experiments for CFD validation

The role of experiment in the development of Computational Fluid Dynamics (CFD) for aerodynamic flow prediction is discussed. The CFD verification is a concept that depends on closely coordinated planning between computational and experimental disciplines. Because code applications are becoming more complex and their potential for design more feasible, it no longer suffices to use experimental data from surface or integral measurements alone to provide the required verification. Flow physics and modeling, flow field, and boundary condition measurements are emerging as critical data. Four types of experiments are introduced and examples are given that meet the challenge of validation: flow physics experiments; flow modeling experiments; calibration experiments; and verification experiments. Measurement and accuracy requirements for each of these differ and are discussed. A comprehensive program of validation is described, some examples given, and it is concluded that the future prospects are encouraging.

Marvin, Joseph G.↗
NASA NTRSDate not supplied

Laser Beam Welding Benchmark Experiments Performed in Reduced Gravity and Vacuum

Laser beam welding (LBW) is affected by the extreme temperatures, reduced pressure, and reduced gravity present in space environments. Gravity and pressure especially influence its melt pool and solidification dynamics. A compact, modular vacuum chamber adaptable to flight platforms from parabolic to orbital currently hosts an experiment to investigate the combined influence of reduced gravity and pressure on LBW. A swappable cartridge contains a rotating platen on which customizable workpieces can be welded under vacuum, greatly increasing experimental throughput. Instrumentation includes weld and thermal cameras observing the process, thermocouples placed on workpieces, accelerometers, and vacuum sensors. Experimental data gathered during the welding process will be combined with post-flight nondestructive evaluation, metallography, and mechanical testing to provide validation datasets for computational modeling. Phase I of this effort involves a parabolic flight campaign in low gravity while an anticipated Phase II would proceed to in-space demonstration to access extended duration microgravity.

in-space welding↗
DOE OSTI2022

Estimating List-Mode Data Sensitivities to Nuclear Data with MCNP6

Nuclear data are a vital component of predictive simulations used in applications like experiment design, stockpile stewardship, nuclear nonproliferation/safeguards, health physics, and criticality safety. A singular simulation requires the coalescence of different areas of nuclear data such as cross sections, angular distributions, and energy distributions of emitted neutrons for different materials and energy ranges. Improving nuclear data and thus reducing the uncertainty in simulated parameters could enable smaller, better-informed safety factors and ultimately reduce operational and procedural costs. There is a constant effort to garner a better understanding of the physical quantities represented by nuclear data through experiments. Integral experiment benchmarks use simulated and measured results to validate current nuclear data values. In the past, benchmarks primarily focused on the effective multiplication factor (k eff ); however, this limited scope has caused compensating errors and areas of nuclear data that lack validation. Compensating errors are inaccuracies in nuclear data that are obfuscated by cancellation when observing integrated values such as k eff . Diverse integral benchmark experiments that look for quantities of interest other than k eff and include multiple responses minimize the possibility of compensating errors and provides validation to areas of nuclear data previously lacking experimental validation. Benchmark experiments can be optimized during the design process to be highly dependent on specific areas of nuclear data. The dependence of a response in an experiment to a specific area/type of nuclear data is defined as sensitivity. A larger sensitivity means that nuclear data uncertainties will play a larger role in the response(s) resulting in larger bias. Currently, the sensitivity capabilities of the Monte Carlo N-Particle (MCNP ®1 ) transport code are limited to responses of k eff and tallied values (e.g., flux, surface current). As a part of the EUCLID project, this work explores estimating list-mode nuclear data sensitivities that can be used to design experiments aimed to constrain and reduce compensating errors in nuclear data by focusing on responses other than k eff . Tallied values are ideal quantities that are estimated with detectors during experiments. List-mode data (a list of neutron collection times) are the direct output of detector systems in subcritical neutron noise experiments. Expanding MCNP sensitivity capabilities to include the sensitivity of responses estimated from list-mode data, such as the prompt neutron decay constant (α) and multiplicity estimates (S and D), enables more direct comparison of simulated and measured experimental quantities. Additionally, deterministic tools such as SENSMG are capable of obtaining sensitivities to a wide variety of responses; however, these tools cannot handle complex geometries due to the assumptions made in discretizing the phase-space variables of the Boltzman transport equation.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

A Verification of Flux Sensitivity Estimates Using the MCNP Tally Perturbation Tool

Nuclear data is commonly used in applications such as nuclear nonproliferation, safeguards, and criticality safety. More specifically, nuclear data is used in predictive simulation codes like the Monte-Carlo N-Particle (MCNP ® ) transport code, Serpent, and similar radiation transport codes. The improvement of nuclear data enables more precise and accurate simulations, which result in higher fidelity designs and reduced operational/procedural costs. Therefore, the improvement of nuclear data is of paramount importance across the nuclear community. Nuclear data is improved and validated through integral benchmark experiments. The design of benchmark experiments is an extensive process; therefore, these experiments are often optimized on multiple characteristics, including sensitivity to the nuclear data, during the design process. Sensitivity is a measure of how much a quantity changes due to changes in independent variables such as experimental configuration. An experimental design that has a larger sensitivity to the nuclear data of interest will have a larger impact on the accuracy and precision of the validated data. Past integral benchmark experiments have primarily used the effective multiplication factor ($k_{eff}$) as the predominant measured quantity; however, experiments designed with other quantities in mind would be able to optimize on validating different areas of the nuclear data. A primary goal of the EUCLID project is to design, constrain, and reduce compensating errors in experiments focused on quantities other than $k_{eff}$ to better validate nuclear data across the board. Currently, there is a capability in MCNP to easily calculate the sensitivity of $k_{eff}$ to specific nuclear data of numerous reactions types and isotopes (KSEN card); however, the sensitivity of other quantities must be estimated in more strenuous manners. For example, the perturbation feature (PERT card) of MCNP can be used to estimate first-order sensitivities of some response in fixed source simulations. A recent announcement revealed that the first- and second-order perturbation features in previous releases of MCNP contained a bug. It was identified that particles were being scored into the wrong energy bin. The bug is in the most recent public release (MCNP6.2); however, a patch has been added to the most up to date version (MCNP6.2.2) that has not been released publicly. A direct comparison of the PERT card results for an F4 (neutron flux averaged over a cell) tally before and after the patch are shown in figure 1. All simulations used in the sensitivity estimates in this report were performed with MCNP6.2.2. This work verifies the patched MCNP perturbation tool by comparing first order sensitivities made using the PERT card to estimates made using manual perturbation of the compact ENDF (ACE) files.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Nuclear Data and Cross Section Testing Using ENDF/B-VIII.0

With the release of the Evaluated Nuclear Data File (ENDF)/B-VIII.0 library, nuclear criticality safety practitioners and engineers have access to the latest cross section sets available for their analyses. However, these cross sections must be rigorously tested and validated to ensure that the nuclear data are responsive to the needs of the individuals responsible for developing, implementing, and maintaining computational tools for criticality safety applications. Thus, the ENDF/B-VIII.0 library is tested and validated with a large collection of experiments that were vetted by the International Criticality Safety Benchmark Evaluation Project and made available in the International Handbook of Evaluated Criticality Safety Benchmark Experiments. A selection of benchmark experiments for use within the criticality safety community were prepared and reviewed within the Verified, Archived Library of Inputs and Data (VALID), which is maintained by the Nuclear Energy and Fuel Cycle Division at Oak Ridge National Laboratory. The performance of the ENDF/B-VIII.0 library is assessed by using VALID models of benchmark experiments with the beta 12 version of SCALE 6.3 KENO V.a and KENO-VI Monte Carlo codes. The performance is compared with the results obtained from with the ENDF/B-VII.1 library. This report considers multigroup (MG) and continuous energy (CE) formats of the ENDF/B-VIII.0 and -VII.1 libraries. The benchmark experiments within VALID that validate the ENDF/B-VIII.0 library cover 15 broad system categories by using a range of fissile materials, uranium enrichments, plutonium isotopic vectors, and mixed uranium/plutonium systems. These forms are represented as metals, solutions, or various arrays of rods or plates that cover a variety of neutron energy spectra: thermal, fast, mixed, and intermediate. Over 600 cases were considered for use with the KENO V.a and KENO-VI codes with the ENDF/B-VIII.0 library. The results of the Monte Carlo comparison of ENDF/B-VIII.0 to ENDF/B-VII.1 with both KENO V.a and KENO-VI indicate that there is a less than 0.53% Δk difference between the bias of calculated k eff from the expected values. The CE ENDF/B-VIII.0 library results in smaller magnitude biases than the ENDF/B-VII.1 data for HEU-MET-FAST, HEU-SOL-THERM, IEU-MET-FAST, LEU-SOL-THERM, PU-SOL-THERM, and U233-MET-FAST systems, while the MG results yielded smaller magnitude biases for HEU-MET-FAST, HEU-SOL-THERM, IEU-MET-FAST, LEU-COMP-THERM, LEU-SOL THERM, MIX-COMP-FAST, and U233-MET-FAST systems. Most notable are the adjustments to the plutonium and 233 U cross section data, which has resulted in noticeably lower biases in the ENDF/B VIII.0 results for the mixed, plutonium, and 233 U systems. Results of the sensitivity data file comparison generated from TSUNAMI-3D for selected VALID cases for the ENDF/B-VIII.0 library indicate a very high level of agreement with correlation coefficients of the effect of nuclear data uncertainty on k eff (the c k integral parameter) all above 0.99. This indicates that cases with the ENDF/B-VIII.0 library would see very similar responses to any nuclear data errors or change as those with the ENDF/B-VII.1 library.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2021

Criticality Accident Alarm System Shielding Benchmark: Integral Experiment Request 498, Critical Engineering Decision 2 Report

A workable design to perform a CAAS benchmark experiment is detailed herein. Key dimensions, materials, source intensity levels, and detectors are listed in this report. Sensitivity to 21 perturbations was determined to be acceptable. The next step will be for NCSP management to determine whether procurement should occur and if the experiment should proceed. The perturbation study suggests that the room return shield cavity radius and runout should be maintained to within a millimeter, the room return shield should be positioned carefully (perhaps with a laser range finder), and that the detectors should be mounted in a lightweight fixture such as aluminum, so their positioning is assured. Using a 3D scanner or photogrammetry to record part shapes may be beneficial. Further work is also needed to verify source reproducibility.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Joint LLNL, LANL, SNL, and IRSN High Multiplication Subcritical (Multiplicity) Benchmark Integral Experiment Execution (CED-3b Report)

This report documents the experimental configurations and measurements for IER-518: Joint LLNL, LANL, SNL, and IRSN High Multiplication Subcritical (Multiplicity) Benchmark Experiments. These measurements involved a series of subcritical configurations at the Sandia Critical Experiments (SCX) facility at Sandia National Laboratories (SNL). The purpose of these measurements was to produce time tagged neutron count data of configurations that exceed a subcritical multiplication of 20, which is the high end of the fundamental physics benchmarks currently available in the International Criticality Safety Benchmark Evaluation Project Handbook (ICSBEP). These measurements leverage experimental configurations 1 and detector systems 2 from previously accepted ICSBEP benchmark evaluations, allowing evaluations of these measurements to be performed at greatly reduced cost.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Sensitivity-based Similarity Metrics for New Experiment Design Optimization

The nuclear data used in advanced reactor simulations requires validation. Data from nuclear criticality experiments can provide this validation. New nuclear criticality experiment design requires extensive knowledge and expert judgement such that the experimental design parameters are selected in such a way to keep the experiment subcritical. To aide in this experimental design process, professionals can utilize sensitivity and uncertainty analysis. Sensitivity and uncertainty analysis relies on matching new application experiments with currently existing benchmark experiments. Currently, there is functionality in the Whisper 1.1 software package to calculate a similarity metric based on neutron multiplication factor sensitivity coefficients between a new application designed by the user and existing International Criticality Safety Benchmark Experiment Project (ICSBEP) benchmarks. The Whisper 1.1 software package is included in Monte Carlo N-Particle ® Code Version 6.21 (MCNP ® 6.2). This work is geared toward expanding this capability to new similarity metrics based on beta-effective sensitivity coefficients and reactivity coefficient sensitivity coefficients. While the investigation of these sensitivity coefficients is presented in detail in separate works at this same conference, this work will be primarily focused on studying the similarity metrics in more detail. These similarity metrics will then be incorporated into the optimization algorithms used for experiment design in EUCLID (Experiments Underpinned by Computational Learning for Improvements in nuclear Data), which is a Los Alamos National Laboratory (LANL) project designed to constrain nuclear data of interest, such that adjustments can be made to possible inaccuracies. A more detailed optimization can be subsequently performed by breaking down these similarity metrics by isotope, reaction, and energy.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Verification of Upcoming MCNP Features For Estimating Nuclear Data Sensitivities in Fixed Source Simulations [Abstract]

Predictive simulation codes, like the Monte Carlo N-Particle (MCNP) transport code, are used throughout the nuclear community. These simulations are based on nuclear data. Maximizing the accuracy and precision of nuclear data maximizes the accuracy and precision of the overall simulation. This is imperative to applications that rely on simulations. For example, improving nuclear data for special nuclear material improves simulation accuracy in stockpile stewardship applications, which results in larger safety margins and decreased operational costs. The improvement and validation of nuclear data is completed through integral benchmark experiments. Past benchmarks have primarily been limited to focus on the effective multiplication factor ($\kappa$ eff ); broadening the purview of benchmarks beyond $\kappa$ eff -dependent nuclear data addresses nuclear data deficiencies. Different response types depend on different areas of nuclear data. This dependence is quantified as nuclear data sensitivity: the change in response due to perturbation of a contributing parameter. The larger the nuclear data sensitivity of a response, the more the experiment is influenced by the uncertainties of the nuclear data. The optimization of nuclear data sensitivities in future benchmarks would result in more detailed validation of lesser studied areas of nuclear data. Currently, direct sensitivity capabilities are not easily found for all experiment types and parameters. An MCNP tool to directly estimate the cross section sensitivities of tallied values is under development. Additionally, updates have been made to the perturbation feature of MCNP, which can be used in a less direct approach to estimating sensitivities. This work verifies these features to estimate nuclear data sensitivities in fixed source simulations of a 4.5-kg sphere of alpha- phase weapons-grade plutonium surrounded by differing amounts of copper and polyethylene. Integrated estimates made using MCNP’s tools were found to statistically agree with integrated estimates made from manual perturbation of nuclear data proving the validity of the MCNP tools.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗