Search NASA⌕ Search

SEARCH · Search NASA

Results for “sensitivity/uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Comparison Study of Upper Subcritical Limits Derived Using Sensitivity/Uncertainty Tools Case Studies of Benchmarks and Applications

Neutron transport methods used to establish subcriticality require validation by comparison to critical experiments considered to be benchmarks. Whisper is a sensitivity/uncertainty analysis tool developed to assist with the task of validation in nuclear criticality safety. Details on the Whisper methodology can be found in References 1-3 on the MCNP ® reference collection website at https://mcnp.lanl.gov. Whisper-1.0 was originally developed in 2014 and used to assist with nuclear criticality safety validation at Los Alamos National Laboratory. Whisper was upgraded in 2016 to Whisper-1.1 and prepared for release with MCNP6.2. Whisper contains a library of over 1100 critical experiment benchmarks and quantifies neutronic similarity of an application to benchmarks in the library. Using highest similarity benchmarks, Whisper computes a calculational margin (CM) encompassing of the worst-case bias and bias uncertainty at a 99% confidence level for each application. In addition, portions of the margin of subcriticality (MOS) for nuclear data uncertainty and potential code errors are computed. The baseline upper subcritical limit (USL) computed by Whisper is comprised of the CM, MOS nuclear data , and MOS code errors . The Whisper baseline USL is absent a portion of the MOS due to the area of application, which is applied based upon judgment by the criticality safety analyst. An objective of this paper is to present the baseline USL, CM and portions of the MOS as computed by Whisper for comparison with similar sensitivity/uncertainty tools, such as those used by IRSN and ORNL. The initial comparison involves four critical experiment benchmarks: HEU-MET-FAST-013-001, HEU-SOLTHERM-001-008, PU-MET-FAST-022-001, AND PU-SOL-THERM-001-001, which have been: 1. modeled independently by LANL, IRSN, and ORNL based upon information provided in the ICSBEP Handbook, 2. are common in S/U libraries for LANL, IRSN, and ORNL, 3. span a range of energy spectrum and fissile material, and 4. taken as applications for the purposes of this study and therefore excluded from use as a benchmark for calculating the upper subcritical limit. Results presented in this paper have been computed using covariance data for all isotopes in ENDF/BVII.0 using a 44-group energy structure. Benchmarks in the Whisper library were run in MCNP6.2 using 100,000 neutrons per cycle, skipping 100 cycles for 500 active cycles. Reference 10 also compares the results for baseline USL with an order of magnitude greater neutrons, using the same total number of cycles with 1,000,000 neutrons per cycle. Subsequent to the results presented in Reference 10 changes were made to the benchmark library, as discussed in Reference 11. Newer results using the revised benchmark library are presented herein.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Comparison Study of Upper Subcritical Limits Derived Using Sensitivity/Uncertainty Tools: Case Studies of U233-SOL-THERM-001-001, MIX-COMP-THERM-001-001, IEU-MET-FAST-002-001, LEU-COMP-THERM-001-001, LEU-SOL-THERM-004-001

Neutron transport methods used to establish subcriticality require validation by comparison to critical experiments considered to be benchmarks. Whisper is a sensitivity/uncertainty analysis tool developed to assist with the task of validation in nuclear criticality safety. Details on the Whisper methodology can be found in References 1-3 on the MCNP® reference collection website at https://mcnp.lanl.gov. Whisper-1.0 was originally developed in 2014 and used to assist with nuclear criticality safety validation at Los Alamos National Laboratory. Whisper was upgraded in 2016 to Whisper-1.1 and prepared for release with MCNP6.2 [References 3-5]. Whisper contains a library of over 1100 critical experiment benchmarks and quantifies neutronic similarity of an application to benchmarks in the library. Using highest similarity benchmarks, Whisper computes a calculational margin (CM) encompassing of the worst-case bias and bias uncertainty at a 99% confidence level for each application. In addition, portions of the margin of subcriticality (MOS) for nuclear data uncertainty and potential code errors are computed. The baseline upper subcritical limit (USL) computed by Whisper is comprised of the CM, MOS nuclear data , and MOS code errors . The Whisper baseline USL is absent a portion of the MOS due to the area of application, which is applied based upon judgment by the criticality safety analyst. An objective of this paper is to present the baseline USL, CM and portions of the MOS as computed by Whisper for comparison with similar sensitivity/uncertainty tools, such as those used by IRSN and ORNL. An initial comparison involved four critical experiment benchmarks: HEU-MET-FAST-013-001, HEU-SOLTHERM-001-008, PU-MET-FAST-022-001, AND PU-SOL-THERM-001-001, which have been documented in References 10-13. This study extends the comparison to include cases U233-SOL-THERM-001-001, MIX-COMP-THERM-001-001, IEU-MET-FAST-002-001, LEU-COMP-THERM-001-001, LEU-SOL-THERM- 004-001.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Sensitivity/Uncertainty Comparison Study Involving IRSN, LANL, and ORNL Tools to Support Validation

Under a DOE Nuclear Criticality Safety Program (NCSP) task involving Analytical Methods, three Laboratories collaborated in a comparison of results obtained from Sensitivity/Uncertainty (S/U) packages relevant to validation of transport codes. The task involves Institut de Radioprotection et de Sûreté Nucléaire (IRSN), Los Alamos National Laboratory (LANL), and Oak Ridge National Laboratory (ORNL) comparing results of MORET 5/MACSENS V3.0, MCNP6.2/Whisper-1.1, and SCALE 6.2.3/TSUNAMI/USLSTATS respectively. All Monte Carlo transport code results utilize nuclear data from ENDF/B-VII.1 evaluation. This study examines five cases from the International Handbook of Evaluated Criticality Safety Benchmark Experiments (ICSBEP Handbook) selected as application models: IEU-MET- FAST-002-001, LEU-COMP-THERM-001-001, LEU-SOL-THERM-004-001, MIX-COMP- THERM-001-001, and U233-SOL-THERM-001-001. This is a continuation of a previous study to examine Pu and HEU cases: HEU-MET-FAST-013-001, HEU-SOL-THERM-001-008, PU-MET- FAST-022-001, and PU-SOL-THERM-001-001. Ultimately, comparison is made between Upper Subcritical Limits (USLs) obtained using each code package for each application case. Since differences exist in whether packages take into account margin of subcriticality (MOS), the USL is computed using only bias and bias uncertainty, also known as the calculational margin (CM) in ANSI/ANS-8.24. Results comparison appears to show that benchmark selection has a greater influence on the USL than the method used for calculation of bias and bias uncertainty.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

SCALE modeling of foil irradiations at WSU’s TRIGA with sensitivity/uncertainty analysis

We report the Washington State University TRIGA reactor was modeled in the SCALE system’s KENO neutron transport code. The model includes 119 fuel rods, a central boral control rod, 4 control blades, 5 irradiation ports, and 20 graphite reflector blocks within a rectangular aluminum grid box. The model accurately simulated the irradiation of depleted uranium and highly enriched uranium foils and predicted reaction rate ratios for 238 U(n,2n) 237 U / 238 U(n,γ) 239 U and 99 Mo / fission, which compared favorably to empirical values previously measured at Los Alamos. Finally, a sensitivity/uncertainty analysis was performed using the continuous-energy TSUNAMI-3D module of SCALE.

237Np↗

Updated Guidance on Sensitivity/Uncertainty Methods Use for Nuclear Criticality Safety Validation

The use of sensitivity/uncertainty (S/U) methods in nuclear criticality safety (NCS) was established more than 25 years ago and has been increasing ever since. Recent interest in commercial applications involving uranium enrichments above 5 wt% 235 U has increased focus on demonstrating the applicability of existing critical experiments to this enrichment range. S/U techniques can also be particularly useful in assessing the similarity of new fuel forms in relation to those documented in existing published evaluations of benchmark critical experiments. Publishing updated recommendations for the use of these methods is thus important to ensure that new S/U practitioners can benefit from the years of development and application invested in generating a set of best practices to maximize the utility of these tools.

NCS↗

Sensitivity/Uncertainty Comparison Study Involving IRSN, LANL, and ORNL Tools to Support Validation [Abstract]

Under a DOE Nuclear Criticality Safety Program (NCSP) task involving Analytical Methods, three Laboratories collaborated in a comparison of results obtained from Sensitivity/Uncertainty (S/U) packages relevant to validation of transport codes. The task involves Institut de Radioprotection et de Sûreté Nucléaire (IRSN), Los Alamos National Laboratory (LANL), and Oak Ridge National Laboratory (ORNL) comparing results of MORET 5/MACSENS V3.0, MCNP6.2/Whisper-1.1, and SCALE 6.2.3/TSUNAMI/USLSTATS respectively. All Monte Carlo transport code results utilize nuclear data from ENDF/B-VII.1 evaluation.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Nuclear Data Sensitivity/Uncertainty Studies of Tantalum-Reflected Systems

Tantalum (Ta) is a refractory metal with high melting point and high corrosion resistance. This makes it useful as a mold material for plutonium casting operations. Unfortunately, there are few criticality benchmarks with high nuclear data sensitivities. Given that, it is desirable to design new experiments to provide additional validation data for nuclear criticality safety, which is the objective of the Thales project. Multiple application models were used to represent process conditions (either normal conditions or credible upset conditions) both at Los Alamos National Laboratory (LANL) and Savannah River Site (SRS). A total of 40 application models were obtained. Given this, it was useful to down-select the number of needed application models. This work documents the down-selection based on several nuclear data sensitivity/uncertainty metrics. In addition to showing the result of the specific down-selection used for the Thales project, this work discusses potential ways to represent a large number of application models with a smaller number of proposed experiment designs.

42 ENGINEERING↗

Sensitivity/Uncertainty Analysis for Nuclear Criticality Safety Validation [Slides]

Sensitivity coefficients predict the expected change in a response ($\kappa$) due to a change in some input parameter ($\Sigma$). These responses can be k eff (or ratios of reaction rates). These input parameters are typically nuclear data. The coefficients are dimensionless ratios. What would happen to the system k eff if some piece of data were changed by some amount? The coefficient is calculated without making the change.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Uses of Sensitivity/Uncertainty Techniques for Critical Experiment Design [Slides]

This presentation discusses the programming languages TSUNAMI and TSAR. It also provides a review of experimental designs using sensitivity analysis in regard to 7uPCX fuel design, fission product experiment analysis, MIRTE, and temperature dependent experiments at the Sandia Pulsed Reactor Facility (SPRF).

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Uncertainty Analysis of Decomposing Polyurethane Foam

Sensitivity/uncertainty analyses are necessary to determine where to allocate resources for improved predictions in support of our nation's nuclear safety mission. Yet, sensitivity/uncertainty analyses are not commonly performed on complex combustion models because the calculations are time consuming, CPU intensive, nontrivial exercises that can lead to deceptive results. To illustrate these ideas, a variety of sensitivity/uncertainty analyses were used to determine the uncertainty associated with thermal decomposition of polyurethane foam exposed to high radiative flux boundary conditions. The polyurethane used in this study is a rigid closed-cell foam used as an encapsulant. Related polyurethane binders such as Estane are used in many energetic materials of interest to the JANNAF community. The complex, finite element foam decomposition model used in this study has 25 input parameters that include chemistry, polymer structure, and thermophysical properties. The response variable was selected as the steady-state decomposition front velocity calculated as the derivative of the decomposition front location versus time. An analytical mean value sensitivity/uncertainty (MV) analysis was used to determine the standard deviation by taking numerical derivatives of the response variable with respect to each of the 25 input parameters. Since the response variable is also a derivative, the standard deviation was essentially determined from a second derivative that was extremely sensitive to numerical noise. To minimize the numerical noise, 50-micrometer element dimensions and approximately 1-msec time steps were required to obtain stable uncertainty results. As an alternative method to determine the uncertainty and sensitivity in the decomposition front velocity, surrogate response surfaces were generated for use with a constrained Latin Hypercube Sampling (LHS) technique. Two surrogate response surfaces were investigated: 1) a linear surrogate response surface (LIN) and 2) a quadratic response surface (QUAD). The LHS techniques do not require derivatives of the response variable and are subsequently relatively insensitive to numerical noise. To compare the LIN and QUAD methods to the MV method, a direct LHS analysis (DLHS) was performed using the full grid and timestep resolved finite element model. The surrogate response models (LIN and QUAD) are shown to give acceptable values of the mean and standard deviation when compared to the fully converged DLHS model.

Hobbs, Michael L.↗

Gaussian Process Optimization of Sensitivity-Based Similarity Metrics between New Nuclear Applications and New/Existing Benchmarks

Confidently designing safe, new nuclear criticality experiments requires expert judgement, which could take years of experience. Sensitivity/uncertainty (S/U) analysis can be utilized by less experienced individuals to conservatively estimate uncertainties in important parameters, such as k eff , in newly proposed nuclear applications. This type of analysis relies on matching new nuclear applications with existing benchmark experiments. The Whisper-1.1 software package included in MCNP6.2 ®1 contains more than 1,100 International Criticality Safety Benchmark Evaluation Project (ICSBEP) benchmarks. These benchmarks however rarely match new nuclear applications. The number of benchmarks available to match a given set of materials or geometric configurations varies significantly. Furthermore, recently performed benchmark experiments may not have had enough time to be properly documented and published. Benchmarks are vital for determining the accuracy of nuclear data and can assist nuclear physics and evaluators in improving nuclear data libraries. Exhaustively exploring the parameter space using simulations with software such as MCNP is too computationally expensive. In this work, Gaussian process optimization was implemented to reduce the number of simulations needed for optimization over multiple parameters. This optimization scheme was designed to selectively generate new benchmarks with high sensitivity-based similarity metrics to user-defined nuclear applications. Two benchmark models of spherically nested shells containing plutonium, uranium, tantalum, and water were used in the optimization to match an application containing plutonium plates, stacked in a tantalum reflector, surrounded by water.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A Review of TSUNAMI Applications

The TSUNAMI-1D and TSUNAMI-3D sequences for generating k eff sensitivity coefficients were first released in SCALE 5 in 2004. Several other tools were introduced in the same release, including primarily the TSUNAMI-IP code for uncertainty analysis and similarity assessments. The TSUNAMI sequences added capabilities for identifying important reactions and data for systems using sensitivity coefficients and also introduced new quantitative tools for rigorously assessing the similarity of systems. Over time, the capabilities of these tools have grown, and their use has expanded into other areas such as nuclear data assessment and nuclear covariance data testing. This paper discusses applications of the TSUNAMI tools for sensitivity calculations, sensitivity/uncertainty (S/U)-based validation, and nuclear data testing. This paper is one of a series of papers at this conference on the development and use of TSUNAMI tools. The other papers address the development of the TSUNAMI methods and the use of TSUNAMI for critical experiment design and optimization.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Characterization of Uranium Foil Irradiations at the WSU TRIGA Reactor Using a New Reactor Model in SCALE [Slides]

A depleted uranium foil and a highly enriched uranium foil that were irradiated at the Washington State University TRIGA reactor were used to measure the relative production of 237 U and 239 U, two key isotopes of interest in nuclear forensics, as well as their decay daughters 237 Np and 239 Pu. Total fissions in the two foils were also estimated using 99 Mo measurement. A reactor model of the TRIGA was built in the SCALE neutron transport code using dimensions obtained from an existing MCNP geometry. The model was successfully used to simulate foil fissions and the reaction rate ratios in 238 U, using the laboratory-measured isotope ratios as a benchmark. The flux distribution in the foils was determined. Finally, using the continuous energy Tsunami-3d module of SCALE, a sensitivity/uncertainty analysis was performed to determine the effects on the reaction ratio caused by other reactions in the reactor and by uncertainties in the known cross-sections.

07 ISOTOPE AND RADIATION SOURCES↗

Gaussian Process Optimization of Sensitivity-Based Similarity Metrics between New Nuclear Applications and New/Existing Benchmarks [Slides]

This presentation discusses Nuclear Criticality Safety (NCS) and how designing safe, new nuclear criticality experiments requires expert judgement, which could take years of experience. Sensitivity/uncertainty (S/U) analysis can be utilized by less experienced individuals to conservatively estimate uncertainties in important parameters, such as k eff , in newly proposed nuclear experiments. The presentation poses the question of how this analysis can be performed and states that the answer lies in matching new nuclear experiments with existing benchmark experiments using similarity metrics. By increasing the criticality safety of the application in this work, higher mass limits could be used in PF-4 operations. Additionally, the presentation discusses MCNP6.2®, Whisper-1.1, the software that can be used in this analysis. Also discussed is the fact that International Criticality Safety Benchmark Evaluation Project (ICSBEP) benchmarks rarely match new nuclear applications and that there are significant differences in given set of materials and/or geometry. If there are no benchmarks that match the application, the presentation discusses the possibility of creating new benchmarks. In conclusion, this work presents a Gaussian process (GP) optimization scheme that was used to generate new benchmarks with the highest sensitivity-based similarity metrics to user-defined nuclear applications. The Gaussian process optimization successfully designed 3 new experimental benchmarks that were highly correlated to the application of interest and had k eff values near critical. Optimization over c k,i-r has shown that investigating specific isotope reactions for different applications is crucial to designing benchmark experiments. Partial contribution from Pu dominates c k similarity metric. Future work includes testing new stand-alone similarity metrics or new combinations of similarity metrics as the design criterion of this optimization – design criterion is application dependent.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Analysis of SCALE Criticality and Sensitivity Calculations for Reflected HEU Cylinders [Abstract]

The SCALE code package offers several nuclear data libraries to support Monte Carlo (MC) transport, as well as MC-based derivation of $\kappa$ eff sensitivity and uncertainty (S/U) data. The CSAS sequence using the KENO MC code can utilize continuous-energy (CE) cross sections, or pre-generated multigroup (MG) cross section libraries. The use of MG libraries introduces bias into calculations in exchange for faster transport solutions. The TSUNAMI-3D sequence also utilizes KENO MC calculations. TSUNAMI-3D has two CE calculational methods: the Iterated Fission Probability (IFP) method, and the Contribution-Linked eigenvalue sensitivity/Uncertainty estimation via Tracklength importance CHaracterization (CLUTCH) method. Previous work has shown poor agreement between CLUTCH and confirmatory direct perturbation calculations in specific applications, e.g., fissionable and polyethylene reflectors

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗