Search NASA⌕ Search

SEARCH · Search NASA

Results for “nuclear data uncertainty quantification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Nuclear Data Adjustment for Nonlinear Applications in the OECD/NEA WPNCS SG14 Benchmark—A Bayesian Inverse UQ-Based Approach for Data Assimilation

The Organisation for Economic Co-operation and Development Working Party on Nuclear Criticality Safety has proposed a benchmark exercise to assess the performance of current nuclear data adjustment techniques applied to nonlinear applications and experiments with low correlation to applications. This work introduces Bayesian inverse uncertainty quantification (IUQ) employing scientific machine learning surrogate models as a method for nuclear data adjustments in this benchmark, and compares IUQ to the more traditional methods of generalized linear least squares (GLLS) and Monte Carlo Bayes (MOCABA). Posterior predictions from IUQ showed agreement with GLLS and MOCABA for linear applications. Here, when comparing GLLS, MOCABA, and IUQ posterior predictions to computed model responses using adjusted parameters, we observe that the GLLS predictions failed to replicate the computed response distributions for nonlinear applications, while MOCABA showed near agreement, and IUQ used the computed model responses directly. We also discuss observations on why experiments with low correlation to applications can be informative to nuclear data adjustments and identify some properties useful in selecting experiments for inclusion in nuclear data adjustment. Performance in this benchmark indicates potential for Bayesian IUQ in nuclear data adjustments.

Bayesian calibration↗

Experimental Covariance Determination for Critical Integral Experiments

Integral benchmarks for criticality safety and nuclear data validation require expensive uncertainty quantification studies. In general, uncertainty quantification techniques ignore correlations between experiments and shared parts. Experiments, such as the TEX (Thermal/Epithermal eXperiments) campaigns, consist of many shared parts, such as the ‘Jemima’ HEU fuel plates, which create a strong correlation in their uncertainties. While these correlations are known to exist, they are often not estimated due to the complexity of such calculations. This paper describes an intuitive method of determining the covariance for each of the experimental components, providing a correlation for each family of parts across the multiple cases examined within a benchmark. A proof-of-principle study using the TEX-HEU experimental campaign was performed and verified that the correlations can be calculated with information commonly found in the ICSBEP (International Criticality Safety Benchmark Evaluation Project) benchmarks. This study showed that the introduction of model and experimental covariances reduces the χ 2 per degree of freedom from 2.203 to 1.179, indicating that the omission causes overly pessimistic bias quantifications. This technique can be seamlessly integrated to current benchmark evaluations as well as reevaluations of legacy benchmarks.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Uncertainty Quantification for Data-Driven Machine Learning Models in Nuclear Engineering Applications: Where We Are and What Do We Need?

Machine learning (ML) has been leveraged to tackle a diverse range of tasks in almost all branches of nuclear engineering. Many of the successes in ML applications can be attributed to the recent performance breakthroughs in deep learning, the growing availability of computational power, data, and easy-to-use ML libraries. However, these empirical successes have often outpaced our formal understanding of the ML algorithms. An important but under-rated area is uncertainty quantification (UQ) of ML. ML-based models are subject to approximation uncertainty when they are used to make predictions, due to sources including but not limited to, data noise, data coverage, extrapolation, imperfect model architecture and the stochastic training process. The goal of this paper is to clearly explain and illustrate the importance of UQ of ML. We will elucidate the differences in the basic concepts of UQ of physics-based models and data-driven ML models. Various sources of uncertainties in physical modeling and data-driven modeling will be discussed, demonstrated, and compared. We will also present and demonstrate a few techniques to quantify the ML prediction uncertainties, including Monte Carlo dropout, deep ensemble, Bayesian neural networks, Gaussian Processes and conformal prediction. Lastly, we will discuss the need for building a verification, validation and UQ framework to establish ML credibility.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Nuclear Criticality Safety Integral Experiment Covariance Determination

Integral benchmarks for criticality safety and nuclear data validation require expensive uncertainty quantification studies. Commonly, the uncertainty quantification ignores correlations between experiments that share components. Experiments such as the TEX (Thermal/Epithermal eXperiments) campaigns consist of many shared parts, such as fuel, which create a strong correlation in their uncertainties. While these correlations are known to exist, they are often not estimated due to the complexity of such calculations. This paper describes a software package that uses an intuitive method of determining the covariance for each of the experimental components, providing a correlation matrix for each family of parts across the multiple cases examined within a benchmark. The code uses the TEX-HEU campaign as a proof of concept, and we show that the correlations can be calculated with information commonly found in ICSBEP (International Criticality Safety Benchmark Evaluation Project) benchmarks. The estimated covariances are used in χ 2 trending studies to evaluate their impact on nuclear data validation. Without covariances, χ 2 per degree of freedom was calculated as 2.203 and with covariances it was 1.179. The difference shows that omitting covariance information may cause overly pessimistic bias quantifications. The covariance determination code can be easily integrated into current benchmark evaluations as well as reevaluating legacy benchmark uncertainties. Uncertainty correlation calculations should become the baseline for criticality safety integral experiment benchmarks and can now be easily calculated with the described software package.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Demonstration of TOFFEE: A Response Uncertainty Quantification Tool

A key characteristic in neutron transport is nuclear data. Cross-section uncertainty is not used in MCNP6.3 to propagate response uncertainty without external analysis. Here, the TOol For Fast Error Estimation (TOFFEE) is a Python-based code developed to automate the propagation of cross-section uncertainty for MCNP evaluations. TOFFEE implements the sandwich rule to calculate the uncertainty from cross sections with sensitivity coefficients from MCNP6.3 and ENDF/B covariance data. In this paper, TOFFEE has been tested with benchmark experiments, and it has been compared to the uncertainty quantification capabilities of Sampler and TSUNAMI, within SCALE, to verify the application’s capabilities.

97 MATHEMATICS AND COMPUTING↗

Nuclear Data Adjustment for Nonlinear Applications in the OECD/NEA WPNCS SG14 Benchmark -- A Bayesian Inverse UQ-based Approach for Data Assimilation

The Organization for Economic Cooperation and Development (OECD) Working Party on Nuclear Criticality Safety (WPNCS) proposed a benchmark exercise to assess the performance of current nuclear data adjustment techniques applied to nonlinear applications and experiments with low correlation to applications. This work introduces Bayesian Inverse Uncertainty Quantification (IUQ) as a method for nuclear data adjustments in this benchmark, and compares IUQ to the more traditional methods of Generalized Linear Least Squares (GLLS) and Monte Carlo Bayes (MOCABA). Posterior predictions from IUQ showed agreement with GLLS and MOCABA for linear applications. When comparing GLLS, MOCABA, and IUQ posterior predictions to computed model responses using adjusted parameters, we observe that GLLS predictions fail to replicate computed response distributions for nonlinear applications, while MOCABA shows near agreement, and IUQ uses computed model responses directly. We also discuss observations on why experiments with low correlation to applications can be informative to nuclear data adjustments and identify some properties useful in selecting experiments for inclusion in nuclear data adjustment. Performance in this benchmark indicates potential for Bayesian IUQ in nuclear data adjustments.

FOS: Computer and information sciences↗

ENDF/B-VIII.1: Updated Nuclear Reaction Data Library for Science and Applications

The ENDF/B-VIII.1 library is the newest recommended evaluated nuclear data file by the Cross Section Evaluation Working Group (CSEWG) for use in nuclear science and technology applications, and incorporates advances made in the six years since the release of ENDF/B-VIII.0. Among key advances made are that the 239 Pu file was reevaluated by a joint international effort and that updated 16,18 O, 19 F, 28–30 Si, 50–54 Cr, 55 Mn, 54,56,57 Fe, 63,65 Cu, 139 La, 233,235,238 U, and 240,241 Pu neutron nuclear data from the IAEA coordinated INDEN collaboration were adopted. Over 60 neutron dosimetry cross sections were adopted from the IAEA's IRDFF-II library. In addition, the new library includes significant changes for 3 He, 6 Li, 9 Be, 51 V, 88 Sr, 103 Rh, 140,142 Ce, Dy, 181 Ta, Pt, 206–208 Pb, and 234,236 U neutron data, and new nuclear data for the photonuclear, charged-particle and atomic sublibraries. Numerous thermal neutron scattering kernels were reevaluated or provided for the very first time. On the covariance side, work was undertaken to introduce better uncertainty quantification standards and testing for nuclear data covariances. The significant effort to reevaluate important nuclides has reduced bias in the simulations of many integral experiments with particular progress noted for fluorine, copper, and stainless steel containing benchmarks. Data issues hindered the successful deployment of the previous ENDF/B-VIII.0 for commercial nuclear power applications in high burnup situations. These issues were addressed by improving the 238 U and 239,240,241 Pu evaluated data in the resonance region. The new library performance as a function of burnup is similar to the reference ENDF/B-VII.1 library.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

ARIADNE

The code ARIADNE performs uncertainty quantification of experimental data for nuclear data. It also performs nuclear data evaluations with the algorithm generalized squares.

Neudecker, Denise↗

Description and Use of SCALE Sampler Parametric Capability for Engineering Analysis and Optimization

The Sampler sequence was introduced into the SCALE nuclear modeling and simulation suite in SCALE 6.2 to perform uncertainty quantification via random sampling of nuclear data, material number densities, and dimensions. Sampler was expanded with the introduction of a parametric capability in SCALE 6.2.2. This paper discusses input for the Sampler parametric sequence and presents two case studies of analyses performed using the sequence. These case studies include preconceptual design of a package for transporting high assay low-enriched uranium (HALEU) oxide and scoping calculations to support subcritical limit development for a future update of the ANSI/ANS-8.1 (ANS-8.1) standard. The parametric capability within Sampler provides many benefits to analysts. For instance, parametric sweeps are frequently used to identify optimum parameter values as part of safety analysis or system design, but such sweeps can require substantial engineering time or may rely on custom-written scripts or scripts such as Write One, Run Many (or WORM) developed outside of any software quality assurance program. With the parametric capabilities in Sampler, however, a large number of inputs can be generated automatically without recourse to scripting by individual analysts. The parametric capability can also be used in lieu of the CSAS5S search sequence to identify optimum parameters more simply with straightforward inputs and outputs. Sampler can also be used to calculate input parameters from engineering specifications. For example, diameters can be converted to radii, or masses can be used to calculate number densities. Overall, the Sampler parametric capability provides a robust feature within SCALE, eliminating the need for user-developed scripting.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Experimental uncertainty quantification using templates of expected measurement uncertainties for fast neutron-induced total, capture, and scattering cross sections

Careful experimental uncertainty quantification (UQ) is key for developing trustworthy evaluated nuclear data. Templates to account for missing or under-reported experimental uncertainties were recently developed by the covariance committee of Cross Section Evaluation Working Group (CSEWG). In this work, we illustrate the practical application and limitations of these templates for selected neutron-induced reactions, including (n, tot), (n, γ), and (n, xn) in the fast energy range, to illustrate their use in data analyses for nuclear data evaluations. We show that while the templates provide consistent framework, proper implementation still requires detailed knowledge of experimental conditions and careful treatment of nonlinear effects in cross section derivation. Case studies highlight how template-assisted UQ improves consistency with previous evaluations such as ENDF/B and reveals open challenges in propagating uncertainties across different energy regimes. The main contribution of this paper is to connect formal template recommendations with their use in practical evaluation workflows, clarifying both their benefits and current limitations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Formatting and V&V of Consistent 238,240−24 2Pu $\overline{v}_p$ Evaluated Mean Values and Covariances

This report is in answer to the Nuclear Criticality Safety Program FY24 quarter 4 milestone that requires: “Format and V&V nu-bar means and covariances” for 238,240-242 Pu average prompt fission neutron multiplicities, $\overline{ν}$ p , that were obtained by a consistent evaluation leveraging the fission-event generator CGMF and a detailed uncertainty quantification of experimental data. It is described how nuclear data mean values and covariances were formatted using ENDFtk. Implementing the new 238,240-242 Pu $\overline{ν}$ p into the ENDF/B-VIII.1β 4 library leads to only small overall changes in criticality values of the Jezebel, Dirty Jezebel, Jupiter-001, Jupiter-002, EUCLID 3x2 and EUCLID 8x1 critical assemblies. Simulated k eff uncertainties due to $\overline{ν}$ p covariances change only little if cross-isotope covariances are considered or not for those assemblies with low percentage content of minor Pu isotopes. However, for the Dirty Jezebel critical assembly, that has a sizeable 240 Pu and non-negligible 241 Pu content, the simulated k eff uncertainties due to considering or neglecting cross-isotope $\overline{ν}$ p covariances is 443 versus 374 pcm.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A refined assessment of nuclear data target accuracy requirements for ALFRED

The interest in target accuracy assessment has been recently renewed within the OECD/NEA Working Party on International Nuclear Data Evaluation Cooperation with an update exercise, thanks to the invaluable initiative of Massimo Salvatores. This work, moving from evaluations on the main core integral parameters of the Advanced Lead-cooled Fast Reactor European Demonstrator (ALFRED), and the identification of the associated target accuracies needed for improving its design, approaches the retrieval of target accuracy requirements for nuclear data, as the inverse problem of uncertainty quantification. The preliminary results obtained in a previous work are here refined by explicitly taking into account the total contribution due to correlations among variables in the optimization constraint, while its various components are evaluated individually. Moreover, three different sets of cost parameters are considered to introduce a bias in the solution in order to take in due account the relative difficulties in the execution of new differential experiments as needed for achieving the proposed target accuracies. By this, the obtained results are deemed usefully informative, and proposed for the update of a High Priority List which identifies the isotopes-reaction couples of most interest for future refinement experiments, especially when integrated with further analogous information collected on other advanced nuclear systems. Among the cross-sections whose refinement contributes the most to the reduction of the multiplication factor, the fission of Pu{sup 239} was found, which needs to be fixed below 1% in the range of interest for ALFRED (2 keV-4 MeV). Another contribution for the amelioration of the multiplication factor calculation accuracy, is due to the capture channel of Pu{sup 239}, for which the initial high uncertainty (around 15%) can be significantly reduced resorting to easily practicable experiments. The same occurs for the inelastic of Pb{sup 207}, for which the initial uncertainty value of around 50% can be drastically reduced up to target values between 4% and 7%.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

SOURCES4D

SOURCES is a code for computing neutron source rates and spectra from spontaneous fission (including delayed neutrons) and (alpha,n) reactions in homogeneous materials and (alpha,n) reactions in single-interface and two-interface geometries. SOURCES is a Los Alamos National Laboratory (LANL) code that is written in FORTRAN and distributed through the Radiation Safety Information Computation Center (RSICC). LANL’s last release of SOURCES to RSICC was SOURCES4C in 2002. This disclosure covers the latest version of SOURCES, SOURCES4D. This version adds sensitivity capabilities for (alpha,n) sources in homogeneous materials. Specifically, SOURCES4D writes new output that can be used to calculate, in post-processing, first and second derivatives of the (alpha,n) source rate density and spectrum with respect to nuclide densities in a homogeneous material and first derivatives of the (alpha,n) source rate density and spectrum with respect to nuclide stopping powers and (alpha,n) cross sections (nuclear data). These derivatives are useful for uncertainty quantification, predictive modeling, and other applications in neutron transport problems.

Favorite, Jeffrey A.↗

Hierarchical Bayesian modeling for Inverse Uncertainty Quantification of system thermal-hydraulics code using critical flow experimental data

The best estimate plus uncertainty methodology in nuclear system thermal-hydraulic studies necessitates a comprehensive understanding of uncertainties in system code predictions. The forward uncertainty quantification (UQ) process involves the propagation of input uncertainties through the computational models to obtain uncertainties in the outputs. To this end, achieving an accurate estimation of input uncertainties is important, which is the focus of inverse UQ (IUQ). Traditionally, research in Bayesian IUQ within the nuclear engineering domain has largely relied on single-level Bayesian inference. While being effective for relatively small datasets, this approach encounters limitations for cases with large datasets. The use of a single-level model may prove inefficient, as the resultant posterior distributions can significantly differ when distinct subsets of data are employed. To address this issue, we employ an hierarchical Bayesian model for IUQ. Furthermore, this approach involves organizing observations into different groups based on the test conditions, thereby accommodating varying calibration parameters across these distinct groups. In this study, we developed and implemented a hierarchical Bayesian IUQ method to consider the grouping effect of critical flow measurement data from various geometries. Comparing the outcomes of IUQ under different selections of test data using hierarchical Bayesian IUQ against those obtained from single-level Bayesian IUQ, the forward propagation of hierarchical Bayesian IUQ results demonstrates a notably improved agreement with the experimental data.

42 ENGINEERING↗

FY22 NCSP accomplishments for U and Pu Evaluations [Slides]

This presentation covers fiscal year 2022 for Nuclear Criticality Safety Program (NCSP) accomplishments for Uranium (U) and Plutonium (Pu) evaluations. This presentation includes an overview on plutonium and uranium. Additionally, this presentation covers the inclusion of sub-thermal data for 235 U and the inclusion of LANL ratio capture-to-fission data for 233 U and 235 Pu. The presentation ends with a discussion on 239 Pu Primary fit of Mosby's data as reported and a look at the uncertainty quantification.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Templates of expected measurement uncertainties

The covariance committee of CSEWG (Cross Section Evaluation Working Group) established templates of expected measurement uncertainties for neutron-induced total, (n,γ), neutron-induced charged-particle, and (n,xn) reaction cross sections as well as prompt fission neutron spectra, average prompt and total fission neutron multiplicities, and fission yields. Templates provide a list of what uncertainty sources are expected for each measurement type and observable, and suggest typical ranges of these uncertainties and correlations based on a survey of experimental data, associated literature, and feedback from experimenters. Information needed to faithfully include the experimental data in the nuclear-data evaluation process is also provided. These templates could assist (a) experimenters and EXFOR compilers in delivering more complete uncertainties and measurement information relevant for evaluations of new experimental data, and (b) evaluators in achieving a more comprehensive uncertainty quantification for evaluation purposes. This effort might ultimately lead to more realistic evaluated covariances for nuclear-data applications. In this topical issue, we cover the templates coming out of this CSEWG effort–typically, one observable per paper. This paper here prefaces this topical issue by introducing the concept and mathematical framework of templates, discussing potential use cases, and giving an example of how they can be applied (estimating missing experimental uncertainties of 235 U(n,f) average prompt fission neutron multiplicities), and their impact on nuclear-data evaluations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Development of nuclear data processing code FRENDY version 2

Nuclear data processing is an important interface between an evaluated nuclear data library and neutronics calculation codes. JAEA has been developed the new nuclear data processing code FRENDY from 2013. FRENDY version 1 generates the ACE files used for the continuous-energy Monte Carlo codes including PHITS, Solomon, Serpent,and MCNP and it was released as the open-source software under the 2-clause BSD license in 2019.After we released FRENDY version 1, many functions, e.g., the multi-group neutron cross-section library generation, the statistical uncertainty quantification of the probability tables for unresolved resonance cross-section, the 'perturbation' of the ACE file for uncertainty quantification, and the modification of the ENDF-6 formatted nuclear data file, have been developed. We released FRENDY version 2 including these functions. The present paper gives an overview of FRENDY and presents features of new functions implemented in FRENDY version 2. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Initial Efforts Organizing WPNCS SG-8: Preservation of Expert Knowledge and Judgement Applied to Criticality Benchmarks

The Working Party on Nuclear Criticality Safety (WPNCS) under the guidance of the Organization for Economic Co-operation and Development (OECD) Nuclear Energy Agency (NEA) has over 20 years of experience addressing concerns related to static and transient configurations encountered within the nuclear fuel cycle: fuel fabrication, transportation, reprocessing, storage, and geological disposal. One of the cornerstone activities of the WPNCS is the International Criticality Safety Benchmark Evaluation Project (ICSBEP), which was established to identify a comprehensive set of criticality benchmark data, evaluate the data, including quantification of overall uncertainties; compile the data into a standardized format, perform sample calculations utilizing modern nuclear data sets and codes utilized in nuclear criticality safety, and formally document the work into a single source of verified benchmark data. Annually, members of the ICSBEP Technical Review Group (TRG) contribute evaluated benchmark data that undergoes comprehensive technical review prior to publication in the ICSBEP Handbook. In the years since the ICSBEP was established, there has been much work to prepare benchmark data to support validation activities in nuclear criticality safety. The 2020 edition of the ICSBEP Handbook contains acceptable benchmark specifications for 5,053 critical, subcritical, or near-critical configurations in 582 benchmark evaluations. Modern benchmark development benefits from decades of experienced international participants, a well-established handbook format, supplementary guides to deal with uncertainty quantification, and a comprehensive review process based upon independent reviews from international experts. The ICSBEP Handbook also contains 838 configurations deemed unacceptable to support criticality safety efforts. They are recorded, with the reasoning for their rejection, to preserve the experimental data, prevent reevaluation of data that are incomplete or contain known errors, and/or to potentially allow future reevaluation of the experiment pending the identification of sufficient data to resolve identified inconsistencies and errors. Users of the ICSBEP Handbook today might notice that the rigor and quality of modern criticality safety benchmarks is much greater than those prepared within the initial decade of the project. Benchmarks with 1s uncertainties in k eff greater than 1% were traditionally rejected unless they were identified as unique experiment types that encompassed materials, fuels, or designs not available from other benchmark experiments. However, benchmarks developed using modern experimental techniques and practices typically have uncertainties on the order of a few tenths of a percent. There have been ongoing efforts to improve the overall quality of previously published benchmark evaluations. Seventy-eight evaluations, containing approximately 600 configurations, have been revised just within the past decade. An additional eleven benchmarks are under revision for updated release in the 2020 edition of the ICSBEP Handbook. If some of the historic benchmarks were resubmitted in their current form to the TRG today, they would be rejected due to lack of data, missing components in the uncertainty analysis, or incomplete benchmark model development. The use of historic criticality safety benchmarks that underestimate the total uncertainty, lack properly quantified biases, or provide inadequate benchmark specifications do not sufficiently support modern criticality safety and nuclear data efforts. Although the ICSBEP Handbook is recognized by regulating bodies to support criticality safety, users are required to justify their reasons to ignore historic benchmark data and include additional safety margins within their designs. Discussions were held at the WPNCS 23rd Annual Meeting in September 2019 regarding the aforementioned issues. The resultant decision was to establish Subgroup 8 (SG-8): Preservation of Expert Knowledge and Judgement Applied to Criticality Benchmarks. The current activities of SG-8 are discussed herein.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗