Search NASA⌕ Search

SEARCH · Search NASA

Results for “Uncertainty quantification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31

Bayesian uncertainty quantification for nuclear matter incompressibility

Within a Bayesian statistical framework using the standard Skyrme-Hartree-Fock model, the maximum a posteriori (MAP) values and uncertainties of nuclear matter incompressibility and isovector interaction parameters are inferred from the experimental data of giant resonances and neutron-skin thicknesses of typical heavy nuclei. Furthermore, with the uncertainties of the isovector interaction parameters constrained by the data of the isovector giant dipole resonance and the neutron-skin thickness, we have obtained K 0 = 223$^{+7}_{–8}$ MeV at 68% confidence level using the data of the isoscalar giant monopole resonance in 208 Pb measured at the Research Center for Nuclear Physics (RCNP), Japan, and at the Texas A&M University, USA. Although the corresponding 120 Sn data gives a MAP value for K 0 about 5 MeV smaller than the 208 Pb data, there are significant overlaps in their posterior probability distribution functions.

190 ≤ A ≤ 219↗

Efficient Probabilistic Prediction and Uncertainty Quantification of Tropical Cyclone–Driven Storm Tides and Inundation

Abstract This study proposes and assesses a methodology to obtain high-quality probabilistic predictions and uncertainty information of near-landfall tropical cyclone–driven (TC-driven) storm tide and inundation with limited time and resources. Forecasts of TC track, intensity, and size are perturbed according to quasi-random Korobov sequences of historical forecast errors with assumed Gaussian and uniform statistical distributions. These perturbations are run in an ensemble of hydrodynamic storm tide model simulations. The resulting set of maximum water surface elevations are dimensionality reduced using Karhunen–Loève expansions and then used as a training set to develop a polynomial chaos (PC) surrogate model from which global sensitivities and probabilistic predictions can be extracted. The maximum water surface elevation is extrapolated over dry points incorporating energy head loss with distance to properly train the surrogate for predicting inundation. We find that the surrogate constructed with third-order PCs using elastic net penalized regression with leave-one-out cross validation provides the most robust fit across training and test sets. Probabilistic predictions of maximum water surface elevation and inundation area by the surrogate model at 48-h lead time for three past U.S. landfalling hurricanes (Irma in 2017, Florence in 2018, and Laura in 2020) are found to be reliable when compared to best track hindcast simulation results, even when trained with as few as 19 samples. The maximum water surface elevation is most sensitive to perpendicular track-offset errors for all three storms. Laura is also highly sensitive to storm size and has the least reliable prediction. Significance Statement The purpose of this study is to develop and evaluate a methodology that can be used to provide high-quality probabilistic predictions of hurricane-induced storm tide and inundation with limited time and resources. This is important for emergency management purposes during or after the landfall of hurricanes. Our results show that sampling forecast errors using quasi-random sequences combined with machine learning techniques that fit polynomial functions to the data are well suited to this task. The polynomial functions also have the benefit of producing exact sensitivity indices of storm tide and inundation to the forecasted hurricane properties such as path, intensity, and size, which can be used for uncertainty estimation. The code implementing the presented methodology is publicly available on GitHub.

54 ENVIRONMENTAL SCIENCES↗

Phenomena-based Uncertainty Quantification in Predictive Coupled- Physics Reactor Simulations

This project has sought to develop methodologies, tailored to phenomena that govern nuclearreactor behavior, to produce predictions (including uncertainties) for quantities of interest (QOIs) in the simulation of steady-state and transient reactor behavior. Examples of such predictions include, for each QOI, an expected value as well as a distribution around this value and an assessment of how much of the distribution stems from each major source of uncertainty. The project has sought to test its methodologies by comparing against measured experimental outcomes. The main experimental platform has been a 1-MW TRIGA reactor. This is a flexible platform for a wide range of experiments, including steady state with and without temperature feedback, slow transients with and without feedback, and rapid transients with strong feedback. The original plan was for the primary experimental data to come from in-core neutron detectors. We made considerable progress toward this goal but did not get as far along as we had planned. We have designed, developed, installed, and tested vertical guide tubes, each able to accept a detector or stack of detectors that can be moved axially inside the tube, and we have tested several new detector designs. One of these shows considerable promise.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Uncertainty Quantification of Extratropical Forest Biomass in CMIP5 Models over the Northern Hemisphere

Abstract Simplified representations of processes influencing forest biomass in Earth system models (ESMs) contribute to large uncertainty in projections. We evaluate forest biomass from eight ESMs outputs archived in the Coupled Model Intercomparison Project Phase 5 (CMIP5) using the biomass data synthesized from radar remote sensing and ground-based observations across northern extratropical latitudes. ESMs exhibit large biases in the forest distribution, forest fraction, and mass of carbon pools that contribute to uncertainty in forest total biomass (biases range from −20 Pg C to 135 Pg C). Forest total biomass is primarily positively correlated with precipitation variations, with surface temperature becoming equally important at higher latitudes, in both simulations and observations. Relatively small differences in forest biomass between the pre-industrial period and the contemporary period indicate uncertainties in forest biomass were introduced in the pre-industrial model equilibration (spin-up), suggesting parametric or structural model differences are a larger source of uncertainty than differences in transient responses. Our findings emphasize the importance of improved (1) models of carbon allocation to biomass compartments, (2) distribution of vegetation types in models, and (3) reproduction of pre-industrial vegetation conditions, in order to reduce the uncertainty in forest biomass simulated by ESMs.

54 ENVIRONMENTAL SCIENCES↗

Dakota Uncertainty Quantification Methods Applied to the CFD code Nek5000

This report presents the state of advancement of a Nuclear Energy Advanced Modeling and Simulation (NEAMS) project to characterize the uncertainty of the computational fluid dynamics (CFD) code Nek5000 using the Dakota package for flows encountered in the nuclear engineering industry. Nek5000 is a high-order spectral element CFD code developed at Argonne National Laboratory for high-resolution spectral-filtered large eddy simulations (LESs) and unsteady Reynolds-averaged Navier-Stokes (URANS) simulations.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Uncertainty Quantification and Sensitivity Analysis for Quantitative Risk Assessments of Hydrogen Infrastructure

Typical QRAs provide deterministic estimates and understanding of risks posed but are constructed using significant assumptions and uncertainties due to limited data availability and historical momentum of using nominal estimates. This report presents a hydrogen QRA analysis using HyRAM+ that incorporates uncertainty with Latin hypercube sampling and sensitivity analysis using linear regression.

08 HYDROGEN↗

Dose Uncertainty Quantification in AGC Experiment

This memorandum formally documents completion of the Advanced Reactor Technologies Level 3 Milestone (M3NT-18IN060504037), “Interoffice Memorandum detailing status of the AGC irradiation uncertainty analysis” due SeptemberAugust 30, 2018. This memorandum details the progress made toward the issuance of a final report detailing the AGC uncertainty analysis including the proposed methodology, progress on activities, and explanation of how the data will be used. Radiation damage estimation is an important component of the post-irradiation analysis of the AGC experiments. It depends primarily on the fast fluence, which is determined using well-established methods of spectral adjustments. These are based on best estimates from models (e.g. MCNP). Input cross-sections, and measured activities from flux wires in the experiment, propagate uncertainties in each of these. While the methods of propagating uncertainty are well-established, the final uncertainty estimates they provide are only as good as the estimates of uncertainty in the inputs on which they are based. The purpose of this work is to implement a method that eliminates some deficiencies in the ways input uncertainties are presently estimated. The rRadiation damage estimates for the AGC experiments are ostensibly based on experimental data in the form of flux wire activation measurements; each AGC experiment has been instrumented with flux wires at various locations along the axial length to provide this data. However, the estimatesy also depend on the results of MCNP calculations. To understand why, consider that the objective of the analysis is to estimate some number of parameters (the energy group fluences ?_i) that best reproduce the observations (the measured activities of the flux wires a_i).

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Classification Using Support Vector Machines with Uncertainty Quantification

Binary classification using machine learning is needed to address engineering problems such as identifying passing/failing parts based on measured features from aging hardware. In these classifications, providing the uncertainty of each prediction is essential to support engineering decision making. One popular classifier is the support vector machine (SVM). There are many variations, with the simplest being a linear division between two classes with a hyperplane. Kernel methods can be implement

Taylor, Sofia Nitsche↗

Detection of atmospheric rivers with inline uncertainty quantification: TECA-BARD v1.0.1

It has become increasingly common for researchers to utilize methods that identify weather features in climate models. There is an increasing recognition that the uncertainty associated with choice of detection method may affect our scientific understanding. For example, results from the Atmospheric River Tracking Method Intercomparison Project (ARTMIP) indicate that there are a broad range of plausible atmospheric river (AR) detectors and that scientific results can depend on the algorithm used. There are similar examples from the literature on extratropical cyclones and tropical cyclones. It is therefore imperative to develop detection techniques that explicitly quantify the uncertainty associated with the detection of events. We seek to answer the following question: given a “plausible” AR detector, how does uncertainty in the detector quantitatively impact scientific results? We develop a large dataset of global AR counts, manually identified by a set of eight researchers with expertise in atmospheric science, which we use to constrain parameters in a novel AR detection method. We use a Bayesian framework to sample from the set of AR detector parameters that yield AR counts similar to the expert database of AR counts; this yields a set of “plausible” AR detectors from which we can assess quantitative uncertainty. This probabilistic AR detector has been implemented in the Toolkit for Extreme Climate Analysis (TECA), which allows for efficient processing of petabyte-scale datasets. We apply the TECA Bayesian AR Detector, TECA-BARD v1.0.1, to the MERRA-2 reanalysis and show that the sign of the correlation between global AR count and El Niño–Southern Oscillation depends on the set of parameters used.

54 ENVIRONMENTAL SCIENCES↗

Uncertainty Quantification in GADRAS Inverse Modeling

The Gamma Detector Response and Analysis Software (GADRAS) package includes an inverse modeling tool that is helpful in identifying characteristics of unknown radioactive materials. Traditionally, uncertainties in this analysis were derived solely from measurement data quality and the fit of synthetic spectra. This paper aims to rigorously quantify additional sources of uncertainty, focusing on uncertainties arising from measurements being analyzed, Detector Response Function (DRF) characterization, and DRF extrapolation. Applying these findings to the BeRPBall benchmark data set, we demonstrated the impact of these uncertainties on plutonium and polyethylene estimates. The results underscore the importance of incorporating diverse uncertainty sources to enhance the accuracy and reliability of GADRAS’s inverse modeling capabilities.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Carbonyl Identification and Quantification Uncertainties for Oxidative Polymer Degradation

The most revealing indicator for oxidative processes or state of degraded plastics is usually carbonyl formation, a key step in materials degradation as part of the carbon cycle for man-made materials. Hence, the identification and quantification of carbonyl species with infrared spectroscopy have been the method of choice for generations, thanks to their strong absorbance and being an essential intermediate in carbon oxidation pathways. Despite their importance, precise identification and quantification can be challenging and rigorous fully traceable data are surprisingly rare in the existing literature. An overview of the complexity of carbonyl quantification is presented by the screening of reference compounds in solution with transmission and polymer films with ATR IR spectroscopy, and systematic data analyses. Significant variances in existing data and their past use have been recognized. Guidance is offered how better measurements and data reporting could be accomplished. Experimental variances depend on the combination of uncertainty in exact carbonyl species, extinction coefficient, contributions from neighboring convoluting peaks, matrix interaction phenomena and instrumental variations in primary IR spectral acquisition (refractive index and penetration depth for ATR measurements). In addition, diverging sources for relevant extinction coefficients may exist, based on original spectral acquisition. For common polymer degradation challenges, a relative comparison of carbonyl yields for a material is easily accessible, but quantification for other purposes, such as degradation rates and spatially dependent interpretation, requires thorough experimental validation. All variables featured in this overview demonstrate the significant error margins in carbonyl quantification, with exact carbonyl species and extinction coefficients already being major contributors on their own.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Uncertainty Quantification for Point Spread Functions in X-Ray Radiography

X-ray radiographers have tools for estimating the point spread function (PSF) which determines the extent of the blur in images. Knowledge of uncertainties in their estimations can be extremely valuable, and existing methods do not provide this information. We have developed a new technique using a Bayesian framework that will provide useful uncertainties to the estimated PSF.

point spread function↗

Uncertainty quantification of optical models in fission fragment deexcitation

Here, we take the first step towards incorporating compound nuclear observables at astrophysically relevant energies into the experimental evidence used to constrain optical models, by propagating the uncertainty in two global optical potentials, one phenomenological and one microscopic, to correlated fission observables using the Monte Carlo Hauser-Feshbach formalism. We compare to a wide range of historic and recent experimental fission measurements, and discuss in detail regions of disagreement. We find that the parametric optical model uncertainty in neutron-fragment correlated observables involving neutron energy is significant. On the other hand, we observe that other experimental features, particularly neutron-fragment correlations near the 132 Sn shell closure and the high energy component of neutron spectra, are unlikely to be explained by the optical potential, and will require further experimental and theoretical effort to explain.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Uncertainty quantification in (α,n) neutron source calculations for an oxide matrix

Here we present a methodology to propagate nuclear data covariance information in neutron source calculations from (α,n) reactions. The approach is applied to estimate the uncertainty in the neutron generation rates for uranium oxide fuel types due to uncertainties on 1) 17,18 O( α,n) reaction cross sections and 2) uranium and oxygen stopping power cross sections. The procedure to generate reaction cross section covariance information is based on the Bayesian fitting method implemented in the R-matrix SAMMY code. The evaluation methodology uses the Reich-Moore approximation to fit the 17,18 O(α,n) reaction cross-sections in order to derive a set of resonance parameters and a related covariance matrix that is then used to calculate the energydependent cross section covariance matrix. The stopping power cross sections and related covariance information for uranium and oxygen were obtained by the fit of stopping power data in the -energy range of 1 keV up to 12 MeV. Cross section perturbation factors based on the covariance information relative to the evaluated 17,18 O( α,n) reaction cross sections, as well as uranium and oxygen stopping power cross sections, were used to generate a varied set of nuclear data libraries used in SOURCES4C and ORIGEN for inventory and source term calculations. The set of randomly perturbed output (α,n) source responses, provide the mean values and standard deviations of the calculated responses reflecting the uncertainties in nuclear data used in the calculations. Lastly, the results and related uncertainties are compared with experiment thick target (α,n) yields for uranium oxide.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Surrogate multi-fidelity data and model fusion for scientific discovery and uncertainty quantification in Earth System Models

This whitepaper addresses the Earth and Environmental Systems Sciences Division (EESSD)’s predictability challenges in modeling the integrated water cycle and data-model integration. Specifically, it focuses on reducing and characterizing the uncertainty in the representation of process models for unresolved physics, either due to model resolution or limited by the physical under standing or computational efficiency, and the use of observational data for in-situ process parameter optimization within ESM. The described methods may also be used to determine the nature of responses (e.g. strength and direction), and hence to identify critical processes that drive the overall ESM responses to perturbation in the forcing

54 ENVIRONMENTAL SCIENCES↗

Uncertain of uncertainties? A comparison of uncertainty quantification metrics for chemical data sets

Abstract With the increasingly more important role of machine learning (ML) models in chemical research, the need for putting a level of confidence to the model predictions naturally arises. Several methods for obtaining uncertainty estimates have been proposed in recent years but consensus on the evaluation of these have yet to be established and different studies on uncertainties generally uses different metrics to evaluate them. We compare three of the most popular validation metrics (Spearman’s rank correlation coefficient, the negative log likelihood (NLL) and the miscalibration area) to the error-based calibration introduced by Levi et al. ( Sensors 2022 , 22 , 5540). Importantly, metrics such as the negative log likelihood (NLL) and Spearman’s rank correlation coefficient bear little information in themselves. We therefore introduce reference values obtained through errors simulated directly from the uncertainty distribution. The different metrics target different properties and we show how to interpret them, but we generally find the best overall validation to be done based on the error-based calibration plot introduced by Levi et al. Finally, we illustrate the sensitivity of ranking-based methods (e.g. Spearman’s rank correlation coefficient) towards test set design by using the same toy model ferent test sets and obtaining vastly different metrics (0.05 vs. 0.65).

Rasmussen, Maria H.↗

Robust Uncertainty Quantification using Response Surface Approximations of Discontinuous Functions

This paper considers response surface approximations for discontinuous quantities of interest. Our objective is not to adaptively characterize the manifold defining the discontinuity. Instead, we utilize an epistemic description of the uncertainty in the location of a discontinuity to produce robust bounds on sample-based estimates of probabilistic quantities of interest. We demonstrate that two common machine learning strategies for classification, one based on nearest neighbors (Voronoi cells) and one based on support vector machines, provide reasonable descriptions of the region where the discontinuity may reside. In higher dimensional spaces, we demonstrate that support vector machines are more accurate for discontinuities defined by smooth manifolds. We also show how gradient information, often available via adjoint-based approaches, can be used to define indicators to effectively detect a discontinuity and to decompose the samples into clusters using an unsupervised learning technique. Numerical results demonstrate the epistemic bounds on probabilistic quantities of interest for simplistic models and for a compressible fluid model with a shock-induced discontinuity.

97 MATHEMATICS AND COMPUTING↗

Uncertainty Quantification of Classifying Mechanical Breach in the Crash and Burn Problem

The prediction of mechanical breach in the Crash and Burn problem is important for designing the full system to minimize the probability of loss of containment. Due to uncertainties in the impact angle, material properties, and material models, it is not possible to define an exact critical impact speed at which the system breaches. Furthermore, the cost of running a large scale sampling study to determine the empirical probability of breach is prohibitive. In this work, surrogate models from machine learning, namely logistic regression and artificial neural networks, are introduced to predict binary classification of pass versus breach from a limited set of samples. The structure and calibration of these classifiers is discussed, and a set of metrics for describing the performance of the classifiers is introduced. The classifiers are used on the UUR version of the Crash model to attempt prediction of failure probability and perform variable sensitivity analysis. Where a single sample of the computational model can take hundreds of CPU-hours, training and evaluating a classifier can take seconds or less, thus giving high predictive power in a relatively short time.

42 ENGINEERING↗