Search NASA⌕ Search

SEARCH · Search NASA

Results for “Uncertainty Quantification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,549 records · Page 86
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Evaluating uncertainty-based active learning for accelerating the generalization of molecular property prediction

Deep learning models have proven to be a powerful tool for the prediction of molecular properties for applications including drug design and the development of energy storage materials. However, in order to learn accurate and robust structure–property mappings, these models require large amounts of data which can be a challenge to collect given the time and resource-intensive nature of experimental material characterization efforts. Additionally, such models fail to generalize to new types of molecular structures that were not included in the model training data. The acceleration of material development through uncertainty-guided experimental design has the promise to significantly reduce the data requirements and enable faster generalization to new types of materials. To evaluate the potential of such approaches for electrolyte design applications, we perform comprehensive evaluation of existing uncertainty quantification methods on the prediction of two relevant molecular properties - aqueous solubility and redox potential. We develop novel evaluation methods to probe the utility of the uncertainty estimates for both in-domain and out-of-domain data sets. Finally, we leverage selected uncertainty estimation methods for active learning to evaluate their capacity to support experimental design.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Advanced Graphite Creep Uncertainty Analysis

Radiation damage estimation is an important component of the post irradiation analysis of the Advanced Graphite Creep (AGC) experiment. It depends primarily on the fast fluence, which is determined using well established methods of spectral adjustment. These are based on best estimates from models such as Monte Carlo N-Particle (MCNP), input cross-sections, and measured activities from flux wires in the experiment. Each of these parameters can propagate uncertainties which will affect the uncertainty in the calculated dose levels for AGC, or any experiment irradiated within a reactor. While the methods of propagating uncertainty are well-established, the final uncertainty estimates they provide are only as good as the estimates of uncertainty in the inputs on which they are based. The purpose of this work is to outline some deficiencies in the ways these input uncertainties are presently estimated, and to outline a methodology by which they can be improved. The fast fluence and radiation damage received by graphite specimens irradiated in the Advanced Graphite Creep (AGC) experiments is presently estimated using spectral adjustment methods that are based on both flux wire activity measurements, and MCNP model predictions. This work describes an ongoing effort to quantify and propagate uncertainties in inputs to the spectral adjustment process, and thereby quantify the resultant error in radiation damage (dpa) estimates. The effort is multi-faceted, and we consider the impacts of both the set of flux wires selected, and the counting process. An expanded set of flux wires is identified that provides a more comprehensive data set on the fast spectrum. To address the counting process itself, a series of round-robin measurements in several reactor metrology laboratories across the Department of Energy (DOE) complex and nuclear industry are being undertaken to refine the American Society for Testing and Materials (ASTM) standards for flux wire measurements. To address the contribution of uncertainty in the MCNP model predictions, an uncertainty quantification (UQ) tool has been developed that statistically samples the model input parameters, runs a series of cases, and assimilates the results to provide an overall uncertainty. The impact of the MCNP UQ tool results is demonstrated by re-analyzing previous AGC flux wire and irradiation data. While the expanded flux wire set obviously cannot be added to these experiments retroactively, plans for future graphite irradiations are outlined.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
NASA NTRSDate not supplied

Uncertainty Reduction With Multi-Model Monte Carlo for Crystal Plasticity Simulations of Additively Manufactured Metals

In this work, multi-model Monte Carlo estimators are developed to reduce uncertainty in quantities of interest (QoIs) extracted from crystal plasticity simulations of additively manufactured (AM) metals. A significant concern in AM parts is uncertainty in mechanical properties caused in part by complex microstructures that arise from the AM process. Quantifying uncertainty in microstructure-sensitive behavior using experiments alone is costly, especially when mechanical allowables must be established. Quantitative relationships among microstructure, micromechanical metrics like slip accumulation, crack initiation, and failure are also difficult to capture with limited experiments. Crystal plasticity material models instead enable computational prediction of micromechanical stress and strain fields given a discretized microstructure. However, high-fidelity finely discretized crystal plasticity simulations are computationally expensive, while lower-fidelity models are less accurate and generally biased, making uncertainty quantification and reduction computationally difficult as well. Multi-model Monte Carlo methods leverage correlations between high- and low-fidelity models to produce unbiased estimators for QoIs with reduced uncertainty relative to standard Monte Carlo. Crystal plasticity QoIs considered in this work include yield strength and the mean and extreme values of micromechanical fields that are relevant to crack initiation. Multi-model Monte Carlo estimators are developed for each individual QoI and several groups of QoIs. The results of this work establish relationships among model correlations, sample allocation, and uncertainty reduction for different combinations of QoIs and demonstrate a trend of less uncertainty reduction as QoIs become more sensitive to local microstructure. Limitations from using pilot samples to estimate model covariances and train low-fidelity models are also addressed. The uncertainty reduction achieved by multi-model Monte Carlo is an important step toward using computational mechanics models to predict microstructure-sensitive crack initiation and failure in AM parts.

uncertainty quantification↗
DOE OSTI2019

Embedded Model Error Representation for Bayesian Model Calibration

Model error estimation remains one of the key challenges in uncertainty quantification and predictive science. For computational models of complex physical systems, model error, also known as structural error or model inadequacy, is often the largest contributor to the overall predictive uncertainty. This work builds on a recently developed framework of embedded, internal model correction, in order to represent and quantify structural errors, together with model parameters,within a Bayesian inference context. We focus specifically on a Polynomial Chaos representation with additive modification of existing model parameters, enabling a non-intrusive procedure for efficient approximate likelihood construction, model error estimation, and disambiguation of model and data errors’ contributions to predictive uncertainty. The framework is demonstrated on several synthetic examples, as well as on a chemical ignition problem.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

Making sense of uncertain nuclear data

At its core, and in an imperfect world, the scientific method relies heavily on the concept of uncertain knowledge. Understanding the nature and magnitude of our lack of knowledge on nuclear data has important ramifications on a wide range of nuclear technologies that encompass defense, energy, medicine, astrophysics, among others. Over the span of a long and fruitful carrier, Dr. Massimo Salvatores has made significant contributions to the fields of nuclear reactor physics, nuclear data, and uncertainty quantification and propagation. Advances in machine learning techniques and computational capabilities are enabling a new level of confidence in our ability to predict key nuclear metrics as well as their associated uncertainties across many applications. Here this short article reviews some of those concepts with an eye towards developing a new paradigm to provide nuclear data libraries of benefit to various applications.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2020

MFNets: Multifidelity data-driven networks for Bayesian learning and prediction

This paper presents a multifidelity uncertainty quantification framework called MFNets. We seek to address three existing challenges that arise when experimental and simulation data from different sources are used to enhance statistical estimation and prediction with quantified uncertainty. Specifically, we demonstrate that MFNets can (1) fuse heterogeneous data sources arising from simulations with different parameterizations, e.g simulation models with different uncertain parameters or data sets collected under different environmental conditions; (2) encode known relationships among data sources to reduce data requirements; and (3) improve the robustness of existing multi-fidelity approaches to corrupted data. MFNets construct a network of latent variables (LVs) to facilitate the fusion of data from an ensemble of sources of varying credibility and cost. These LVs are posited as explanatory variables that provide the source of correlation in the observed data. Furthermore, MFNets provide a way to encode prior physical knowledge to enable efficient estimation of statistics and/or construction of surrogates via conditional independence relations on the LVs. We highlight the utility of our framework with a number of theoretical results which assess the quality of the posterior mean as a frequentist estimator and compare it to standard sampling approaches that use single fidelity, multilevel, and control variate Monte Carlo estimators. We also use the proposed framework to derive the Monte Carlo-based control variate estimator entirely from the use of Bayes rule and linear-Gaussian models -- to our knowledge the first such derivation. Finally, we demonstrate the ability to work with different uncertain parameters across different models.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2014

Quantification of key long-term risks at CO₂ sequestration sites: Latest results from US DOE's National Risk Assessment Partnership (NRAP) Project

Risk assessment for geologic CO₂ storage including quantification of risks is an area of active investigation. The National Risk Assessment Partnership (NRAP) is a US-Department of Energy (US-DOE) effort focused on developing a defensible, science-based methodology and platform for quantifying risk profiles at geologic CO₂ sequestration sites. NRAP has been developing a methodology that centers round development of an integrated assessment model (IAM) using system modeling approach to quantify risks and risk profiles. The IAM has been used to calculate risk profiles with a few key potential impacts due to potential CO₂ and brine leakage. The simulation results are also used to determine long-term storage security relationships and compare the long-term storage effectiveness to IPCC storage permanence goal. Additionally, we also demonstrate application of IAM for uncertainty quantification in order to determine parameters to which the uncertainty in model results is most sensitive.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Anomalous electroweak physics unraveled via evidential deep learning

The ever-growing ecosystem of beyond standard model (BSM) calculations and parametrizations has motivated the development of systematic methods for making quantitative cross-comparisons over the wide range of possible models, especially with controllable uncertainties. In this setting, the language of uncertainty quantification (UQ) furnishes useful metrics for assessing statistical overlaps and discrepancies among BSM and related models. In this study, we leverage recent machine learning (ML) developments in evidential deep learning (EDL) for UQ to separate data (aleatoric) and knowledge (epistemic) uncertainties in a model-discrimination setting. We construct several potentially BSM-motivated scenarios for the anomalous electroweak interaction (AEWI) of neutrinos with nucleons in deep inelastic scattering ( v DIS). These scenarios are then quantitatively mapped, as a demonstration, alongside Monte Carlo replicas of the CT18 PDFs used to calculate the $\varDelta \chi ^{2}$ statistic for a typical multi-GeV v DIS experiment, CDHSW. Our framework effectively highlights areas of model agreement and provides a classification of out-of-distribution (OOD) samples. By offering the opportunity to quantitatively understand model overlaps, the approach presented in this work can help facilitate efficient BSM model exploration and exclusion for future New Physics searches.

AI↗
NASA NTRSDate not supplied

Integrated Process-Structure-Property Simulations for Additive Manufacturing Using the Open-Source Materialite Package

The microstructure and properties of additively manufactured (AM) metals are strongly dependent on process conditions. Therefore, process-structure-property (PSP) simulations are a useful tool for exploring process parameter space, studying process variations, and quantifying uncertainty in material properties. However, integrating process-structure and structure-property simulations often involves connecting multiple software packages. Each package may use unique data structures and require substantial domain knowledge. This presentation demonstrates PSP simulation capabilities of Materialite, an open-source package developed at NASA Langley Research Center. Materialite simplifies model linkages by using a common data structure and model interface, enabling straightforward simulation across a PSP model chain. Physics-based models, including kinetic Monte Carlo and crystal plasticity, are implemented within the package. The model interface is also intended to simplify implementation of new models and enable integration with external simulation tools. Example use cases include uncertainty quantification with PSP models and GPU-accelerated powder bed fusion AM process models.

additive manufacturing↗
DOE OSTI2023

Uncertainty-aware photovoltaic generation estimation through fusion of physics with harmonics information using Bayesian neural networks

We develop an aggregate photovoltaic generation estimation methodology that uses diverse inputs and can reason on its current input-dependent predictive uncertainty. Named PVPHEst, for PhotoVoltaic Physics- & Harmonics-driven Estimator, the resulting tool is intelligently weighing and fusing information carried by the output of physics models, harmonics, and line sensors, using Bayesian neural networks and related techniques aimed at solving machine learning problems with intrinsic uncertainty quantification. As each of the three input classes carries heterogeneous information that only sheds light on one facet of the estimation problem but its value can diminish in the face of diverse grid phenomena, PV-PHEst with its estimation and uncertainty reasoning capabilities perform a nontrivial and potentially mission-critical task of value to grid operators.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

A Brief Account of Steven Weinberg’s Legacy in ab initio Many-Body Theory

In this contribution to the special issue “Celebrating 30 years of Steven Weinberg’s papers on Nuclear Forces from Chiral Lagrangians,” we emphasize the important role chiral effective field theory has played in leading nuclear physics into a precision era. To this end, we share our perspective on a few of the recent advances made in ab initio calculations of nuclear structure and nuclear matter observables, as well as Bayesian uncertainty quantification of effective field theory truncation errors.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Time-temperature-superposition analysis of diverse datasets by the minimum-arclength method: long-term prediction with uncertainty margins

In a recent publication, we carried out an extensive analysis of an unsupervised method of determining optimum shift factors in time-temperature-superposition of accelerated-aging data that involves minimizing the vertical arclength to obtain the master curve. For synthetic Arrhenius data with a variety of noise distributions, the work showed that, in conjunction with bootstrap-resampling, the method can produce reliable estimates of the mean activation energy along with uncertainty quantification. Here, we apply the above method to six different datasets taken from the published literature and demonstrate accurate prediction of mean activation energy from the data as-is without the need for any pre-processing or fitting. We also compare uncertainty margins computed by second-order bootstrap with that by linear regression theory and show that the former appears to provide consistent margins in the presence of common noise types in real data, including intra-isotherm measurement-errors, sample-to-sample variations, and intrinsic deviation from perfect Arrhenius behavior.

36 MATERIALS SCIENCE↗
DOE OSTI2022

A Spatiotemporal-Aware Weighting Scheme for Improving Climate Model Ensemble Predictions

Multimodel ensembling has been widely used to improve climate model predictions, and the improvement strongly depends on the ensembling scheme. In this work, we propose a Bayesian neural network (BNN) ensembling method, which combines climate models within a Bayesian model averaging framework, to improve the predictive capability of model ensembles. Our proposed BNN approach calculates spatiotemporally varying model weights and biases by leveraging individual models' simulation skill, calibrates the ensemble prediction against observations by considering observation data uncertainty, and quantifies epistemic uncertainty when extrapolating to new conditions. More importantly, the BNN method provides interpretability about which climate model contributes more to the ensemble prediction at which locations and times. Thus, beyond its predictive capability, the method also brings insights and understanding of the models to guide further model and data development. In this study, we design experiments using an ensemble of CMIP6 climate model simulations to illustrate the BNN ensembling method's capability with respect to prediction accuracy, interpretability, and uncertainty quantification (UQ). We demonstrate that BNN can correctly assign larger weights to the regions and seasons where the individual model fits the observation better. Moreover, its offered interpretability is consistent with our understanding of localized climate model performance. Additionally, BNN shows an increasing uncertainty when the prediction is farther away from the period with constrained data, which appropriately reflects our trustworthiness of the models in the changing climate.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Bayesian reduced-order deep learning surrogate model for dynamic systems described by partial differential equations

We propose a reduced-order deep-learning surrogate model for dynamic systems described by time-dependent partial differential equations. This method employs space–time Karhunen–Loève expansions (KLEs) of the state variables and space-dependent KLEs of space-varying parameters to identify the reduced (latent) dimensions. Subsequently, a deep neural network (DNN) is used to map the parameter latent space to the state variable latent space. An approximate Bayesian method is developed for uncertainty quantification (UQ) in the proposed KL-DNN surrogate model. The KL-DNN method is tested for the linear advection–diffusion and nonlinear diffusion equations, and the Bayesian approach for UQ is compared with the deep ensembling (DE) approach, commonly used for quantifying uncertainty in DNN models. It was found that the approximate Bayesian method provides a more informative distribution of the PDE solutions in terms of the coverage of the reference PDE solutions (the percentage of nodes where the reference solution is within the confidence interval predicted by the UQ methods) and log predictive probability. The DE method is found to underestimate uncertainty and introduce bias. For the nonlinear diffusion equation, we compare the KL-DNN method with the Fourier Neural Operator (FNO) method and find that KL-DNN is 10% more accurate and needs less training time than the FNO method.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2014

Development and Validation of a Lifecycle-based Prognostics Architecture with Test Bed Validation

On-line monitoring and tracking of nuclear plant system and component degradation is being investigated as a method for improving the safety, reliability, and maintainability of aging nuclear power plants. Accurate prediction of the current degradation state of system components and structures is important for accurate estimates of their remaining useful life (RUL). The correct quantification and propagation of both the measurement uncertainty and model uncertainty is necessary for quantifying the uncertainty of the RUL prediction. This research project developed and validated methods to perform RUL estimation throughout the lifecycle of plant components. Prognostic methods should seamlessly operate from beginning of component life (BOL) to end of component life (EOL). We term this "Lifecycle Prognostics." When a component is put into use, the only information available may be past failure times of similar components used in similar conditions, and the predicted failure distribution can be estimated with reliability methods such as Weibull Analysis (Type I Prognostics). As the component operates, it begins to degrade and consume its available life. This life consumption may be a function of system stresses, and the failure distribution should be updated to account for the system operational stress levels (Type II Prognostics). When degradation becomes apparent, this information can be used to again improve the RUL estimate (Type III Prognostics). This research focused on developing prognostics algorithms for the three types of prognostics, developing uncertainty quantification methods for each of the algorithms, and, most importantly, developing a framework using Bayesian methods to transition between prognostic model types and update failure distribution estimates as new information becomes available. The developed methods were then validated on a range of accelerated degradation test beds. The ultimate goal of prognostics is to provide an accurate assessment for RUL predictions, with as little uncertainty as possible. From a reliability and maintenance standpoint, there would be improved safety by avoiding all failures. Calculated risk would decrease, saving money by avoiding unnecessary maintenance. One major bottleneck for data-driven prognostics is the availability of run-to-failure degradation data. Without enough degradation data leading to failure, prognostic models can yield RUL distributions with large uncertainty or mathematically unsound predictions. To address these issues a "Lifecycle Prognostics" method was developed to create RUL distributions from Beginning of Life (BOL) to End of Life (EOL). This employs established Type I, II, and III prognostic methods, and Bayesian transitioning between each Type. Bayesian methods, as opposed to classical frequency statistics, show how an expected value, a priori, changes with new data to form a posterior distribution. For example, when you purchase a component you have a prior belief, or estimation, of how long it will operate before failing. As you operate it, you may collect information related to its condition that will allow you to update your estimated failure time. Bayesian methods are best used when limited data are available. The use of a prior also means that information is conserved when new data are available. The weightings of the prior belief and information contained in the sampled data are dependent on the variance (uncertainty) of the prior, the variance (uncertainty) of the data, and the amount of measured data (number of samples). If the variance of the prior is small compared to the uncertainty of the data, the prior will be weighed more heavily. However, as more data are collected, the data will be weighted more heavily and will eventually swamp out the prior in calculating the posterior distribution of model parameters. Fundamentally Bayesian analysis updates a prior belief with new data to get a posterior belief. The general approach to applying the Bayesian method to lifecycle prognostics consisted of identifying the prior, which is the RUL estimate and uncertainty from the previous prognostics type, and combining it with observational data related to the newer prognostics type. The resulting lifecycle prognostics algorithm uses all available information throughout the component lifecycle.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRS2018

Dynamics and Control of Quadcopter in Uncertain Environment

We consider problem of dynamics, control, and uncertainty quantification for quadcopter. We use the 6DOF model of quadcopter dynamics, linear quadratic regulator and linear quadratic Gaussian control of quadcopter in the presence of dynamical disturbances, measurement noise, hidden dynamical variables, dashing GPS signal, and wind gusts to predict quadcopter trajectory. We identify key sources of uncertainties and report on progress in development of a system that estimates the probability of safety-critical events using a set of algorithms based on the trajectory predictions.

uncertainty quantification↗
DOE OSTI2022

Ensemble approximate control variate estimators: Applications to multi-fidelity importance sampling.

The recent growth in multifidelity uncertainty quantification has given rise to a large set of variance reduction techniques that leverage information from model ensembles to provide variance reduction for estimates of the statistics of a high-fidelity model. In this paper we provide two contributions: (1) we utilize an ensemble estimator to account for uncertainties in the optimal weights of approximate control variate (ACV) approaches and derive lower bounds on the number of samples required to guarantee variance reduction; and (2) we extend an existing multifidelity importance sampling (MFIS) scheme to leverage control variates. Our approach directly addresses a limitation of many multifidelity sampling strategies that require the usage of pilot samples to estimate covariances. As such we make significant progress towards both increasing the practicality of approximate control variates—for instance, by accounting for the effect of pilot samples—and using multifidelity approaches more effectively for estimating low-probability events. The numerical results indicate our hybrid MFIS-ACV estimator achieves up to 50% improvement in variance reduction over the existing state-of-the-art MFIS estimator, which had already shown an outstanding convergence rate compared to the Monte Carlo method, on several problems of computational mechanics.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

FY22 NCSP accomplishments for U and Pu Evaluations [Slides]

This presentation covers fiscal year 2022 for Nuclear Criticality Safety Program (NCSP) accomplishments for Uranium (U) and Plutonium (Pu) evaluations. This presentation includes an overview on plutonium and uranium. Additionally, this presentation covers the inclusion of sub-thermal data for 235 U and the inclusion of LANL ratio capture-to-fission data for 233 U and 235 Pu. The presentation ends with a discussion on 239 Pu Primary fit of Mosby's data as reported and a look at the uncertainty quantification.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗