SEARCH · Search NASA

Results for “uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Preliminary investigation of an uncertainty budget for uranium isotope ratio analysis using a liquid sampling—atmospheric pressure glow discharge—orbitrap mass spectrometer system

The liquid sampling-atmospheric pressure glow discharge (LS-APGD) ionization source has proven to be an effective analysis tool for making uranium isotope ratio measurements when coupled to high-resolution mass spectrometers, such as the Orbitrap. While previous studies have shown the capabilities of the LS-APGD for isotope ratio determination, a systematic evaluation of the measurement uncertainty of the technique has not been conducted. To this end, the International Standards Organizations (ISO) guidelines to the expression of uncertainty in measurement (GUM analysis) have been applied to generate an uncertainty budget. For this work, a preliminary assessment derived from the GUM analysis was performed. The uncertainty in the instrument blank determination has been identified as a primary factor contributing to measurement uncertainty for the LS-APGD-Orbitrap method. These findings for the specific test case of uranium isotopic analysis will be invaluable in applications across the breadth of isotope ratio mass spectrometry performed on this unique instrumental platform.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

DOE OSTI2025

Uncertainty improvement of 22 Na based radioactive tracer dilution for determining total mass of pyroprocessing molten salt systems by 154 Eu removal

To determine the total salt mass of the molten salt systems for pyroprocessing spent nuclear fuels, a 22 Na based radioactive tracer dilution was studied in Idaho National Laboratory in recent years. This 22 Na based RTD technique was deemed feasible, but due to the gamma energy peak of 22 Na coinciding with one of the energy peaks of 154 Eu radioisotope in the molten salt, the uncertainty of the 22 Na radioactivity in the 22 Na-spiked salt samples was quite high. To improve the uncertainty of the 22 Na based RTD technique, we proposed to chemically remove the 154 Eu of the salt samples by DGA resin for gamma spectroscopy. The effectiveness of removing 154 Eu on uncertainty improvement was evaluated. Furthermore, it was found that (1) the 154 Eu fission product effect on the uncertainty and detection limit can be effectively eliminated by chemically removing the 154 Eu during the salt sample preparation and (2) the uncertainty of 22 Na radioactivity in the salt samples for electrorefining was significantly improved from 13% to 2%, showing the potential of practical engineering application of 22 Na based RTD as a safeguards technique for molten salt systems for pyroprocessing spent nuclear fuels.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2022

Uncertainty Quantification Framework for Predicting Material Response with Large Number of Parameters: Application to Creep Prediction in Ferritic-Martensitic Steels Using Combined Crystal Plasticity and Grain Boundary Models

This paper presents an uncertainty quantification (UQ) framework for the physics-based model prediction of material response with a large number of parameters. The application problem presented in this work is that of predicting creep in Grade 91 steel at 600°C. The material response is defined with a physically based microstructural model with constitutive equations emulating several observed phenomena in Grade 91 and embodied into an explicit geometry mesoscale finite element model for prior austenite grains and grain boundaries. Creep within the grains and in grain boundaries are represented by crystal plasticity for dislocation motion and a physics-based model for cavity growth and nucleation, respectively. The creep behavior of this material is influenced by several parameters, some of which have a wide range of variation based on experimental data. UQ combined with microstructural modeling can discover the core microstructural causes of experimental variability, leading to improved materials with lower variability in critical long-term material properties. In this study, we investigate the model's uncertainty to identify material properties that may be modified during production to increase creep life and analyze different components of the crystal plasticity model for improvements. For this purpose, a quantity of interest is defined as time to minimum creep rate, which correlates well to the creep failure of the material. A deep neural network model was trained and validated to be used as a surrogate for the finite element model. Then, a variance-based sensitivity analysis is performed on the surrogate model to find the Sobol indices of the input parameters in respect to the output quantity of interest. The Sobol indices are used to reduce the dimensionality of the model. Generalized polynomial chaos expansion is used on the reduced basis models to propagate the uncertainty from the input parameters to the quantity of interest using the deep neural network surrogate model. These results are benchmarked against uncertainty propagation using Monte Carlo simulations. In conclusion, the UQ performed through the reduced basis model captures almost all the uncertainty in the model with significantly fewer simulations, making it possible to perform the UQ directly via simulations with the finite element model rather than surrogate machine-learned models.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Catalytic resonance theory for parametric uncertainty of programmable catalysis

Microkinetic models are useful tools for screening catalytic materials; however, errors in their input parameters can lead to significant uncertainty in model predictions of catalyst performance. Here, in this work, we investigate the impact of linear scaling and Brønsted-Evans-Polanyi relation parametric uncertainty on microkinetic predictions of programmable-catalyst performance. Two case studies are considered: a generic A-to-B prototype reaction and the oxygen evolution reaction (OER). The results show that error-unaware models can accurately predict trends and, for the prototype reaction, values of optimal waveform parameters. The specific model parameters driving output uncertainty are identified via variance-based global sensitivity analysis. However, predictions of dynamic rate enhancement can decrease when uncertainty is propagated into the models. In both cases, we identify operating conditions where the programmable catalyst achieves a rate enhancement of at least one order of magnitude despite parametric uncertainty in the model, supporting programmable catalysis as a viable strategy for exceeding the Sabatier limit.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2025

Bayesian prior construction for uncertainty quantification in first-principles statistical mechanics

First-principles statistical mechanics enables the prediction of thermodynamic and kinetic properties of materials, but is computationally expensive. Many approaches require surrogate models to calculate energies within Monte Carlo or molecular dynamics simulations. Inexpensive surrogates such as cluster expansions enable otherwise intractable calculations by interpolating data from higher accuracy methods, such as Density Functional Theory (DFT). Surrogate models introduce uncertainty into downstream calculations, in addition to any uncertainty inherent to DFT calculations. Bayesian frameworks address this by quantifying uncertainty and incorporating expert knowledge through priors. However, constructing effective priors remains challenging. This work introduces and describes practical strategies for building Bayesian cluster expansions, focusing on basis truncation, hyperparameter selection, and ground state replication. We analyze multiple basis truncation schemes, compare cross-validation to the evidence-approximation for hyperparameter optimization, and provide methods to find and enforce ground-state-preserving models through priors. Additionally, we compare the uncertainties between different approximations to DFT (LDA, PBE, SCAN) against the uncertainty introduced with the use of cluster expansion surrogate models. These approaches are demonstrated on the BCC Li x Mg 1-x and Li x Al 1-x alloys, which are both of interest for solid-state Li batteries. Our results provide guidelines for constructing and utilizing Bayesian cluster expansions, thereby improving the transparency of materials modeling. Furthermore, the approaches and insights developed in this work can be transferred to a wide range of cluster expansion surrogate models, including the atomic cluster expansion and related machine-learned interatomic potential architectures.

Alloy theory↗

DOE OSTI2021

A predictive discrete-continuum multiscale model of plasticity with quantified uncertainty

Multiscale models of materials, consisting of upscaling discrete simulations to continuum models, are unique in their capability to simulate complex materials behavior. The fundamental limitation in multiscale models is the presence of uncertainty in the computational predictions delivered by them. In this work, a sequential multiscale model has been developed, incorporating discrete dislocation dynamics (DDD) simulations and a strain gradient plasticity (SGP) model to predict the size effect in plastic deformations of metallic micro-pillars. The DDD simulations include uniaxial compression of micro-pillars with different sizes and over a wide range of initial dislocation densities and spatial distributions of dislocations. An SGP model is employed at the continuum level that accounts for the size-dependency of flow stress and hardening rate. Sequences of uncertainty analyses have been performed to assess the predictive capability of the multiscale model. The variance-based global sensitivity analysis determines the effect of parameter uncertainty on the SGP model prediction. The multiscale model is then constructed by calibrating the continuum model using the data furnished by the DDD simulations. A Bayesian calibration method is implemented to quantify the uncertainty due to microstructural randomness in discrete dislocation simulations (density and spatial distribution of dislocations) on the macroscopic continuum model prediction (size effect in plastic deformation). Here, the outcomes of this study indicate that the discrete-continuum multiscale model can accurately simulate the plastic deformation of micro-pillars, despite the significant uncertainty in the DDD results. Additionally, depending on the macroscopic features represented by the DDD simulations, the SGP model can reliably predict the size effect in plasticity responses of the micropillars with below 10% of error.

36 MATERIALS SCIENCE↗

DOE OSTI2022

A new multi-model absolute difference-based sensitivity (MMADS) analysis method to screen non-influential processes under process model and parametric uncertainty

Process-based models have been widely used for hydrologic modeling, and it is a common practice to use sensitivity analysis methods for excluding non-influential hydrologic processes from further investigation and/or model improvement. This study develops a new method called multi-model absolute difference-based sensitivity (MMADS) analysis method to screen non-influential system processes and parameters. MMADS is conceptually similar to the Morris method for addressing parametric uncertainty, but has a unique feature to address both process model uncertainty (i.e., a process may be represented by multiple process models) and process model parameter uncertainty (i.e., parameters associated with a process model are random). MMADS first evaluates absolute differences of a quantity of interest (i.e., a system model output) by varying process models and/or process model parameter values, and then calculates the mean and variance of the differences for investigating process influence. The mean measures overall influence of the process on the quantity of interest, and the variance estimates influence of nonlinear effects of the process and/or its interactions with other processes. MMADS is an extension of the Morris method from a parameter space to a joint parameter-model space for explicitly addressing both process model uncertainty and model parameter uncertainty. The performance of MMADS is evaluated by using two numerical experiments. One experiment is based on Sobol’s G*-function with ten product elements, and has analytical solutions of the MMADS mean and variance of absolute differences. The other experiment is for groundwater flow modeling which considers three processes (i.e., recharge, geology, and snowmelt) that interact with each other. Finally, results indicate that MMADS is computationally efficient and can identify non-influential processes of complex hydrological systems.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2026

Uncertainty guided online ensemble for non-stationary data streams in fusion science

Machine Learning (ML) is poised to play a pivotal role in the development and operation of next-generation fusion devices. Fusion data shows non-stationary behavior with distribution drifts, resulted by both experimental evolution and machine wear-and-tear. ML models assume stationary distribution and fail to maintain performance when encountered with such non-stationary data streams. Online learning techniques have been leveraged in other domains, however it has been largely unexplored for fusion applications. In this paper, we investigate online learning for continuous adaptation to drifting data streams in the prediction of Toroidal Field (TF) coils deflection at the DIII-D fusion facility. We further address the short-term performance degradation inherent to standard online learning, which arises because ground truth is unavailable at prediction time. To mitigate this issue, we propose an uncertainty-guided online ensemble framework. The method leverages the Deep Gaussian Process Approximation (DGPA) for calibrated uncertainty estimation and uses these uncertainty measures to guide a meta-algorithm that aggregates predictions from learners trained over different historical horizons. Our results show that online learning reduces prediction error by 80% compared to a static model. The online ensemble and the proposed uncertainty-guided ensemble further reduce error by approximately 6%, and 10% respectively, relative to standard single-model online learning, while also providing calibrated uncertainty estimates to support operational decision-making.

AI↗

DOE OSTI2021

An uncertainty-focused database approach to extract spatiotemporal trends from qualitative and discontinuous lake-status histories

Changes in lake status are often interpreted as palaeoclimate indicators due to their dependence on precipitation and evaporation. The Global Lake Status Database (GLSDB) has since long provided a standardised synopsis of qualitative lake status over the last 30,000 14C years. Potential sources of uncertainty however are not recorded in the GLSDB. Here we present an updated and improved relational-database framework that incorporates uncertainty in both chronology and the interpretation of palaeoenvironmental data. The database uses peer-reviewed palaeolimnological studies to produce a consensus on qualitative lake-status histories, whose chronologies are revised and standardized through the recalibration of radiocarbon dates and the application of Bayesian age-depth modelling for stratigraphic archives. Quantitative information on absolute water-level elevation is preserved if available from geomorphological sources. We also propose a new probabilistic analytical framework that accounts for these uncertainties to reconstruct synoptic, integrated environmental signals. The process is based on a Monte Carlo algorithm that iteratively samples individual lake-status histories within the limits of their uncertainties to produce many possible scenarios. We then use Recursively-Subtracted Empirical Orthogonal Function analysis to extract dominant patterns of lake-status variability from these scenarios. As a proof of concept, we apply this framework to 67 sites in eastern and southern Africa whose lake-status histories cover part of the late Pleistocene and/or Holocene. We show that, despite the sometimes large temporal and interpretation uncertainties, and the inclusion of highly discontinuous lake-status time series, identifying the major known millennial-scale climatic phases during the last 20,000 years is possible. Our framework was also able to identify an antiphased response between the lake basins in eastern and interior southern Africa to these changes. Here, we propose that our new database and methodology framework serves as a template for efficient lake-status data synthesis, encourages the incorporation of lake-status data in palaeoclimate syntheses, and expands the possibilities for the use of such data in the evaluation of climate models.

58 GEOSCIENCES↗

DOE OSTI2025

Bayesian Optimized Deep Ensemble for Uncertainty Quantification of Deep Neural Networks: a System Safety Case Study on Sodium Fast Reactor Thermal Stratification Modeling

Deep neural networks (DNNs) are increasingly important to scientific computing and engineering system simulations. Accurate uncertainty quantification (UQ) for DNNs is critical in safety-sensitive engineering domains. Traditional Deep Ensemble (DE) methods, while easy to implement, frequently suffer from poorly calibrated uncertainty estimates and limited predictive accuracy due to reliance on fixed architectures with varied weight initializations. To address these issues, we introduce a workflow that combines Bayesian Optimization (BO) and DE. The workflow is modular, scalable, and integrates parallel BO initialized with Sobol sequences to individually optimize the hyperparameters of each ensemble member. This method enhances ensemble diversity, improves predictive accuracy, and provides reliable uncertainty estimates. We evaluate the proposed BODE approach in a sodium fast reactor thermal stratification modeling case study, where we used a densely connected convolutional neural network to predict turbulent viscosity during the reactor transient with consideration of data noise. We benchmark its performance against several optimization approaches, including baseline deep ensemble, evolutionary algorithm-optimized ensemble, ensemble formed via random search combined with greedy selection, and a BO ensemble using random initialization. Here, our results demonstrate superior performance of the developed BODE approach. In noise-free scenarios, BODE notably reduces incorrect aleatoric uncertainty and significantly enhances predictive accuracy. Under conditions of 5% and 10% Gaussian noise, BODE adaptively quantifies uncertainty proportional to data noise, achieving up to an 80% reduction in root mean square error compared to baseline methods and producing well-calibrated prediction intervals.

Bayesian optimization↗

DOE OSTI2023

The inclusion of uncertainty in circularity transition modeling: A case study on wind turbine blade end-of-life management

The transition to a more circular economy (CE) is complex and hard to predict, including in sustainable energy technologies. Many sources of uncertainty make it challenging to model CE scenarios and their potential benefits. As an example, the high variability in costs and revenues of different recycling options makes future wind turbine blade recycling highly uncertain. To better understand this challenge, the circular economy, life cycle assessment and visualization (CELAVI) framework - a discrete event simulation and life cycle assessment framework - is modified to incorporate uncertainty analysis capabilities. Moreover, a 3-step procedure that covers different aspects of uncertainty in CE studies and includes a Monte-Carlo analysis is proposed. The procedure is tested in a case study on wind turbine blade recycling using CELAVI. Results highlight that grinding and landfilling costs are the most influential parameters for wind power circularity. The model's output coefficients of variation (when input parameter uncertainties are propagated) are between 92% and 384% depending on the indicator. The approach developed in this study may help researchers and decision-makers who study circularity prioritize their data collection effort. Finally, our method contributes to a mounting yet critical body of research: the measurement of uncertainty in circularity transitions.

17 WIND ENERGY↗

DOE OSTI2025

GenAI4UQ: A software for forward and inverse uncertainty quantification using conditional generative AI

We introduce GenAI4UQ, a software package for forward and inverse uncertainty quantification in model calibration, parameter estimation, and ensemble forecasting. GenAI4UQ leverages a generative AI-based conditional modeling framework to address limitations of traditional inverse modeling techniques, such as Markov Chain Monte Carlo (MCMC) methods. By replacing computationally intensive iterative processes with a direct, learned mapping, GenAI4UQ enables efficient calibration of input parameters and generation of predictions directly from observations. The software supports rapid ensemble forecasting with robust uncertainty quantification while maintaining computational and storage efficiency. Built-in auto-tuning of hyperparameters simplifies model training, ensuring accessibility for users with varying expertise. Its versatile conditional generative framework is applicable across diverse scientific domains. While GenAI4UQ offers significant advantages in flexibility and efficiency, users should interpret its uncertainty estimates with caution in data-sparse scenarios, as the model may overestimate uncertainty—an effect common to all surrogate-based approaches including MCMC with surrogate models. Despite this, GenAI4UQ transforms inverse modeling by providing a fast, reliable, and user-friendly solution. It empowers researchers and practitioners to quickly estimate parameter distributions and generate model predictions for new observations, facilitating efficient decision-making and advancing the state of uncertainty quantification in computational modeling.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Evaluating the Potential and Challenges of an Uncertainty Quantification Method for Long Short–Term Memory Models for Soil Moisture Predictions

Recently, recurrent deep networks have shown promise to harness newly available satellite–sensed data for long–term soil moisture projections. However, to be useful in forecasting, deep networks must also provide uncertainty estimates. Here we evaluated Monte Carlo dropout with an input–dependent data noise term (MCD+N), an efficient uncertainty estimation framework originally developed in computer vision, for hydrologic time series predictions. MCD+N simultaneously estimates a heteroscedastic input–dependent data noise term (a trained error model attributable to observational noise) and a network weight uncertainty term (attributable to insufficiently constrained model parameters). Although MCD+N has appealing features, many heuristic approximations were employed during its derivation, and rigorous evaluations and evidence of its asserted capability to detect dissimilarity were lacking. To address this, we provided an in–depth evaluation of the scheme's potential and limitations. We showed that for reproducing soil moisture dynamics recorded by the Soil Moisture Active Passive (SMAP) mission, MCD+N indeed gave a good estimate of predictive error, provided that we tuned a hyperparameter and used a representative training data set. The input–dependent term responded strongly to observational noise, while the model term clearly acted as a detector for physiographic dissimilarity from the training data, behaving as intended. However, when the training and test data were characteristically different, the input–dependent term could be misled, undermining its reliability. Additionally, due to the data–driven nature of the model, data noise also influences network weight uncertainty, and therefore the two uncertainty terms are correlated. Altogether, this approach has promise, but care is needed to interpret the results.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Estimating Uncertainty in Simulated ENSO Statistics

Abstract Large ensembles of model simulations are frequently used to reduce the impact of internal variability when evaluating climate models and assessing climate change induced trends. However, the optimal number of ensemble members required to distinguish model biases and climate change signals from internal variability varies across models and metrics. Here we analyze the mean, variance and skewness of precipitation and sea surface temperature in the eastern equatorial Pacific region often used to describe the El Niño–Southern Oscillation (ENSO), obtained from large ensembles of Coupled model intercomparison project phase 6 climate simulations. Leveraging established statistical theory, we develop and assess equations to estimate, a priori, the ensemble size or simulation length required to limit sampling‐based uncertainties in ENSO statistics to within a desired tolerance. Our results confirm that the uncertainty of these statistics decreases with the square root of the time series length and/or ensemble size. Moreover, we demonstrate that uncertainties of these statistics are generally comparable when computed using either pre‐industrial control or historical runs. This suggests that pre‐industrial runs can sometimes be used to estimate the expected uncertainty of statistics computed from an existing historical member or ensemble, and the number of simulation years (run duration and/or ensemble size) required to adequately characterize the statistic. This advance allows us to use existing simulations (e.g., control runs that are performed during model development) to design ensembles that can sufficiently limit diagnostic uncertainties arising from simulated internal variability. These results may well be applicable to variables and regions beyond ENSO.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Uncertainty Quantification for Multiphase Computational Fluid Dynamics Closure Relations with a Physics-Informed Bayesian Approach

Multiphase Computational Fluid Dynamics (MCFD) based on the two-fluid model is considered a promising tool to model complex two-phase flow systems. MCFD simulation can predict local flow features without resolving interfacial information. As a result, the MCFD solver relies on closure relations to describe the interaction between the two phases. Those empirical or semi-mechanistic closure relations constitute a major source of uncertainty for MCFD predictions. In this paper, we leverage a physics-informed uncertainty quantification (UQ) approach to inversely quantify the closure relations’ model form uncertainty in a physically consistent manner. This proposed approach considers the model form uncertainty terms as stochastic fields that are additive to the closure relation outputs. Combining dimensionality reduction and Gaussian processes, the posterior distribution of the stochastic fields can be effectively quantified within the Bayesian framework with the support of experimental measurements. As this UQ approach is fully integrated into the MCFD solving process, the physical constraints of the system can be naturally preserved in the UQ results. Here, in a case study of adiabatic bubbly flow, we demonstrate that this UQ approach can quantify the model form uncertainty of the MCFD interfacial force closure relations, thus effectively improving the simulation results with relatively sparse data support.

42 ENGINEERING↗

DOE OSTI2025

Demonstration of TOFFEE: A Response Uncertainty Quantification Tool

A key characteristic in neutron transport is nuclear data. Cross-section uncertainty is not used in MCNP6.3 to propagate response uncertainty without external analysis. Here, the TOol For Fast Error Estimation (TOFFEE) is a Python-based code developed to automate the propagation of cross-section uncertainty for MCNP evaluations. TOFFEE implements the sandwich rule to calculate the uncertainty from cross sections with sensitivity coefficients from MCNP6.3 and ENDF/B covariance data. In this paper, TOFFEE has been tested with benchmark experiments, and it has been compared to the uncertainty quantification capabilities of Sampler and TSUNAMI, within SCALE, to verify the application’s capabilities.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Calculating Interval Uncertainties for Calibration Standards That Drift with Time

Calibrated values of many devices exhibit predictable drift over time. To provide an uncertainty statement valid over the entire calibration interval, one must account for drift. In this article, a method of accounting for drift is proposed based on guidance in the Guide to Expression of Uncertainty in Measurement. An additional uncertainty term is computed using a linear regression of historical measurement data, which is included along with the time-of-test uncertainty. This method is evaluated by analyzing its average out-of-tolerance (OOT) rate using a Monte Carlo simulation, which results in the desired 5% average OOT rate when the total uncertainty is expanded to a 95% confidence interval.

47 OTHER INSTRUMENTATION↗

DOE OSTI2020

Recent advances in the quantification of uncertainties in reaction theory

Uncertainty quantification has become increasingly more prominent in nuclear physics over the past several years. In few-body reaction theory, there are four main sources that contribute to the uncertainties in the calculated observables: the effective potentials, approximations made to the few-body problem, structure functions, and degrees of freedom left out of the model space. In this work, we illustrate some of the features that can be obtained when modern statistical tools are applied in the context of nuclear reactions. This work consists of a summary of the progress that has been made in quantifying theoretical uncertainties in this domain, focusing primarily on those uncertainties coming from the effective optical potential as well as their propagation within various reaction theories. We use, as the central example, reactions on the doubly-magic stable nucleus 40 Ca, namely neutron and proton elastic scattering and single-nucleon transfer 40 Ca(d,p) 41 Ca. First, we show different optimization schemes used to constrain the optical potential from differential cross sections and other experimental constraints; we then discuss how these uncertainties propagate to the transfer cross section, comparing two reaction theories. Finally, we finish by laying out our future plans.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗