Search NASA⌕ Search

SEARCH · Search NASA

Results for “Uncertainty quantification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32

Uncertainty quantification for Multiphase-CFD simulations of bubbly flows: a machine learning-based Bayesian approach supported by high-resolution experiments

In this paper, we developed a machine learning-based Bayesian approach to inversely quantify and reduce the uncertainties of multiphase computational fluid dynamics (MCFD) simulations for bubbly flows. The proposed approach is supported by high-resolution two-phase flow measurements, including those by double-sensor conductivity probes, high-speed imaging, and particle image velocimetry. Local distributions of key physical quantities of interest (QoIs), including the void fraction and phasic velocities, are obtained to support the Bayesian inference. In the process, the epistemic uncertainties of the closure relations are inversely quantified while the aleatory uncertainties from stochastic fluctuations of the system are evaluated based on experimental uncertainty analysis. The combined uncertainties are then propagated through the MCFD solver to obtain uncertainties of the QoIs, based on which probability-boxes are constructed for validation. The proposed approach relies on three machine learning methods: feedforward neural networks and principal component analysis for surrogate modeling, and Gaussian processes for model form uncertainty modeling. The whole process is implemented within the framework of an open-source deep learning library PyTorch with graphics processing unit (GPU) acceleration, thus ensuring the efficiency of the computation. The results demonstrate that with the support of high-resolution data, the uncertainties of MCFD simulations can be significantly reduced. The proposed approach has the potential for other applications that involve numerical models with empirical parameters.

42 ENGINEERING↗

Uncertainty quantification for neutrino opacities in core-collapse supernovae and neutron star mergers

We perform an extensive study of the correlations between the neutrino-nucleon inverse mean free paths (IMFPs) and the underlying equation of states (EoSs). Strong interaction uncertainties in the neutrino mean free path are investigated in different density regimes. The nucleon effective mass, the nucleon chemical potentials, and the residual interactions in the medium play an important role in determining neutrino-nucleon interactions in a density-dependent manner. Here we study how the above quantities are constrained by an EoS consistent with (i) nuclear mass measurements, (ii) proton-proton scattering phase shifts, and (iii) neutron star observations. We then study the uncertainties of both the charged current and the neutral current neutrino-nucleon inverse mean free paths due to the variation of these quantities, using the Hartree-Fock+random phase approximation method. Finally, we calculate the Pearson correlation coefficients between (i) the EoS-based quantities and the EoS-based quantities; (ii) the EoS-based quantities and the IMFPs; (iii) the IMFPs and the IMFPs. We find a strong impact of residual interactions on neutrino opacity in the spin and spin-isospin channels, which are not well constrained by current nuclear modelings.

79 ASTRONOMY AND ASTROPHYSICS↗

MLUQ (Uncertainty quantification for ML closure models) [SWR-24-36]

Data-based closure models are increasingly being used to replace physic-based closure models because of their flexibility and the growing availability of data. However, closure models are subject to uncertainty because of lack of data in parts of the input space (epistemic uncertainty) or because of noise in the data (aleatoric uncertainty). This software contains a toolbox for training bayesian neural nets that can estimate both uncertainties. A specific treatment is provided to ensure accuracy outside of the data distribution. A set of tools are provided to reduce the dimensionality of the uncertain parameter space, thereby enabling fast uncertainty propagation.

Hassanaly, Malik↗

Dakota, a multilevel parallel object-oriented framework for design optimization, parameter estimation, uncertainty quantification, and sensitivity analysis :

The Dakota (Design Analysis Kit for Optimization and Terascale Applications) toolkit provides a exible and extensible interface between simulation codes and iterative analysis methods. Dakota contains algorithms for optimization with gradient and nongradient-based methods; uncertainty quanti cation with sampling, reliability, and stochastic expansion methods; parameter estimation with nonlinear least squares methods; and sensitivity/variance analysis with design of experiments and parameter study methods. These capabilities may be used on their own or as components within advanced strategies such as surrogate-based optimization, mixed integer nonlinear programming, or optimization under uncertainty. By employing object-oriented design to implement abstractions of the key components required for iterative systems analyses, the Dakota toolkit provides a exible and extensible problem-solving environment for design and performance analysis of computational models on high performance computers. This report serves as a user's manual for the Dakota software and provides capability overviews and procedures for software execution, as well as a variety of example studies.

97 MATHEMATICS AND COMPUTING↗

Uncertainty quantification and validation of combined hydrological and macroeconomic analyses.

Changes in climate can lead to instabilities in physical and economic systems, particularly in regions with marginal resources. Global climate models indicate increasing global mean temperatures over the decades to come and uncertainty in the local to national impacts means perceived risks will drive planning decisions. Agent-based models provide one of the few ways to evaluate the potential changes in behavior in coupled social-physical systems and to quantify and compare risks. The current generation of climate impact analyses provides estimates of the economic cost of climate change for a limited set of climate scenarios that account for a small subset of the dynamics and uncertainties. To better understand the risk to national security, the next generation of risk assessment models must represent global stresses, population vulnerability to those stresses, and the uncertainty in population responses and outcomes that could have a significant impact on U.S. national security.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Uncertainty Quantification of Multi-Phase Closures

In the ensemble-averaged dispersed phase formulation used for CFD of multiphase ows in nuclear reactor thermohydraulics, closures of interphase transfer of mass, momentum, and energy constitute, by far, the biggest source of error and uncertainty. Reliable estimators of this source of error and uncertainty are currently non-existent. Here, we report on how modern Validation and Uncertainty Quanti cation (VUQ) techniques can be leveraged to not only quantify such errors and uncertainties, but also to uncover (unintended) interactions between closures of di erent phenomena. As such this approach serves as a valuable aide in the research and development of multiphase closures. The joint modeling of lift, drag, wall lubrication, and turbulent dispersion|forces that lead to tranfer of momentum between the liquid and gas phases|is examined in the frame- work of validation of the adiabatic but turbulent experiments of Liu and Banko , 1993. An extensive calibration study is undertaken with a popular combination of closure relations and the popular k-ϵ turbulence model in a Bayesian framework. When a wide range of super cial liquid and gas velocities and void fractions is considered, it is found that this set of closures can be validated against the experimental data only by allowing large variations in the coe cients associated with the closures. We argue that such an extent of variation is a measure of uncertainty induced by the chosen set of closures. We also nd that while mean uid velocity and void fraction pro les are properly t, uctuating uid velocity may or may not be properly t. This aspect needs to be investigated further. The popular set of closures considered contains ad-hoc components and are undesirable from a predictive modeling point of view. Consequently, we next consider improvements that are being developed by the MIT group under CASL and which remove the ad-hoc elements. We use non-intrusive methodologies for sensitivity analysis and calibration (using Dakota) to study sensitivities of the CFD representation (STARCCM+) of uid velocity pro les and void fraction pro les in the context of Shaver and Podowski, 2015 correction to lift, and the Lubchenko et al., 2017 formulation of wall lubrication.

97 MATHEMATICS AND COMPUTING↗

A simplified approach to uncertainty quantification for orbits in impulsive deflection scenarios

For the majority of near-Earth Asteroid (NEA) impact scenarios, optimal deflection strategies use a massive impactor or a nuclear explosive, either of which produce an impulsive change to the orbit of the object. However, uncertainties regarding the object composition and the efficiency of the deflection event lead to a non-negligible uncertainty in the deflection delta-velocity. Propagating this uncertainty through the resulting orbit will create a positional uncertainty envelope at the original impact epoch. In this work, we calculate a simplified analytic evolution for impulsively deflected NEAs and perform a full propagation of uncertainties that is nonlinear in the deflection delta-velocity vector. This provides an understanding of both the optimal deflection velocities needed for a given scenario, as well as the resulting positional uncertainty and corresponding residual impact probability. Confidence of a successful deflection attempt as a function of launch opportunities is also discussed for a specific case.

79 ASTRONOMY AND ASTROPHYSICS↗

Evaluating the Potential and Challenges of an Uncertainty Quantification Method for Long Short–Term Memory Models for Soil Moisture Predictions

Recently, recurrent deep networks have shown promise to harness newly available satellite–sensed data for long–term soil moisture projections. However, to be useful in forecasting, deep networks must also provide uncertainty estimates. Here we evaluated Monte Carlo dropout with an input–dependent data noise term (MCD+N), an efficient uncertainty estimation framework originally developed in computer vision, for hydrologic time series predictions. MCD+N simultaneously estimates a heteroscedastic input–dependent data noise term (a trained error model attributable to observational noise) and a network weight uncertainty term (attributable to insufficiently constrained model parameters). Although MCD+N has appealing features, many heuristic approximations were employed during its derivation, and rigorous evaluations and evidence of its asserted capability to detect dissimilarity were lacking. To address this, we provided an in–depth evaluation of the scheme's potential and limitations. We showed that for reproducing soil moisture dynamics recorded by the Soil Moisture Active Passive (SMAP) mission, MCD+N indeed gave a good estimate of predictive error, provided that we tuned a hyperparameter and used a representative training data set. The input–dependent term responded strongly to observational noise, while the model term clearly acted as a detector for physiographic dissimilarity from the training data, behaving as intended. However, when the training and test data were characteristically different, the input–dependent term could be misled, undermining its reliability. Additionally, due to the data–driven nature of the model, data noise also influences network weight uncertainty, and therefore the two uncertainty terms are correlated. Altogether, this approach has promise, but care is needed to interpret the results.

54 ENVIRONMENTAL SCIENCES↗

Dakota, a multilevel parallel object-oriented framework for design optimization, parameter estimation, uncertainty quantification, and sensitivity analysis version 6.0 theory manual

The Dakota (Design Analysis Kit for Optimization and Terascale Applications) toolkit provides a exible and extensible interface between simulation codes and iterative analysis methods. Dakota contains algorithms for optimization with gradient and nongradient-based methods; uncertainty quanti cation with sampling, reliability, and stochastic expansion methods; parameter estimation with nonlinear least squares methods; and sensitivity/variance analysis with design of experiments and parameter study methods. These capabilities may be used on their own or as components within advanced strategies such as surrogate-based optimization, mixed integer nonlinear programming, or optimization under uncertainty. By employing object-oriented design to implement abstractions of the key components required for iterative systems analyses, the Dakota toolkit provides a exible and extensible problem-solving environment for design and performance analysis of computational models on high performance computers. This report serves as a theoretical manual for selected algorithms implemented within the Dakota software. It is not intended as a comprehensive theoretical treatment, since a number of existing texts cover general optimization theory, statistical analysis, and other introductory topics. Rather, this manual is intended to summarize a set of Dakota-related research publications in the areas of surrogate-based optimization, uncertainty quanti cation, and optimization under uncertainty that provide the foundation for many of Dakota's iterative analysis capabilities.

97 MATHEMATICS AND COMPUTING↗

Multi-fidelity uncertainty quantification strategies for large-scale multiphysics applications: PSAAP II particle-based solar energy receiver

The study of complex systems is often based on computationally intensive, high-fidelity, simulations. To build confidence or improve the prediction accuracy of such simulations, the impact of uncertainties in model inputs, or even the structure of the models, on the quantities of interest must be measured. This, however, requires a computational budget that is a possibly large multiple of the cost of a single simulation, and thus may become infeasible for expensive simulation models featuring a large number of uncertain inputs and highly non-linear behavior. Therefore, this work explores multi-fidelity strategies to accelerate the estimation of the effect of uncertainties. The main idea behind multi-fidelity methods is to utilize cheaper, lower-fidelity models – than the intended high-fidelity, expensive model of the problem – to generate a baseline solution that together with relatively small number of high-fidelity simulations can lead to accurate predictions. The methods are briefly presented, and their performance assessed on an irradiated particle-laden turbulent flow case related to Stanford’s PSAAP II particle-based solar energy receiver.

Physics↗

Uncertainty Quantification with MCMC method and BFBT Data

The reliability of predictions of the system codes is closely related to the validation of their physical models. For example, the accuracy of void fraction prediction in a Boiling Water Reactor (BWR) using TRACE code depends on the uncertainties of closure relations developed for the two-phase flow models. This work focus on quantifying the uncertainties of two physical models, interfacial drag model and subcooled boiling model, using Markov Chain Monte Carlo (MCMC) method and BFBT experimental benchmark data. We applied the MCMC and MLE algorithms to BFBT benchmark data and estimated the uncertainty distribution of two model parameters: subcooled boiling heat transfer coefficient and interfacial drag (bubbly/slug rod bundle) coefficient. These algorithms tend to give various estimation results. Despite the differences in these algorithms, we find that the estimation results are consistent. After obtaining the uncertainty estimates, we validated the uncertainty estimates by applying the estimated distributions of model parameters to TRACE prediction. The new predictions succeed in reducing the void fraction prediction error, but it is not possible to eliminate all prediction error. We are only adjusting two model parameters, and there exists uncertainties in all model parameters. Application of the algorithms to other physical models and experimental data will be helpful for future work. (authors)

42 ENGINEERING↗

Sequential Designs Based on Bayesian Uncertainty Quantification in Sparse Representation Surrogate Modeling

A numerical method, called OBSM, was recently proposed which employs overcomplete basis functions to achieve sparse representations. While the method can handle non-stationary response without the need of inverting large covariance matrices, it lacks the capability to quantify uncertainty in predictions. We address this issue by proposing a Bayesian approach which first imposes a normal prior on the large space of linear coefficients, then applies the MCMC algorithm to generate posterior samples for predictions. From these samples, Bayesian credible intervals can then be obtained to assess prediction uncertainty. A key application for the proposed method is the efficient construction of sequential designs. Several sequential design procedures with different infill criteria are proposed based on the generated posterior samples. As a result, numerical studies show that the proposed schemes are capable of solving problems of positive point identification, optimization, and surrogate fitting.

97 MATHEMATICS AND COMPUTING↗

Uncertainty quantification for deep learning in particle accelerator applications

With the advent of increased computational resources and improved algorithms, machine learning-based models are being increasingly applied to complex problems in particle accelerators. However, such data-driven models may provide overly confident predictions with unknown errors and uncertainties. For reliable deployment of machine learning models in high-regret and safety-critical systems such as particle accelerators, estimates of prediction uncertainty are needed along with accurate point predictions. In this investigation, we evaluate Bayesian neural networks (BNN) as an approach that can provide accurate predictions along with reliably quantified uncertainties for particle accelerator problems, and compare their performance with bootstrapped ensembles of neural networks. We select three accelerator setups for this evaluation: a storage ring, a photoinjector, and a linac. The problems span different data volumes and dimensionalities (e.g., scalar predictions as well as image outputs). It is found that BNN provide accurate predictions of the mean along with reliable estimates of predictive uncertainty across the test cases. In this vein, BNN may offer an attractive alternative to deterministic deep learning tools to generate accurate predictions with quantified uncertainties in particle accelerator applications.

43 PARTICLE ACCELERATORS↗

An Extended Study on the Uncertainty Quantification of a Photodiode's Spectral Responsivity

An extended study was done on the analysis procedure for spectral responsivity of a silicon detector from the range of 200 nm to 1100 nm for the Optical Component Calibration laboratory at Livermore Operations in Livermore California. As a result, the uncertainty of the procedure was quantified to account for variables that contribute to uncertainty; such as the reproducibility and repeatability of the working standards, quantifying Type A and B uncertainties, validating laboratory equipment and associated software, and looking at environmental variables. The findings lead to a revised analysis reporting procedure that reports uncertainties depending on three spectral ranges, 300 nm to 400 nm, 400 nm to 700 nm, and 700 nm to 1100 nm. A proficiency test was done to compare the difference between both methods and a noticeable difference was found. The results showed that the previous reporting method over estimated uncertainty as much as 3.5% for the 300 nm to 400 nm range, 4% in the >400 nm to 700 nm range, and 2% in the >700 nm to 1100 nm range. The findings lead to the use of the revised procedure when producing calibration certificates, better quantified measurement uncertainties, and will be used for the process of updating the scope of accreditation from the National Voluntary Laboratory Accreditation Program.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

MONTE-CARLO BURNUP CALCULATION UNCERTAINTY QUANTIFICATION AND PROPAGATION DETERMINATION

Reactor burnup or depletion codes are used thoroughly in the fields of nuclear forensics and nuclear safeguards. Two common codes include MONTEBURNS and MCNPX/CINDER. These are Monte-Carlo depletion routines utilizing MCNP for neutron transport calculations and either ORIGEN or CINDER for burnup calculations. Uncertainties exist in the MCNP steps, but this information is not passed to the depletion calculations or saved. To quantify this transport uncertainty and determine how it propagates between burnup steps, a statistical analysis of multiple repeated depletion runs is performed. The reactor model chosen is the Oak Ridge Research Reactor (ORR) in a single assembly, infinite lattice configuration. This model was burned for a 150 day cycle broken down into three steps. The output isotopics as well as effective multiplication factor (k-effective) were tabulated and histograms were created at each burnup step using the Scott Method to determine the bin width. The distributions for each code are a statistical benchmark and comparisons made. It was expected that the gram quantities and k-effective histograms would produce normally distributed results since they were produced from a Monte-Carlo routine, but some of the results appear to not. Statistical analyses are performed using the {chi}{sup 2} test against a normal distribution for the k-effective results and several isotopes including {sup 134}Cs, {sup 137}Cs, {sup 235}U, {sup 238}U, {sup 237}Np, {sup 238}Pu, {sup 239}Pu, and {sup 240}Pu.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Uncertainty quantification for misspecified machine learned interatomic potentials

The use of high-dimensional regression techniques from machine learning has significantly improved the quantitative accuracy of interatomic potentials. Atomic simulations can now plausibly target quantitative predictions in a variety of settings, which has brought renewed interest in robust means to quantify uncertainties. In many practical settings where model complexity is constrained (e.g., due to performance considerations), misspecification — the inability of any one choice of model parameters to exactly match all training data — is a key contributor to errors that is often disregarded. Here, we employ a recent misspecification-aware regression technique to quantify parameter uncertainties, which is then propagated to a broad range of phase and defect properties in tungsten. The propagation is performed through both brute-force resampling and implicit Taylor expansion. The propagated misspecification uncertainties robustly quantify and bound errors on a broad range of material properties. We demonstrate application to recent foundational machine learning interatomic potentials, accurately predicting and bounding errors in MACE-MPA-0 energy predictions across the diverse materials project database.

36 MATERIALS SCIENCE↗

Pairing Simulation with Uncertainty Quantification for Exploding Wire Tests

In a 2025 SAND report by Carnes et al., it was observed that experimental and model results were not in agreement, especially peak voltage, and time of peak, for gold, with observed disagreements of up to 40%. In this work, we investigate whether other sources of uncertainty in the model can explain this disagreement between experiment and model.

Mendoza, Hector Javier [Sandia National Laboratori↗

Uncertainty Quantification via Stable Distribution Propagation

We propose a new approach for propagating stable probability distributions through neural networks. Our method is based on local linearization, which we show to be an optimal approximation in terms of total variation distance for the ReLU non-linearity. This allows propagating Gaussian and Cauchy input uncertainties through neural networks to quantify their output uncertainties. To demonstrate the utility of propagating distributions, we apply the proposed method to predicting calibrated confidence intervals and selective prediction on out-of-distribution data. The results demonstrate a broad applicability of propagating distributions and show the advantages of our method over other approaches such as moment matching.

Artificial Intelligence (cs.AI)↗