Search NASA⌕ Search

SEARCH · Search NASA

Results for “Uncertainty quantification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,495 records · Page 83
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Multidimensional Distributional Neural Network Output Demonstrated in Super‐Resolution of Surface Wind Speed

Accurate quantification of uncertainty in neural network predictions remains a central challenge for scientific applications involving high-dimensional, correlated data. While existing methods capture either aleatoric or epistemic uncertainty, few offer closed-form, multidimensional distributions that preserve spatial correlation while remaining computationally tractable. In this work, we present a framework for training neural networks with a multidimensional Gaussian loss, generating a closed-form predictive distribution over outputs informed by non-identically distributed training data. Our approach captures aleatoric uncertainty by iteratively estimating the means and covariance matrices, and is demonstrated on a super-resolution example out-of-training-sample. We leverage a Fourier representation of the covariance matrix to stabilize network training and preserve spatial correlation. We introduce a novel regularization strategy—referred to as information sharing—that interpolates between image-specific and global covariance estimates, enabling convergence of the super-resolution downscaling network trained on image-specific distributional loss functions. This framework allows for efficient sampling, explicit correlation modeling, and extensions to more complex distribution families all without disrupting prediction performance. We demonstrate the method on a surface wind speed downscaling task and discuss its broader applicability to uncertainty-aware prediction in scientific models.

17 WIND ENERGY↗
DOE OSTI2015

Calibration and Forward Uncertainty Propagation for Large-eddy Simulations of Engineering Flows

The objective of this work is to investigate the efficacy of using calibration strategies from Uncertainty Quantification (UQ) to determine model coefficients for LES. As the target methods are for engineering LES, uncertainty from numerical aspects of the model must also be quantified. 15 The ultimate goal of this research thread is to generate a cost versus accuracy curve for LES such that the cost could be minimized given an accuracy prescribed by an engineering need. Realization of this goal would enable LES to serve as a predictive simulation tool within the engineering design process.

42 ENGINEERING↗
NASA NTRS2010

Quantification of the Uncertainties for the Ares I A106 Ascent Aerodynamic Database

A detailed description of the quantification of uncertainties for the Ares I ascent aero 6-DOF wind tunnel database is presented. The database was constructed from wind tunnel test data and CFD results. The experimental data came from tests conducted in the Boeing Polysonic Wind Tunnel in St. Louis and the Unitary Plan Wind Tunnel at NASA Langley Research Center. The major sources of error for this database were: experimental error (repeatability), database modeling errors, and database interpolation errors.

Houlden, Heather P.↗
DOE OSTI2015

Simplified predictive models for CO 2 sequestration performance assessment

CO2 sequestration in deep saline formations is increasingly being considered as a viable strategy for the mitigation of greenhouse gas emissions from anthropogenic sources. In this context, detailed numerical simulation based models are routinely used to understand key processes and parameters affecting pressure propagation and buoyant plume migration following CO2 injection into the subsurface. As these models are data and computation intensive, the development of computationally-efficient alternatives to conventional numerical simulators has become an active area of research. Such simplified models can be valuable assets during preliminary CO2 injection project screening, serve as a key element of probabilistic system assessment modeling tools, and assist regulators in quickly evaluating geological storage projects. We present three strategies for the development and validation of simplified modeling approaches for CO2 sequestration in deep saline formations: (1) simplified physics-based modeling, (2) statisticallearning based modeling, and (3) reduced-order method based modeling. In the first category, a set of full-physics compositional simulations is used to develop correlations for dimensionless injectivity as a function of the slope of the CO2 fractional-flow curve, variance of layer permeability values, and the nature of vertical permeability arrangement. The same variables, along with a modified gravity number, can be used to develop a correlation for the total storage efficiency within the CO2 plume footprint. Furthermore, the dimensionless average pressure buildup after the onset of boundary effects can be correlated to dimensionless time, CO2 plume footprint, and storativity contrast between the reservoir and caprock. In the second category, statistical “proxy models” are developed using the simulation domain described previously with two approaches: (a) classical Box-Behnken experimental design with a quadratic response surface, and (b) maximin Latin Hypercube sampling (LHS) based design with a multidimensional kriging metamodel fit. For roughly the same number of simulations, the LHS-based metamodel yields a more robust predictive model, as verified by a k-fold cross-validation approach (with data split into training and test sets) as well by validation with an independent dataset. In the third category, a reduced-order modeling procedure is utilized that combines proper orthogonal decomposition (POD) for reducing problem dimensionality with trajectory-piecewise linearization (TPWL) in order to represent system response at new control settings from a limited number of training runs. Significant savings in computational time are observed with reasonable accuracy from the PODTPWL reduced-order model for both vertical and horizontal well problems – which could be important in the context of history matching, uncertainty quantification and optimization problems. The simplified physics and statistical learning based models are also validated using an uncertainty analysis framework. Reference cumulative distribution functions of key model outcomes (i.e., plume radius and reservoir pressure buildup) generated using a 97-run full-physics simulation are successfully validated against the CDF from 10,000 sample probabilistic simulations using the simplified models. The main contribution of this research project is the development and validation of a portfolio of simplified modeling approaches that will enable rapid feasibility and risk assessment for CO2 sequestration in deep saline formations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

(U) Calculating First-Order Sensitivities to Material Density and Composition in Fixed-Source Problems Using the MCNP6 Perturbation Capability

The Taylor series (differential operator) perturbation method, as implemented in the PERT capability in MCNP6 (Ref. 1), can be used for first-order sensitivity analyses in fixed-source problems.2 Sensitivities of a response with respect to material and nuclide densities can be used for efficient first-order uncertainty quantification. This report discusses how to compute sensitivities of material densities and compositions in order to propagate uncertainties using the standard uncertainty propagation formula.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Bayesian Poroelastic Aquifer Characterization From InSAR Surface Deformation Data. 2. Quantifying the Uncertainty

Uncertainty quantification of groundwater (GW) aquifer parameters is critical for efficient management and sustainable extraction of GW resources. These uncertainties are introduced by the data, model, and prior information on the parameters. We develop a Bayesian inversion framework that uses Interferometric Synthetic Aperture Radar (InSAR) surface deformation data to infer the laterally heterogeneous permeability of a transient linear poroelastic model of a confined GW aquifer. The Bayesian solution of this inverse problem takes the form of a posterior probability density of the permeability. Exploring this posterior using classical Markov chain Monte Carlo (MCMC) methods is computationally prohibitive due to the large dimension of the discretized permeability field and the expense of solving the poroelastic forward problem. However, in many partial differential equation (PDE)-based Bayesian inversion problems, the data are only informative in a few directions in parameter space. For the poroelasticity problem, we prove this property theoretically for a one-dimensional problem and demonstrate it numerically for a three-dimensional aquifer model. Here we design a generalized preconditioned Crank-Nicolson (gpCN) MCMC method that exploits this intrinsic low dimensionality by using a low-rank-based Laplace approximation of the posterior as a proposal, which we build scalably. The feasibility of our approach is demonstrated through a real GW aquifer test in Nevada. The inherently two-dimensional nature of InSAR surface deformation data informs a sufficient number of modes of the permeability field to allow detection of major structures within the aquifer, significantly reducing the uncertainty in the pressure and the displacement quantities of interest.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2017

Integration of Dakota into the NEAMS Workbench

This report summarizes a NEAMS (Nuclear Energy Advanced Modeling and Simulation) project focused on integrating Dakota into the NEAMS Workbench. The NEAMS Workbench, developed at Oak Ridge National Laboratory, is a new software framework that provides a graphical user interface, input file creation, parsing, validation, job execution, workflow management, and output processing for a variety of nuclear codes. Dakota is a tool developed at Sandia National Laboratories that provides a suite of uncertainty quantification and optimization algorithms. Providing Dakota within the NEAMS Workbench allows users of nuclear simulation codes to perform uncertainty and optimization studies on their nuclear codes from within a common, integrated environment. Details of the integration and parsing are provided, along with an example of Dakota running a sampling study on the fuels performance code, BISON, from within the NEAMS Workbench.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Risk Importance Ranking of Fire Data Parameters to Enhance Fire PRA Model Realism

Fire is historically and analytically a significant contributor to nuclear power plant risk. The level of fire risk and the methods, tools and data for modeling this risk is highly debated by experts. One area of debate is the input data used in fire modeling and how to deal with this data’s high uncertainty. This report outlines initial work performed for determining the key parameters causing this uncertainty and how it propagates into nuclear power plant models. This research paves the way for the development of methods to reduce fire data uncertainty used in modeling. The Nuclear Regulatory Commission has mandated that nuclear power plants perform fire risk modeling. However, there are several issues with the current risk modeling implementation that affect the results. Approved modeling methods can be overly conservative and often do not match plant experience. Also, the data used in the modeling can have high uncertainties and is influenced by expert judgement. To evaluate input data uncertainty, researchers performed an initial review of several fire experiments done at Sandia National Laboratories. Uncertainties for fire data can come from many sources, such as experiment design constraints, environmental conditions, or other plant-specific aspects. There are many different significant and insignificant parameters driving the uncertainty. Additionally, the uncertainty of the different input data used in the fire modeling could have a significant or insignificant effect on the entire plant risk. A four-step methodology was developed to perform Integrated Probabilistic Risk Assessment Importance Ranking. A demonstration case using these steps was set up and three of the four steps were completed in fiscal year (FY) 2019 and the fourth step done FY 2020. These steps are: 1. The qualitative analysis of potential sources was conducted with the following items identified for the demonstration. • Maximum heat release rate • Time to maximum heat release rate • Duration of max heat release rate • Time to decay • Thermal conductivity of concrete • Specific heat of concrete • Density of concrete • Cable jacket thickness 2. A quantitative characterization of dominant sources of uncertainty was performed. A list of distributions and determined values of the dominant sources is shown in Appendix A. 3. A quantitative screening of the potential sources of uncertainty using Morris Elementary Effects Analysis was completed. An experimental model using the physics-based fire modeling tool Fire Dynamics Simulator was developed and coupled with the Risk Analysis Virtual Environment. The Morris analysis identified at least two parameters that can be eliminated as significant contributors (specific heat of concrete and cable jacket thickness). 4. Global importance measure (Global IM) analysis to generate a comprehensive ranking based on their influence on the plant risk. In this research, a moment-independent Global IM is used since it can address (a) uncertainty in the input parameters of the fire model, (b) uncertainty in the risk outputs, and (c) non-linearity and interactions among input parameters in the fire model, more accurately than the correlation-based and variance-based global methods. The observations from the research showed that, depending on the initial and boundary conditions of the fire scenarios, fire-induced damage could have a very small probability and could be dominated by the tail of the uncertainty distribution; hence, the accuracy of the correlation-based and variance-based methods is questionable. The moment-independent Global IM analysis in this research provides a better understanding of how experimental uncertainty data affects industry’s plant models and where improvements in that data will have the largest benefit for improving fire modeling accuracy in causing core damage. Among the five unscreened parameters obtained from the Morris EE analysis, the Global IM analysis results for the case study indicated that max heat release rate and fire location are the most important parameters. The report also outlines benefits of using a unified computational platform that integrates the underlying simulations (e.g., a fire progression model), quantitative screening (using the Morris EE method), and the Global IM analysis. A unified platform can (i) facilitate the ranking of input parameters considering multiple key fire scenarios simultaneously, rather than considering one scenario at a time, (ii) contribute to more explicit and accurate treatment of dependencies at multiple levels of Fire PRA, (iii) facilitate the sampling-based uncertainty quantification for Fire PRA, and (iv) help generating both “industry-wide” and "plant-specific" ranking of uncertainty sources in Fire PRA. Future research should be done to include additional parameters such as detection/suppression or cable fire spread. Adding a PRA software such as SAPHIRE to the RAVEN platform would help with plant model integration and improve treatment of fire-induced dependency. The I-PRA risk importance ranking methodology offered in this report can provide valuable information for efficiently (a) enhancing the realism of Fire PRA for existing plants and (b) supporting the development of Dynamic Fire PRA for advanced reactors and new plants.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2024

Development of a Data Fusion Methodology for Lineload Aerodynamic Databases for a Launch Vehicle during Liftoff and Transition

The need for databases for the distributed loading on launch vehicles during the early portion of flight necessitates the use of expensive computational flows in regimes where wake effects dominate. While also being expensive, this is a regime that computational tools tend to historically have problems simulating accurately. To help tackle this problem, a method of data fusion to combine computational results to wind tunnel derived force and moment data is developed. Using this method, significant reduction in computational costs and increases in confidence of the final product is possible and has been used to generate several databases for the Space Launch System (SLS) at NASA. While the full details of database generation are not part of this work, the crucial method at its core is developed here. Two SLS geometries are used throughout the work to demonstrate the techniques. These are two of the larger geometries and represent both planned crewed missions to the Moon as well as potential cargo missions to deep space. The method uses principal component analysis (PCA) to generate a reduced ordered model (ROM) to help fill in the full parameter space. Other similar techniques are explored, but were not found to have a significant result on the predictions of the ROM. Because the full number of components are kept to generate the model, this lack of difference is expected. This method is then extended to ensure that predicted surfaces match trusted force and moment data derived from wind tunnel testing. This extension is done by setting up a constrained optimization problem in order to minimize the deviation from the surface resolved computational data while still integrating to the desired values. When generating the constrained optimization problem, a weighting factor to balance these competing needs is introduced. The work compares previously introduced weighting terms from similar work to the proposed terms and shows that the previously used terms do not have as desirable behavior in this flow regime. This method is then expanded by developing a technique to incorporate uncertainty quantification into the developed data fusion methodology. This expansion takes a two pronged approach. One examines transferring the uncertainties in the force and moment database and characterizes how those adjustments change the predicted lineloads. The second looks at model form error and looks how rebuilding the model using slightly different data changes the predictions. These two terms are then combined in order to create an uncertainty model that takes both effects into account. The limitations of the proposed methods is then discussed as well as possible techniques to address these shortcomings.

Launch Vehicles↗
DOE OSTI2021

Processing Aleatory and Epistemic Uncertainties in Experimental Data From Sparse Replicate Tests of Stochastic Systems for Real-Space Model Validation

This paper presents a practical methodology for propagating and processing uncertainties associated with random measurement and estimation errors (that vary from test-to-test) and systematic measurement and estimation errors (uncertain but similar from test-to-test) in inputs and outputs of replicate tests to characterize response variability of stochastically varying test units. Also treated are test condition control variability from test-to-test and sampling uncertainty due to limited numbers of replicate tests. These aleatory variabilities and epistemic uncertainties result in uncertainty on computed statistics of output response quantities. The methodology was developed in the context of processing experimental data for “real-space” (RS) model validation comparisons against model-predicted statistics and uncertainty thereof. The methodology is flexible and sufficient for many types of experimental and data uncertainty, offering the most extensive data uncertainty quantification (UQ) treatment of any model validation method the authors are aware of. It handles both interval and probabilistic uncertainty descriptions and can be performed with relatively little computational cost through use of simple and effective dimension- and order-adaptive polynomial response surfaces in a Monte Carlo (MC) uncertainty propagation approach. A key feature of the progressively upgraded response surfaces is that they enable estimation of propagation error contributed by the surrogate model. Sensitivity analysis of the relative contributions of the various uncertainty sources to the total uncertainty of statistical estimates is also presented. Finally, the methodologies are demonstrated on real experimental validation data involving all the mentioned sources and types of error and uncertainty in five replicate tests of pressure vessels heated and pressurized to failure. Simple spreadsheet procedures are used for all processing operations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Combined Data and Deep Learning Model Uncertainties: An Application to the Measurement of Solid Fuel Regression Rate

In complex physical process characterization, such as the measurement of the regression rate for solid hybrid rocket fuels, where both the observation data and the model used have uncertainties originating from multiple sources, combining these in a systematic way for quantities of interest (QoI) remains a challenge. In this paper, we present a forward propagation uncertainty quantification (UQ) process to produce a probabilistic distribution for the observed regression rate r. We characterized two input data uncertainty sources from the experiment (the distortion from the camera U c and the non-zero-angle fuel placement U Y ), the prediction and model form uncertainty from the deep neural network (U m ), as well as the variability from the manually segmented images used for training it (U s ). Here, we conducted seven case studies on combinations of these uncertainty sources with the model form uncertainty. The main contribution of this paper is the investigation and inclusion of the experimental image data uncertainties involved, and how to include them in a workflow when the QoI is the result of multiple sequential processes.

42 ENGINEERING↗
DOE OSTI2022

ORNL Contributions to the ENDF/B-VIII.1 Library [Slides]

For uranium and plutonium isotopes, evaluation work is converging to a stable configuration with an overall satisfactory benchmark performance (more information on the validation tests after CSEWG). Strontium evaluation was included in the repository library and successfully tested by processing codes relative to an alternative quantification of the external function. Cerium covariance matrices were updated to address review comments on the magnitude of the uncertainty. For future uncertainty quantification, theoretical observables should be properly decoupled from current measured guidelines. Tests to correctly include LP (from resonance parameters) fitted to measured energy-averaged data are in progress. Current ENDF files contains experimental LP data.

07 ISOTOPE AND RADIATION SOURCES↗
DOE OSTI2019

Exploring experimental conditions to reduce uncertainties in the optical potential

Uncertainty quantification for nuclear theories has gained a more prominent role in the field, with more groups attempting to understand the uncertainties in their calculations. However, recent studies have shown that the uncertainties on the optical potentials are too large for the theory to be useful. The goal of this work is to explore possible experimental conditions that may reduce the uncertainties on elastic scattering and single-nucleon transfer cross sections that come from the fitting of the optical model parameters to experimental data. Using Bayesian methods, we explore the effect of the uncertainties of optical model parameters on the angular grid of the differential cross section, including cross-section data at nearby energies, and changes in the experimental error bars. We also study the effect on the resulting uncertainty when other observables are included in the fitting procedure, particularly the total (reaction) cross sections. We study proton and neutron elastic scattering on 48 Ca and 208 Pb. We explore the parameter space with the Markov-chain Monte Carlo method, produce posterior distributions for the optical model parameters, and construct the corresponding 95% confidence intervals on the elastic-scattering cross sections. We also propagate the uncertainties on the optical potentials to the 48 Ca(d,p) 49 Ca(g.s.) and 208 Pb(d,p) 209 Pb(g.s.) cross sections. We find little sensitivity to the angular grid and an improvement of up to a factor of 2 on the uncertainties by including data at a nearby energy. Although reducing the error bars on the data does reduce the uncertainty, the gain is often considerably smaller than one would naively expect. We also find that the inclusion of total reaction cross section can improve the uncertainty although the magnitude of the effect depends strongly on the cases considered.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2017

Data Driven Smart Proxy for CFD: Application of Big Data Analytics & Machine Learning in Computational Fluid Dynamics (Part 1)

Simulation technologies can reduce the time and cost of the development and deployment of advanced technologies and allow rapid scale-up of these technologies for fossil fuel based energy systems. However, to ensure their usefulness in practice, the credibility of the simulations needs to be established with Uncertainty Quantification (UQ) methods. National Energy Technology Laboratory (NETL) has been applying non-intrusive UQ methodologies to categorize and quantify uncertainties in CFD simulations of gas-solid multiphase flows. To reduce the computational cost associated with gas-solid flow simulations required for UQ analysis, techniques commonly used in the area of Artificial Intelligence (AI) and Data Mining (DM) are used to construct smart proxy models, which can reduce the computational cost of conducting large number of multiphase CFD simulations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

On the Statistical Uncertainty of Monte Carlo-Calculated Scattering Sensitivities

Sensitivity coefficients calculated with Monte Carlo codes are widely used for nuclear data uncertainty quantification in the modeling and simulation of complex 3D reactor systems. This study systematically compares sensitivity coefficients and associated statistical uncertainties for the multiplication factor and fuel temperature reactivity across multiple Monte Carlo codes (SCALE/KENO, SCALE/Shift, MCNP, and Serpent) using simple models representing light-water reactors and advanced reactor concepts. For multiplication factor sensitivities, statistical uncertainties are generally acceptable, although scattering sensitivities show significantly larger statistical uncertainties than, for example, fission and capture reactions. Fuel temperature reactivity sensitivities show significantly larger statistical uncertainties across all reactions. Elastic scattering sensitivities are the most problematic: all Monte Carlo codes fail to resolve energy-dependent coefficients, and they produce dramatically different energy-collapsed values. Critically, the use of these sensitivity coefficients in nuclear data uncertainty propagation leads to reduced statistical uncertainties in individual uncertainty contributions. This can lead to the masking of unusable sensitivity coefficients and producing misleading uncertainty results. The findings of this study show that new or enhanced methods are needed to improve Monte Carlo elastic scattering sensitivity calculations. Additionally, this study shows the relevance of verifying sensitivity coefficients through direct perturbation calculations for individual nuclide reactions, instead of only for total cross sections as commonly done.

Bostelmann, Rike [ORNL] (ORCID:0000000165968088)↗
NASA NTRS2014

Assessment of Satellite Ocean Colour Radiometry and Derived Geophysical Products

Standardization of methods to assess and assign quality metrics to satellite ocean color radiometry and derived geophysical products has become paramount with the inclusion of the marine reflectance and chlorophyll-a concentration (Chla) as essential climate variables (ECV; [1]) and the recognition that optical remote sensing of the oceans can only contribute to climate research if and when a continuous succession of satellite missions can be shown to collectively provide a consistent, long-term record with known uncertainties. In 20 years, the community has made significant advancements toward that objective, but providing a complete uncertainty budget for all products and for all conditions remains a daunting task. In the retrieval of marine water-leaving radiance from observed top-of-atmosphere radiance, the sources of uncertainties include those associated with propagation of sensor noise and radiometric calibration and characterization errors, as well as a multitude of uncertainties associated with the modeling and removal of effects from the atmosphere and sea surface. This chapter describes some common approaches used to assess quality and consistency of ocean color satellite products and reviews the current status of uncertainty quantification in the field. Its focus is on the primary ocean color product, the spectrum of marine reflectance Rrs, but uncertainties in some derived products such as the Chla or inherent optical properties (IOPs) will also be considered.

Ocean↗
DOE OSTI2017

Bayesian inference for high confidence signal validation and sensor calibration assessment - 328

Online Monitoring (OLM) systems has been investigated for applications in the nuclear industry for the past two decades. These systems offer economic and technological advantages over the currently implemented time based testing methods for sensors and associated instrumentations. The advantages offered not only augment economic viability of current nuclear reactors but will be an inevitable change called for to suit the technologies of the advanced reactors (Gen III+). Irrespective, the acceptance of OLM into the regulatory structure in the U.S. is still hindered by technical and structural clarity on uncertainty quantification used by these systems. A Bayesian inference technique is implemented in the form of a residual model to quantify uncertainty in OLM predictions. The developed system used Gaussian processes to represent the OLM predictions and model inadequacy, the stationary representation of model based uncertainty. In addition, model selection techniques are used in conjunction with numerical methods such as Genetic Algorithm (GA) and Gibb's sampler to add robustness to the estimation model inadequacy, particularly in the presence of drifts and faulted conditions. The prediction model developed herein find applicability in fault detection, obtaining real values of processes after the onset of faults etc. Further development looks into the extension of current method for a multiple output scale implementation. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗