Search NASA⌕ Search

SEARCH · Search NASA

Results for “Uncertainty quantification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28
All sourcesNASA NTRSDOE OSTI
DOE OSTI2016

Efficient Uncertainty Quantification in Stochastic Economic Dispatch

Stochastic economic dispatch models usually address uncertainties in forecasts of renewable generation output by considering a finite number of realizations drawn from a stochastic process model, typically via Monte Carlo sampling. Accurate evaluations of expectations or higher order moments for quantities of interest, e.g., generating cost, can require a prohibitively large number of samples. We propose an alternative to Monte Carlo sampling based on polynomial chaos expansions. These representations enable efficient and accurate propagation of uncertainties in model parameters, using sparse quadrature methods. Furthermore, we use Karhunen-Loève expansions for efficient representation of uncertain renewable energy generation that follows geographical and temporal correlations derived from historical data at each wind farm. Considering expected production cost, we show that the proposed approach can yield several orders of magnitude reduction in computational cost for solving stochastic economic dispatch relative to Monte Carlo sampling, for a given target error threshold.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2016

Monte Carlo Uncertainty Quantification for an Unattended Enrichment Monitor

As a case study for uncertainty analysis, we consider a model flow monitor for measuring enrichment in gas centrifuge enrichment plants (GCEPs) that could provide continuous monitoring of all declared gas flow and provide high-accuracy gas enrichment estimates as a function of time. The monitor system could include NaI(Tl) gamma-ray spectrometers, a pressure signal-sharing device to be installed on an operator\rq{}s pressure gauge or a dedicated inspector pressure sensor, and temperature sensors attached to the outside of the header pipe, to provide pressure, temperature, and gamma-ray spectra measurements of UF$_6$ gas flow through unit header pipes. Our study builds on previous modeling and analysis methods development for enrichment monitor concepts and a software tool that was developed at Oak Ridge National Laboratory to generate and analyze synthetic data.

international safeguards↗
DOE OSTI2023

Deep learning uncertainty quantification for clinical text classification

Machine learning algorithms are expected to work side-by-side with humans in decision-making pipelines. Thus, the ability of classifiers to make reliable decisions is of paramount importance. Deep neural networks (DNNs) represent the state-of-the-art models to address real-world classification. Although the strength of activation in DNNs is often correlated with the network’s confidence, in-depth analyses are needed to establish whether they are well calibrated. In this paper, we demonstrate the use of DNN-based classification tools to benefit cancer registries by automating information extraction of disease at diagnosis and at surgery from electronic text pathology reports from the US National Cancer Institute (NCI) Surveillance, Epidemiology, and End Results (SEER) population-based cancer registries. In particular, we introduce multiple methods for selective classification to achieve a target level of accuracy on multiple classification tasks while minimizing the rejection amount—that is, the number of electronic pathology reports for which the model’s predictions are unreliable. We evaluate the proposed methods by comparing our approach with the current in-house deep learning-based abstaining classifier. Overall, all the proposed selective classification methods effectively allow for achieving the targeted level of accuracy or higher in a trade-off analysis aimed to minimize the rejection rate. On in-distribution validation and holdout test data, with all the proposed methods, we achieve on all tasks the required target level of accuracy with a lower rejection rate than the deep abstaining classifier (DAC). Interpreting the results for the out-of-distribution test data is more complex; nevertheless, in this case as well, the rejection rate from the best among the proposed methods achieving 97% accuracy or higher is lower than the rejection rate based on the DAC. We show that although both approaches can flag those samples that should be manually reviewed and labeled by human annotators, the newly proposed methods retain a larger fraction and do so without retraining—thus offering a reduced computational cost compared with the in-house deep learning-based abstaining classifier.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2018

Particle image velocimetry (PIV) uncertainty quantification using moment of correlation (MC) plane

Here, we present a new uncertainty estimation method for particle image velocimetry (PIV), that uses the correlation plane as a model for the probability density function (PDF) of displacements and calculates the second order moment of the correlation (MC). The cross-correlation between particle image patterns is the summation of all particle matches convolved with the apparent particle image diameter. MC uses this property to estimate the PIV uncertainty from the shape of the cross-correlation plane. In this new approach, the generalized cross-correlation (GCC) plane corresponding to a PIV measurement is obtained by removing the particle image diameter contribution. The GCC primary peak represents a discretization of the displacement PDF, from which the standard uncertainty is obtained by convolving the GCC plane with a Gaussian function. Then a Gaussian least-squares-fit is applied to the peak region, accounting for the stretching and rotation of the peak, due to the local velocity gradients and the effect of the convolved Gaussian. The MC method was tested with simulated image sets and the predicted uncertainties show good sensitivity to the error sources and agreement with the expected RMS error. Subsequently, the method was demonstrated in three PIV challenge cases and two experimental datasets and was compared with the published image matching (IM) and correlation statistics (CS) techniques. Results show that the MC method has a better response to spatial variation in RMS error and the predicted uncertainty is in good agreement with the expected standard uncertainty. The uncertainty prediction was also explored as a function of PIV interrogation window size. Overall, the MC method performance establishes itself as a valid uncertainty estimation tool for planar PIV.

47 OTHER INSTRUMENTATION↗
DOE OSTI2016

Hierarchical Multi-Scale Approach To Validation and Uncertainty Quantification of Hyper-Spectral Image Modeling

Validating predictive models and quantifying uncertainties inherent in the modeling process is a critical component of the HARD Solids Venture program [1]. Our current research focuses on validating physics-based models predicting the optical properties of solid materials for arbitrary surface morphologies and characterizing the uncertainties in these models. We employ a systematic and hierarchical approach by designing physical experiments and comparing the experimental results with the outputs of computational predictive models. We illustrate this approach through an example comparing a micro-scale forward model to an idealized solid-material system and then propagating the results through a system model to the sensor level. Our efforts should enhance detection reliability of the hyper-spectral imaging technique and the confidence in model utilization and model outputs by users and stakeholders.

Engel, David W.↗
DOE OSTI2012

Uncertainty quantification in kinematic wave models

We developed a probabilistic approach to quantify parametric uncertainty in first-order hyperbolic conservation laws (kinematic wave equations). The approach relies on the derivation of a deterministic equation for the cumulative density function (CDF) of the system state, in which probabilistic descriptions (probability density functions or PDFs) of the system parameters and/or initial and boundary conditions serve as inputs. In contrast to PDF equations, which are often used in other contexts, CDF equations allow for straightforward and unambiguous determination of boundary conditions with respect to sample variables.The accuracy and robustness of solutions of the CDF equation for one such system, the Saint-Venant equations of river flows, were investigated via comparison with Monte Carlo simulations.

UQ, CDF methods, surface flow, kinematic wave, hyp↗
DOE OSTI2015

Branch-and-Bound algorithm applied to uncertainty quantification of a Boiling Water Reactor Station Blackout

Evaluation of the impacts of uncertainty and sensitivity in modeling presents a significant set of challenges in particular to high fidelity modeling. Computational costs and validation of models creates a need for cost effective decision making with regards to experiment design. Experiments designed to validate computation models can be used to reduce uncertainty in the physical model. In some cases, large uncertainty in a particular aspect of the model may or may not have a large impact on the final results. For example, modeling of a relief valve may result in large uncertainty, however, the actual effects on final peak clad temperature in a reactor transient may be small and the large uncertainty with respect to valve modeling may be considered acceptable. Additionally, the ability to determine the adequacy of a model and the validation supporting it should be considered within a risk informed framework. Low fidelity modeling with large uncertainty may be considered adequate if the uncertainty is considered acceptable with respect to risk. In other words, models that are used to evaluate the probability of failure should be evaluated more rigorously with the intent of increasing safety margin. Probabilistic risk assessment (PRA) techniques have traditionally been used to identify accident conditions and transients. Traditional classical event tree methods utilize analysts’ knowledge and experience to identify the important timing of events in coordination with thermal-hydraulic modeling. These methods lack the capability to evaluate complex dynamic systems. In these systems, time and energy scales associated with transient events may vary as a function of transition times and energies to arrive at a different physical state. Dynamic PRA (DPRA) methods provide a more rigorous analysis of complex dynamic systems. Unfortunately DPRA methods introduce issues associated with combinatorial explosion of states. This study presents a methodology to address combinatorial explosion using a Branch-and-Bound algorithm applied to Dynamic Event Trees (DET), which utilize LENDIT (L – Length, E – Energy, N – Number, D – Distribution, I – Information, and T – Time) as well as a set theory to describe system, state, resource, and response (S2R2) sets to create bounding functions for the DET. The optimization of the DET in identifying high probability failure branches is extended to create a Phenomenological Identification and Ranking Table (PIRT) methodology to evaluate modeling parameters important to safety of those failure branches that have a high probability of failure. The PIRT can then be used as a tool to identify and evaluate the need for experimental validation of models that have the potential to reduce risk. Finally, in order to demonstrate this methodology, a Boiling Water Reactor (BWR) Station Blackout (SBO) case study is presented.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2026

A Framework for Parametric and Predictive Uncertainty Quantification in the E3SM Land Model: Assessing Site and Observable Generalizability

Quantifying parametric uncertainty using observations from individual sites provides a critical foundation for Earth system modeling, serving as a necessary first step before scaling up to regional or global applications. This study introduces a novel computational framework designed to enhance model predictability by reducing parametric uncertainty and assessing site and observable generalizability using various observational constraints. The framework integrates five components: Model Simulation, Statistical Emulation, Global Sensitivity Analysis (GSA), Model Calibration, and Model Prediction. Using the E3SM land model, we simulated site-level land-atmosphere carbon and energy fluxes from 2003 to 2007 across five evergreen needleleaf FLUXNET sites, perturbing 26 vegetation-related model parameters. Gaussian process emulators were employed to expedite GSA and model calibration. Four critical parameters that strongly influence selected land-atmosphere fluxes were identified by GSA. Bayesian approaches were used to infer parameter probability distributions leveraging synthetic data and FLUXNET observations. The results reveal that posterior parameter distributions vary significantly across different sites and observables within the same plant functional type. Probabilistic predictions indicate that parameters calibrated at one site can enhance predictive accuracy at other sites, although site heterogeneity may sometimes outweigh parametric uncertainty. Additionally, the probabilistic predictions demonstrate that calibration for one variable can also improve predictability for other variables, thereby maximizing predictive capabilities with limited observations. This framework provides a powerful approach for reducing parametric uncertainty in Earth system models and deepening our understanding of carbon dynamics and energy cycles. Its adaptability makes it a valuable tool for broader applications in Earth system modeling.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2016

Uncertainty Quantification of Pressurization Due to Organic Material Decomposition

A new approach for describing the uncertainty associated with organic material decomposition in an abnormal thermal environment is described. Rather than applying multipliers to the pressure predicted by the simulation, the uncertain parameters are incorporated in a broader Latin hypercube sampling study. The resulting distribution gives more information than the pressure multiplier, but similar uncertainty bounds can be derived from a log-normal fit.

36 MATERIALS SCIENCE↗
DOE OSTI2013

Physics-based dimension reduction in uncertainty quantification for radiative transfer

We present a physics-based methodology for quantifying the uncertainty in a given quantity of interest (QOI) that is contributed by uncertainties in opacities in radiation transport problems. Typically, opacities are tabulated as a function of density, temperature, and photon energy group. The size of this table makes a study of uncertainties at this level challenging because of the well-known 'curse of dimensionality.' We address this by studying uncertain parameters in the underlying physical model that generates the opacity tables. At this level, there are fewer uncertain parameters but still too many to analyze directly through computationally expensive radiation transport simulations. In order to explore this large uncertain parameter space, we develop two simplified radiation transport problems that are much less computationally demanding than the target problem of interest. An emulator is created for each QOI for each simplified problem using Bayesian Multivariate Adaptive Regression Splines (BMARS). This emulator is used to create a functional relationship between the QOIs and the uncertain parameters. Sensitivity analysis is performed using the emulator to determine which parameters contribute significantly to the uncertainty. This physics-based screening process reduces the dimension of the parameter space that is then studied via the computationally expensive radiation transport calculation to generate distributions of quantities of interest. Results of this research demonstrate that the QOIs for the target problem agree for varying screening criteria determined by the sensitivity analysis, and the QOIs agree well for varying Latin Hypercube Design (LHD) sample sizes for the uncertain space. (authors)

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Nonlocal Operator Learning with Uncertainty Quantification

The goal of this work is to develop a Bayesian framework to characterize the uncertainty of material response when using a nonlocal, homogenized model to describe wave propagation through heterogeneous, disordered materials. Our approach is based on an operator regression technique combined with Bayesian optimization, through which the nonlocal kernel for a specific disordered microstructure is investigated.

36 MATERIALS SCIENCE↗
DOE OSTI2018

Importance of treating correlations in the uncertainty quantification of radiation damage metrics - 25461

The radiation effects community embraces the importance of quantifying uncertainty in model predictions and the importance of propagating this uncertainty into the integral metrics used to validate models, but they are not always aware of the importance of addressing the energy- and reaction-dependent correlations in the underlying uncertainty contributors. This paper presents a rigorous high-fidelity Total Monte Carlo approach that addresses the correlation in the underlying uncertainty components and quantifies the role of both energy and reaction-dependent correlations in a sample application that addresses the damage metrics relevant to silicon semiconductors. (authors)

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2018

Uncertainty quantification due to optical potentials in models for ( d , p ) reactions

Recent work has studied the uncertainty in predictions for $A(d,p)B$ reactions using the distorted-wave Born approximation (DWBA), coming from the parametrization of the effective $dA$ interactions [Lovell et al. Phys. Rev. C 95, 024611 (2017)]. There are different levels of sophistication in reaction theories for one-nucleon transfer reactions, including the adiabatic wave approximation (ADWA) which takes deuteron breakup into account to all orders. In this paper, we quantify the uncertainties associated with the ADWA method that come from the parametrization of the NA interactions and compare ADWA with DWBA. Similar to Lovell et al., we use nucleon elastic-scattering data on a wide variety of targets at the appropriate incoming and outgoing energies to constrain the optical potential input to the ADWA theory. Pulling from the χ 2 distribution, we obtain 95% confidence bands for the elastic distributions. From the resulting parameters, we predict 95% confidence bands for the ( d , p ) transfer cross sections. Results obtained with the standard uncorrelated χ 2 are compared to those using the correlated χ 2 of Lovell et al. We also repeat the DWBA calculations for the exact same reactions for comparison purposes. We find that NA elastic-scattering data provide a significant constraint to the interactions, and, when the uncertainties are propagated to the transfer reactions using ADWA, predictions are consistent with the transfer data. The angular distributions for ADWA differ from those predicted by DWBA, particularly at small angles. As in Lovell et al., confidence bands obtained using the uncorrelated χ 2 function are unrealistically narrow and become much wider when the correlated χ 2 function is considered. For most cases, the uncertainty bands obtained in ADWA are narrower than DWBA when using elastic data of similar quality and range. However, given the large uncertainties predicted from the correlated χ 2 function, at this point, the transfer data cannot discriminate between these two methods.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

Uncertainty Quantification (UQ) for AI fact Sheet

UQ is traditionally defined as quantitative characterization and estimation of uncertainties in both computational and real-world applications. It tries to determine how likely certain outcomes are if some aspects of the system are not exactly known.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2015

Subspace-based Inverse Uncertainty Quantification for Nuclear Data Assessment

Safety analysis and design optimization depend on the accurate prediction of various reactor attributes. Predictions can be enhanced by reducing the uncertainty associated with the attributes of interest. An inverse problem can be defined and solved to assess the sources of uncertainty, and experimental effort can be subsequently directed to further improve the uncertainty associated with these sources. In this work a subspace-based algorithm for inverse sensitivity/uncertainty quantification (IS/UQ) has been developed to enable analysts account for all sources of nuclear data uncertainties in support of target accuracy assessment-type analysis. An approximate analytical solution of the optimization problem is used to guide the search for the dominant uncertainty subspace. By limiting the search to a subspace, the degrees of freedom available for the optimization search are significantly reduced. A quarter PWR fuel assembly is modeled and the accuracy of the multiplication factor and the fission reaction rate are used as reactor attributes whose uncertainties are to be reduced. Numerical experiments are used to demonstrate the computational efficiency of the proposed algorithm. Our ongoing work is focusing on extending the proposed algorithm to account for various forms of feedback, e.g., thermal-hydraulics and depletion effects.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2019

Bayesian Hierarchical Model Uncertainty Quantification for Future Hydroclimate Projections in Southern Hills-Gulf Region, USA

The study investigates the hierarchical uncertainty of multi-ensemble hydroclimate projections for the Southern Hills-Gulf region, USA, considering emission pathways and a global climate model (GCM) as two main sources of uncertainty. Forty projections of downscaled daily air temperature and precipitation from 2010 to 2099 under four emission pathways and ten CMIP5 GCMs are adopted for hydroclimate modeling via the HELP3 hydrologic model. This study focuses on evapotranspiration (ET), surface runoff, and groundwater recharge projections in this century. Climate projection uncertainty is characterized by the hierarchical Bayesian model averaging (HBMA) method, which segregates emission pathway uncertainty and climate model uncertainty. HBMA is able to derive ensemble means and standard deviations, arising from individual uncertainty sources, for ET, runoff, and recharge. The model results show that future recharge in the Southern Hills-Gulf region is more sensitive to different climate projections and exhibits higher variability than ET and runoff. Overall, ET is likely to increase and runoff is likely to decrease in this century given the current emission path scenarios. Runoff are predicted to have an 18% to 20% decrease and ET is predicted to have around a 3% increase throughout the century. Groundwater recharge is likely to increase in this century with a decreasing trend. Recharge would increase about 13% in the early century and will have only a 3% increase in the late century. All hydrological projections have increasing uncertainty towards the end of the century. The HBMA result suggests that the GCM uncertainty dominates the overall hydrological projection uncertainty in the early century and the mid-century. The emission pathway uncertainty becomes important in the late century.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2011

MONTE-CARLO BURNUP CALCULATION UNCERTAINTY QUANTIFICATION AND PROPAGATION DETERMINATION

MONTEBURNS is a Monte-Carlo depletion routine utilizing MCNP and ORIGEN 2.2. Uncertainties exist in the MCNP transport calculation, but this information is not passed to the depletion calculation in ORIGEN or saved. To quantify this transport uncertainty and determine how it propagates between burnup steps, a statistical analysis of a multiple repeated depletion runs is performed. The reactor model chosen is the Oak Ridge Research Reactor (ORR) in a single assembly, infinite lattice configuration. This model was burned for a 25.5 day cycle broken down into three steps. The output isotopics as well as effective multiplication factor (k-effective) were tabulated and histograms were created at each burnup step using the Scott Method to determine the bin width. It was expected that the gram quantities and k-effective histograms would produce normally distributed results since they were produced from a Monte-Carlo routine, but some of results do not. The standard deviation at each burnup step was consistent between fission product isotopes as expected, while the uranium isotopes created some unique results. The variation in the quantity of uranium was small enough that, from the reaction rate MCNP tally, round off error occurred producing a set of repeated results with slight variation. Statistical analyses were performed using the {chi}{sup 2} test against a normal distribution for several isotopes and the k-effective results. While the isotopes failed to reject the null hypothesis of being normally distributed, the {chi}{sup 2} statistic grew through the steps in the k-effective test. The null hypothesis was rejected in the later steps. These results suggest, for a high accuracy solution, MCNP cell material quantities less than 100 grams and greater kcode parameters are needed to minimize uncertainty propagation and minimize round off effects.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗