Search NASA⌕ Search

SEARCH · Search NASA

Results for “Uncertainty quantification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

Neural Network Prediction of Strong Lensing Systems with Domain Adaptation and Uncertainty Quantification

Modeling strong gravitational lenses is computationally expensive for the complex data from modern and next-generation cosmic surveys. Deep learning has emerged as a promising approach for finding lenses and predicting lensing parameters, such as the Einstein radius. Mean-variance Estimators (MVEs) are a common approach for obtaining aleatoric (data) uncertainties from a neural network prediction. However, neural networks have not been demonstrated to perform well on out-of-domain target data successfully - e.g., when trained on simulated data and applied to real, observational data. In this work, we perform the first study of the efficacy of MVEs in combination with unsupervised domain adaptation (UDA) on strong lensing data. The source domain data is noiseless, and the target domain data has noise mimicking modern cosmology surveys. We find that adding UDA to MVE increases the accuracy on the target data by a factor of about two over an MVE model without UDA. Including UDA also permits much more well-calibrated aleatoric uncertainty predictions. Advancements in this approach may enable future applications of MVE models to real observational data.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

High-resolution modeling of indoor radon exposure with uncertainty quantification in Utah

Indoor radon accounts for 37% of population-level exposure to ionizing radiation in the United States. However, radon metrics are typically reported at coarse spatial scales, potentially obscuring meaningful local variation. We developed a high-resolution modeling framework to estimate indoor radon concentrations across Utah while explicitly quantifying predictive uncertainty. A total of 19,497 residential radon measurements collected between 2006 and 2017 were combined with environmental and housing characteristics and analyzed using a geospatial neural network that accommodates spatial dependence and nonlinear associations. Predictions were generated on a uniform hexagonal grid at 0.73 km2 resolution (H3 level 8). Out-of-sample predictions aggregated to the H3 level 8 grid showed good agreement with observed concentrations (Pearson r=0.64), while household-level predictions exhibited more moderate agreement (r=0.45). The model produced well-calibrated uncertainty estimates, with 24.1% of held-out observations exceeding the predicted 75th-percentile threshold. Maps of predicted radon concentrations and the probability of exceeding the U.S. EPA action level of 148 Bq/m3 (4 pCi/L) revealed substantial fine-scale spatial heterogeneity that was not apparent in conventional coarse-resolution summaries, with greater local variability observed in densely monitored urban counties than in sparsely sampled regions. High-resolution radon models that explicitly quantify uncertainty provide a useful framework for characterizing the spatial distribution of indoor radon and identifying areas of elevated exceedance risk. These findings highlight the value of fine-scale monitoring data and uncertainty-aware modeling approaches for radon exposure assessment, environmental risk characterization, and radon-related health research.

Wu, Yunhan [ORNL] (ORCID:0000000178842994)↗

Principle and Uncertainty Quantification of an Experiment Designed to Infer Actinide Neutron Capture Cross-Sections

An integral reactor physics experiment devoted to infer higher actinide (Am, Cm, Bk, Cf) neutron cross sections will take place in the US. This report presents the principle of the planned experiment as well as a first exercise aiming at quantifying the uncertainties related to the inferred quantities. It has been funded in part by the DOE Office of Science in the framework of the Recovery Act and has been given the name MANTRA for Measurement of Actinides Neutron TRAnsmutation. The principle is to irradiate different pure actinide samples in a test reactor like INL’s Advanced Test Reactor, and, after a given time, determine the amount of the different transmutation products. The precise characterization of the nuclide densities before and after neutron irradiation allows the energy integrated neutron cross-sections to be inferred since the relation between the two are the well-known neutron-induced transmutation equations. This approach has been used in the past and the principal novelty of this experiment is that the atom densities of the different transmutation products will be determined with the Accelerator Mass Spectroscopy (AMS) facility located at ANL. While AMS facilities traditionally have been limited to the assay of low-to-medium atomic mass materials, i.e., A < 100, there has been recent progress in extending AMS to heavier isotopes – even to A > 200. The detection limit of AMS being orders of magnitude lower than that of standard mass spectroscopy techniques, more transmutation products could be measured and, potentially, more cross-sections could be inferred from the irradiation of a single sample. Furthermore, measurements will be carried out at the INL using more standard methods in order to have another set of totally uncorrelated information.

74 ATOMIC AND MOLECULAR PHYSICS↗

Uncertainty Quantification and Global Sensitivity Analysis of Subsurface Flow Parameters to Gravimetric Variations During Pumping Tests in Unconfined Aquifers

We study the contribution of typically uncertain subsurface flow parameters to gravity changes that can be recorded during pumping tests in unconfined aquifers. We do so in the framework of a Global Sensitivity Analysis and quantify the effects of uncertainty of such parameters on the first four statistical moments of the probability distribution of gravimetric variations induced by the operation of the well. System parameters are grouped into two main categories, respectively, governing groundwater flow in the unsaturated and saturated portions of the domain. We ground our work on the three-dimensional analytical model proposed by Mishra and Neuman (2011), which fully takes into account the richness of the physical process taking place across the unsaturated and saturated zones and storage effects in a finite radius pumping well. The relative influence of model parameter uncertainties on drawdown, moisture content, and gravity changes are quantified through (a) the Sobol' indices, derived from a classical decomposition of variance and (b) recently developed indices quantifying the relative contribution of each uncertain model parameter to the (ensemble) mean, skewness, and kurtosis of the model output. Our results document (i) the importance of the effects of the parameters governing the unsaturated flow dynamics on the mean and variance of local drawdown and gravity changes; (ii) the marked sensitivity (as expressed in terms of the statistical moments analyzed) of gravity changes to the employed water retention curve model parameter, specific yield, and storage, and (iii) the influential role of hydraulic conductivity of the unsaturated and saturated zones to the skewness and kurtosis of gravimetric variation distributions. The observed temporal dynamics of the strength of the relative contribution of system parameters to gravimetric variations suggest that gravity data have a clear potential to provide useful information for estimating the key hydraulic parameters of the system.

54 ENVIRONMENTAL SCIENCES↗

Uncertainty quantification for Bayesian active learning in rupture life prediction of ferritic steels

Abstract Three probabilistic methodologies are developed for predicting the long-term creep rupture life of 9–12 wt%Cr ferritic-martensitic steels using their chemical and processing parameters. The framework developed in this research strives to simultaneously make efficient inference along with associated risk, i.e., the uncertainty of estimation. The study highlights the limitations of applying probabilistic machine learning to model creep life and provides suggestions as to how this might be alleviated to make an efficient and accurate model with the evaluation of epistemic uncertainty of each prediction. Based on extensive experimentation, Gaussian Process Regression yielded more accurate inference ( $$Pearson\;correlation\;coefficent> 0.95$$ P e a r s o n c o r r e l a t i o n c o e f f i c e n t > 0.95 for the holdout test set) in addition to meaningful uncertainty estimate (i.e., coverage ranges from 94 to 98% for the test set) as compared to quantile regression and natural gradient boosting algorithm. Furthermore, the possibility of an active learning framework to iteratively explore the material space intelligently was demonstrated by simulating the experimental data collection process. This framework can be subsequently deployed to improve model performance or to explore new alloy domains with minimal experimental effort.

20 FOSSIL-FUELED POWER PLANTS↗

Statistically Rigorous Uncertainty Quantification for Physical Parameter Model Calibration with Functional Output

In experiments conducted on the Z-machine at Sandia National Laboratories, dynamic material properties cannot be analyzed using traditional analytic methods, necessitating solving an inverse problem. Bayesian model calibration is a statistical framework for solving an inverse problem to estimate parameters input into a computational model in the presence of multiple uncertainties. Disentangling input parameter uncertainty and model misspecification is often poorly identified problem. When using computational models for physical parameter estimation, the issue of parameter identifiability must be carefully considered to obtain accurate and precise estimates of physical parameters. Additionally, in dynamic material properties applications, the experimental output is a function, velocity over time. While we can sample an arbitrarily large number of points from the measured velocity, these curves only contain a finite amount of information about the calibration parameters. In this report, we propose modifications to the Bayesian model calibration framework to simplify and improve the estimation of physical parameters with functional outputs. Specifically, we propose scaling the likelihood function by an effective sample size rather than modeling the discrepancy function; and modularizing input nuisance parameters with weakly identified parameters. We evaluate the performance of these proposed methods using a statistical simulation study and then apply these methods to estimate parameters of the tantalum equation of state. We conclude that these proposed methods can provide simple, fast, and statistically valid alternatives to the full Bayesian model calibration procedure; and that these methods can be used to estimate parameters of the equation of state for tantalum.

97 MATHEMATICS AND COMPUTING↗

EGS Stimulation Design with Uncertainty Quantification at the EGS Collab Site

Engineering a robust hydraulic connection between wells is one of the most difficult aspects of enhanced geothermal systems (EGS). Designing and constructing such hydraulic connections requires and understanding of the in situ state of stress and the heterogeneities and discontinuities that naturally exist and may control the stimulation. Even with comprehensive stress and formation characterization programs substantial uncertainty remains in these key parameters. This is especially the case in high-temperature EGS environments where drilling conditions are often difficult and a far fewer logging and testing options are available. This paper presents a new approach for explicitly quantifying the uncertainties in the state of stress using a Bayesian Markov Chain Monte Carlo method. This approach produces a probability distribution for the stress tensor, including a general 3D orientation, that reflects the uncertainties in all the observations or indicators used to constrain the stress state. This method is demonstrated on the characterization data for the EGS Collab Experiment 2 site. The output of the analysis is used to guide the design of the planned stimulations. In the case of research projects like EGS Collab, explicitly quantifying the uncertainties in the stress state allow for more rigorous hypothesis testing by allowing conclusions drawn from the experiments to be interpreted in the context of the uncertain knowledge about conditions in the test bed.

Burghardt, Jeffrey A.↗

Comparison of Burnup Credit Uncertainty Quantification Methods

The recent revision of Interim Staff Guidance (ISG-8 revision 3), issued by the US Nuclear Regulatory Commission, on burnup credit for criticality safety analysis of pressurized water reactor spent fuel in transportation and storage casks expands the nuclides that can be credited in the fuel composition to include minor actinides and fission products. The technical basis for development of the uncertainties associated with calculated nuclide concentrations in spent nuclear fuel that are recommended in ISG-8 was established through the use of measured isotopic data acquired from destructive radiochemical assay data for spent fuel samples. These data provide a direct experimental basis for determining uncertainties in the calculated nuclide concentrations. To provide additional insight into code uncertainties resulting from nuclear data and also the level of conservatism associated with using experimental assay benchmark data for uncertainty evaluation, a new uncertainty analysis tool in the SCALE code system that performs stochastic sampling of nuclear data has been applied to representative burnup credit calculations for spent fuel pool and dry cask storage applications methodology. The nuclear data uncertainty analysis capabilities in Sampler can account for uncertainty contributions from cross sections, fission yields, and decay data by using correlated sampling of covariance files developed for all nuclear data used by SCALE. These uncertainties associated with nuclear data evaluations are compared to corresponding values developed in ISG-8 that are based on destructive assay data, as well as to values obtained using an alternate methodology that was developed by the Electric Power Research Institute based on reactor core simulation data.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Uncertainty Quantification and Comparison of Weld Residual Stress Measurements and Predictions.

In pressurized water reactors, the prevention, detection, and repair of cracks within dissimilar metal welds is essential to ensure proper plant functionality and safety. Weld residual stresses, which are difficult to model and cannot be directly measured, contribute to the formation and growth of cracks due to primary water stress corrosion cracking. Additionally, the uncertainty in weld residual stress measurements and modeling predictions is not well understood, further complicating the prediction of crack evolution. The purpose of this document is to develop methodology to quantify the uncertainty associated with weld residual stress that can be applied to modeling predictions and experimental measurements. Ultimately, the results can be used to assess the current state of uncertainty and to build confidence in both modeling and experimental procedures. The methodology consists of statistically modeling the variation in the weld residual stress profiles using functional data analysis techniques. Uncertainty is quantified using statistical bounds (e.g. confidence and tolerance bounds) constructed with a semi-parametric bootstrap procedure. Such bounds describe the range in which quantities of interest, such as means, are expected to lie as evidenced by the data. The methodology is extended to provide direct comparisons between experimental measurements and modeling predictions by constructing statistical confidence bounds for the average difference between the two quantities. The statistical bounds on the average difference can be used to assess the level of agreement between measurements and predictions. The methodology is applied to experimental measurements of residual stress obtained using two strain relief measurement methods and predictions from seven finite element models developed by different organizations during a round robin study.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

A Bayesian Approach for In-Situ Stress Prediction and Uncertainty Quantification for Subsurface Engineering

Many subsurface engineering applications require accurate knowledge of the in-situ state of stress for their safe design and operation. Existing methods to meet this need primarily include field measurements for estimating one or more of the principal stresses from a borehole, or optimization methods for constructing a 3D geomechanical model in terms of geophysical measurements. These methods, however, often contain considerable uncertainty in estimating the state of stress. Here, in this paper, we build on a Bayesian approach to quantify uncertainty in stress estimations for subsurface engineering applications. This approach can provide an estimate of the 3D distribution of stress throughout the volume of interest and provide an estimate of the uncertainty arising from the stress measurement, the rheology parameters, and a paucity of measurements. The value of this approach is demonstrated using stress measurements from the In Salah carbon storage site, which was one of the world’s first industrial carbon capture and storage projects. This demonstration shows the application of this Bayesian approach for estimating the initial state of stress for In Salah and quantifying the uncertainty in the estimated stress. Also, an assessment of a maximum injection pressure to prevent geomechanical risks from CO 2 injection pressures is provided in terms of the probability distribution of the minimum principal stress quantified by the approach. With the In Salah case study, this paper demonstrates that using the Bayesian approach can provide additional insights for site explorations and/or project operations to make informed-site decisions for subsurface engineering applications.

58 GEOSCIENCES↗

Model-Form Epistemic Uncertainty Quantification for Modeling with Differential Equations: Application to Epidemiology

Modeling real-world phenomena to any degree of accuracy is a challenge that the scientific research community has navigated since its foundation. Lack of information and limited computational and observational resources necessitate modeling assumptions which, when invalid, lead to model-form error (MFE). The work reported herein explored a novel method to represent model-form uncertainty (MFU) that combines Bayesian statistics with the emerging field of universal differential equations (UDEs). The fundamental principle behind UDEs is simple: use known equational forms that govern a dynamical system when you have them; then incorporate data-driven approaches – in this case neural networks (NNs) – embedded within the governing equations to learn the interacting terms that were underrepresented. Utilizing epidemiology as our motivating exemplar, this report will highlight the challenges of modeling novel infectious diseases while introducing ways to incorporate NN approximations to MFE. Prior to embarking on a Bayesian calibration, we first explored methods to augment the standard (non-Bayesian) UDE training procedure to account for uncertainty and increase robustness of training. In addition, it is often the case that uncertainty in observations is significant; this may be due to randomness or lack of precision in the measurement process. This uncertainty typically manifests as “noisy” observations which deviate from a true underlying signal. To account for such variability, the NN approximation to MFE is endowed with a probabilistic representation and is updated using available observational data in a Bayesian framework. By representing the MFU explicitly and deploying an embedded, data-driven model, this approach enables an agile, expressive, and interpretable method for representing MFU. In this report we will provide evidence that Bayesian UDEs show promise as a novel framework for any science-based, data-driven MFU representation; while emphasizing that significant advances must be made in the calibration of Bayesian NNs to ensure a robust calibration procedure.

97 MATHEMATICS AND COMPUTING↗

Uncertainty Quantification for Nuclear Safeguards and Non-Destructive Assay - Fact Sheet

UQ is the scientific art of generating confidence statements. Without defensible UQ physical measurements and calculations have no meaning. The UQ team performed a series of case studies with the following results: minimum detectable activity of a Tomographic Gamma-Ray Scanning system was determined using the Currie formalism. Bootstrapping method was used to generate fluorescence yield parameters and uncertainties. For Hybrid K-Edge Densitometry (HKED) measurements, these parameters can be used to predict the concentration of plutonium and quantify uncertainty in HKED models for nuclear safeguards measurements. Detection efficiency was determined for a coincidence counter using covariance data. The use of covariance information drastically reduced the total uncertainty in the average detection efficiency.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Uncertainty quantification in MELCOR Safety analysis of ARIES reactor designs

MELCOR-TMAP is a combined thermal-hydraulics and tritium tracking code developed to simulate severe accident scenarios in fission and fusion power plants. Here, we demonstrate the results of MELCOR-TMAP analyses on historical ARIES program reference designs. By coupling MELCOR-TMAP with the open source RAVEN probabilistic risk analysis framework’s Bayesian UQ capabilities, we also demonstrate key uncertainties in material properties with the highest impact on tritium inventory and plant risk.

70 - PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Model Comparison and Uncertainty Quantification for Geologic Carbon Storage. The Sim-SEQ Initiative

Sim-SEQ is a model comparison initiative for geologic carbon storage (GCS). In Sim-SEQ, fifteen different modeling teams are developing conceptual models for flow and transport of an injected CO 2 plume at the Sim-SEQ study site (or the S-3 site) located near Cranfield, Mississippi. The objective of the project is to understand the sources of model uncertainty in GCS, and if possible, to quantify these uncertainties through comparison of the different conceptual models and also through comparison with observed data from the S-3 site. In this paper, we compare six different conceptual models of the S-3 site, and present a preliminary uncertainty analysis of these six models using a generalized linear model approach. We show that differences in model conceptualization and interpretation of site characterization data caus a significant range in predictions.

54 ENVIRONMENTAL SCIENCES↗

Uncertainty quantification of the virial black hole mass with conformal prediction

Precise measurements of the black hole mass are essential to gain insight on the black hole and host galaxy co-evolution. A direct measure of the black hole mass is often restricted to nearest galaxies and instead, an indirect method using the single-epoch virial black hole mass estimation is used for objects at high redshifts. However, this method is subjected to biases and uncertainties as it is reliant on the scaling relation from a small sample of local active galactic nuclei. In this study, we propose the application of conformalized quantile regression (CQR) to quantify the uncertainties of the black hole predictions in a machine learning setting. We compare CQR with various prediction interval techniques and demonstrated that CQR can provide a more useful prediction interval indicator. In contrast to baseline approaches for prediction interval estimation, we show that the CQR method provides prediction intervals that adjust to the black hole mass and its related properties. That is it yields a tighter constraint on the prediction interval (hence more certain) for a larger black hole mass, and accordingly, bright and broad spectral line width source. Using a combination of neural network model and CQR framework, the recovered virial black hole mass predictions and uncertainties are comparable to those measured from the Sloan Digital Sky Survey. The code is publicly available.

79 ASTRONOMY AND ASTROPHYSICS↗

Geologic CO 2 sequestration monitoring design: A machine learning and uncertainty quantification based approach

Monitoring is a crucial aspect of geologic carbon dioxide (CO 2 ) sequestration risk management. Effective monitoring is critical to ensure CO 2 is safely and permanently stored throughout the life-cycle of a geologic CO 2 sequestration project. Effective monitoring involves deciding: (i) where is the optimal location to place the monitoring well(s), and (ii) what type of data (pressure, temperature, CO 2 saturation, etc.) should be measured taking into consideration the uncertainties at geologic sequestration sites. We have developed a filtering-based data assimilation procedure to design effective monitoring approaches. To reduce the computational cost of the filtering-based data assimilation process, a machine-learning algorithm: Multivariate Adaptive Regression Splines is used to derive computationally effcient reduced order models from results of full-physics numerical simulations of CO 2 injection in saline aquifer and subsequent multi-phase fluid flow. We use example scenarios of CO 2 leakage through legacy wellbore and demonstrate a monitoring strategy can be selected with the aim of reducing uncertainty in metrics related to CO 2 leakage. We demonstrate the proposed framework with two synthetic examples: a simple validation case and a more complicated case including multiple monitoring wells. The examples demonstrate that the proposed approach can be effective in developing monitoring approaches that take into consideration uncertainties.

58 GEOSCIENCES↗

Yearly Report for the Period Jan-Dec 2012: IC PROJECT W12c_earthuq - “High-Performance Computing for Uncertainty Quantification of 3D Earth Models”

This proposal was written to be a new project leveraging on computational achievements of the two IC11 proposals “3D Geophysical Modeling Validation” and “Time-Reversal Imaging of tremor sources”. W12c_earthuq involves additional codes/tools other than SPECFEM3D for data processing and planned a strong effort to move toward modeling at much larger scales than the aforementioned projects. W12c_earthuq goal was to use extensive HPC resources at LANL to assess the uncertainty of high resolution 3D geophysical models. Validation of these models as planned in W11_geophys is the first step in a full assessment of uncertainty. So, the scientific and programmatic impacts of this project are the same as W11_geophys. The main effort related to w12c_earthuq is the preparation to transition to large runs with a resolution down to 2s. We already report the work done in the report for w11_geophys. Such resolution requires meshes with 10 billions elements with a size of about 5km and a few thousands of compute nodes. First tests on mustang have revealed that the I/O part of the code need to be reviewed because it opens too many files in its current version.

58 GEOSCIENCES↗

Science Based Stockpile Stewardship, Uncertainty Quantification, and Surrogate Reactions

Stewardship of this nation's nuclear weapons is predicated on developing a fundamental scientific understanding of the physics and chemistry required to describe weapon performance without the need to resort to underground nuclear testing and to predict expected future performance as a result of intended or unintended modifications. In order to construct more reliable models, underground nuclear test data is being reanalyzed in novel ways. To improve the interpretation of these experiments with quantified uncertainties, improved nuclear data is required. As an example, the thermonuclear yield of a device was often inferred through the use of radiochemical detectors. Conversion of the detector activations observed to thermonuclear yield was accomplished through explosion code calculations (models) and a good set of nuclear reaction cross-sections. Because of the unique high-fluence environment of an exploding nuclear weapon, many reactions occurred on radioactive nuclides, for which only theoretically calculated cross-sections are available. Surrogate nuclear reactions at STARS/LIBERACE offer the opportunity to measure cross-sections on unstable nuclei and thus improve the quality of the nuclear reaction cross-section sets. One radiochemical detector that was loaded in devices was mono-isotopic yttrium ({sup 89}Y). Nuclear reactions produced {sup 87}Y and {sup 88}Y which could be quantified post-shot as a ratio of {sup 87}Y/{sup 88}Y. The yttrium cross-section set from 1988 is shown in Figure 1(a) and contains approximately 62 cross-sections interconnecting the yttrium nuclides. The 6 experimentally measured cross-sections are shown in Figure 1(b). Any measurement of cross-sections on {sup 87}Y or {sup 88}Y would improve the quality of the cross-section set. A recent re-evaluation of the yttrium cross-section set was performed with many more calculated reaction cross-sections included.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗