Search NASA⌕ Search

SEARCH · Search NASA

Results for “Uncertainty Quantification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Yttrium solid phase equation of state with uncertainty quantification

We discuss the development of an equation of state (EOS) for solid yttrium up to roughly 80 GPa. The EOS makes use of different experimental datasets, including measurements of the isobaric density, isobaric specific heat, room temperature isotherm, and principal shock Hugoniot. The fitting procedure is carried out using Markov Chain Monte Carlo (MCMC), where we fit model parameters for both the cold curve and ion thermal models simultaneously. The results show close agreement with experimental data and provide meaningful uncertainty estimates on the model parameters. This work serves as a first step towards a multiphase EOS for yttrium, which will include higher pressure solid phases (> 80 GPa), as well as modeling of the liquid phase.

36 MATERIALS SCIENCE↗
NASA NTRSDate not supplied

Uncertainty Quantification of Classical Theories of Dendritic Growth Kinetics Applied to Nickel-Based Alloys

The solidification velocity in a model nickel-alloy single crystal during laser spot melting was recently characterized using synchrotron X-ray imaging. The measured solidification velocity was found to exceed the absolute stability threshold predicted by the Kurz-Giovanola-Trivedi (KGT) model. The discrepancies between the model and experiments motivate the further assessment of accurate material properties. This work quantifies the impact material property uncertainty has on model predictions of the absolute stability threshold velocities. Properties from the literature are reviewed and compared to those calculated using computational thermodynamics to provide uncertainty estimates on input properties to the KGT model. Global sensitivity analysis is used to quantify the influence of each uncertain input property on the predicted threshold velocity. This work supports the understanding of the nickel-alloy solidification during powder bed fusion additive manufacturing and identifies the solidification material properties that are the most important to assess from first-principles computations and experiments.

Computational thermodynamics↗
DOE OSTI2022

Uncertainty quantification in breakup reactions

Breakup reactions are one of the favored probes to study loosely bound nuclei, particularly those in the limit of stability forming a halo. In order to interpret such breakup experiments, the continuum discretized coupled channel method is typically used. In this study, the first Bayesian analysis of a breakup reaction model is performed. Herein we use a combination of statistical methods together with a three-body reaction model (the continuum discretized coupled channel method) to quantify the uncertainties on the breakup observables due to the parameters in the effective potential describing the loosely bound projectile of interest. The combination of tools we develop opens the path for a Bayesian analysis of not only breakup processes, but also a wide array of complex processes that require computationally intensive reaction models.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Daily Forecasting of Regional Epidemics of Coronavirus Disease with Bayesian Uncertainty Quantification, United States

To increase situational awareness and support evidence-based policymaking, we formulated a mathematical model for coronavirus disease transmission within a regional population. This compartmental model accounts for quarantine, self-isolation, social distancing, a nonexponentially distributed incubation period, asymptomatic persons, and mild and severe forms of symptomatic disease. We used Bayesian inference to calibrate region-specific models for consistency with daily reports of confirmed cases in the 15 most populous metropolitan statistical areas in the United States. We also quantified uncertainty in parameter estimates and forecasts. This online learning approach enables early identification of new trends despite considerable variability in case reporting.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Integrated Tiger Series (ITS) Code Validation and Uncertainty Quantification for Electron Number Albedo in Various Materials

In the 1970’s and 1980’s, researchers at Sandia National Laboratories produced electron albedo data for a range of materials. Since that time, the electron albedo data has been used for a wide variety of purposes including the validation of Monte Carlo electron transport codes. This report was compiled to examine the electron albedo experiment results in the context of Integrated Tiger Series (ITS) validation. The report presents tables and figures that could provide insight into the underlying model form uncertainty present in the ITS code. Additionally, the report provides data on potential means to reduce these model form errors by highlighting potential refinements in the cross-section generation process.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Uncertainty Quantification of Fatigue Behavior of Rough AM Surfaces and Microstructures to Enable Hydrogen Gas Turbine Combustion

Modification of fossil-fueled industrial gas turbines to accept no/low carbon fuels (Hydrogen, H2/natural gas blends) is a significant undertaking. Successful deployment of this technology sits at the intersection of three design criteria (1) new functional fuel injectors that can burn these fuels, (2) manufacturability to meet cost and time-to-market targets, and (3) durability in the harsh environment of an operating turbine. Additive manufacturing (AM) provides accelerated product development. However, uncertainty remains around the durability of parts with rough AM surfaces. A fully experimental approach towards quantifying fatigue performance of rough AM microstructures is costly and laborious. Instead, Solar Turbines Incorporated (Solar) proposes the use of a crystal plasticity finite element (CPFE) model to quantify the factors that drive AM surface fatigue behavior. Solar will use the CPFE results, along with targeted experimental data, to train a computationally efficient surrogate model that can be incorporated into existing turbine part lifing methods.

08 HYDROGEN↗
DOE OSTI2022

Reactivity initiated accident uncertainty quantification for fuel assembly with subchannel code

UNIST CORE lab has developed a multiphysics coupling framework (MPCORE) consisting of Neutronics, Thermal Hydraulics and Fuel Performance modules. It can accommodate one-dimensional as well as sub-channel code Thermal Hydraulics (TH) module. Generally, running a transient requires more computational power due to the convergence of modules with each other. The difference between one-dimensional and sub-channel TH modules is studied in this research for a Reactivity Initiated Accident (RIA). Both TH modules are compared for a RIA uncertainty propagation in a single VERA fuel assembly with 2.11% enrichment. MPCORE is capable of analyzing the transient at any burnup point but for current work, only fresh fuel has been considered. The results have been obtained using dynamic gap heat conductance in FRAPTRAN. Peak centerline temperature, fuel enthalpy and DNBR are compared for both the approaches. The results indicate that the use of sub-channel code lead to greater safety margin for critical parameters. Computation time comparison is also presented for both the cases. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2019

Uncertainty Quantification on SAM Simulations of EBR-II Loss-of-Flow Tests

The System Analysis Module (SAM) is a modern system analysis tool being developed at Argonne National Laboratory for advanced non-LWR safety analysis. It aims to provide fast-running, whole-plant transient analyses capability with improved-fidelity for SFR, LFR, and MSR/FHR. In prior work, SAM has performed well in modeling the EBR-II benchmark based on the SHRT-17 and SHRT-45R protected and unprotected loss-of-flow experiments. However, underlying uncertainties in the modeling parameters need to be quantified to gain confidence in any best-estimate simulations. In this work, a Python coupling framework between Dakota and SAM has been developed to investigate these uncertainties, alongside code enhancements in SAM for user-flexibility in perturbing physical closure models and fluid equations of state. 25 significant input parameters covering boundary conditions, geometry, physical closure models, and equations of state were identified with their uncertainties defined from literature. Two SAM transient models for SHRT-17 and SHRT-45R were perturbed on these input parameters using Latin Hypercube Sampling and the uncertainties in predicted maximum fuel, cladding, and coolant temperatures were quantified as the output responses. Spearman rank correlation of input parameters to the predicted temperatures indicated that the most sensitive parameters include the initial core power, pipe wall drag, fuel & coolant conductivity, and peak channel flow area. Sensitivity of input parameters was found to differ between the two transients and core channel modeling strategies. The overall perturbations did not result in large uncertainties in the predicted temperatures, despite the efforts made to obtain accurate yet conservative input uncertainties.

Mui, Travis↗
NASA NTRS2016

Progress of Aircraft System Noise Assessment with Uncertainty Quantification for the Environmentally Responsible Aviation Project

Aircraft system noise predictions have been performed for NASA modeled hybrid wing body aircraft advanced concepts with 2025 entry-into-service technology assumptions. The system noise predictions developed over a period from 2009 to 2016 as a result of improved modeling of the aircraft concepts, design changes, technology development, flight path modeling, and the use of extensive integrated system level experimental data. In addition, the system noise prediction models and process have been improved in many ways. An additional process is developed here for quantifying the uncertainty with a 95% confidence level. This uncertainty applies only to the aircraft system noise prediction process. For three points in time during this period, the vehicle designs, technologies, and noise prediction process are documented. For each of the three predictions, and with the information available at each of those points in time, the uncertainty is quantified using the direct Monte Carlo method with 10,000 simulations. For the prediction of cumulative noise of an advanced aircraft at the conceptual level of design, the total uncertainty band has been reduced from 12.2 to 9.6 EPNL dB. A value of 3.6 EPNL dB is proposed as the lower limit of uncertainty possible for the cumulative system noise prediction of an advanced aircraft concept.

Thomas, Russell H.↗
NASA NTRSDate not supplied

Comparison of Entry Descent and Landing Aerodynamic Databases with Uncertainty Quantification Developed Using Machine Learning Techniques

When developing the aerodynamic databases for use in trajectory simulations, it is important to develop a system of metrics to qualify which aerodynamic models are best to use. Since aerodynamics are just one input into trajectory simulations, the results of these simulations do not reflect on the quality of the aerodynamic database used. This means that aerodynamic database comparisons must be done offline. While traditional metrics that focus on mean/nominal predictions are a good first step, more robust estimates of the prediction interval become important as more focused uncertainty models are developed. We explore the limitations of evaluating aerodynamic models based purely on nominal-centered response surfaces. Before elaborating and evaluating metrics based on distributed models, the value of evaluating prediction interval and confidence interval are discussed to conclude that prediction intervals are more relevant to the use of trajectory analysis. Several metrics to evaluate the prediction interval are introduced with a focus on the standard calibration metric. Finally, we compare candidate models using both mean and distributed metrics. A finalized candidate model developed using state of the art machine learning methods is compared to a baseline model developed using traditional aerodynamic database modeling techniques.

Aerodynamic Database↗
DOE OSTI2019

Second-order statistical bootstrap for the uncertainty quantification of time-temperature-superposition analysis

Time-temperature superposition (TTS), which for decades has been a powerful method for long-term prediction from accelerated aging data, involves rigid-shifting isotherms in logarithmic time to produce a single master prediction curve. For simple thermo-rheological properties that accurately follow the TTS principle, the shifts can be easily determined, even manually by the eye. However, for many properties of interest, where the principle is obeyed only approximately, or the data is noisy, it is imperative to develop objective shifting techniques along with reliable uncertainty bounds. This work analyzes in detail the method of arclength-minimization as an unsupervised algorithm to determining optimum shifts and demonstrates that the method is nearly unbiased for all practical datasets with a variety of noise distributions. Moreover, if averaged over with-replacement (bootstrap) resamples, the predicted shifts follow a normal distribution, a fact that can be used to construct confidence interval for the master curve through a second-order bootstrap procedure.

36 MATERIALS SCIENCE↗
DOE OSTI2018

Low energy peripheral scaling in nucleon–nucleon scattering and uncertainty quantification

We analyze the peripheral structure of the nucleon–nucleon interaction for LAB energies below 350 MeV. To this end we transform the scattering matrix into the impact parameter representation by analyzing the scaled phase shifts (L + 1/2) δ JLS (p) and the scaled mixing parameters (L + 1/2)ϵ JLS (p) in terms of the impact parameter b = (L + 1/2)/p. According to the eikonal approximation, at large angular momentum L these functions should become an universal function of b, independent on L. This allows to discuss in a rather transparent way the role of statistical and systematic uncertainties in the different long range components of the two-body potential. Implications for peripheral waves obtained in chiral perturbation theory interactions to fifth order (N5LO) or from the large body of NN data considered in the SAID partial wave analysis are also drawn from comparing them with other phenomenological high-quality interactions, constructed to fit scattering data as well. Here, we find that both N5LO and SAID peripheral waves disagree more than 5σ with the Granada-2013 statistical analysis, more than 2σ with the 6 statistically equivalent potentials fitting the Granada-2013 database and about 1σ with the historical set of 13 high-quality potentials developed since the 1993 Nijmegen analysis.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS2016

Performance Metrics, Error Modeling, and Uncertainty Quantification

A common set of statistical metrics has been used to summarize the performance of models or measurements-­ the most widely used ones being bias, mean square error, and linear correlation coefficient. They assume linear, additive, Gaussian errors, and they are interdependent, incomplete, and incapable of directly quantifying un­certainty. The authors demonstrate that these metrics can be directly derived from the parameters of the simple linear error model. Since a correct error model captures the full error information, it is argued that the specification of a parametric error model should be an alternative to the metrics-based approach. The error-modeling meth­odology is applicable to both linear and nonlinear errors, while the metrics are only meaningful for linear errors. In addition, the error model expresses the error structure more naturally, and directly quantifies uncertainty. This argument is further explained by highlighting the intrinsic connections between the performance metrics, the error model, and the joint distribution between the data and the reference.

Quantification↗
DOE OSTI2020

Reconstruction and uncertainty quantification of lattice Hamiltonian model parameters from observations of microscopic degrees of freedom

The emergence of scanning probe and electron beam imaging techniques has allowed quantitative studies of atomic structure and minute details of electronic and vibrational structure on the level of individual atomic units. These microscopic descriptors, in turn, can be associated with local symmetry breaking phenomena, representing the stochastic manifestation of the underpinning generative physical model. In this work, we explore the reconstruction of exchange integrals in the Hamiltonian for a lattice model with two competing interactions from observations of microscopic degrees of freedom and establish the uncertainties and reliability of such analysis in a broad parameter-temperature space. In contrast to other approaches, we specifically specify a loss function inherent to thermodynamic systems and utilize it to estimate uncertainty in simulated realizations of different models. As an ancillary task, we develop a machine learning approach based on histogram clustering to predict phase diagrams efficiently using a reduced descriptor space. We further demonstrate that reconstruction is possible well above the phase transition and in the regions of parameter space when the macroscopic ground state of the system is poorly defined due to frustrated interactions. This suggests that this approach can be applied to the traditionally complex problems of condensed matter physics such as ferroelectric relaxors and morphotropic phase boundary systems, spin and cluster glasses, and quantum systems once the local descriptors linked to the relevant physical behaviors are known.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2023

Constraining Bedrock Groundwater Residence Times in a Mountain System With Environmental Tracer Observations and Bayesian Uncertainty Quantification

Groundwater residence time distributions provide fundamental insights on the hydrological processes within watersheds. Yet, observations that can constrain groundwater residence times over broad timescales remain scarce in mountain catchment studies. We use environmental tracers (CFC-12, SF 6 , 3 H, and 4 He) to investigate groundwater residence times along a hillslope in the East River Watershed, Colorado, USA. We develop a Bayesian inference framework that applies a Markov-chain Monte Carlo (MCMC) approach to estimate noble gas recharge temperature, elevation, and excess-air parameters and the resulting environmental tracer concentrations. MCMC is then used to propagate the environmental tracer uncertainties to estimates of groundwater mean residence times inferred with lumped parameter models. All samples contain 3 H, CFC-12, and SF 6 in addition to terrigenic 4 He, suggesting a mixture of water characterized by modern and premodern residence times. 4He exponential mean residence times range from hundreds of years at the upslope well to thousands of years at the toe-slope well assuming average crustal production rates. We find that binary mixing residence time distributions with separate young and old mixing fractions are needed to predict the 4 He, CFC-12, SF 6 , and 3 H observations, supporting the importance of flow path mixing in this bedrock system. Our findings that the fractured bedrock hosts groundwater with a mixture of residence times ranging from decades to millennia suggest variable recharge dynamics and flow path mixing along the hillslope and highlight the importance of characterizing groundwater systems with observations that are sensitive to transport over a broad range of residence times.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2018

Parallel multiple-chain DRAM MCMC for large-scale geosteering inversion and uncertainty quantification

Geosteering is the proactive control of a wellbore placement based on the downhole measurements, aiming at maximizing economic production from the well. We report the recent development of azimuthal resistivity logging-whiledrilling (LWD) tools have a much larger depth of detection, thus sets higher demands for geosteering inversion as more unknown parameters need to be taken into account in the earth model to be inverted. For complicated nonlinear problems, traditional deterministic inversion methods are more likely to be trapped near local optima. In general, Markov chain Monte Carlo (MCMC) inversion methods are more capable of finding the global optimal solution and providing additional uncertainty analyses by sampling from the target distribution. However, MCMC methods usually have the problem of slow convergence. Even though optimization methods like delayed rejection (DR) and adaptive Metropolis (AM) were proposed to speed up the convergence, using MCMC methods to solve geosteering inversion problems may still incur unacceptable time cost. To reduce the sampling cost of MCMC methods, we use parallel multiple-chain DRAM MCMC methods to solve geosteering inverse problems and estimate the corresponding uncertainty. A clustering method, density-based spatial clustering of applications with noise (DBSCAN), is applied to select the best solution among many results. Lastly, the simulation results show that running many relatively short MCMC chains for one problem can obtain a similar result as running a long single chain. Besides, avoiding communications between multiple Markov chains during the sampling process yields almost linear scalability.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Probabilistic Programming for Transportable Source Characterization and Uncertainty Quantification of the North Korean Nuclear Tests 2006–2017

Here, we introduce a transportable technique to determine the yield and depth of burial (DOB) from seismic source spectra of underground nuclear explosions. We demonstrate this technique on the six declared North Korean nuclear tests. This approach derives source spectra in absolute units from regional phase (Pg) amplitudes by correcting the observations for geometric spreading, attenuation, and site amplification. We couple the source spectra and explosion source models with a probabilistic programming framework that integrates deep learning techniques and Bayesian modeling. This approach permits the exchange of information across various data categories to quantify both the data and model uncertainty. This technique stands out as an innovative use of broad‐area propagation models, making it transportable across various geologic settings. This method proves to be effective in scenarios with diverse and/or limited observational data, even when the source depth is unknown. We present new independent estimates of absolute yield and DOB that are consistent with the prior assessments, underscoring the potential of this method in enhancing transportable nuclear explosion monitoring capabilities.

58 GEOSCIENCES↗
DOE OSTI2021

Machine learning based algorithms for uncertainty quantification in numerical weather prediction models

Complex numerical weather prediction models incorporate a variety of physical processes, each described by multiple alternative physical schemes with specific parameters. The selection of the physical schemes and the choice of the corresponding physical parameters during model configuration can significantly impact the accuracy of model forecasts. There is no combination of physical schemes that works best for all times, at all locations, and under all conditions. It is therefore of considerable interest to understand the interplay between the choice of physics and the accuracy of the resulting forecasts under different conditions. This paper demonstrates the use of machine learning techniques to study the uncertainty in numerical weather prediction models due to the interaction of multiple physical processes. The first problem addressed herein is the estimation of systematic model errors in output quantities of interest at future times, and the use of this information to improve the model forecasts. The second problem considered is the identification of those specific physical processes that contribute most to the forecast uncertainty in the quantity of interest under specified meteorological conditions. In order to address these questions we employ two machine learning approaches, random forests and artificial neural networks. The discrepancies between model results and observations at past times are used to learn the relationships between the choice of physical processes and the resulting forecast errors. Numerical experiments are carried out with the Weather Research and Forecasting (WRF) model. The output quantity of interest is the model precipitation, a variable that is both extremely important and very challenging to forecast. The physical processes under consideration include various micro-physics schemes, cumulus parameterizations, short wave, and long wave radiation schemes. The experiments demonstrate the strong potential of machine learning approaches to aid the study of model errors.

97 MATHEMATICS AND COMPUTING↗