Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian parameter estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

Impacts of Observational Constraints Related to Sea Level on Estimates of Climate Sensitivity

Reduced complexity climate models are necessary tools for quantifying decision-relevant uncertainties, given their flexibility, computational efficiency, and suitability for large-ensemble frameworks necessary for statistical estimation using resampling techniques (e.g. Markov chain Monte Carlo—MCMC). Here we document a new version of the simple, open-source, global climate model Hector, coupled with a one-dimensional diffusive heat and energy balance model (Diffusion Ocean Energy balance CLIMate model; DOECLIM) and a sea-level change module (Building blocks for Relevant Ice and Climate Knowledge; BRICK) that also represents contributions from thermal expansion, glaciers and ice caps, and polar ice sheets. We apply a Bayesian calibration approach to quantify model uncertainties surrounding 39 model parameters with prescribed radiative forcing, using observational information from global surface temperature, ocean heat uptake, and sea-level change. Furthermore, we find sea-level change as an observational constraint sharpens inference for the upper tail of posterior climate sensitivity estimates (the 97.5 percentile is tightened from 6.5 K to 5.3 K). The addition of sea-level change as an observational constraint also has implications for probabilistic projections of global surface temperature (the 97.5 percentile for RCP8.5 2100 temperature decreases 0.3 K) and sea-level rise (the 97.5 percentile for RCP8.5 2100 sea level decreases 0.5 m).

54 ENVIRONMENTAL SCIENCES↗

B-DeepONet: An enhanced Bayesian DeepONet for solving noisy parametric PDEs using accelerated replica exchange SGLD

Here, the Deep Operator Network (DeepONet) is a neural network architecture used to approximate operators, including the solution operator of parametric PDEs. DeepONets have shown remarkable approximation ability. However, the performance of DeepONets deteriorates when the training data is polluted with noise, a scenario that occurs in practice. To handle noisy data, we propose a Bayesian DeepONet based on replica exchange Langevin diffusion (reLD). Replica exchange uses two particles. The first particle trains a DeepONet to exploit the loss landscape and make predictions. The other particle trains a different DeepONet to explore the loss landscape and escape local minima via swapping. Compared to DeepONets trained with state-of-the-art gradient-based algorithms (e.g., Adam), the proposed Bayesian DeepONet greatly improves the training convergence for noisy scenarios and accurately estimates the uncertainty. To further reduce the high computational cost of the reLD training of DeepONets, we propose (1) an accelerated training framework that exploits the DeepONet's architecture to reduce its computational cost up to 25% without compromising performance and (2) a transfer learning strategy that accelerates training DeepONets for PDEs with different parameter values. Finally, we illustrate the effectiveness of the proposed Bayesian DeepONet using four parametric PDE problems.

97 MATHEMATICS AND COMPUTING↗

Neural message-passing for objective-based uncertainty quantification and optimal experimental design

Various real-world scientific applications involve the mathematical modeling of complex uncertain systems with numerous unknown parameters. Accurate parameter estimation is often practically infeasible in such systems, as the available training data may be insufficient and the cost of acquiring additional data may be high. In such cases, based on a Bayesian paradigm, we can design robust operators retaining the best overall performance across all possible models and design optimal experiments that can effectively reduce uncertainty to enhance the performance of such operators maximally. While objective-based uncertainty quantification (objective-UQ) based on MOCU (mean objective cost of uncertainty) provides an effective means for quantifying uncertainty in complex systems, the high computational cost of estimating MOCU has been a challenge in applying it to real-world scientific/engineering problems. In this work, we propose a novel scheme to reduce the computational cost for objective-UQ via MOCU based on a data-driven approach. We adopt a neural message-passing model for surrogate modeling, incorporating a novel axiomatic constraint loss that penalizes an increase in the estimated system uncertainty. As an illustrative example, we consider the optimal experimental design (OED) problem for uncertain Kuramoto models, where the goal is to predict the experiments that can most effectively enhance robust synchronization performance through uncertainty reduction. We show that our proposed approach can accelerate MOCU-based OED by four to five orders of magnitude, without any visible performance loss compared to the state-of-the-art. The proposed approach applies to general OED tasks, beyond the Kuramoto model.

97 MATHEMATICS AND COMPUTING↗

Stochastic Filtering of Rain Profiles Using Radar, Surface-Referenced Radar, or Combined Radar-Radiometer Measurements

This paper describes a computationally efficient nearly optimal Bayesian algorithm to estimate rain (and drop size distribution) profiles, given a radar reflectivity profile at a single attenuating wavelength. In addition to estimating the averages of all the mutually ambiguous combinations of rain parameters that can produce the data observed, the approach also calculates the n-ns uncertainty in its estimates (this uncertainty thus quantifies "the amount of ambiguity" in the "solution"). The paper also describes a more general approach that can make estimates based on a radar reflectivity profile together with an approximate measurement of the path-integrated attenuation, or a radar reflectivity profile and a set of passive microwave brightness temperatures. This more general "combined" algorithm is currently being adapted for the Tropical Rainfall Measuring Mission.

Haddad, Ziad S.↗

A Measurement of νe Appearance and νµ Disappearance Using 10 Years of Data from the NOvA Experiment

NOvA is a long baseline neutrino experiment with an 810 km baseline, using the NuMIbeam at Fermilab, and a functionally identical near and far detector operating at an angle14 mrad off axis from the beam. NOvA jointly measures muon neutrino (and antineutrino)disappearance and electron neutrino (and antineutrino) appearance to make a measurementof sin2θ23, δCP, and ∆m232, including its sign, the mass ordering.This dissertation reports a new measurement from NOvA, using 10 years of data, with a totalexposure of 26.6 ×1020 POT of neutrino beam and 12.5 ×1020 POT of antineutrino beam.This represents 95.6% more neutrino beam exposure since the last NOvA analysis. Aspects ofthe analysis are discussed in detail, including neutrino energy estimation, analysis systematicuncertainties, including the implementation of systematics new to the NOvA analysis, andthe Bayesian fit infrastructure using Markov Chain Monte Carlo (MCMC).The analysis yields the following credible intervals for the oscillation parameters assumingthe normal ordering: δCP = 0.930+0.210−0.290 π ∪0.150+0.150−0.110 π,∆m232 = 2.424+0.035−0.040 × 10−3eV2,and sin2θ23 = 0.55+0.02−0.06, with a 76% preference for normal ordering using a prior for sin2(2θ13)using Daya Bay’s measurement. If the Daya Bay sin2(2θ13) vs ∆m232 constraint is used as aprior instead, an 87% preference for normal ordering emerges.

43 PARTICLE ACCELERATORS↗

MLUQ (Uncertainty quantification for ML closure models) [SWR-24-36]

Data-based closure models are increasingly being used to replace physic-based closure models because of their flexibility and the growing availability of data. However, closure models are subject to uncertainty because of lack of data in parts of the input space (epistemic uncertainty) or because of noise in the data (aleatoric uncertainty). This software contains a toolbox for training bayesian neural nets that can estimate both uncertainties. A specific treatment is provided to ensure accuracy outside of the data distribution. A set of tools are provided to reduce the dimensionality of the uncertain parameter space, thereby enabling fast uncertainty propagation.

Hassanaly, Malik↗

Daily Forecasting of Regional Epidemics of Coronavirus Disease with Bayesian Uncertainty Quantification, United States

To increase situational awareness and support evidence-based policymaking, we formulated a mathematical model for coronavirus disease transmission within a regional population. This compartmental model accounts for quarantine, self-isolation, social distancing, a nonexponentially distributed incubation period, asymptomatic persons, and mild and severe forms of symptomatic disease. We used Bayesian inference to calibrate region-specific models for consistency with daily reports of confirmed cases in the 15 most populous metropolitan statistical areas in the United States. We also quantified uncertainty in parameter estimates and forecasts. This online learning approach enables early identification of new trends despite considerable variability in case reporting.

59 BASIC BIOLOGICAL SCIENCES↗

Deep Learning and Uncertainty Quantification for Climate Resilience

Modeling and monitoring of earth’s processes through physical models and satellite observations at high resolutions is crucial for ensuring society’s ability to adapt to climate change. Deep learning (DL) has been shown to be a valuable tool for generating high resolution data, emulating physical models, and detecting weather patterns which can then be used to inform stakeholders and decision makers. However, both the data and model parameters contain substantial uncertainties that may alter users’ decisions. In this work we present two DL applications on high-resolution climate and satellite datasets using Bayesian neural networks to generate well calibrated uncertainty estimates.

Vandal, Thomas↗

Uncertainty quantification for nuclear density functional theory and information content of new measurements

Statistical tools of uncertainty quantification can be used to assess the information content of measured observables with respect to present-day theoretical models, to estimate model errors and thereby improve predictive capability, to extrapolate beyond the regions reached by experiment, and to provide meaningful input to applications and planned measurements. To showcase new opportunities offered by such tools, we make a rigorous analysis of theoretical statistical uncertainties in nuclear density functional theory using Bayesian inference methods. By considering the recent mass measurements from the Canadian Penning Trap at Argonne National Laboratory, we demonstrate how the Bayesian analysis and a direct least-squares optimization, combined with high-performance computing, can be used to assess the information content of the new data with respect to a model based on the Skyrme energy density functional approach. Employing the posterior probability distribution computed with a Gaussian process emulator, we apply the Bayesian framework to propagate theoretical statistical uncertainties in predictions of nuclear masses, two-neutron dripline, and fission barriers. Overall, we find that the new mass measurements do not impose a constraint that is strong enough to lead to significant changes in the model parameters. In addition, the example discussed in this study sets the stage for quantifying and maximizing the impact of new measurements with respect to current modeling and guiding future experimental efforts, thus enhancing the experiment-theory cycle in the scientific method.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Integrating GLL-Weibull Distribution Within a Bayesian Framework for Life Prediction of Shape Memory Alloy Spring Undergoing Thermo-mechanical Fatigue

The present paper tackles an important but unmapped problem of the reliability estimations of smart materials. First, an experimental setup is developed for accelerated life testing of the shape memory alloy (SMA) springs. Generalized log-linear Weibull (GLL-Weibull) distribution-based novel approach is then developed for SMA spring life estimation. Applied stimulus (voltage), elongation and cycles of operation are used as inputs for the life prediction model. The values of the parameter coefficients of the model provide better interpretability compared to artificial intelligence based life prediction approaches. In addition, the model also considers the effect of operating conditions, making it generic for a range of the operating conditions. Moreover, a Bayesian framework is used to continuously update the prediction with the actual degradation value of the springs, thereby reducing the uncertainty in the data and improving the prediction accuracy. In addition, the deterioration of material with number of cycles is also investigated using thermogravimetric analysis and scanning electron microscopy.

36 MATERIALS SCIENCE↗

FIVE-YEAR WILKINSON MICROWAVE ANISOTROPY PROBE (WMAP) OBSERVATIONS: BAYESIAN ESTIMATION OF COSMIC MICROWAVE BACKGROUND POLARIZATION MAPS

We describe a sampling method to estimate the polarized cosmic microwave background (CMB) signal from observed maps of the sky. We use a Metropolis-within-Gibbs algorithm to estimate the polarized CMB map, containing Q and U Stokes parameters at each pixel, and its covariance matrix. These can be used as inputs for cosmological analyses. The polarized sky signal is parameterized as the sum of three components: CMB, synchrotron emission, and thermal dust emission. The polarized Galactic components are modeled with spatially varying power-law spectral indices for the synchrotron, and a fixed power law for the dust, and their component maps are estimated as by-products. We apply the method to simulated low-resolution maps with pixels of side 7.2 deg, using diagonal and full noise realizations drawn from the WMAP noise matrices. The CMB maps are recovered with goodness of fit consistent with errors. Computing the likelihood of the E-mode power in the maps as a function of optical depth to reionization, {tau}, for fixed temperature anisotropy power, we recover {tau} = 0.091 {+-} 0.019 for a simulation with input {tau} = 0.1, and mean {tau} = 0.098 averaged over 10 simulations. A 'null' simulation with no polarized CMB signal has maximum likelihood consistent with {tau} = 0. The method is applied to the five-year WMAP data, using the K, Ka, Q, and V channels. We find {tau} = 0.090 {+-} 0.019, compared to {tau} = 0.086 {+-} 0.016 from the template-cleaned maps used in the primary WMAP analysis. The synchrotron spectral index, {beta}, averaged over high signal-to-noise pixels with standard deviation {sigma}({beta}) < 0.25, but excluding {approx}6% of the sky masked in the Galactic plane, is -3.03 {+-} 0.04. This estimate does not vary significantly with Galactic latitude, although includes an informative prior.

79 ASTRONOMY AND ASTROPHYSICS↗

Rest-Frame UV and Optical Emission Line Diagnostics of Ionized Gas Properties: a Test Case in a Star-Forming Knot of a Lensed Galaxy at Z ∼ 1.7

We examine the diagnostic power of rest-frame ultraviolet (UV) nebular emission lines, and compare them to more commonly used rest-frame optical emission lines, using the test case of a single star-forming knot of the bright lensed galaxy RCSGA 032727–132609 at redshift z ∼ 1.7. This galaxy has complete coverage of all the major rest-frame UV and optical emission lines from Magellan/MagE and Keck/NIRSPEC. Using the full suite of diagnostic lines, we infer the physical properties: nebular electron temperature (T(sub e)), electron density (n(sub e)), oxygen abundance (log (O/H), ionization parameter [log (q), and interstellar medium (ISM) pressure (log (P/k)]. We examine the effectiveness of the different UV, optical, and joint UV–optical spectra in constraining the physical conditions. Using UV lines alone we can reliably estimate log (q), but the same is difficult for log (O/H). UV lines yield a higher (∼1.5 dex) log (P/k) than the optical lines, as the former probes a further inner nebular region than the latter. For this comparison, we extend the existing Bayesian inference code IZI, adding to it the capability to infer ISM pressure simultaneously with metallicity and ionization parameter. This work anticipates future rest-frame UV spectral data sets from the James Webb Space Telescope (JWST) at high redshift and from the Extremely Large Telescope (ELT) at moderate redshift.

Acharyya, Ayan↗

Probabilistic Calibration of Expensive Models using Efficiently Trained Surrogates

Calibration of computational models in the presence of uncertainty is often cast as a Bayesian inference problem and solved via sampling methods, e.g., Markov chain Monte Carlo. When the computational model is expensive, this task becomes intractable due to the large number of samples required to accurately estimate the posterior distribution of the calibration parameters. A popular solution to this problem is to use machine learning to develop a faster-to-evaluate, lower-fidelity substitute for the original model to serve as a surrogate while solving the inference problem. Although considered an offline cost, generating training data to construct this surrogate model can still be an expensive task in practice. An active learning algorithm is presented that focuses training on improving surrogate accuracy specifically in and around the bulk of the posterior distribution, as this is where the model is exercised during calibration. Candidate samples are drawn from families of distributions related to an approximation of the posterior. The sample maximizing predictive variance is then selected for evaluation by the original computational model, yielding a label for the training point. Iterating this approach increases efficiency relative to space filling designs (e.g., Latin hypercube sampling) by avoiding low probability points. Practical considerations are discussed, including the benefits of using a sequential Monte Carlo sampling approach, convergence heuristics, and the importance of both exploration and exploitation given that the true posterior is unknown a priori.

uncertainty quantification↗

OGLE-2013-BLG-1761Lb: A Massive Planet around an M/K Dwarf

We report the discovery and the analysis of the planetary microlensing event, OGLE-2013-BLG-1761. There are some degenerate solutions in this event because the planetary anomaly is only sparsely sampled. However, the detailed light-curve analysis ruled out all stellar binary models and shows the lens to be a planetary system. There is the so-called close/wide degeneracy in the solutions with the planet/host mass ratio of q ∼ (7.0 ± 2.0) × 10{sup −3} and q ∼ (8.1 ± 2.6) × 10{sup −3} with the projected separation in Einstein radius units of s = 0.95 (close) and s = 1.18 (wide), respectively. The microlens parallax effect is not detected, but the finite source effect is detected. Our Bayesian analysis indicates that the lens system is located D{sub L}=6.9{sub −1.2}{sup +1.0} kpc away from us and the host star is an M/K dwarf with a mass of M{sub L}=0.33{sub −0.19}{sup +0.32} M{sub ⊙} orbited by a super-Jupiter mass planet with a mass of m{sub P}=2.7{sub −1.5}{sup +2.5} M{sub Jup} at the projected separation of a{sub ⊥}=1.8{sub −0.5}{sup +0.5} au. The preference of the large lens distance in the Bayesian analysis is due to the relatively large observed source star radius. The distance and other physical parameters may be constrained by the future high-resolution imaging by large ground telescopes or HST. If the estimated lens distance is correct, then this planet provides another sample for testing the claimed deficit of planets in the Galactic bulge.

79 ASTRONOMY AND ASTROPHYSICS↗

OGLE-2013-BLG-1761Lb: A Massive Planet around an MK Dwarf

We report the discovery and the analysis of the planetary microlensing event, OGLE-2013-BLG-1761. There are some degenerate solutions in this event because the planetary anomaly is only sparsely sampled. However, the detailed light curve analysis ruled out all stellar binary models and shows the lens to be a planetary system. There is the so-called close wide degeneracy in the solutions with the planet host mass ratio of q approx.(7.0+/-2.0) x 10(exp -3) and q approx.(8.1+/-2.6) x 10(exp -3) with the projected separation in Einstein radius units of s = 0.95 (close) and s = 1.18(wide), respectively. The microlens parallax effect is not detected, but the finite source effect is detected. Our Bayesian analysis indicates that the lens system is located -D(sub L) = 6.9(+ 1.0 -1.2)kpc away from us and the host star is an M/K dwarf with amass of M(sub L) = 0.33(+ 0.32- 1.9)Stellar Mass orbited by a super-Jupiter mass planet with a mass of m(sub p) = 2.7(+ 2.5 - 1.5) M(sub Jup) at the projected separation of a(sub l) = 1.8(+ 0.5 -0.5)au. The preference of the large lens distance in the Bayesian analysis is due to the relatively large observed source star radius. The distance and other physical parameters may be constrained by the future high-resolution imaging by large ground telescopes or HST. If the estimated lens distance is correct, then this planet provides another sample for testing the claimed deficit of planets in the Galactic bulge.

Hirao, Y.↗

Bayesian model-data comparison incorporating theoretical uncertainties

Accurate comparisons between theoretical models and experimental data are critical for scientific progress. However, inferred physical model parameters can vary significantly with the chosen physics model, highlighting the importance of properly accounting for theoretical uncertainties. In this Letter, we present a Bayesian framework that explicitly quantifies these uncertainties by statistically modeling theory errors, guided by qualitative knowledge of a theory’s varying reliability across the input domain. We demonstrate the effectiveness of this approach using two systems: a simple ball drop experiment and multi-stage heavy-ion simulations. In both cases incorporating model discrepancy leads to improved parameter estimates, with systematic improvements observed as additional experimental observables are integrated.

Bayesian methods↗

Exploring physics of ferroelectric domain walls via Bayesian analysis of atomically resolved STEM data

The physics of ferroelectric domain walls is explored using the Bayesian inference analysis of atomically resolved STEM data. We demonstrate that domain wall profile shapes are ultimately sensitive to the nature of the order parameter in the material, including the functional form of Ginzburg-Landau-Devonshire expansion, and numerical value of the corresponding parameters. The preexisting materials knowledge naturally folds in the Bayesian framework in the form of prior distributions, with the different order parameters forming competing (or hierarchical) models. Here, we explore the physics of the ferroelectric domain walls in BiFeO 3 using this method, and derive the posterior estimates of relevant parameters. More generally, this inference approach both allows learning materials physics from experimental data with associated uncertainty quantification, and establishing guidelines for instrumental development answering questions on what resolution and information limits are necessary for reliable observation of specific physical mechanisms of interest.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Final Report, DOE Early Career Award: Predictive modeling of complex physical systems: new tools for statistical inference, uncertainty quantification, and experimental design

Predictive simulation of complex physical systems increasingly rests on the interplay of experimental observations with computational models. Key inputs, parameters, or structural aspects of models may be incomplete or unknown, and must be developed from indirect and limited observations. At the same time, quantified uncertainties are needed to qualify computational predictions in the support of design and decision-making. In this context, Bayesian statistics provides a foundation for inference from noisy and limited data, but at prohibitive computional expense. This project intends to make rigorous predictive modeling *feasible* in complex physical systems, via accelerated and scalable tools for uncertainty quantification, Bayesian inference, and experimental design. Specific objectives are as follows: 1. Develop adaptive posterior approximations and dimensionality reduction approaches for Bayesian inference in high-dimensional nonlinear systems. 2. Extend accelerated Bayesian methodologies to large-scale {\em sequential} data assimilation, fully treating nonlinear models and non-Gaussian state and parameter distributions. 3. Devise efficient surrogate-based methods for Bayesian model selection and the learning of model structure. 4. Develop scalable simulation/optimization approaches to nonlinear Bayesian experimental design, for both parameter inference and model selection. 5. Demonstrate these inferential tools on chemical kinetic models in reacting flow, constructing and refining thermochemical and electrochemical models from limited data. Demonstrate Bayesian filtering on canonical stochastic PDEs and in the dynamic estimation of inhomogeneous subsurface properties and flow fields.

97 MATHEMATICS AND COMPUTING↗