Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian Inversion”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Multi-Modal Bayesian Neural Network Surrogates with Conjugate Last-Layer Estimation

As data collection and simulation capabilities advance, multi-modal learning, the task of learning from multiple modalities and sources of data, is becoming an increasingly important area of research. Surrogate models that learn from data of multiple auxiliary modalities to support the modeling of a highly expensive quantity of interest have the potential to aid outer loop applications such as optimization, inverse problems, or sensitivity analyses when multi-modal data are available. We develop two multi-modal Bayesian neural network surrogate models and leverage conditionally conjugate distributions in the last layer to estimate model parameters using stochastic variational inference (SVI). We provide a method to perform this conjugate SVI estimation in the presence of partially missing observations. Here, we demonstrate improved prediction accuracy and uncertainty quantification compared to unimodal surrogate models for both scalar and time series data.

97 MATHEMATICS AND COMPUTING↗

Adaptive Interface-PINNs (AdaI-PINNs) for inverse problems: Determining material properties for heterogeneous systems

Here, we determine spatially varying discontinuous material properties using a domain-decomposition based physics-informed neural networks (PINNs) framework named the Adaptive Interface-PINNs or AdaI-PINNs (Roy et al., 2024). We propose the use of distinct neural networks for the field variables and material properties within each material, utilizing adaptive activation functions. While the neural networks across different materials share the same weights and biases, their activation functions are uniquely tailored using a hyperparameter that influences the slope of the activation function. The proposed framework is tested on several one-dimensional and two-dimensional benchmark examples, and its performance is compared with conventional PINNs and existing domain-decomposition PINNs frameworks, namely, the Multi-domain physics-informed neural network (M-PINN), and the eXtended physics-informed neural networks (XPINNs). The results demonstrate that the proposed approach can determine randomly distributed discontinuous material properties with an L 2 error of $\mathscr{O}$ (10 -3 ) for the material property and the root-mean-square error of $\mathscr{O}$ (10 -3 ) for the primary variable while the other approaches yield errors that are approximately two orders of magnitude larger (that is, $\mathscr{O}$ (10 -1 )). Moreover, the spatial distribution of material properties obtained using the proposed framework is in close agreement with the true distribution, whereas the other approaches fare much worse. Additionally, the proposed approach is approximately 40% faster than its competitors, indicating its potential as a robust alternative for solving inverse problems in heterogeneous materials.

36 MATERIALS SCIENCE↗

Measurement of the top-quark pole mass in dileptonic $t\overline{t}$ + 1-jet events at $\sqrt{s}=13$ TeV with the ATLAS experiment

A measurement of the top-quark pole mass $m$$^{pole}_{t}$ is presented in $t\bar{t}$ events with an additional jet, $t\bar{t}$+ 1-jet, produced in pp collisions at $\sqrt{s} = 13 TeV. The data sample, recorded with the ATLAS experiment during Run 2 of the LHC, corresponds to an integrated luminosity of 140 fb −1 . Events with one electron and one muon of opposite electric charge in the final state are selected to measure the $t\bar{t}$ + 1-jet differential cross-section as a function of the inverse of the invariant mass of the $t\bar{t}$ + 1-jet system. Iterative Bayesian Unfolding is used to correct the data to enable comparison with fixed-order calculations at next-to-leading-order accuracy in the strong coupling. The process pp → $t\bar{t}$j(2 → 3), where top quarks are taken as stable particles, and the process pp → $b\bar{b}$l + vl – $\overline{ν}$j (2 → 7), which includes top-quark decays to the dilepton final state and off-shell effects, are considered. The top-quark mass is extracted using a χ 2 fit of the unfolded normalized differential cross-section distribution. The results obtained with the 2 → 3 and 2 → 7 calculations are compatible within theoretical uncertainties, providing an important consistency check.

Hadron-Hadron Scattering↗

Characterizing the impact of model error in hydrologic time series recovery inverse problems

Hydrologic models are commonly over-smoothed relative to reality, owing to computational limitations and to the difficulty of obtaining accurate high-resolution information. When used in an inversion context, such models may introduce systematic biases which cannot be encapsulated by an unbiased “observation noise” term of the type assumed by standard regularization theory and typical Bayesian formulations. Despite its importance, model error is difficult to encapsulate systematically and is often neglected. In this paper, model error is considered for an important class of inverse problems that includes interpretation of hydraulic transients and contaminant source history inference: reconstruction of a time series that has been convolved against a transfer function (i.e., impulse response) that is only approximately known. Using established harmonic theory along with two results established here regarding triangular Toeplitz matrices, upper and lower error bounds are derived for the effect of systematic model error on time series recovery for both well-determined and over-determined inverse problems. It is seen that use of additional measurement locations does not improve expected performance in the face of model error. A Monte Carlo study of a realistic hydraulic reconstruction problem is presented, and the lower error bound is seen informative about expected behavior. Finally, a possible diagnostic criterion for blind transfer function characterization is also uncovered.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A hierarchical Bayesian model for background variation in radiation source localization

In this paper, we apply a new model to account for varying background radiation in radiological source localization. We present a hierarchical Bayesian model that simultaneously infers background and source location parameters without requiring separate estimation of the background radiation at each detector location. We employ a simplified photon transport model to reduce the computational expense of Bayesian model calibration. Furthermore, we demonstrate the model accuracy by localizing a cesium-137 source in a simulated city block, and we analyze experimental field measurements with varying background. In both cases, the model provides sufficient fidelity that we can locate the source while simultaneously estimating background radiation.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Unfolding quantum computer readout noise

Abstract In the current era of noisy intermediate-scale quantum computers, noisy qubits can result in biased results for early quantum algorithm applications. This is a significant challenge for interpreting results from quantum computer simulations for quantum chemistry, nuclear physics, high energy physics (HEP), and other emerging scientific applications. An important class of qubit errors are readout errors. The most basic method to correct readout errors is matrix inversion, using a response matrix built from simple operations to probe the rate of transitions from known initial quantum states to readout outcomes. One challenge with inverting matrices with large off-diagonal components is that the results are sensitive to statistical fluctuations. This challenge is familiar to HEP, where prior-independent regularized matrix inversion techniques (“unfolding”) have been developed for years to correct for acceptance and detector effects, when performing differential cross section measurements. We study one such method, known as iterative Bayesian unfolding, as a potential tool for correcting readout errors from universal gate-based quantum computers. This method is shown to avoid pathologies from commonly used matrix inversion and least squares methods.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

The inference of mantle viscosity from an inversion of the Fennoscandian relaxation spectrum

The theory of Peltier (1976) for mantle viscosity is adopted, within the framework of nonlinear Bayesian Inference, to invert the Fennoscandian relaxation spectra derived by McConnell (1968). A set of rigorous constraints which all models for the viscosity variation beneath Fennoscandian must satisfy is derived. These constraints are used to test the plausibility of a wide class of viscosity models. It is shown that a model with a weak asthenosphere overlying an isoviscous 10 exp 21 Pa s deep mantle provides to good fit to the relaxation spectrum. This is also true of models with a thin sublithospheric low-viscosity zone overlying a two-layer deep mantle with a moderate jump in viscosity across 670 km depth, and models with a viscosity jump of between four and six across isoviscous upper and lower mantle regions.

Mitrovica, J. X.↗

A multitower measurement network estimate of California's methane emissions

In this paper, we present an analysis of methane (CH 4 ) emissions using atmospheric observations from five sites in California's Central Valley across different seasons (September 2010 to June 2011). CH 4 emissions for spatial regions and source sectors are estimated by comparing measured CH 4 mixing ratios with transport model (Weather Research and Forecasting and Stochastic Time-Inverted Lagrangian Transport) predictions based on two 0.1° CH 4 (seasonally varying “California-specific” (California Greenhouse Gas Emission Measurements, CALGEM) and a static global (Emission Database for Global Atmospheric Research, release version 42, EDGAR42)) prior emission models. Region-specific Bayesian analyses indicate that for California's Central Valley, the CALGEM- and EDGAR42-based inversions provide consistent annual total CH 4 emissions (32.87 ± 2.09 versus 31.60 ± 2.17 Tg CO 2 eq yr -1 ; 68% confidence interval (CI), assuming uncorrelated errors between regions). Summing across all regions of California, optimized CH 4 emissions are only marginally consistent between CALGEM- and EDGAR42-based inversions (48.35 ± 6.47 versus 64.97 ± 11.85 Tg CO 2 eq), because emissions from coastal urban regions (where landfill and natural gas emissions are much higher in EDGAR than CALGEM) are not strongly constrained by the measurements. Combining our results with those from a recent study of the South Coast Air Basin narrows the range of estimates to 43–57 Tg CO2eq yr -1 (1.3–1.8 times higher than the current state inventory). Finally, these results suggest that the combination of rural and urban measurements will be necessary to verify future changes in California's total CH 4 emissions.

54 ENVIRONMENTAL SCIENCES↗

Passive Microwave Signatures and Retrieval of High-Latitude Snowfall Over Open Oceans and Sea Ice: Insights From Coincidences of GPM and CloudSat Satellites

This article studies changes in microwave signals of oceanic snowfall in response to the formation of snow-covered sea ice using active and passive coincident data from the radar and radiometer onboard the CloudSat and the global precipitation measurement satellites. Using reanalysis data of liquid and ice water path as well as satellite retrievals of sea ice snow-cover depth, spectral regions are determined over which the snowfall signatures are likely to be obscured or falsely detected. Relying on an a priori database populated with the active–passive coincidences, a Bayesian snowfall retrieval algorithm is presented that links a k -nearest neighbor matching with the inverse Gaussian estimator used in the Goddard profiling algorithm. Without relying on any ancillary data of air temperature, the results demonstrate that over open oceans (sea ice), we can passively retrieve the CloudSat active snowfalls with a true positive rate of 92 (85%) and the root mean squared error of 0.24 (0.15) mm per h.

Sajad Vahedizade↗

Bayesian inference for the seismic moment tensor using regional waveforms and a data-derived distribution of velocity models

The largest source of uncertainty in any source inversion is the velocity model used to construct the transfer function employed in the forward model that relates observed ground motion to the seismic moment tensor. However, standard inverse procedures often does not quantify uncertainty in the seismic moment tensor due to error in the Green’s functions from uncertain event location and Earth structure. We attempt to incorporate this uncertainty into an estimation of the seismic moment tensor using a distribution of velocity models calculated in a prior effort based on different and complementary data sets. The posterior distribution of velocity models is then used to construct Green’s functions for use in Bayesian inference of an unknown seismic moment tensor using regional waveform data. The combined likelihood is estimated using data-specific error models and the posterior of the seismic moment tensor is estimated and can be interpreted in terms of most-probable source-type.

58 GEOSCIENCES↗

Stochastic Inversion of 2D Magnetotelluric Data

The algorithm is developed to invert 2D magnetotelluric (MT) data based on sharp boundary parametrization using a Bayesian framework. Within the algorithm, we consider the locations and the resistivity of regions formed by the interfaces are as unknowns. We use a parallel, adaptive finite-element algorithm to forward simulate frequency-domain MT responses of 2D conductivity structure. Those unknown parameters are spatially correlated and are described by a geostatistical model. The joint posterior probability distribution function is explored by Markov Chain Monte Carlo (MCMC) sampling methods. The developed stochastic model is effective for estimating the interface locations and resistivity. Most importantly, it provides details uncertainty information on each unknown parameter. Hardware requirements: PC, Supercomputer, Multi-platform, Workstation; Software requirements C and Fortan; Operation Systems/version is Linux/Unix or Windows

Chen, Jinsong↗

Sparse Bayesian Inference and the Temperature Structure of the Solar Corona

Measuring the temperature structure of the solar atmosphere is critical to understanding how it is heated to high temperatures. Unfortunately, the temperature of the upper atmosphere cannot be observed directly, but must be inferred from spectrally resolved observations of individual emission lines that span a wide range of temperatures. Such observations are “inverted” to determine the distribution of plasma temperatures along the line of sight. This inversion is ill posed and, in the absence of regularization, tends to produce wildly oscillatory solutions. We introduce the application of sparse Bayesian inference to the problem of inferring the temperature structure of the solar corona. Within a Bayesian framework a preference for solutions that utilize a minimum number of basis functions can be encoded into the prior and many ad hoc assumptions can be avoided. We demonstrate the efficacy of the Bayesian approach by considering a test library of 40 assumed temperature distributions.

79 ASTRONOMY AND ASTROPHYSICS↗

A Computationally-Efficient Inverse Approach to Probabilistic Strain-Based Damage Diagnosis

This work presents a computationally-efficient inverse approach to probabilistic damage diagnosis. Given strain data at a limited number of measurement locations, Bayesian inference and Markov Chain Monte Carlo (MCMC) sampling are used to estimate probability distributions of the unknown location, size, and orientation of damage. Substantial computational speedup is obtained by replacing a three-dimensional finite element (FE) model with an efficient surrogate model. The approach is experimentally validated on cracked test specimens where full field strains are determined using digital image correlation (DIC). Access to full field DIC data allows for testing of different hypothetical sensor arrangements, facilitating the study of strain-based diagnosis effectiveness as the distance between damage and measurement locations increases. The ability of the framework to effectively perform both probabilistic damage localization and characterization in cracked plates is demonstrated and the impact of measurement location on uncertainty in the predictions is shown. Furthermore, the analysis time to produce these predictions is orders of magnitude less than a baseline Bayesian approach with the FE method by utilizing surrogate modeling and effective numerical sampling approaches.

Warner, James E.↗

Statistical Treatment of Inverse Problems Constrained by Differential Equations-based Models with Stochastic Terms

This paper introduces a statistical treatment of inverse problems constrained by models with stochastic terms. The solution of the forward problem is given by a distribution represented numerically by an ensemble of simulations. The goal is to formulate the inverse problem, in particular the objective function, to find the closest forward distribution (i.e., the output of the stochastic forward problem) that best explains the distribution of the observations in a certain metric. We use proper scoring rules, a concept employed in statistical forecast verification, namely energy, variogram, and hybrid (i.e., combination of the two) scores. We study the performance of the proposed formulation in the context of two applications: a coefficient field inversion for subsurface flow governed by an elliptic partial differential equation with a stochastic source and a parameter inversion for power grid governed by differential-algebraic equations. In both cases we show that the variogram and the hybrid scores produce better parameter inversion results than does the energy score, whereas the energy score leads to better probabilistic predictions.

97 MATHEMATICS AND COMPUTING↗

Statistical method for resolving the photon-photoelectron-counting inversion problem

A statistical inversion method is proposed for the photon-photoelectron-counting statistics in quantum key distribution experiment. With the statistical viewpoint, this problem is equivalent to the parameter estimation for an infinite binomial mixture model. The coarse-graining idea and Bayesian methods are applied to deal with this ill-posed problem, which is a good simple example to show the successful application of the statistical methods to the inverse problem. Numerical results show the applicability of the proposed strategy. The coarse-graining idea for the infinite mixture models should be general to be used in the future.

97 MATHEMATICS AND COMPUTING↗

Machine-learning-based inversion of nuclear responses

A microscopic description of the interaction of atomic nuclei with external electroweak probes is required for elucidating aspects of short-range nuclear dynamics and for the correct interpretation of neutrino oscillation experiments. Nuclear quantum Monte Carlo methods infer the nuclear electroweak response functions from their Laplace transforms. Inverting the Laplace transform is a notoriously ill-posed problem; and Bayesian techniques, such as maximum entropy, are typically used to reconstruct the original response functions in the quasielastic region. In this work, we present a physics-informed artificial neural network architecture suitable for approximating the inverse of the Laplace transform. Utilizing simulated, albeit realistic, electromagnetic response functions, we show that this physics-informed artificial neural network outperforms maximum entropy in both the low-energy transfer and the quasielastic regions, thereby allowing for robust calculations of electron scattering and neutrino scattering on nuclei and inclusive muon capture rates.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Multi-fidelity Bayesian neural networks: Algorithms and applications

Here we propose a new class of Bayesian neural networks (BNNs) that can be trained using noisy data of variable fidelity, and we apply them to learn function approximations as well as to solve inverse problems based on partial differential equations (PDEs). These multi-fidelity BNNs consist of three neural networks: The first is a fully connected neural network, which is trained following the maximum a posteriori probability (MAP) method to fit the low-fidelity data; the second is a Bayesian neural network employed to capture the cross-correlation with uncertainty quantification between the low- and high-fidelity data; and the last one is the physics-informed neural network, which encodes the physical laws described by PDEs. For the training of the last two neural networks, we first employ the mean-field variational inference (VI) to maximize the evidence lower bound (ELBO) to obtain informative prior distributions for the hyperparameters in the BNNs, and subsequently we use the Hamiltonian Monte Carlo (HMC) method to estimate accurately the posterior distributions for the corresponding hyperparameters. We demonstrate the accuracy of the present method using synthetic data as well as real measurements. Specifically, we first approximate a one- and four-dimensional function, and then infer the reaction rates in one- and two-dimensional diffusion-reaction systems. Moreover, we infer the sea surface temperature (SST) in the Massachusetts and Cape Cod Bays using satellite images and in-situ measurements. Taken together, our results demonstrate that the present method can capture both linear and nonlinear correlation between the low- and high-fidelity data adaptively, identify unknown parameters in PDEs, and quantify uncertainties in predictions, given a few scattered noisy high-fidelity data. Finally, we demonstrate that we can effectively and efficiently reduce the uncertainties and hence enhance the prediction accuracy with an active learning approach, using as examples a specific one-dimensional function approximation and an inverse PDE problem.

97 MATHEMATICS AND COMPUTING↗