Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian Methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,369 records · Page 76

Retrieving Temperatures and Abundances of Exoplanet Atmospheres with High-resolution Cross-correlation Spectroscopy

High-resolution spectroscopy (R ≥ 25,000) has recently emerged as one of the leading methods for detecting atomic and molecular species in the atmospheres of exoplanets. However, it has so far been lacking a robust method for extracting quantitative constraints on the temperature structure and molecular/atomic abundances. In this work, we present a novel Bayesian atmospheric retrieval framework applicable to high-resolution cross-correlation spectroscopy (HRCCS) that relies on the cross-correlation between data and models to extract the planetary spectral signal. We successfully test the framework on simulated data and show that it can correctly determine Bayesian credibility intervals on atmospheric temperatures and abundances, allowing for a quantitative exploration of the inherent degeneracies. Furthermore, our new framework permits us to trivially combine and explore the synergies between HRCCS and low-resolution spectroscopy to maximally leverage the information contained within each. This framework also allows us to quantitatively assess the impact of molecular line opacities at high resolution. We apply the framework to VLT CRIRES K-band spectra of HD 209458 b and HD 189733 b and retrieve abundant carbon monoxide but subsolar abundances for water, which are largely invariant under different model assumptions. This confirms previous analysis of these data sets, but is possibly at odds with detections of H{sub 2}O at different wavelengths and spectral resolutions. The framework presented here is the first step toward a true synergy between space observatories and ground-based high-resolution observations.

79 ASTRONOMY AND ASTROPHYSICS↗

Efficient Calibration of Expensive Computational Models

Accounting for uncertainty when calibrating expensive computational models is a common challenge faced by scientists and engineers. Often Bayesian techniques are adopted to estimate a probability density function over the model parameters given noisy empirical data. The methods used to perform this type of probabilistic calibration are computationally prohibitive in that they require a large number of evaluations of the expensive model. In these cases, surrogate modeling -- that is, using a fast-to-evaluate, lower fidelity stand-in for the original computational model -- may be the only option to alleviate this computational burden. However, the upfront cost of generating training data to build a surrogate model can itself be expensive. As such, it is important to be judicious when selecting training points at which the full-fidelity model is evaluated. Here, an active learning approach is proposed that enables efficient selection of training points using approximate samples of the calibrated parameter probability density function. In this way, the training points can be concentrated in regions where the calibration algorithm requires high model accuracy.

active learning↗

Dissecting the Gravitational Lens B1608 656. II. Precision Measurements of the Hubble Constant, Spatial Curvature, and the Dark Energy Equation of State

Strong gravitational lens systems with measured time delays between the multiple images provide a method for measuring the 'time-delay distance' to the lens, and thus the Hubble constant. We present a Bayesian analysis of the strong gravitational lens system B1608+656, incorporating (1) new, deep Hubble Space Telescope (HST) observations, (2) a new velocity dispersion measurement of 260 {+-} 15 km s{sup -1} for the primary lens galaxy, and (3) an updated study of the lens environment. Our analysis of the HST images takes into account the extended source surface brightness, and the dust extinction and optical emission by the interacting lens galaxies. When modeling the stellar dynamics of the primary lens galaxy, the lensing effect, and the environment of the lens, we explicitly include the total mass distribution profile logarithmic slope {gamma}{prime} and the external convergence {kappa}{sub ext}; we marginalize over these parameters, assigning well-motivated priors for them, and so turn the major systematic errors into statistical ones. The HST images provide one such prior, constraining the lens mass density profile logarithmic slope to be {gamma}{prime} = 2.08 {+-} 0.03; a combination of numerical simulations and photometric observations of the B1608+656 field provides an estimate of the prior for {kappa}{sub ext}: 0.10{sub -0.05}{sup +0.08}. This latter distribution dominates the final uncertainty on H{sub 0}. Fixing the cosmological parameters at {Omega}{sub m} = 0.3, {Omega}{sub {Lambda}} = 0.7, and w = -1 in order to compare with previous work on this system, we find H{sub 0} = 70.6{sub -3.1}{sup +3.1} km s{sup -1} Mpc{sup -1}. The new data provide an increase in precision of more than a factor of two, even including the marginalization over {kappa}{sub ext}. Relaxing the prior probability density function for the cosmological parameters to that derived from the WMAP 5-year data set, we find that the B1608+656 data set breaks the degeneracy between {Omega}{sub m} and {Omega}{sub {Lambda}} at w = -1 and constrains the curvature parameter to be -0.031 < {Omega}{sub k} < 0.009 (95% CL), a level of precision comparable to that afforded by the current Type Ia SNe sample. Asserting a flat spatial geometry, we find that, in combination with WMAP, H{sub 0} = 69.7{sub 5.0}{sup +4.9} km s{sup -1} Mpc{sup -1} and w = -0.94{sub -0.19}{sup +0.17} (68% CL), suggesting that the observations of B1608+656 constrain w as tightly as do the current Baryon Acoustic Oscillation data.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Accelerating Markov Chain Monte Carlo sampling with diffusion models

Global fits of physics models require efficient methods for exploring high-dimensional and/or multimodal posterior functions. We introduce a novel method for accelerating Markov Chain Monte Carlo (MCMC) sampling by pairing a Metropolis-Hastings algorithm with a diffusion model that can draw global samples with the aim of approximating the posterior. We briefly review diffusion models in the context of image synthesis before providing a streamlined diffusion model tailored towards low-dimensional data arrays. We then present our adapted Metropolis-Hastings algorithm which combines local proposals with global proposals taken from a diffusion model that is regularly trained on the samples produced during the MCMC run. Our approach leads to a significant reduction in the number of likelihood evaluations required to obtain an accurate representation of the Bayesian posterior across several analytic functions, as well as for a physical example based on a global fit of parton distribution functions. Our method is extensible to other MCMC techniques, and we briefly compare our method to similar approaches based on normalising flows. A code implementation can be found at https://github.com/NickHunt-Smith/MCMC-diffusion.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A systematic strategy for estimating hERG block potency and its implications in a new cardiac safety paradigm

Introduction: hERG block potency is widely used to calculate a drug's safety margin against its torsadogenic potential. Previous studies are confounded by use of different patch clamp electrophysiology protocols and a lack of statistical quantification of experimental variability. Since the new cardiac safety paradigm being discussed by the International Council for Harmonisation promotes a tighter integration of nonclinical and clinical data for torsadogenic risk assessment, a more systematic approach to estimate the hERG block potency and safety margin is needed. Methods: A cross-industry study was performed to collect hERG data on 28 drugs with known torsadogenic risk using a standardized experimental protocol. A Bayesian hierarchical modeling (BHM) approach was used to assess the hERG block potency of these drugs by quantifying both the inter-site and intra-site variability. A modeling and simulation study was also done to evaluate protocol-dependent changes in hERG potency estimates. Results: A systematic approach to estimate hERG block potency is established. The impact of choosing a safety margin threshold on torsadogenic risk evaluation is explored based on the posterior distributions of hERG potency estimated by this method. The modeling and simulation results suggest any potency estimate is specific to the protocol used. Discussion: This methodology can estimate hERG block potency specific to a given voltage protocol. The relationship between safety margin thresholds and torsadogenic risk predictivity suggests the threshold should be tailored to each specific context of use, and safety margin evaluation may need to be integrated with other information to form a more comprehensive risk assessment.

60 APPLIED LIFE SCIENCES↗

A Bayesian Approach for Extracting Fluorescence Lifetimes from Sparse Data Sets and Its Significance for Imaging Experiments

The measurement of fluorescence lifetimes, especially in small sample volumes, presents the dual challenge of probing a small number of fluorophores and fitting the concomitant sparse data set to the appropriate excited-state decay function. A common method of analysis, such as the maximum likelihood (ML) technique, assumes a uniform probability distribution of the parameters describing the fluorescence decay function. An improvement is thus suggested by implementing a suitable nonuniform distribution, as is provided by a Bayesian framework, where the distribution of parameters is obtained from both their prior knowledge and the evidence-based likelihood of an event for a given set of parameters. We have also considered the Dirichlet prior distribution, whose mathematical form enables analytical solutions of the fitting parameters to be rapidly obtained. If Gaussian and exponential prior distributions are judiciously chosen, they reproduce the experimental target lifetime to within 20% with as few as 20 total photon counts for the data set, as does the Dirichlet prior distribution. But because of the analytical solutions afforded by the Dirichlet prior distribution, it is proposed to employ a Dirichlet prior to search parameter space rapidly to provide, if necessary, appropriate parameters for subsequent employment of a Gaussian or exponential prior distribution

97 MATHEMATICS AND COMPUTING↗

A Model-Based, Bayesian Solution for Characterization of Complex Damage Scenarios in Aerospace Composite Structures

Ultrasonic damage detection and characterization is commonly used in nondestructive evaluation (NDE) of aerospace composite components. In recent years there has been an increased development of guided wave based methods. In real materials and structures, these dispersive waves result in complicated behavior in the presence of complex damage scenarios. Model-based characterization methods utilize accurate three dimensional finite element models (FEMs) of guided wave interaction with realistic damage scenarios to aid in defect identification and classification. This work describes an inverse solution for realistic composite damage characterization by comparing the wavenumber-frequency spectra of experimental and simulated ultrasonic inspections. The composite laminate material properties are first verified through a Bayesian solution (Markov chain Monte Carlo), enabling uncertainty quantification surrounding the characterization. A study is undertaken to assess the efficacy of the proposed damage model and comparative metrics between the experimental and simulated output. The FEM is then parameterized with a damage model capable of describing the typical complex damage created by impact events in composites. The damage is characterized through a transdimensional Markov chain Monte Carlo solution, enabling a flexible damage model capable of adapting to the complex damage geometry investigated here. The posterior probability distributions of the individual delamination petals as well as the overall envelope of the damage site are determined.

H. Reed↗

WAVELENGTH MEASUREMENTS OF K TRANSITIONS OF OXYGEN, NEON, AND MAGNESIUM WITH X-RAY ABSORPTION LINES

Accurate atomic transition data are important in many astronomical research areas, especially for studies of line spectroscopy. Whereas transition data of He-like and H-like ions (i.e., ions in high-charge states) have been accurately calculated, the corresponding data of K transitions of neutral or low-ionized metal elements are still very uncertain. Spectroscopy of absorption lines produced in the interstellar medium (ISM) has been proven to be an effective way to measure the central wavelengths of these atomic transitions. In this work, we analyze 36 Chandra High Energy Transmission Grating observations to search for and measure the ISM absorption lines along sight lines to 11 low-mass X-ray binaries. We correct the Galactic rotation velocity to the rest frame for every observation and then use two different methods to merge all the corrected spectra to a co-added spectrum. However, the co-added spectra obtained by this method exhibit biases, toward to either observations with high counts or lines with high signal-to-noise ratios. We do a Bayesian analysis of several significantly detected lines to obtain the systematic uncertainty and the bias correction for other lines. Compared to previous studies, our results improve the wavelength accuracy by a factor of two to five and significantly reduce the systematic uncertainties and biases. Several weak transitions (e.g., 1s-2p of Mg IV and Mg V; 1s-3p of Mg III and Mg V) are also detected for the first time, albeit with low significance; future observations with improved accuracy are required to confirm these detections.

79 ASTRONOMY AND ASTROPHYSICS↗

Acoustic emission Bayesian source location: Onset time challenge

Robust identification of the most accurate observed input data among a pool of observations is key in modeling and decision making. A statistically biased observed measurement deteriorates the predictive power of a model and affects decision-making ability based on the prediction of the model. When two competing methods of measurement are available, such as methods which identify arrival times in acoustic emission (AE) signals, a principal question is whether one of the two obtained datasets, or a combination of the two, should be used later on, for example, to localize an AE source. This question becomes more important when collecting not repeatable data such as AE signals created by a propagating crack. Here this paper considers an inverse source location problem in a concrete block to address the mentioned issue, a proposed methodology which also has wider application in competitive data selection. Elastic energy released by an AE event, such as a propagating crack, is recorded by acoustic emission data acquisition system. The onset time of AE signals is often used to locate the source of the event, and its accuracy directly affects the precision of source identification. This research proposes an innovative approach to select the most probable onset time obtained from two automatic picker methods. The proposed method selects the most probable onset times, which are observed by each picker for each sensor, in a probabilistic fashion. To validate the proposed method, the most accurate onset time observed by each picker is identified by visual inspection and is compared with the one is selected by the proposed method. Finally, the dataset is used for source location identification. Results show that picked onset times determined by the proposed method generate more accurate source identification when compared with coordinates obtained using each dataset individually.

97 MATHEMATICS AND COMPUTING↗

Assessing and benchmarking the fidelity of posterior inference methods for astrophysics data analysis

In this era of large and complex astronomical survey data, interpreting, validating, and comparing inference techniques becomes increasingly difficult. This is particularly critical for emerging inference methods like Simulation-Based Inference (SBI), which offer significant speedup potential and posterior modeling flexibility, especially when deep learning is incorporated. We present a study to assess and compare the performance and uncertainty prediction capability of Bayesian inference algorithms – from traditional MCMC sampling of analytic functions to deep learning-enabled SBI. We focus on testing the capacity of hierarchical inference modeling in those scenarios. Before we extend this study to cosmology, we first use astrophysical simulation data to ensure interpretability. We demonstrate a probabilistic programming implementation of hierarchical and non-hierarchical Bayesian inference using simulations derived from the DeepBench software library, a benchmarking tool developed by our group that generates simple and controllable astrophysical objects from first principles. This study will enable astronomers and physicists to harness the inference potential of these methods with confidence.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

An Ensemble Approach to Building Mercer Kernels with Prior Information

This paper presents a new methodology for automatic knowledge driven data mining based on the theory of Mercer Kernels, which are highly nonlinear symmetric positive definite mappings from the original image space to a very high, possibly dimensional feature space. we describe a new method called Mixture Density Mercer Kernels to learn kernel function directly from data, rather than using pre-defined kernels. These data adaptive kernels can encode prior knowledge in the kernel using a Bayesian formulation, thus allowing for physical information to be encoded in the model. Specifically, we demonstrate the use of the algorithm in situations with extremely small samples of data. We compare the results with existing algorithms on data from the Sloan Digital Sky Survey (SDSS) and demonstrate the method's superior performance against standard methods. The code for these experiments has been generated with the AUTOBAYES tool, which automatically generates efficient and documented C/C++ code from abstract statistical model specifications. The core of the system is a schema library which contains templates for learning and knowledge discovery algorithms like different versions of EM, or numeric optimization methods like conjugate gradient methods. The template instantiation is supported by symbolic-algebraic computations, which allows AUTOBAYES to find closed-form solutions and, where possible, to integrate them into the code.

Srivastava, Ashok N.↗

Mass Detection for Heavy-Duty Vehicles using Gaussian Belief Propagation

Predicting vehicle mass is critical to accurately estimate energy use and emissions of commercial trucks. However, data from vehicle telematics is often not at sufficient temporal resolution or accuracy for use in model-based detection methods. In this work, a new statistical mass prediction technique is described for heavy-duty vehicles that incorporates the use Gaussian Belief Propagation (GBP) for probabilistic inference. Similar to Bayesian inference models, the GBP model typically requires less labeled training data than other contemporary machine learning techniques. First, a factor graph is constructed, and a set of Gaussian belief nodes with associated means and variances are fitted to the training data. To better handle noisy input data, the GBP mass prediction model utilizes a k-nearest factors (kNF) algorithm for probabilistic inference on unseen testing data. The proposed method is compared with a classical weighted k-nearest neighbors (kNN) regressor. This statistical kNF-GBP model works even with low-quantity, low-quality initial training data, while being capable of realtime mass estimation. Unlike the kNN regressor, the GBP model produces a measure of uncertainty with its predictions. The proposed method is validated using curve-sampled driving data collected from multiple cloud-connected Class 8 regional haul diesel trucks. Both the kNN regressor and the kNF-GBP mass prediction model were able to predict payload mass with coefficients of determination above 0.97 with minimal data preprocessing.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Efficient uncertainty quantification methodologies for high-dimensional climate land models

In this report, we proposed, examined and implemented approaches for performing efficient uncertainty quantification (UQ) in climate land models. Specifically, we applied Bayesian compressive sensing framework to a polynomial chaos spectral expansions, enhanced it with an iterative algorithm of basis reduction, and investigated the results on test models as well as on the community land model (CLM). Furthermore, we discussed construction of efficient quadrature rules for forward propagation of uncertainties from high-dimensional, constrained input space to output quantities of interest. The work lays grounds for efficient forward UQ for high-dimensional, strongly non-linear and computationally costly climate models. Moreover, to investigate parameter inference approaches, we have applied two variants of the Markov chain Monte Carlo (MCMC) method to a soil moisture dynamics submodel of the CLM. The evaluation of these algorithms gave us a good foundation for further building out the Bayesian calibration framework towards the goal of robust component-wise calibration.

54 ENVIRONMENTAL SCIENCES↗

A Bayesian Prognostic Algorithm for Assessing Remaining Useful Life of Nuclear Power Components

A central issue in life extension for the current fleet of light water nuclear power reactors is the early detection and monitoring of significant materials degradation. To meet this need nondestructive measurement methods that are suitable for on-line, continuous, in-plant monitoring over extended time periods (months to years) are needed. A related issue is then, based on a condition assessment or degradation trend, to have the ability to estimate the remaining useful life based of components, structures and systems based on the available materials degradation information. Such measurement and modeling methods form the basis for a new range of advanced diagnostic and prognostic approaches. Prognostic methods that predict remaining life based on large crack growth, and phenomena that can be described by linear elastic fracture mechanics, have been reported by several researchers. The challenge of predicting remaining life for earlier phases of degradation is largely unsolved. Monitoring for early detection of materials degradation requires novel and enhanced sensors and data integration techniques. A recent review has considered the stages of degradation and sensing methods that can potentially be employed to detect and monitor early degradation for nuclear power plant applications. An experimental assessment of selected diagnostic techniques was also reported recently. However, the estimation of remaining useful life (RUL) determined from nondestructive diagnostic measurements for early degradation is still an unsolved problem. This present paper will discuss the application of Bayesian prognostic algorithms applied to the early degradation- life problem.

Bayesian prognostics↗

Estimating posterior quantity of interest expectations in a multilevel scalable framework

Scalable approaches for uncertainty quantification are necessary for characterizing prediction confidence in large-scale subsurface flow simulations with uncertain permeability. To this end we explore a multilevel Monte Carlo approach for estimating posterior moments of a particular quantity of interest, where we employ an element-agglomerated algebraic multigrid (AMG) technique to generate the hierarchy of coarse spaces with guaranteed approximation properties for both the generation of spatially correlated random fields and the forward simulation of Darcy's law to model subsurface flow. In both these components (sampling and forward solves), we exploit solvers that rely on state-of-the-art scalable AMG. To illustrate the applicability of this approach, numerical tests are performed on two 3D examples-a unit cube and an egg-shaped domain with an irregular boundary-where the scalability of each simulation as well as the scalability of the overall algorithm are demonstrated.

97 MATHEMATICS AND COMPUTING↗

Multidimensional sum-up rounding for integer programming in optimal experimental design

Here we present a numerical method for approximating the solution of convex integer programs stemming from optimal experimental design. The statistical setup consists of a Bayesian framework for linear inverse problems for which the direct relationship is described by a discretized integral equation. Specifically, we aim to find the optimal sensor placement from a set of candidate locations where data are collected with measurement error. The convex objective function is a measure of the uncertainty, described here by the trace or log-determinant of the posterior covariance matrix, for the discretized linear inverse problem solution. The resulting convex integer program is relaxed, producing a lower bound. An upper bound is obtained by extending the sum-up rounding approach to multiple dimensions. For this extension, we analyze its accuracy as a function of the discretization mesh size for a rectangular domain. We show asymptotic optimality of the integer solution defining the upper bound for different experimental design criteria (A- and D-optimal), by proving the convergence to zero of the gap between the upper and lower bounds as the mesh size goes to zero. The technique is illustrated on a two-dimensional gravity surveying problem for both A-optimal and D-optimal sensor placement where our designs yield better results compared with a thresholding rounding approach.

97 MATHEMATICS AND COMPUTING↗

A Probabilistic Model-Based Diagnostic Framework for Nuclear Engineering Systems

A fault diagnostic framework was investigated in this study for applications in thermal–hydraulic systems of nuclear power plants. The proposed framework consists of quantitative model-based diagnosis, statistical change detection and probabilistic reasoning. The use of physics-based diagnostic models provides high detection sensitivity and allows noise and measurement uncertainty to be incorporated robustly. Performance-related parametric models for each component are constructed based on first principles. Numerical model residuals are generated using the concept of analytical redundancy. Statistical change detection methods are employed to detect non-zero residuals in the presence of uncertainty. The diagnosis task is performed using Bayesian inference to detect and localize possible faults. Application to a single-phase heat exchanger for demonstration showed that the proposed probabilistic framework can provide improved results in comparison with traditional approaches while remaining less sensitive to false alarms in the presence of measurement and modeling uncertainty.

Bayesian network↗

Uncertainty quantification for high explosive reactant and product equations of state

Equations of state (EOSs) are typically represented as physics-informed models with tunable parameters that are adjusted to replicate calibration data as closely as possible. Uncertainty quantification (UQ) allows for the development of an ensemble of EOS parameters that are consistent with the calibration data instead of a single EOS. In this work, we perform UQ for the reactant and product EOSs for a variety of high explosives (HEs). In doing so, we demonstrate a strategy for dealing with heterogeneous (both experimental and calculated) data. We also use a statistical distance metric to quantify the differences between the various HEs using the UQ results.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗