Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian method”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Selection of polynomial chaos bases via Bayesian model uncertainty methods with applications to sparse approximation of PDEs with stochastic inputs

Generalized polynomial chaos (gPC) expansions allow us to represent the solution of a stochastic system using a series of polynomial chaos basis functions. The number of gPC terms increases dramatically as the dimension of the random input variables increases. When the number of the gPC terms is larger than that of the available samples, a scenario that often occurs when the corresponding deterministic solver is computationally expensive, evaluation of the gPC expansion can be inaccurate due to over-fitting. We propose a fully Bayesian approach that allows for global recovery of the stochastic solutions, in both spatial and random domains, by coupling Bayesian model uncertainty and regularization regression methods. It allows the evaluation of the PC coefficients on a grid of spatial points, via (1) the Bayesian model average (BMA) or (2) the median probability model, and their construction as spatial functions on the spatial domain via spline interpolation. The former accounts for the model uncertainty and provides Bayes-optimal predictions; while the latter provides a sparse representation of the stochastic solutions by evaluating the expansion on a subset of dominating gPC bases. Moreover, the proposed methods quantify the importance of the gPC bases in the probabilistic sense through inclusion probabilities. We design a Markov chain Monte Carlo (MCMC) sampler that evaluates all the unknown quantities without the need of ad-hoc techniques. The proposed methods are suitable for, but not restricted to, problems whose stochastic solutions are sparse in the stochastic space with respect to the gPC bases while the deterministic solver involved is expensive. We demonstrate the accuracy and performance of the proposed methods and make comparisons with other approaches on solving elliptic SPDEs with 1-, 14- and 40-random dimensions.

97 MATHEMATICS AND COMPUTING↗

Taweret: a Python package for Bayesian model mixing

Uncertainty quantification using Bayesian methods is a growing area of research. Bayesian model mixing (BMM) is a recent development which combines the predictions from multiple models such that the fidelity of each model is preserved in the final result. Practical tools and analysis suites that facilitate such methods are therefore needed. Taweret introduces BMM to existing Bayesian uncertainty quantification efforts. Currently, Taweret contains three individual Bayesian model mixing techniques, each pertaining to a different type of problem structure; we encourage the future inclusion of user-developed mixing methods. Taweret’s first use case is in nuclear physics, but the package has been structured such that it should be adaptable to any research engaged in model comparison or model mixing.

Ingles, Kevin↗

Response Surface Model Building and Multidisciplinary Optimization Using D-Optimal Designs

This paper discusses response surface methods for approximation model building and multidisciplinary design optimization. The response surface methods discussed are central composite designs, Bayesian methods and D-optimal designs. An over-determined D-optimal design is applied to a configuration design and optimization study of a wing-body, launch vehicle. Results suggest that over determined D-optimal designs may provide an efficient approach for approximation model building and for multidisciplinary design optimization.

Unal, Resit↗

Bond Line Thickness Estimation in Composite Structures Using Multiple Inspection Techniques

Imaging and other nondestructive evaluation techniques are commonly used for material characterization and defect recognition in safety critical aerospace applications, with data fusion providing the framework for uncertainty quantification in these contexts. Most commonly, forward physics-based modeling predicts the response conditioned on material properties and defect assumptions, and probabilistic methods are used to infer the hidden state of subject of the inspection from a combination of prior information, likelihoods, and inspection data. In this paper Bayesian methods are used to estimate bond thickness in lap joints comprised of aluminum adherends using a combination of infrared thermography, digital radiography, and ultrasound. The accuracy of the fused estimates are validated against data generated from synthetic specimens, and by comparison against high resolution X-ray computed tomography inspections of built specimens.

thermal nondestructive evaluation↗

Bond Line Thickness Estimation in Composite Structures Using Multiple Inspection Techniques

Imaging and other nondestructive evaluation techniques are commonly used for material characterization and defect recognition in safety critical aerospace applications, with data fusion providing the framework for uncertainty quantification in these contexts. Most commonly, forward physics-based modeling predicts the response conditioned on material properties and defect assumptions, and probabilistic methods are used to infer the hidden state of the subject of the inspection from a combination of prior information, likelihoods, and inspection data. In this paper Bayesian methods are used to estimate bond thickness in lap joints comprised of aluminum adherends using a combination of infrared thermography and ultrasound. The concept of the conflation of probability distributions is applied to combine the posterior distributions derived from thermography and ultrasound and the quality of the fused estimates are compared against the individual estimates against synthetic data that was created to mimic the inspection of a lap joint comprised of aluminum adherends.

thermal nondestructive evaluation↗

Bayesian Monte Carlo Method for Nuclear Data Evaluation

A Bayesian Monte Carlo method is outlined which allows a systematic evaluation of nuclear reactions using TALYS. The result will be either an EXFOR-weighted covariance matrix or a collection of random files, each accompanied by an experiment based weight.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Single Gaussian process method for arbitrary tokamak regimes with a statistical analysis

Abstract Gaussian process regression is a Bayesian method for inferring profiles based on input data. The technique is increasing in popularity in the fusion community due to its many advantages over traditional fitting techniques including intrinsic uncertainty quantification and robustness to over-fitting. This work investigates the use of a new method, the change-point method, for handling the varying length scales found in different tokamak regimes. The use of the Student’s t-distribution for the Bayesian likelihood probability is also investigated and shown to be advantageous in providing good fits in profiles with many outliers. To compare different methods, synthetic data generated from analytic profiles is used to create a database enabling a quantitative statistical comparison of which methods perform the best. Using a full Bayesian approach with the change-point method, Matérn kernel for the prior probability, and Student’s t-distribution for the likelihood is shown to give the best results.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

New constraints on sodium production in globular clusters from the Na 23 ( He 3 , d ) Mg 24 reaction

The star-to-star anticorrelation of sodium and oxygen is a defining feature of globular clusters, but, to date, the astrophysical site responsible for this unique chemical signature remains unknown. Sodium enrichment within these clusters depends sensitively on reaction rate of the sodium destroying reactions 23 Na(p, γ) and 23 Na(p,α). In this paper, we report the results of a 23 Na( 3 He,d) 24 Mg transfer reaction carried out at Triangle Universities Nuclear Laboratory using a 21 MeV 3 He beam. Astrophysically relevant states in 24 Mg between 11 < E x < 12 MeV were studied using high-resolution magnetic spectroscopy, thereby allowing the extraction of excitation energies and spectroscopic factors. Bayesian methods are combined with the distorted wave Born approximation to assign statistically meaningful uncertainties to the extracted spectroscopic factors. For the first time, these uncertainties are propagated through to the estimation of proton partial widths. Our experimental data are used to calculate the reaction rate. The impact of the new rates are investigated using asymptotic giant branch star models. Furthermore, it is found that while the astrophysical conditions still dominate the total uncertainty, intramodel variations on sodium production from the 23 Na(p, γ) and 23 Na(p,α) reaction channels are a lingering source of uncertainty.

20 ≤ A ≤ 38↗

Towards the spatial resolution of metalloprotein charge states by detailed modeling of XFEL crystallographic diffraction

Oxidation states of individual metal atoms within a metalloprotein can be assigned by examining X-ray absorption edges, which shift to higher energy for progressively more positive valence numbers. Indeed, X-ray crystallography is well suited for such a measurement, owing to its ability to spatially resolve the scattering contributions of individual metal atoms that have distinct electronic environments contributing to protein function. However, as the magnitude of the shift is quite small, about +2 eV per valence state for iron, it has only been possible to measure the effect when performed with monochromated X-ray sources at synchrotron facilities with energy resolutions in the range 2–3 × 10 −4 (Δ E / E ). This paper tests whether X-ray free-electron laser (XFEL) pulses, which have a broader bandpass (Δ E / E = 3 × 10 −3 ) when used without a monochromator, might also be useful for such studies. The program nanoBragg is used to simulate serial femtosecond crystallography (SFX) diffraction images with sufficient granularity to model the XFEL spectrum, the crystal mosaicity and the wavelength-dependent anomalous scattering factors contributed by two differently charged iron centers in the 110-amino-acid protein, ferredoxin. Bayesian methods are then used to deduce, from the simulated data, the most likely X-ray absorption curves for each metal atom in the protein, which agree well with the curves chosen for the simulation. The data analysis relies critically on the ability to measure the incident spectrum for each pulse, and also on the nanoBragg simulator to predict the size, shape and intensity profile of Bragg spots based on an underlying physical model that includes the absorption curves, which are then modified to produce the best agreement with the simulated data. This inference methodology potentially enables the use of SFX diffraction for the study of metalloenzyme mechanisms and, in general, offers a more detailed approach to Bragg spot data reduction.

59 BASIC BIOLOGICAL SCIENCES↗

Scalable Statistical Analysis of Gaussian Models for Petascale Spatiotemporal Data (Final Technical Report)

Gaussian process models for spatial and spatiotemporal data are ubiquitous in scientific and engineering applications. Likelihood-based methods for fitting such models, which includes all Bayesian methods, have desirable statistical properties and are thus the methods of choice when feasible. However, calculating the likelihood function even once can be a challenge for N irregularly sited observations from such a process, requiring O(N 2 ) memory and O(N 3 ) complexity. Thus, there is a need for fast and accurate likelihood approximation even for N on the order of 10 5 , not to mention the 10 15 implied by petascale data. The main objective of this research was to develop computational tools for the statistical analysis of massive spatiotemporal datasets based on Gaussian process models. Another important objective was the development of appropriate statistical models for specific spatiotemporal processes arising in the physical sciences.

97 MATHEMATICS AND COMPUTING↗

Superresolution of a compact neutron spectrometer at energies relevant for fusion diagnostics

The ability to achieve resolution that is better than the instrument resolution (i.e., superresolution) is well known in optics, where it has been extensively studied. Unfortunately, there are only a handful of theoretical studies concerning superresolution of particle spectrometers, even though experimentalists are familiar with the enhancement of resolution that is achievable when appropriate methods of data analysis are used, such as maximum entropy and Bayesian methods. Knowledge of the superresolution factor is in many cases important. For example, in applications of neutron spectrometry to fusion diagnostics, the temperature of a burning plasma is an important physical parameter which may be inferred from the width of the peak of the neutron energy spectrum, and the ability to determine this width depends on the superresolution factor. Kosarev has derived an absolute limit for resolution enhancement using arguments based on a well known theorem of Shannon. Most calculations of superresolution factors in the literature, however, are based on the assumption of Gaussian, translationally invariant response functions and therefore not directly applicable to neutron spectrometers which typically have response functions not satisfying these requirements. In this work, we develop a procedure that allows us to overcome these difficulties and we derive estimates of superresolution for liquid scintillator spectrometers of a type commonly used for neutron measurements. Theoretical superresolution factors are compared to experimental results.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

CHARACTERIZING THE CONTAMINATING DISTANCE DISTRIBUTION FOR BAYESIAN SUPERNOVA COSMOLOGY

Measurements of the equation of state of dark energy from surveys of thousands of Type Ia Supernovae will be limited by spectroscopic follow-up and must therefore rely on photometric identification, increasing the chance that the sample is contaminated by core collapse supernovae (CC SNe). Bayesian methods for SN cosmology can remove contamination bias while maintaining high statistical precision but are sensitive to the choice of parameterization of the contaminating distance distribution. We use simulations to investigate the form of the contaminating distribution and its dependence on the absolute magnitudes, light curve shapes, colors, extinction, and redshifts of CC SNe. We find that the CC luminosity function (LF) dominates the distance distribution function, but its shape is increasingly distorted as the redshift increases and more CC SNe fall below the survey magnitude limit. The shapes and colors of the CC light curves generally shift the distance distribution, and their effect on the CC distances is correlated. We compare the simulated distances to the first year results of the SDSS-II SN survey and find that the SDSS distance distributions can be reproduced with simulated CC SNe that are {approx}1 mag fainter than the standard Richardson et al. LFs, which do not produce a good fit. To exploit the full power of the Bayesian parameter estimation method, parameterization of the contaminating distribution should be guided by the current knowledge of the CC LFs, coupled with the effects of the survey selection and magnitude limit, and allow for systematic shifts caused by the parameters of the distance fit.

79 ASTRONOMY AND ASTROPHYSICS↗

Bayesian inference for plasmonic nanometrology

Here, we introduce a Bayesian method for the characterization of plasmonic nanoparticles, which is applicable to both near- and far-field problems. Designed to combine data generated from any photon-plasmon interaction experiment with physically motivated theoretical models, our approach leverages state-of-the-art Markov chain Monte Carlo sampling techniques and returns parameter estimates on nanometric scales. Simulated spectral data sets, describing resonant scattering of photons from ellipsoidal and toroidal nanoparticles, are explored as concrete examples of our approach, with the resulting Bayesian estimates showing excellent agreement with the ground truth, even under conditions of high statistical noise. By incorporating Bayes factors into the method as well, we reveal how model selection can determine which one of competing geometric shapes better explains the observed data. Our comprehensive nanometrology procedure can be tailored to a variety of light-particle interaction models, and its reliance on Bayesian inference furnishes automatic uncertainty quantification. In addition to applicability to a host of plasmonic configurations such as nanoparticle dimers, trimers, and array studies, it is proposed that the presented analysis can be extended to the quantum regime, where nonclassical photon statistics may provide additional insight for inference of scatterer properties.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Neural posterior unfolding

Differential cross section measurements are the currency of scientific exchange in particle and nuclear physics. A key challenge for these analyses is the correction for detector distortions, known as deconvolution or unfolding. Binned unfolding of cross section measurements traditionally rely on the regularized inversion of the response matrix that represents the detector response, mapping pre-detector (`particle level') observables to post-detector (`detector level') observables. In this paper we introduce Neural Posterior Unfolding, a modern, Bayesian approach that leverages normalizing flows for unfolding. By using normalizing flows for neural posterior estimation, NPU offers several key advantages including implicit regularization through the neural network architecture, fast amortized inference that eliminates the need for repeated retraining, and direct access to the full uncertainty in the unfolded result. In addition to introducing NPU, we implement a classical Bayesian unfolding method called Fully Bayesian Unfolding (FBU) in modern Python so it can also be studied. These tools are validated on simple Gaussian examples and then tested on simulated jet substructure examples from the Large Hadron Collider (LHC). We find that the Bayesian methods are effective and worth additional development to be analysis ready for cross section measurements at the LHC and beyond.

Analysis and statistical methods↗

Bayesian mass estimates of the milky way: including measurement uncertainties with hierarchical bayes

We present a hierarchical Bayesian method for estimating the total mass and mass profile of the Milky Way Galaxy. The new hierarchical Bayesian approach further improves the framework presented by Eadie et al. and Eadie and Harris and builds upon the preliminary reports by Eadie et al. The method uses a distribution function f(E,L) to model the Galaxy and kinematic data from satellite objects, such as globular clusters (GCs), to trace the Galaxy’s gravitational potential. A major advantage of the method is that it not only includes complete and incomplete data simultaneously in the analysis, but also incorporates measurement uncertainties in a coherent and meaningful way. We first test the hierarchical Bayesian framework, which includes measurement uncertainties, using the same data and power-law model assumed in Eadie and Harris and find the results are similar but more strongly constrained. Next, we take advantage of the new statistical framework and incorporate all possible GC data, finding a cumulative mass profile with Bayesian credible regions. This profile implies a mass within 125 kpc of 4.8×10{sup 11}M{sub ⊙} with a 95% Bayesian credible region of (4.0--5.8)×10{sup 11}M{sub ⊙}. Our results also provide estimates of the true specific energies of all the GCs. By comparing these estimated energies to the measured energies of GCs with complete velocity measurements, we observe that (the few) remote tracers with complete measurements may play a large role in determining a total mass estimate of the Galaxy. Thus, our study stresses the need for more remote tracers with complete velocity measurements.

79 ASTRONOMY AND ASTROPHYSICS↗

A Multi-Objective Bayesian Optimization Approach Using the Weighted Tchebycheff Method

Abstract Bayesian optimization (BO) is a low-cost global optimization tool for expensive black-box objective functions, where we learn from prior evaluated designs, update a posterior surrogate Gaussian process model, and select new designs for future evaluation using an acquisition function. This research focuses upon developing a BO model with multiple black-box objective functions. In the standard multi-objective (MO) optimization problem, the weighted Tchebycheff method is efficiently used to find both convex and non-convex Pareto frontiers. This approach requires knowledge of utopia values before we start optimization. However, in the BO framework, since the functions are expensive to evaluate, it is very expensive to obtain the utopia values as a prior knowledge. Therefore, in this paper, we develop a MO-BO framework where we calibrate with multiple linear regression (MLR) models to estimate the utopia value for each objective as a function of design input variables; the models are updated iteratively with sampled training data from the proposed MO-BO. These iteratively estimated mean utopia values are used to formulate the weighted Tchebycheff MO acquisition function. The proposed approach is implemented in two numerical test examples and one engineering design problem of optimizing thin tube geometries under constant loading of temperature and pressure, with minimizing the risk of creep-fatigue failure and design cost, along with risk-based and manufacturing constraints. Finally, the model accuracy with frequentist, Bayesian and without MLR-based calibration are compared to true Pareto solutions.

Engineering↗

Exploration with Scalable Gaussian Process Reinforcement Learning

Exploration is a challenging problem in reinforcement learning (RL), especially in environments with sparse rewards. Quantifying and utilizing the parametric uncertainty has been shown to be paramount for successful exploration [Osband et al., 2018]. Bayesian, or approximately Bayesian, methods present a principled means of estimating the parametric uncertainty in RL problems. Gaussian processes, nonparametric Bayesian models, are often impractical due to poor scalability and computational bottlenecks. We introduce a scalable Gaussian process RL (GPRL) method which directly induces sparsity in the covariance matrix to facilitate faster computation. This is a departure from previous GPRL methods which instead rely on data reduction and subsampling. We compare various covariance-based exploration techniques (Thompson sampling, upper confidence bound, and probabilistic maximum variance) which leverage our scalable GP framework in sparse reward environments. Finally, we show favorable comparison against the bootstrapped deep Q-Network.

97 MATHEMATICS AND COMPUTING↗

Generic inference of inflation models by non-Gaussianity and primordial power spectrum reconstruction

We present a generic inference method for inflation models from observational data by the usage of higher-order statistics of the curvature perturbation on uniform density hypersurfaces. This method is based on the calculation of the posterior for the primordial non-Gaussianity parameters f{sub NL} and g{sub NL}, which in general depend on specific parameters of inflation and reheating models, and enables to discriminate among the still viable inflation models. To keep analyticity as far as possible to dispense with numerically expensive sampling techniques a saddle-point approximation is introduced, whose precision is validated for a numerical toy example. The mathematical formulation is done in a generic way so that the approach remains applicable to cosmic microwave background data as well as to large scale structure data. Additionally, we review a few currently interesting inflation models and present numerical toy examples thereof in two and three dimensions to demonstrate the efficiency of the higher-order statistics method. A second quantity of interest is the primordial power spectrum. Here, we present two Bayesian methods to infer it from observational data, the so called critical filter and an extension thereof with smoothness prior, both allowing for a non-parametric spectrum reconstruction. These methods are able to reconstruct the spectra of the observed perturbations and the primordial ones of curvature perturbation even in case of non-Gaussianity and partial sky coverage. We argue that observables like T- and B-modes permit to measure both spectra. This also allows to infer the level of non-Gaussianity generated since inflation.

79 ASTRONOMY AND ASTROPHYSICS↗