Search NASA⌕ Search

SEARCH · Search NASA

Results for “bayesian inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30

Accelerating parameter inference with graphics processing units

Gravitational wave Bayesian parameter inference involves repeated comparisons of GW data to generic candidate predictions. Even with algorithmically efficient methods like RIFT or reduced-order quadrature, the time needed to perform these calculations and overall computational cost can be significant compared to the minutes to hours needed to achieve the goals of low-latency multimessenger astronomy. By translating some elements of the RIFT algorithm to operate on graphics processing units (GPU), we demonstrate substantial performance improvements, enabling dramatically reduced overall cost and latency.

97 MATHEMATICS AND COMPUTING↗

Multiverse: Bayesian model selection for neural networks

Multiverse is a code repository for a set of tools for Bayesian model selection for neural networks. The goal of the tools is to provide capabilities for selecting among prior and model specifications for Bayesian neural networks. Multiverse will include tools for creating Bayesian neural networks, evaluating the Bayesian model evidence, and performing inference in Bayesian neural networks. These components are written in Python, a high-level programming language that takes advantage of the Python ecosystem of high-quality open-source packages for machine learning and signal processing.

Klein, Natalie↗

Lens Model Accuracy in the Expected LSST Lensed AGN Sample

Strong gravitational lensing of active galactic nuclei (AGN) enables measurements of cosmological parameters through time-delay cosmography (TDC). With data from the upcoming LSST survey, we anticipate using a sample of O(1000) lensed AGN for TDC. To prepare for this dataset and enable this measurement, we construct and analyze a realistic mock sample of 1300 systems drawn from the OM10 (Oguri & Marshall 2010) catalog of simulated lenses with AGN sources at $z<3.1$ in order to test a key aspect of the analysis pipeline, that of the lens modeling. We realize the lenses as power law elliptical mass distributions and simulate 5-year LSST i-band coadd images. From every image, we infer the lens mass model parameters using neural posterior estimation (NPE). Focusing on the key model parameters, $θ_E$ (the Einstein Radius) and $γ_{lens}$ (the projected mass density profile slope), with consistent mass-light ellipticity correlations in test and training data, we recover $θ_E$ with less than 1% bias per lens, 6.5% precision per lens and $γ_{lens}$ with less than 3% bias per lens, 8% precision per lens. We find that lens light subtraction prior to modeling is only useful when applied to data sampled from the training prior. If emulated deconvolution is applied to the data prior to modeling, precision improves across all parameters by a factor of 2. Finally, we combine the inferred lens mass models using Bayesian Hierarchical Inference to recover the global properties of the lens sample with less than 1% bias.

Venkatraman, Padmavathi [Illinois U., Urbana; KIPA↗

A Bayesian statistical approach to inferring particle dynamics from in-situ pump POC and chloropigment data from the Mediterranean Sea

Concentrations of chloropigments and particulate organic carbon (POC) in large-volume in-situ pump samples from the Mediterranean Sea were used to estimate rate constants of processes that control the fate of particles, and specifically chloropigments, in the water column. In this paper we introduce a Bayesian statistical inversion method that combines the data with a new box model and has the capacity to infer rate constants for POC respiration/dissolution, chlorophyll and pheopigment degradation, and particle aggregation and disaggregation. We use first-order kinetics to model disaggregation, and use both first-order and second-order kinetics to model aggregation. Using these methods, the estimated small-particle (1–70 μm) POC respiration rate constant was 2.44 -1.00 +1.69 yr -1 (0.41 yr). The estimated disaggregation and second-order aggregation rate constants were 85.6 -36.4 +63.4 yr -1 (1.17×10 -2 yr) and 2.78 -1.17 +2.01 μM -1 yr -1 , respectively. Using the optimal rate constants and the corresponding particle concentrations, disaggregation is ~4.2 times faster than the small-size POC dissolution rate, which indicates that disaggregation is a dominant processes at the time of sampling. More importantly, by comparing our results with those of previous studies, we conclude that sampling methods have less influence than tracers themselves on inferring particle dynamic rate constants. We previously introduced a somewhat similar approach to modeling SV sediment trap data, but large volume pumps are a much more common sample collection method in oceanographic surveys than SV sediment traps, and thus our new model should have a wider applicability.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Intrepid MCMC: Metropolis-Hastings with exploration

In engineering examples, one often encounters the need to sample from unnormalized distributions with complex shapes that may also be implicitly defined through a physical or numerical simulation model, making it computationally expensive to evaluate the associated density function. For such cases, MCMC has proven to be an invaluable tool. Random-walk Metropolis Methods (also known as Metropolis-Hastings (MH)), in particular, are highly popular for their simplicity, flexibility, and ease of implementation. However, most MH algorithms suffer from significant limitations when attempting to sample from distributions with multiple modes (particularly disconnected ones). Here, in this paper, we present Intrepid MCMC - a novel MH scheme that utilizes a simple coordinate transformation to significantly improve the mode-finding ability and convergence rate to the target distribution of random-walk Markov chains while retaining most of the simplicity of the vanilla MH paradigm. Through multiple examples, we showcase the improvement in the performance of Intrepid MCMC over vanilla MH for a wide variety of target distribution shapes. We also provide an analysis of the mixing behavior of the Intrepid Markov chain, as well as the efficiency of our algorithm for increasing dimensions. A thorough discussion is presented on the practical implementation of the Intrepid MCMC algorithm. Finally, its utility is highlighted through a Bayesian parameter inference problem for a two-degree-of-freedom oscillator under free vibration.

97 - MATHEMATICS AND COMPUTING↗

Altering Terahertz Sound Propagation in a Liquid upon Nanoparticle Immersion

One of the grand challenges of new generation Condensed Matter physicists is the development of novel devices enabling the control of sound propagation at terahertz frequency. Indeed, phonon excitations in this frequency window are the leading conveyor of heat transfer in insulators. Their manipulation is thus critical to implementing heat management based on the structural design. To explore the possibility of controlling the damping of sound waves, we used high spectral contrast Inelastic X-ray Scattering (IXS) to comparatively study terahertz acoustic damping in a dilute suspension of 50 nm nanospheres in glycerol and on pure glycerol. Bayesian inference-based modeling of measured spectra indicates that, at sufficiently large distances, the spectral contribution of collective modes in the glycerol suspension becomes barely detectable due to the enhanced damping, the weakening, and the slight softening of the dominant acoustic mode.

36 MATERIALS SCIENCE↗

PINN surrogate of Li-ion battery models for parameter inference, Part II: Regularization and application of the pseudo-2D model

Bayesian parameter inference is useful to improve Li-ion battery diagnostics and can help formulate battery aging models. However, it is computationally intensive and cannot be easily repeated for multiple cycles, multiple operating conditions, or multiple replicate cells. To reduce the computational cost of Bayesian calibration, numerical solvers for physics-based models can be replaced with faster surrogates. A physics-informed neural network (PINN) is developed as a surrogate for the pseudo-2D (P2D) battery model calibration. For the P2D surrogate, additional training regularization was needed as compared to the PINN single-particle model (SPM) developed in Part I. Both the PINN SPM and P2D surrogate models are exercised for parameter inference and compared to data obtained from a direct numerical solution of the governing equations. A parameter inference study highlights the ability to use these PINNs to calibrate scaling parameters for the cathode Li diffusion and the anode exchange current density. By realizing computational speed-ups of ~2250x for the P2D model, as compared to using standard integrating methods, the PINN surrogates enable rapid state-of-health diagnostics. Finally, in the low-data availability scenario, the testing error was estimated to ~2 mV for the SPM surrogate and ~10 mV for the P2D surrogate which could be mitigated with additional data.

25 ENERGY STORAGE↗

Uncertainties in Density and Simulation Parameters for Radiographic Reconstructions Using Machine Learning

We will develop new and improved methods that will enable a fuller and more extensive use of experimental data, such as from radiographic imaging, towards better characterizing and reducing uncertainties in predictive modeling of weapons performance. We will achieve this by leveraging recent developments in the areas of computational imaging, statistical and machine learning, and reduced order modeling. Key new aspects of our approach include (a) a coupling of deep learning based density reconstruction with fast hydrodynamics simulators that will permit the development of certain guarantees on extrapolatability and bounds on certain other hydrodynamics-related para- metric uncertainties and (b) a dual approach towards better characterizing uncertainties in density reconstruction using deep learning based surrogates to accelerate Bayesian reconstructions on the one hand and using variational inference and Bayesian machine learning on the other hand.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Inference, Prediction, & Entropy-Rate Estimation of Continuous-Time, Discrete-Event Processes

Inferring models, predicting the future, and estimating the entropy rate of discrete-time, discrete-event processes is well-worn ground. However, a much broader class of discrete-event processes operates in continuous-time. Here, we provide new methods for inferring, predicting, and estimating them. The methods rely on an extension of Bayesian structural inference that takes advantage of neural network’s universal approximation power. Based on experiments with complex synthetic data, the methods are competitive with the state-of-the-art for prediction and entropy-rate estimation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Inference of experimental radial impurity transport on Alcator C-Mod: Bayesian parameter estimation and model selection

We present a fully Bayesian approach for the inference of radial profiles of impurity transport coefficients and compare its results to neoclassical, gyrofluid and gyrokinetic modeling. Using nested sampling, the Bayesian Impurity Transport InferencE (BITE) framework can handle complex parameter spaces with multiple possible solutions, offering great advantages in interpretative power and reliability with respect to previously demonstrated methods. BITE employs a forward model based on the pySTRAHL package, built on the success of the well-known STRAHL code [Dux, IPP Report, 2004], to simulate impurity transport in magnetically-confined plasmas. In this paper, we focus on calcium (Ca, Z=20) Laser Blow-Off injections into Alcator C-Mod plasmas. Multiple Ca atomic lines are diagnosed via high-resolution X-ray Imaging Crystal Spectroscopy and Vacuum Ultra-Violet measurements. We analyze a sawtoothing I-mode discharge for which neoclassical and turbulent (quasilinear and nonlinear) predictions are also obtained. Here, we find good agreement in diffusion across the entire radial extent, while turbulent convection and density profile peaking are estimated to be larger in experiment than suggested by theory. Efforts and challenges associated with the inference of experimental pedestal impurity transport are discussed.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Inference of Experimental Radial Impurity Transport on Alcator C-Mod: Bayesian Parameter Estimation and Model Selection.

We present a fully Bayesian approach for the inference of radial profiles of impurity transport coefficients and compare its results to neoclassical, gyrofluid and gyrokinetic modeling. Using nested sampling, the Bayesian Impurity Transport InferencE (BITE) framework can handle complex parameter spaces with multiple possible solutions, offering great advantages in interpretative power and reliability with respect to previously demonstrated methods. BITE employs a forward model based on the pySTRAHL package, built on the success of the well-known STRAHL code [Dux, IPP Report, 2004], to simulate impurity transport in magnetically-confined plasmas. In this paper, we focus on calcium (Ca, Z=20) Laser Blow-Off injections into Alcator C-Mod plasmas. Multiple Ca atomic lines are diagnosed via high-resolution X-ray Imaging Crystal Spectroscopy and Vacuum Ultra-Violet measurements. We analyze a sawtoothing I-mode discharge for which neoclassical and turbulent (quasilinear and nonlinear) predictions are also obtained. We find good agreement in diffusion across the entire radial extent, while turbulent convection and density profile peaking are estimated to be larger in experiment than suggested by theory. Efforts and challenges associated with the inference of experimental pedestal impurity transport are discussed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

The Langmuir probe system in the Wendelstein 7-X test divertor

Here, the design and evaluation of the Langmuir probe system used in the first divertor operation phase of Wendelstein 7-X is described. The probes are integrated into the target plates and have individually facetted surfaces to keep the angle of incidence of the magnetic field within an appropriate range for different magnetic configurations. Multiple models for the derivation of plasma parameters from current–voltage characteristics are introduced. These are analyzed with regard to their assumptions and limitations, generalized, and adapted to our use case. A detailed comparison is made to determine the most suitable model. It is found that the choice of model has a large impact, for example, resulting in a change in the inferred temperatures of up to a factor two. This evaluation is implemented in a Bayesian modeling framework and automated to allow for joint analysis with other diagnostics and a replacement of ad hoc assumptions. We rigorously treat parameter uncertainties, revealing strong correlations between them. General and flexible model formulations permit an expansion to additional effects.

47 OTHER INSTRUMENTATION↗

On the quantification and efficient propagation of imprecise probabilities with copula dependence

This paper addresses the problem of quantification and propagation of uncertainties associated with dependence modeling when data for characterizing probability models are limited. Practically, the system inputs are often assumed to be mutually independent or correlated by a multivariate Gaussian distribution. However, this subjective assumption may introduce bias in the response estimate if the real dependence structure deviates from this assumption. In this work, we overcome this limitation by introducing a flexible copula dependence model to capture complex dependencies. Here, a hierarchical Bayesian multimodel approach is proposed to quantify uncertainty in dependence model-form and model parameters that result from small data sets. This approach begins by identifying, through Bayesian multimodel inference, a set of candidate marginal models and their corresponding model probabilities, and then estimating the uncertainty in the copula-based dependence structure, which is conditional on the marginals and their parameters. The overall uncertainties integrating marginals and copulas are probabilistically represented by an ensemble of multivariate candidate densities. A novel importance sampling reweighting approach is proposed to efficiently propagate the overall uncertainties through a computational model. Through an example studying the influence of constituent properties on the out-of-plane properties of transversely isotropic E-glass fiber composites, we show that the composite property with copula-based dependence model converges to the true estimate as data set size increases, while an independence or arbitrary Gaussian correlation assumption leads to a biased estimate.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Optimal Cosmic Microwave Background Lensing Reconstruction and Parameter Estimation with SPTpol Data

Here, we perform the first simultaneous Bayesian parameter inference and optimal reconstruction of the gravitational lensing of the cosmic microwave background (CMB), using 100 deg 2 of polarization observations from the SPTpol receiver on the South Pole Telescope. These data reach noise levels as low as 5.8 μK arcmin in polarization, which are low enough that the typically used quadratic estimator (QE) technique for analyzing CMB lensing is significantly suboptimal. Conversely, the Bayesian procedure extracts all lensing information from the data and is optimal at any noise level. We infer the amplitude of the gravitational lensing potential to be ${A}_{\phi }=0.949\,\pm \,0.122$ using the Bayesian pipeline, consistent with our QE pipeline result, but with 17% smaller error bars. The Bayesian analysis also provides a simple way to account for systematic uncertainties, performing a similar job as frequentist "bias hardening" or linear bias correction, and reducing the systematic uncertainty on A Φ due to polarization calibration from almost half of the statistical error to effectively zero. Finally, we jointly constrain A Φ along with A L , the amplitude of lensing-like effects on the CMB power spectra, demonstrating that the Bayesian method can be used to easily infer parameters both from an optimal lensing reconstruction and from the delensed CMB, while exactly accounting for the correlation between the two. These results demonstrate the feasibility of the Bayesian approach on real data, and pave the way for future analysis of deep CMB polarization measurements with SPT-3G, Simons Observatory, and CMB-S4, where improvements relative to the QE can reach 1.5 times tighter constraints on A Φ and seven times lower effective lensing reconstruction noise.

79 ASTRONOMY AND ASTROPHYSICS↗

Bayesian Hierarchical Models for Parameter Inference with Missing Data: Supernova Cosmology Case Study [Slides]

Large scale astronomical surveys are going wider and deeper than ever before. However, astronomers, cosmologists and theorists continue to face the perennial issue that their data sets are often incomplete in magnitude space and must be carefully treated in order to avoid Malmquist bias, especially in the field of supernova cosmology. Historically, cosmological parameter inference in supernova cosmology was done using χ2 methodology; however, recent years have seen a rise in the use of Bayesian Hierarchical Models. In this presentation we develop a Bayesian Hierarchical methodology to account for magnitude limited surveys and present a specific application to cosmological parameter inference and model selection in supernova cosmology.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗