Search NASA⌕ Search

SEARCH · Search NASA

Results for “bayesian inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Disentangling the Black Hole Mass Spectrum with Photometric Microlensing Surveys

Abstract From the formation mechanisms of stars and compact objects to nuclear physics, modern astronomy frequently leverages surveys to understand populations of objects to answer fundamental questions. The population of dark and isolated compact objects in the Galaxy contains critical information related to many of these topics, but is only practically accessible via gravitational microlensing. However, photometric microlensing observables are degenerate for different types of lenses, and one can seldom classify an event as involving either a compact object or stellar lens on its own. To address this difficulty, we apply a Bayesian framework that treats lens type probabilistically and jointly with a lens population model. This method allows lens population characteristics to be inferred despite intrinsic uncertainty in the lens class of any single event. We investigate this method’s effectiveness on a simulated ground-based photometric survey in the context of characterizing a hypothetical population of primordial black holes (PBHs) with an average mass of 30 M ⊙ . On simulated data, our method outperforms current black hole (BH) lens identification pipelines and characterizes different subpopulations of lenses while jointly constraining the PBH contribution to dark matter to ≈25%. Key to robust inference, our method can marginalize over population model uncertainty. We find the lower mass cutoff for stellar origin BHs, a key observable in understanding the BH mass gap, particularly difficult to infer in our simulations. This work lays the foundation for cutting-edge PBH abundance constraints to be extracted from current photometric microlensing surveys.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

A Robust Estimate of Continental-Scale Terrestrial Carbon Sinks Using GOSAT XCO 2 Retrievals

Satellite XCO 2 retrievals could improve the estimates of surface carbon fluxes, but it remains unknown on what scales these estimates are robust. Here, we use the time-dependent Bayesian synthesis top-down method and prior net ecosystem exchanges (NEEs) from 12 terrestrial biosphere models (TBMs) to infer the monthly carbon fluxes of 51 land regions with constraints by GOSAT XCO 2 retrievals. We find that the uncertainty (standard deviation of 12 TBMs) reduction rates (uncertainty reduction rate (URR)) decrease significantly at decreasing spatial scales. On the continental-scale, the mean URR is about 57%, and the annual and seasonal cycle estimates of NEE are rather robust. The evaluation shows that the posterior CO 2 concentrations are significantly improved at the continental scale. Our study suggests that the GOSAT XCO 2 can only promise a robust continental-scale NEE estimate and improving the XCO 2 accuracy is an effective way to achieve robust estimates on smaller scales under current spatial coverage.

58 GEOSCIENCES↗
DOE OSTI2024

Forward variable selection enables fast and accurate dynamic system identification with Karhunen-Loève decomposed Gaussian processes

A promising approach for scalable Gaussian processes (GPs) is the Karhunen-Loève (KL) decomposition, in which the GP kernel is represented by a set of basis functions which are the eigenfunctions of the kernel operator. Such decomposed kernels have the potential to be very fast, and do not depend on the selection of a reduced set of inducing points. However KL decompositions lead to high dimensionality, and variable selection thus becomes paramount. This paper reports a new method of forward variable selection, enabled by the ordered nature of the basis functions in the KL expansion of the Bayesian Smoothing Spline ANOVA kernel (BSS-ANOVA), coupled with fast Gibbs sampling in a fully Bayesian approach. It quickly and effectively limits the number of terms, yielding a method with competitive accuracies, training and inference times for tabular datasets of low feature set dimensionality. Theoretical computational complexities are O ( N P 2 ) in training and O ( P ) per point in inference, where N is the number of instances and P the number of expansion terms. The inference speed and accuracy makes the method especially useful for dynamic systems identification, by modeling the dynamics in the tangent space as a static problem, then integrating the learned dynamics using a high-order scheme. The methods are demonstrated on two dynamic datasets: a ‘Susceptible, Infected, Recovered’ (SIR) toy problem, along with the experimental ‘Cascaded Tanks’ benchmark dataset. Comparisons on the static prediction of time derivatives are made with a random forest (RF), a residual neural network (ResNet), and the Orthogonal Additive Kernel (OAK) inducing points scalable GP, while for the timeseries prediction comparisons are made with LSTM and GRU recurrent neural networks (RNNs) along with the SINDy package.

Hayes, Kyle↗
DOE OSTI2020

"Sintering" Models and In-Situ Experiments: Data Assimilation for Microstructure Prediction in SLS Additive Manufacturing of Nylon Components

Selective laser sintering methods are workhorses for additively manufacturing polymer-based components. The ease of rapid prototyping also means it is easy to produce illicit components. It is necessary to have a data-calibrated in-situ physical model of the build process in order to predict expected and defective microstructure characteristics that inform component provenance. Toward this end, sintering models are calibrated and characteristics such as component defects are explored. This is accomplished by assimilating multiple data streams, imaging analysis, and computational model predictions in an adaptive Bayesian parameter estimation algorithm. From these data sources, along with a phase-field model, bulk porosity distributions are inferred. Model parameters are constrained to physically-relevant search directions by sensitivity analysis, and then matched to predictions using adaptive sampling. Using this feedback loop, data-constrained estimates of sintering model parameters along with uncertainty bounds are obtained.

3D printing, Additive Manufacturing, polymer, sint↗
DOE OSTI2019

Scalable optimal Bayesian classification of single-cell trajectories under regulatory model uncertainty

Single-cell gene expression measurements offer opportunities in deriving mechanistic understanding of complex diseases, including cancer. However, due to the complex regulatory machinery of the cell, gene regulatory network (GRN) model inference based on such data still manifests significant uncertainty. The goal of this paper is to develop optimal classification of single-cell trajectories accounting for potential model uncertainty. Partially-observed Boolean dynamical systems (POBDS) are used for modeling gene regulatory networks observed through noisy gene-expression data. We derive the exact optimal Bayesian classifier (OBC) for binary classification of single-cell trajectories. The application of the OBC becomes impractical for large GRNs, due to computational and memory requirements. To address this, we introduce a particle-based single-cell classification method that is highly scalable for large GRNs with much lower complexity than the optimal solution. The performance of the proposed particle-based method is demonstrated through numerical experiments using a POBDS model of the well-known T-cell large granular lymphocyte (T-LGL) leukemia network with noisy time-series gene-expression data.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Simultaneous inference of the compressibility and inelastic response of tantalum under extreme loading

We study the deformation of tantalum under extreme loading conditions. Experimental velocity data are drawn from both ramp loading experiments on Sandia’s Z-machine and gas gun compression experiments. The drive conditions enable the study of materials under pressures greater than 100 GPa. We provide a detailed forward model of the experiments including a model of the magnetic drive for the Z-machine. Utilizing these experiments, we simultaneously infer several different types of physically motivated parameters describing equation of state, plasticity, and anelasticity via the computational device of Bayesian model calibration. Characteristics of the resulting calculated posterior distributions illustrate relationships among the parameters of interest via the degree of cross correlation. The calibrated velocity traces display good agreement with the experiments up to experimental uncertainty as well as improvement over previous calibrations. Examining the Z-shots and gun-shots together and separately reveals a trade-off between accuracy and transferability across different experimental conditions. Implications for model calibration, limitations from model form, and suggestions for improvements are discussed.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

Correlations between the Neutron Star Mass–Radius Relation and the Equation of State of Dense Matter

We develop an analytic method of inverting the Tolman–Oppenheimer–Volkoff relations to high accuracy. In principle, a specified energy density–pressure relation gives a unique mass–radius (M–R) relation and vice versa. Our method is developed from the strong correlations that are shown to exist between the neutron star mass–radius curve and the equation of state (EOS) or pressure–energy density relation. Selecting points that have masses equal to fixed fractions of the maximum mass, we find a semi-universal power-law relation between the central energy densities, pressures, sound speeds, chemical potentials, and number densities of those stars, with the maximum mass and the radii of one or more fractional maximum mass points. Rms fitting accuracies, for EOSs without large first-order phase transitions, are typically 0.5% for all quantities at all mass points. The method also works well, although less accurately, in reconstructing the EOS of hybrid stars with first-order phase transitions. These results permit, in effect, an analytic method of inverting an arbitrary M–R curve to yield its underlying EOS. We discuss applications of this inversion technique to the inference of the dense matter EOS from measurements of neutron star masses and radii as a possible alternative to traditional Bayesian approaches.

Bayesian statistics↗
DOE OSTI2022

Multimodel ensemble predictions of precipitation using bayesian neural networks

Multimodel ensembling improves predictions and considers model uncertainties. In this study, we present a Bayesian Neural Network (BNN) ensemble approach for large-scale precipitation predictions based on a set of climate models. BNN infers spatiotemporally varying model weights and biases through the calibration against observations. This ensemble scheme of BNN sufficiently leverages individual model skill for accurate predictions as well as provides interpretability about which models contribute more to the ensemble prediction at which locations and times to inform model development. Additionally, BNN accurately quantifies epistemic uncertainty to avoid overconfident projections. We demonstrate BNN’s superior prediction performance to three state-of-the-art ensemble approaches and discuss its interpretability and uncertainty quantification.

Fan, Patrick↗
DOE OSTI2022

Multimodel Ensemble Predictions of Precipitation using Bayesian Neural Networks

Multimodel ensembling improves predictions and considers model uncertainties. In this study, we present a Bayesian Neural Network (BNN) ensemble approach for large-scale precipitation predictions based on a set of climate models. BNN infers spatiotemporally varying model weights and biases through the calibration against observations. This ensemble scheme of BNN sufficiently leverages individual model skill for accurate predictions as well as provides interpretability about which models contribute more to the ensemble prediction at which locations and times to inform model development. Additionally, BNN accurately quantifies epistemic uncertainty to avoid overconfident projections. We demonstrate BNN’s superior prediction performance to three state-of-the-art ensemble approaches and discuss its interpretability and uncertainty quantification.

Fan, Patrick↗
DOE OSTI2019

Scalable and efficient learning from crowds with Gaussian processes

Over the last few years, multiply-annotated data has become a very popular source of information. Online platforms such as Amazon Mechanical Turk have revolutionized the labelling process needed for any classification task, sharing the effort between a number of annotators (instead of the classical single expert). This crowdsourcing approach has introduced new challenging problems, such as handling disagreements on the annotated samples or combining the unknown expertise of the annotators. Probabilistic methods, such as Gaussian Processes (GP), have proven successful to model this new crowdsourcing scenario. However, GPs do not scale up well with the training set size, which makes them prohibitive for medium-to-large datasets (beyond 10K training instances). This constitutes a serious limitation for current real-world applications. In this work, we introduce two scalable and efficient GP-based crowdsourcing methods that allow for processing previously-prohibitive datasets. The first one is an efficient and fast approximation to GP with squared exponential (SE) kernel. The second allows for learning a more flexible kernel at the expense of a heavier training (but still scalable to large datasets). Since the latter is not a GP-SE approximation, it can be also considered as a whole new scalable and efficient crowdsourcing method, useful for any dataset size. Both methods use Fourier features and variational inference, can predict the class of new samples, and estimate the expertise of the involved annotators. A complete experimentation compares them with state-of-the-art probabilistic approaches in synthetic and real crowdsourcing datasets of different sizes. Finally, they stand out as the best performing approach for large scale problems. Moreover, the second method is competitive with the current state-of-the-art for small datasets.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2025

Jensen–Shannon divergence based novel loss functions for Bayesian neural networks

Bayesian neural networks (BNNs) are state-of-the-art machine learning methods that can naturally regularize and systematically quantify uncertainties using their stochastic parameters. Kullback–Leibler (KL) divergence-based variational inference used in BNNs suffer from unstable optimization and challenges in approximating light-tailed posteriors due to the unbounded nature of the KL divergence. To resolve these issues, we formulate a novel loss function for BNNs based on a new modification to the generalized Jensen–Shannon (JS) divergence, which is bounded. In addition, we propose a Geometric JS divergence-based loss, which is computationally efficient since it can be evaluated analytically. We found that the JS divergence-based variational inference is intractable, and hence employed a constrained optimization framework to formulate these losses. Our theoretical analysis and empirical experiments on multiple regression and classification data sets suggest that the proposed losses perform better than the KL divergence-based loss, especially when the data sets are noisy or biased. Specifically, there are approximately 5% and 8% improvements in accuracy for a noise-added CIFAR-10 dataset and a regression dataset, respectively. There is about 13% reduction in false negative predictions of a biased histopathology dataset. Additionally, we quantify and compare the uncertainty metrics for the regression and classification tasks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Improving Trustworthiness of Data-Driven Power Grid Contingency Analysis With Bayesian Residual Graph Neural Networks

The evolving energy landscape requires novel tools to efficiently perform contingency analysis and reliability assessment of power grids, potentially in real-time. The high computational cost of traditional power flow solvers limits their applicability in practice. Machine learning (ML) surrogates such as deep neural networks (NNs) accelerate power flow solvers computations, enabling high-order contingency analysis and real-time decision-making by learning highly nonlinear functions and integrating grid topology via graph architectures. However, (graph) NNs lack predictive power away from training data and do not provide predictive confidence estimates. Here, we present a Bayesian residual graph NN that integrates knowledge from low-fidelity data via residual training and embeds granular quantification of uncertainties, improving trustworthiness critical for high-consequence decision-making. Applying Bayesian concepts to NNs is challenging due to the high-dimensionality of both the parameter space, complicating derivation of a meaningful prior, and the output space in large grid systems, requiring enhanced techniques to assess the predicted high-dimensional uncertainties. Our contributions include: (1) Deriving a prior for fully connected and graph NNs that leverages low-fidelity data to guide mean predictions and appropriately control prior predictive uncertainty. (2) Integrating this prior within an ensembling with anchoring scheme for efficient approximate posterior inference. (3) Deriving enhanced metrics to assess accuracy of both the mean and uncertainty predictions in high dimensions, appropriately accounting for correlations propagated through graph layers. The resulting Bayesian residual graph NN is tested on a contingency analysis task for 14-bus and 118-bus grids.

24 - POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2018

Hierarchical Model for Bayesian Hypothesis Testing

A common problem in data analysis is testing a point hypothesis. For example, one might test whether or not the mean of a distribution is zero. We describe the standard Bayesian approach, which requires the choice of a width parameter to define a prior distribution for an alternative hypothesis. Standard practice is to choose this width parameter to be the least favorable choice for the original, point hypothesis. This approach, however, is ad-hoc and not informed by the data. We examine this practice in more detail than in previous work by constructing a hierarchical model, where the width parameter is an unknown value subject to inference. This yields a marginal posterior distribution for the width parameter. We then show that using the median of this marginal posterior distribution as the width parameter in the Bayesian comparison between the hypotheses gives results which are very similar to those obtained from the existing approaches. This gives a more rigorous and data-informed justification for the standard practice of choosing a width parameter which is least favorable to the point hypothesis.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

System risk quantification and decision making support using functional modeling and dynamic Bayesian network

Risk-informed decision-making requires a probabilistic assessment of the likelihood of success of control action, given the system status. This paper presents a systematic state transition modeling approach integrating dynamic probabilistic risk assessment with a decision-making process using a dynamic Bayesian network (DBN) coupled with functional modeling. A functional model designed with multilevel flow modeling (MFM) technique was used to build a system state structure inferred by energy, mass, and information flow so that one can verify the developed model with respect to system functionality. The MFM model represents the causal relationship among the nodes, which captures the structure of process parameters and control units. Each node may have multiple possible states, and the DBN structured by the MFM model represents the time-domain transitions among the defined states. Furthermore, the MFM-DBN integrated state transition modeling is a white-box approach that allows one to draw the system's risk profile by updating the system states and supports the decisions probabilistically with physical inference. An example of a simple heating system has been used to illustrate this process, including decision-making support based on quantitative risk profile. For demonstrating its applicability to a complex system operational decision making, a case study of station blackout accident scenario leading to the seal loss of coolant accident in a nuclear power plant is presented. The proposed approach effectively provided the risk profile along time for each option so that the operators can make the best decision, which minimizes the plant risk.

42 ENGINEERING↗
NASA NTRS2020

Bayesian Framework For Bioburden Density Calculations To Perform Planetary Protection Probabilistic Risk Assessment

The planetary protection discipline aims to minimize the microbial contamination on spacecraft to prevent the inadvertent contamination of other planetary bodies, known as forward planetary protection (PP). Planetary protection probabilistic risk assessment (PRA) relies on two core methodologies-the contamination probability event tree analysis and statistical parameter estimation. Planetary protection engineers combine several techniques to estimate the bioburden present on spacecraft components. A direct assay to enumerate CFU (colony forming units) is the preferred methodology, but given a similar processing environment the bioburden present on certain components is inferred using: (1) a NASA defined bioburden estimate based upon the biological cleanliness of the manufacturing/assembly environment or (2) sampled data from a similar spacecraft component. The paper presents an empirical Bayesian framework to systematically treat bioburden estimation and its uncertainties on different levels starting with measurement procedures to combining different components to subsystems and whole spacecraft. It is shown that the Bayesian approach can effectively handle estimations and their uncertainties at different levels and produce a reliable estimate for bioburden to be used to evaluate the probability of contamination.

Seuylemezian, Arman↗
DOE OSTI2025

Direct nonparametric multimessenger constraints on the equation of state of cold dense nuclear matter

We utilize the now substantial amount of astrophysical observations of neutron stars (NSs), along with perturbative quantum chromodynamics (pQCD) calculations at high density, to directly constrain the NS equation of state (EOS). To this end, we construct nonparametric EOS priors by using Gaussian processes trained on 75 EOSs, which include models with either hadrons, hyperons, or quarks at high densities. We create a prior using the full EOS sample (model agnostic), and one prior for each EOS family to test model discrimination. We introduce a novel inference approach, which allows the simultaneous sampling of intrinsic and extrinsic parameters of binary NS mergers, as well as a nonparametric equation of state. We showcase this method in a Bayesian updating scheme by first performing a complete analysis of the binary NS merger event GW170817 with minimal assumptions, and sequentially adding information from x-ray and radio NS observations, along with pQCD calculations. Besides providing standard constraints, such as the pressure at twice nuclear saturation density 𝑝⁡(2⁢𝜌 sat ) = 4.3$^{+0.6}_{−0.6}$ × 10 34 dyne/cm 2 , at 95% confidence level, for the model agnostic prior, our methodology shows how the choice of EOS families used in conditioning changes the inferred astrophysical properties of the EOS, namely tidal deformability and maximum supported NS mass. We find hyperonic priors predicting higher tidal deformabilities for a 1.4⁢𝑀 ⊙ NS, and hadronic priors being preferred by the considered astrophysical data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

PINN surrogate of Li-ion battery models for parameter inference, Part I: Implementation and multi-fidelity hierarchies for the single-particle model

To plan and optimize energy storage demands that account for Li-ion battery aging dynamics, techniques need to be developed to diagnose battery internal states accurately and rapidly. Here, this study seeks to reduce the computational resources needed to determine a battery's internal states by replacing physics-based Li-ion battery models - such as the single-particle model (SPM) and the pseudo-2D (P2D) model - with a physics-informed neural network (PINN) surrogate. The surrogate model makes high-throughput techniques, such as Bayesian calibration, tractable to determine battery internal parameters from voltage responses. This manuscript is the first of a two-part series that introduces PINN surrogates of Li-ion battery models for parameter inference (i.e., state-of-health diagnostics). In this first part, a method is presented for constructing a PINN surrogate of the SPM. A multi-fidelity hierarchical training, where several neural nets are trained with multiple physics-loss fidelities is shown to significantly improve the surrogate accuracy when only training on the governing equation residuals. The implementation is made available in a companion repository (https://github.com/NREL/PINNSTRIPES). The techniques used to develop a PINN surrogate of the SPM are extended in Part II for the PINN surrogate for the P2D battery model, and explore the Bayesian calibration capabilities of both surrogates.

25 ENERGY STORAGE↗
DOE OSTI2022

Active Galactic Nuclei Continuum Reverberation Mapping Based on Zwicky Transient Facility Light Curves

We perform a systematic survey of active galactic nuclei (AGNs) continuum lags using ~3 days cadence gri-band light curves from the Zwicky Transient Facility. We select a sample of 94 type 1 AGNs at z < 0.8 with significant and consistent inter-band lags based on the interpolated cross-correlation function method and the Bayesian method JAVELIN. Within the framework of the "lamp-post" reprocessing model, our findings are: (1) The continuum emission (CE) sizes inferred from the data are larger than the disk sizes predicted by the standard thin-disk model. (2) For a subset of the sample, the CE size exceeds the theoretical limit of the self-gravity radius (12 lt-days) for geometrically thin disks. (3) The CE size scales with continuum luminosity as R CE ∝ L 0.48±0.04 with a scatter of 0.2 dex, analogous to the well-known radius–luminosity relation of broad Hβ. These findings suggest a significant contribution of diffuse continuum emission from the broad-line region (BLR) to AGN continuum lags. We find that the R CE –L relation can be explained by a photoionization model that assumes ~23% of the total flux comes from the diffuse BLR emission. In addition, the ratio of the CE size and model-predicted disk size anticorrelates with the continuum luminosity, which is indicative of a potential nondisk BLR lag contribution evolving with the luminosity. Finally, a robust positive correlation between the CE size and black hole mass is detected.

79 ASTRONOMY AND ASTROPHYSICS↗