Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Active operator learning with predictive uncertainty quantification for partial differential equations

With the increased prevalence of neural operators being used to provide rapid solutions to partial differential equations (PDEs), understanding the accuracy of model predictions and the associated error levels is necessary for deploying reliable surrogate models in scientific applications. Existing uncertainty quantification (UQ) frameworks employ ensembles or Bayesian methods, which can incur substantial computational costs during both training and inference. Here, we propose a lightweight predictive UQ method tailored for Deep operator networks (DeepONets) that also generalizes to other operator networks. Numerical experiments on linear and nonlinear PDEs demonstrate that the framework’s uncertainty estimates are unbiased and provide accurate out-of-distribution uncertainty predictions with a sufficiently large training dataset. Our framework provides fast inference and uncertainty estimates that can efficiently drive outer-loop analyses that would be prohibitively expensive with conventional solvers. We demonstrate how predictive uncertainties can be used in the context of Bayesian optimization and active learning problems to yield improvements in accuracy and data-efficiency for outer-loop optimization procedures. In the active learning setup, we extend the framework to Fourier Neural Operators (FNO) and describe a generalized method for other operator networks. To enable real-time deployment, we introduce an inference strategy based on precomputed trunk outputs and a sparse placement matrix, reducing evaluation time by more than a factor of five. Our method provides a practical route to uncertainty-aware operator learning in time-sensitive settings.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Designing an Optimal Sensor Network via Minimizing Information Loss

Optimal experimental design is a classic topic in statistics, with many well-studied problems, applications, and solutions. The design problem we study is the placement of sensors to monitor spatiotemporal processes, explicitly accounting for the temporal dimension in our modeling and optimization. We observe that recent advancements in computational sciences often yield large datasets based on physics-based simulations, which are rarely leveraged in experimental design. We introduce a novel model-based sensor placement criterion, along with a highly-efficient optimization algorithm, which integrates physics-based simulations and Bayesian experimental design principles to identify sensor networks that “minimize information loss” from simulated data. Our technique relies on sparse variational inference and (separable) Gauss-Markov priors, and thus may adapt many techniques from Bayesian experimental design. We validate our method through a case study monitoring air temperature in Phoenix, Arizona, using state-of-the-art physics-based simulations. Our results show our framework to be superior to random or quasi-random sampling, particularly with a limited number of sensors. We conclude by discussing practical considerations and implications of our framework, including more complex modeling tools and real-world deployments.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1994

Learning time series for intelligent monitoring

We address the problem of classifying time series according to their morphological features in the time domain. In a supervised machine-learning framework, we induce a classification procedure from a set of preclassified examples. For each class, we infer a model that captures its morphological features using Bayesian model induction and the minimum message length approach to assign priors. In the performance task, we classify a time series in one of the learned classes when there is enough evidence to support that decision. Time series with sufficiently novel features, belonging to classes not present in the training set, are recognized as such. We report results from experiments in a monitoring domain of interest to NASA.

Manganaris, Stefanos↗
DOE OSTI2024

Uncertainty quantification of material parameters in modeling coupled metal and high explosive experiments

Experiments involving the coupling of metal and high explosives (HE) are of notable defense-related interest, and we seek to refine the uncertainty quantification associated with models of such experiments. In particular, our focus is on how uncertainty related to the metal constitutive model challenges our ability to infer high explosive model parameters when analyzing focused science experiments. We consider three focused experiments involving an HE accelerating metal: small plate tests with tantalum/LX-14 and tantalum/LX-17 pairings as well as a tantalum/LX-17 cylinder test. For all three models, we perform sensitivity analysis to ascertain the influence of metal strength on the coupled experimental response. Moreover, we calibrate each model in a Bayesian setting and study the quantification of metal strength on the inference of the HE parameters. Based on our results, we offer guidance for future metal/HE experiments.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Bayesian model-data comparison incorporating theoretical uncertainties

Accurate comparisons between theoretical models and experimental data are critical for scientific progress. However, inferred physical model parameters can vary significantly with the chosen physics model, highlighting the importance of properly accounting for theoretical uncertainties. In this Letter, we present a Bayesian framework that explicitly quantifies these uncertainties by statistically modeling theory errors, guided by qualitative knowledge of a theory’s varying reliability across the input domain. We demonstrate the effectiveness of this approach using two systems: a simple ball drop experiment and multi-stage heavy-ion simulations. In both cases incorporating model discrepancy leads to improved parameter estimates, with systematic improvements observed as additional experimental observables are integrated.

Bayesian methods↗
DOE OSTI2024

Visible core spectroscopy at Wendelstein 7-X

This paper presents an overview of recent hardware extensions and data analysis developments to the Wendelstein 7-X visible core spectroscopy systems. These include upgrades to prepare the in-vessel components for long-pulse operation, nine additional spectrometers, a new line of sight array for passive spectroscopy, and a coherence imaging charge exchange spectroscopy diagnostic. Progress in data analysis includes ion temperatures and densities from multiple impurity species, a statistical comparison with x-ray crystal spectrometer measurements, neutral density measurements from thermal passive Balmer-alpha emission, and a Bayesian analysis of active hydrogen emission, which is able to infer electron density and main ion temperature profiles.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

CONCURRENT, CONDENSED STEIN VARIATIONAL GRADIENT DESCENT FOR UNCERTAINTY QUANTIFICATION OF NEURAL NETWORKS

In this work, we propose a Stein variational gradient descent (SVGD) method to concurrently sparsify, train, and provide uncertainty quantification (UQ) of a complexly parameterized model, such as a neural network (NN). It employs a graph reconciliation and condensation process to reduce complexity and increase similarity in the Stein ensemble of parameterizations. Therefore, the proposed concurrent, condensed SVGD (ccSVGD) method can provide UQ on parameters, not just outputs. Furthermore, the parameter reduction speeds up the convergence of the Stein gradient descent as it reduces the combinatorial complexity by aligning and differentiating the sensitivity to parameters. These properties are demonstrated with an illustrative example and an application to a mechanical response representation problem in solid mechanics.

42 ENGINEERING↗
NASA NTRS1995

Inductive Approaches to Improving Diagnosis and Design for Diagnosability

The first research area under this grant addresses the problem of classifying time series according to their morphological features in the time domain. A supervised learning system called CALCHAS, which induces a classification procedure for signatures from preclassified examples, was developed. For each of several signature classes, the system infers a model that captures the class's morphological features using Bayesian model induction and the minimum message length approach to assign priors. After induction, a time series (signature) is classified in one of the classes when there is enough evidence to support that decision. Time series with sufficiently novel features, belonging to classes not present in the training set, are recognized as such. A second area of research assumes two sources of information about a system: a model or domain theory that encodes aspects of the system under study and data from actual system operations over time. A model, when it exists, represents strong prior expectations about how a system will perform. Our work with a diagnostic model of the RCS (Reaction Control System) of the Space Shuttle motivated the development of SIG, a system which combines information from a model (or domain theory) and data. As it tracks RCS behavior, the model computes quantitative and qualitative values. Induction is then performed over the data represented by both the 'raw' features and the model-computed high-level features. Finally, work on clustering for operating mode discovery motivated some important extensions to the clustering strategy we had used. One modification appends an iterative optimization technique onto the clustering system; this optimization strategy appears to be novel in the clustering literature. A second modification improves the noise tolerance of the clustering system. In particular, we adapt resampling-based pruning strategies used by supervised learning systems to the task of simplifying hierarchical clusterings, thus making post-clustering analysis easier.

Fisher, Douglas H.↗
DOE OSTI2024

Calibrating Bayesian generative machine learning for Bayesiamplification

Recently, combinations of generative and Bayesian deep learning have been introduced in particle physics for both fast detector simulation and inference tasks. These neural networks aim to quantify the uncertainty on the generated distribution originating from limited training statistics. The interpretation of a distribution-wide uncertainty however remains ill-defined. We show a clear scheme for quantifying the calibration of Bayesian generative machine learning models. For a Continuous Normalizing Flow applied to a low-dimensional toy example, we evaluate the calibration of Bayesian uncertainties from either a mean-field Gaussian weight posterior, or Monte Carlo sampling network weights, to gauge their behaviour on unsteady distribution edges. Well calibrated uncertainties can then be used to roughly estimate the number of uncorrelated truth samples that are equivalent to the generated sample and clearly indicate data amplification for smooth features of the distribution.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1995

Inferring the spatial and energy distribution of gamma-ray burst sources. 1: Methodology

We describe Bayesian methods for analyzing the distribution of gamma-ray burst peak photon fluxes and directions. These methods fit the differential distribution, and have the following advantages over rival methods: (1) they do not destroy information by binning or averaging the data (as do, say, chi squared, the averaged value of V/V(sub max), and angular moment analyses); (2) they straightforwardly handle uncertainties in the measured quantities; (3) they analyze the strength and direction information jointly; (4) they use information available about nondetections; and (5) they automatically identify and account for biases and selection effects given a precise description of the experiment. In these methods, the most important information needed about the instrument threshold is not its value at the times of burst triggers, as is used in the average value of V/V(sub max) analyses, but rather the value of the threshold at times when no trigger occurred. We show that this information can be summarized as an average detection efficiency that is similar to the product of the exposure and efficiency reported in the First Burst and Transient Source Experiment (BATSE) Burst (1B) Catalog, but significantly different from it at low fluxes. We also quantify an important bias that results from estimating the peak flux by scanning the burst to find the peak number of counts in a window of specified duration, as was done for the 1B Catalog. When the duration of the peak of the light curve is longer than the window duration, a simple flux estimate based on the peak counts significantly overestimates the peak flux in a nonlinear fashion that distorts the shape of the log(N)-log(P) distribution. This distortion also corrupts analyses of the V/V(sub max) distribution that use ratios of counts above background to estimate V/V(sub max). The Bayesian calculation specifies how to account for this bias. Implementation of the Bayesian approach requires some changes in the way burst data are reported that we describe in detail. Subsequent papers will report analyses of the 1B Catalog data using the methods described here.

Loredo, Thomas J.↗
NASA NTRS2002

Incorporating Biological Knowledge into Evaluation of Casual Regulatory Hypothesis

Biological data can be scarce and costly to obtain. The small number of samples available typically limits statistical power and makes reliable inference of causal relations extremely difficult. However, we argue that statistical power can be increased substantially by incorporating prior knowledge and data from diverse sources. We present a Bayesian framework that combines information from different sources and we show empirically that this lets one make correct causal inferences with small sample sizes that otherwise would be impossible.

Chrisman, Lonnie↗
DOE OSTI2024

Spike-and-Slab Shrinkage Priors for Structurally Sparse Bayesian Neural Networks

Network complexity and computational efficiency have become increasingly significant aspects of deep learning. Sparse deep learning addresses these challenges by recovering a sparse representation of the underlying target function by reducing heavily overparameterized deep neural networks. Specifically, deep neural architectures compressed via structured sparsity (e.g., node sparsity) provide low-latency inference, higher data throughput, and reduced energy consumption. In this article, we explore two well-established shrinkage techniques, Lasso and Horseshoe, for model compression in Bayesian neural networks (BNNs). To this end, we propose structurally sparse BNNs, which systematically prune excessive nodes with the following: 1) spike-and-slab group Lasso (SS-GL) and 2) SS group Horseshoe (SS-GHS) priors, and develop computationally tractable variational inference, including continuous relaxation of Bernoulli variables. We establish the contraction rates of the variational posterior of our proposed models as a function of the network topology, layerwise node cardinalities, and bounds on the network weights. Furthermore, we empirically demonstrate the competitive performance of our models compared with the baseline models in prediction accuracy, model compression, and inference latency.

97 MATHEMATICS AND COMPUTING↗
NASA NTRSDate not supplied

Consequences of Asteroid Characterization on the State of Knowledge about Inferred Physical Properties and Impact Risk

Physical characteristics of Near-Earth Objects (NEOs) are essential inputs to planetary defense assessments. The size, density, and strength of an NEO are critical inputs to modeling behavior during atmospheric entry as well as assessing the risk of impact. Similarly, knowledge of the physical characteristics of an object are necessary to evaluate the probable result of a mitigation mission. Usually, these attributes cannot be directly measured, but increasingly sophisticated methods have been developed to infer physical properties from related measurements of asteroids, meteors, and/or meteorites. Fortuitously, some of these measurements have been obtained for enough NEOs to elucidate the distribution of values across the sampled population. However, the situation becomes more challenging when considering a specific asteroid, since it is unlikely that all the relevant measurements have been made for any given object. We have developed a Bayesian network that can combine available information about a particular NEO with knowledge of the larger population to infer probabilistic values and uncertainties for physical characteristics of interest. Distributions of asteroid population albedos, taxonomic classes, and macroporosities, along with meteorite density distributions and associations between taxonomic classes and meteorite classes, provide the default distributions for the network’s parameter nodes. The inference network links parameters for each virtual asteroid either deterministically or probabilistically as appropriate, and eliminates any unphysical combinations of parameters. Within the context of planetary defense, our Bayesian network can be used to constrain the ranges of likely impactor properties, which can subsequently reduce the uncertainty in modelling of atmospheric entry, mitigation efficacy, and impact risk assessment. When additional measurements become available for a specific object, the network incorporates those measurements to generate virtual asteroids with property distributions that are consistent with the measurements. We will use the 2023 PDC scenario to demonstrate how the inference network can be combined with plausible characterization measurements to refine the state of knowledge about likely combinations of physical parameters and the resulting impact risk.

risk assessment↗
NASA NTRSDate not supplied

Consequences of Asteroid Characterization on the State of Knowledge about Inferred Physical Properties and Impact Risk

Physical characteristics of Near-Earth Objects (NEOs) are essential inputs to planetary defense assessments. The size, density, and strength of an NEO are critical inputs to modeling behavior during atmospheric entry as well as assessing the risk of impact. Similarly, knowledge of the physical characteristics of an object are necessary to evaluate the probable result of a mitigation mission. Usually, these attributes cannot be directly measured, but increasingly sophisticated methods have been developed to infer physical properties from related measurements of asteroids, meteors, and/or meteorites. Fortuitously, some of these measurements have been obtained for enough NEOs to elucidate the distribution of values across the sampled population. However, the situation becomes more challenging when considering a specific asteroid, since it is unlikely that all the relevant measurements have been made for any given object. We have developed a Bayesian network that can combine available information about a particular NEO with knowledge of the larger population to infer probabilistic values and uncertainties for physical characteristics of interest. Distributions of asteroid population albedos, taxonomic classes, and macroporosities, along with meteorite density distributions and associations between taxonomic classes and meteorite classes, provide the default distributions for the network’s parameter nodes. The inference network links parameters for each virtual asteroid either deterministically or probabilistically as appropriate, and eliminates any unphysical combinations of parameters. Within the context of planetary defense, our Bayesian network can be used to constrain the ranges of likely impactor properties, which can subsequently reduce the uncertainty in modelling of atmospheric entry, mitigation efficacy, and impact risk assessment. When additional measurements become available for a specific object, the network incorporates those measurements to generate virtual asteroids with property distributions that are consistent with the measurements. We will use the 2023 PDC scenario to demonstrate how the inference network can be combined with plausible characterization measurements to refine the state of knowledge about likely combinations of physical parameters and the resulting impact risk.

risk assessment↗
DOE OSTI2026

A scalable variational method for estimating the latent infection-rate field of an outbreak

In this paper, we explore whether the infection-rate of a disease can serve as a robust monitoring variable in epidemiological surveillance algorithms. The infection-rate is dependent on population mixing patterns that do not vary erratically day-to-day; in contrast, daily case-counts used in contemporary surveillance algorithms are corrupted by reporting errors. The technical challenge lies in estimating the latent infection-rate from case-counts. Here we devise a Bayesian method to estimate the infection-rate across multiple adjoining areal units, and then use it, via an anomaly detector, to discern a change in epidemiological dynamics. We extend an existing model for estimating the infection-rate in an areal unit by incorporating a Markov random field model, so that we may estimate infection-rates across multiple areal units, while preserving spatial correlations observed in the epidemiological dynamics. To carry out the high-dimensional Bayesian inverse problem, we develop an implementation of mean-field variational inference specific to the infection model and integrate it with the random field model to incorporate correlations across counties. The method is tested on estimating the COVID-19 infection-rates across all 33 counties in New Mexico using data from the summer of 2020, and then employing them to detect the arrival of the Fall 2020 COVID-19 wave. We perform the detection using a temporal algorithm that is applied county-by-county. We also show how the infection-rate field can be used to cluster counties with similar epidemiological dynamics.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Improved Statistical Analysis for the Neutrinoless Double-Beta Decay Matrix Element of 136Xe

Neutrinoless double beta decay nuclear matrix element (M0ν) for 136Xe was recently analyzed using a statistical approach (Phys. Rev. C 107, 045501 (2023)). In the analysis, three initial shell model effective Hamiltonians were randomly altered, and their results for 23 measured observables were used to infer credibility for the M0ν nuclear matrix element (NME) based on a Bayesian Model Averaging approach. In that analysis, a reasonable Gamow-Teller quenching factor of 0.7 was assumed for each starting effective Hamiltonian. Given that the result of the statistical analysis was sensible to this choice, we are here improving that analysis by assuming that the Gamow-Teller quenching factor is also randomly chosen within reasonabe limits for all three starting Hamiltonians. The outcomes are slightly higher expectation values and uncertainties for the M0ν NME.

Astronomy & Astrophysics↗
DOE OSTI2026

ELG×LRG Distribution through Dark Matter Halo Dynamics

We investigate the clustering and halo occupation distribution (HOD) of DESI Y1 emission-line (ELGs) and luminous red (LRGs) galaxies at 0.8 < z < 1.1, including their cross-correlation (ELG×LRG), using the A BACUS S UMMIT suite and a new Halo Occupation Model (H OME ) for galaxy multitracers. This integrates intrahalo dynamics, halo exclusion, and quenching, bridging insights from hydrodynamical, HOD, abundance-matching, and semianalytic studies. Leveraging full phase-space information from the Uchuu N-body simulation, and sampling satellites from dark-matter particle positions via physically motivated prescriptions, Home reproduces the anisotropic clustering down to s = 200 h −1 kpc with unprecedented accuracy. Model parameters are inferred solely from two-point statistics using a two-level Bayesian framework, yielding high-fidelity ELG, LRG, and cross-reference catalogs. We find that satellite ELGs behave as incoherent flows within their parent halos, dominating the clustering below 4 h −1 Mpc. The HOD from the best-fit Home has the following properties: (i) 90.50% (85.91%) of ELGs (LRGs) are central galaxies without satellites, residing in halos of M vir ∼ 6.6 × 10 11 (1.2 × 10 13 ) h −1 M ⊙ ; (ii) the ELG×LRG cross-correlation is governed by central-central pairs and shaped by halo exclusion on 2–5 h −1 Mpc scales; (iii) 9.50% (14.09%) of ELGs (LRGs) are satellites, of which 1.09% (3.52%) inhabit halos with a central galaxy of the same species in a maximally conformal configuration, 7.02% (0.005%) orbit complementary hosts in a minimally conformal state, and 0.58% (10.57%) are orphans. The high sensitivity of Home precisely captures the dynamics of satellites in different host environments, opening a promising avenue for understanding systematics and the dynamical nature of dark matter, potentially distinguishing gravity models.

Favole, Ginevra [Universidad de La Laguna (Spain);↗
DOE OSTI2026

Bayesian discovery of optimal reduced order models from mechanistic and experimental data: A case study of Pd penetration in TRISO fuels using BISON

TRistructural ISOtropic (TRISO) particles rely on a silicon carbide (SiC) layer as the primary structural material and barrier to metallic fission products (FPs) release. Accurate prediction of palladium (Pd) transport and penetration is therefore critical for qualifying TRISO fuels for advanced reactors. The empirical correlation for Pd penetration in BISON is derived from historical particle-fuel data, but cannot explain the large scatter in the experimental data that arises from varying experimental conditions. To aid fuel qualification, we previously developed a mechanistic reduced order model (ROM) using BISON that resolves these dependencies. Here, in this work we build on that mechanistic ROM and perform validation and quantify its uncertainty using Bayesian uncertainty quantification (UQ). calibration against a suite of in-pile and out-of-pile experiments spanning particle compositions, geometries, and operating conditions, and we benchmark it against the empirical correlation. Bayesian UQ identifies influential parameters, calibrates them to data, and yields predictive intervals. Results show that while the empirical correlation can be tuned to fit a single experiment type, it transfers poorly; the mechanistic ROM sustains accuracy with credible uncertainty across disparate conditions. This demonstrates a practical path—via Bayesian UQ applied to mechanistic ROMs—to leverage single-effect experiments for inferring in-reactor behavior and supporting TRISO fuel qualification.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗