Results for “bayesian methodology” — Page 6

DOE OSTI2023

Uncertainty quantification of a deep learning fuel property prediction model

Deep learning models are being widely used in the field of combustion. Given the black-box nature of typical neural network based models, uncertainty quantification (UQ) is critical to ensure the reliability of predictions as well as the training datasets, and for a principled quantification of noise and its various sources. Deep learning surrogate models for predicting properties of chemical compounds and mixtures have been recently shown to be promising for enabling data-driven fuel design and optimization, with the ultimate goal of improving efficiency and lowering emissions from combustion engines. In this study, UQ is performed for a multi-task deep learning model that simultaneously predicts the research octane number (RON), Motor Octane Number (MON), and Yield Sooting Index (YSI) of pure components and multicomponent blends. The deep learning model is comprised of three smaller networks: Extractor 1, Extractor 2, and Predictor, and a mixing operator. The molecular fingerprints of individual components are encoded via Extractor 1 and Extractor 2, the mixing operator generates fingerprints for mixtures/blends based on linear mixing operation, and the predictor maps the fingerprint to the target properties. Two different classes of UQ methods, Monte Carlo ensemble methods and Bayesian neural networks (BNNs), are employed for quantifying the epistemic uncertainty. Combinations of Bernoulli and Gaussian distributions with DropConnect and DropOut techniques are explored as ensemble methods. All the DropConnect, DropOut and Bayesian layers are applied to the predictor network. Aleatoric uncertainty is modeled by assuming that each data point has an independent uncertainty associated with it. The results of the UQ study are further analyzed to compare the performance of BNN and ensemble methods. Although this study is confined to UQ of fuel property prediction, the methodologies are applicable to other deep learning frameworks that are being widely used in the combustion community.

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2021

New insights on the nebular emission, ionizing radiation, and low metallicity of Green Peas from advanced modelling

ABSTRACT Low-metallicity, compact starburst galaxies referred to as Green Peas (GPs) provide a unique window to study galactic evolution across cosmic epochs. In this work, we present new deep optical spectra for three GPs from OSIRIS at the 10-m Gran Telescopio Canarias, which are studied using a state-of-the-art methodology. A stellar population synthesis is conducted with 1098 spectral templates. The methodology succeeds at characterizing stellar populations from 0.5 Myr to 10 Gyr. The light distribution shows a large red excess from a single population with ${log}\left({age}\right) \gt 8.5\, \mathrm{yr}$ in the GP sample analysed. This points towards an incomplete characterization of the gas luminosity, whose continuum already accounts between 7.4 and $27.6{{\ \rm per\ cent}}$ in the galaxy sample. The emission spectra are fitted with the largest Bayesian chemical model consisting of an electron temperature, an electron density, the logarithmic extinction coefficient and eleven ionic species under the direct method paradigm. Additionally, building on previous work, we propose a neural networks sampler to constrain the effective temperature and ionization parameter of each source from photoionization model grids. Finally, we combine both methodologies into a 16-dimensional model, which for the first time, simultaneously explores the direct method and photoionization parameter spaces. Both techniques consistently indicate a low-metallicity gas, $7.76\lt 12+{\rm log}\left(O/H \right)\lt 8.04$, ionized by strong radiation fields, in agreement with previous works.

Fernández, V. (ORCID:0000000305315450)↗

DOE OSTI2020

Training Spiking Neural Networks Using Combined Learning Approaches

Spiking neural networks (SNNs), the class of neural networks used in neuromorphic computing, are difficult to train using traditional back-propagation techniques. Spike timingdependent plasticity (STDP) is a biologically inspired learning mechanism that can be used to train SNNs. Evolutionary algorithms have also been demonstrated as a method for training SNNs. In this work, we explore the relationship between these two training methodologies. We evaluate STDP and evolutionary optimization as standalone methods for training networks, and also evaluate a combined approach where STDP weight updates are applied within an evolutionary algorithm. We also apply Bayesian hyperparameter optimization as a meta learner for each of the algorithms. We find that STDP by itself is not an ideal learning rule for randomly connected networks, while the inclusion of STDP within an evolutionary algorithm leads to similar performance, with a few interesting differences. This study suggests future work in understanding the relationship between network topology and learning rules.

Elbrecht, Daniel↗

DOE OSTI2026

Goal-oriented real-time Bayesian inference for linear autonomous dynamical systems with application to digital twins for tsunami early warning

We present a goal-oriented framework for constructing digital twins with the following properties: (1) they employ discretizations of high-fidelity partial differential equation (PDE) models governed by autonomous dynamical systems, leading to large-scale forward problems; (2) they solve a linear inverse problem to assimilate observational data to infer uncertain model components followed by a forward prediction of the evolving dynamics; and (3) the entire end-to-end, data-to-inference-to-prediction computation is carried out without approximation and in real time through a Bayesian framework that rigorously accounts for uncertainties. Several challenges must be overcome to realize this framework, including the large scale of the forward problem, the high dimensionality of the parameter space, and for a class of problems including those we target, the slow decay of the singular values of the parameter-to-observable map. Here we introduce a methodology to overcome these challenges by exploiting the autonomous structure of the forward model to decompose the solution of the inverse problem into a one-time-only offline phase in which the PDE model is solved a limited number of times (equal to the number of sensors), and an online phase that maps well onto GPUs and computes the parameter inference and prediction of quantities of interest in real time, given observational data. Our ultimate goal is to apply this framework to construct digital twins for subduction zones, including Cascadia, to provide early warning for tsunamis generated by megathrust earthquakes. To this end, we demonstrate how our methodology can be used to employ seafloor pressure observations, along with the coupled acoustic–gravity wave equations, to infer the earthquake-induced spatiotemporal seafloor motion (discretized with $\mathscr{O}$ (10 9 ) parameters) and forward predict the tsunami propagation. We present results of an end-to-end inference, prediction, and uncertainty quantification for a representative test problem with $\mathscr{O}$ (10 8 ) inversion parameters for which goal-oriented Bayesian inference is accomplished exactly and in real time, that is, in a matter of seconds.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Improved naive Bayesian probability classifier in predictions of nuclear mass

Recently, novel statistical methods such as neural networks and Bayesian learning methods are implemented to describe the nuclear masses. Based on previous studies, an improved naive Bayesian probability (iNBP) classifier is proposed to study the nuclear masses by refining the results of sophisticated nuclear models. In the iNBP method, the prediction for nuclear masses is treated as a classification problem. The residuals are classified into several groups to generate prior and conditional probabilities, and the posterior probabilities are further determined by the Bayesian formula. We choose the expectation with maximum probability as the final prediction. Reliability of the iNBP method is assessed by analyzing the global optimizations and the extrapolating capabilities. Here, the iNBP method exhibits impressive improvements on global descriptions for different mass models. Moreover, the method shows robust extrapolating capabilities. Results demonstrate the iNBP method can be applied to predict the nuclear masses of unknown regions. Considering the local mass relations, the iNBP method can offer considerable fine-tuning of the mass descriptions from nuclear models. The methodology proposed in this paper can also be applied to other model-based extrapolations of nuclear observables.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2023

Developing and applying quantifiable metrics for diagnostic and experiment design on Z

This project applies methods in Bayesian inference and modern statistical methods to quantify the value of new experimental data, in the form of new or modified diagnostic configurations and/or experiment designs. We demonstrate experiment design methods that can be used to identify the highest priority diagnostic improvements or experimental data to obtain in order to reduce uncertainties on critical inferred experimental quantities and select the best course of action to distinguish between competing physical models. Bayesian statistics and information theory provide the foundation for developing the necessary metrics, using two high impact experimental platforms on Z as exemplars to develop and illustrate the technique. We emphasize that the general methodology is extensible to new diagnostics (provided synthetic models are available), as well as additional platforms. We also discuss initial scoping of additional applications that began development in the last year of this LDRD.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Analyzing count data with measurement error

In this article, we analyze observed count data such as the number of defects in a steel product where the observed counts are the true counts measured with errors. We account for the measurement error by using a measurement error model based on a latent lognormal (LLN) distribution. We consider making inference about a single population (e.g., from samples of a production lot) and a regression model (e.g., from runs of a designed experiment), where the measurement system properties are known, that is, the parameters of the LLN distribution are known. Then, we consider simultaneous inference for the single population and regression model as well as the measurement system. We demonstrate the proposed methodology with both simulated and real observed counts.

42 ENGINEERING↗

DOE OSTI2024

Evolution of homologous recombination rates across bacteria

Bacteria are nonsexual organisms but are capable of exchanging DNA at diverse degrees through homologous recombination. Intriguingly, the rates of recombination vary immensely across lineages where some species have been described as purely clonal and others as “quasi-sexual.” However, estimating recombination rates has proven a difficult endeavor and estimates often vary substantially across studies. It is unclear whether these variations reflect natural variations across populations or are due to differences in methodologies. Consequently, the impact of recombination on bacterial evolution has not been extensively evaluated and the evolution of recombination rate—as a trait—remains to be accurately described. Here, we developed an approach based on Approximate Bayesian Computation that integrates multiple signals of recombination to estimate recombination rates. We inferred the rate of recombination of 162 bacterial species and one archaeon and tested the robustness of our approach. Our results confirm that recombination rates vary drastically across bacteria; however, we found that recombination rate—as a trait—is conserved in several lineages but evolves rapidly in others. Although some traits are thought to be associated with recombination rate (e.g., GC-content), we found no clear association between genomic or phenotypic traits and recombination rate. Overall, our results provide an overview of recombination rate, its evolution, and its impact on bacterial evolution.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2020

Geometric Scale-up Experiments on Fluidization of Geldart B Glass Beads

The objective of this work is to provide a valuable database from controlled experiments for validating computational models. Recently, coarse-grained techniques such as particle-in-cell (PIC) or coarse-grained discrete element modeling (DEM) have gained popularity due to their computational efficiency while modeling large-scale systems; however, the influence of model parameters and their sensitivities at different geometric scales and flow conditions remain to be analyzed. These datasets are critical for the multiphase flow research community to assess predictive capability of modeling techniques as well as elucidate the hydrodynamic behavior in these systems. This study performed fluidization experiments using three different test sections with internal diameters of 2.5, 4, and 6 in. The operating conditions, bed material, and range of flow velocities at the inlet were constant in all the units, which were not hydrodynamically scaled. Glass beads having a Sauter Mean Diameter of 332 μm were used. Superficial velocity was varied from 2.97 to 5.35 times the minimum fluidization velocity and the initial static bed height was 0.1524 m. The order in which the experiments were performed was randomized and replicates were included to provide uncertainty in measurements. Statistics of differential pressure and bed height from these tests were reported. Future plans include validating PIC methodology in the open-source software, MFiX (Multiphase Flow with Interphase Exchanges) using results from this study. This could further be extended to determine optimal model parameters using inverse techniques such as deterministic calibration or Bayesian inference.

20 FOSSIL-FUELED POWER PLANTS↗

DOE OSTI2020

Geometric Scale-up Experiments on Fluidization of Geldart B Glass Beads

The objective of this work is to provide a valuable database from controlled experiments for validating computational models. Recently, coarse-grained techniques such as particle-in-cell (PIC) or coarse-grained discrete element modeling (DEM) have gained popularity due to their computational efficiency while modeling large-scale systems; however, the influence of model parameters and their sensitivities at different geometric scales and flow conditions remain to be analyzed. These datasets are critical for the multiphase flow research community to assess predictive capability of modeling techniques as well as elucidate the hydrodynamic behavior in these systems. This study performed fluidization experiments using three different test sections with internal diameters of 2.5, 4, and 6 in. The operating conditions, bed material, and range of flow velocities at the inlet were constant in all the units, which were not hydrodynamically scaled. Glass beads having a Sauter Mean Diameter of 332 μm were used. Superficial velocity was varied from 2.97 to 5.35 times the minimum fluidization velocity and the initial static bed height was 0.1524 m. The order in which the experiments were performed was randomized and replicates were included to provide uncertainty in measurements. Statistics of differential pressure and bed height from these tests were reported. Future plans include validating PIC methodology in the open-source software, MFiX (Multiphase Flow with Interphase Exchanges) using results from this study. This could further be extended to determine optimal model parameters using inverse techniques such as deterministic calibration or Bayesian inference.

42 ENGINEERING↗

DOE OSTI2022

Uniform Recalibration of Common Spectrophotometry Standard Stars onto the CALSPEC System Using the SuperNova Integral Field Spectrograph

Abstract We calibrate spectrophotometric optical spectra of 32 stars commonly used as standard stars, referenced to 14 stars already on the Hubble Space Telescope–based CALSPEC flux system. Observations of CALSPEC and non-CALSPEC stars were obtained with the SuperNova Integral Field Spectrograph over the wavelength range 3300–9400 Å as calibration for the Nearby Supernova Factory cosmology experiment. In total, this analysis used 4289 standard-star spectra taken on photometric nights. As a modern cosmology analysis, all presubmission methodological decisions were made with the flux scale and external comparison results blinded. The large number of spectra per star allows us to treat the wavelength-by-wavelength calibration for all nights simultaneously with a Bayesian hierarchical model, thereby enabling a consistent treatment of the Type Ia supernova cosmology analysis and the calibration on which it critically relies. We determine the typical per-observation repeatability (median 14 mmag for exposures ≳5 s), the Maunakea atmospheric transmission distribution (median dispersion of 7 mmag with uncertainty 1 mmag), and the scatter internal to our CALSPEC reference stars (median of 8 mmag). We also check our standards against literature filter photometry, finding generally good agreement over the full 12 mag range. Overall, the mean of our system is calibrated to the mean of CALSPEC at the level of ∼3 mmag. With our large number of observations, careful cross-checks, and 14 reference stars, our results are the best calibration yet achieved with an integral-field spectrograph, and among the best calibrated surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2025

Dynamical dark energy in light of the DESI DR2 baryonic acoustic oscillations measurements

Understanding whether cosmic acceleration arises from a cosmological constant or a dynamical component is a central goal of cosmology, and the Dark Energy Spectroscopic Instrument (DESI) enables stringent tests with high-precision distance measurements. Here we analyse measurements of baryon acoustic oscillations in DESI Data Release 1 and Data Release 2 and consider type Ia supernovae and a distance prior for the cosmic microwave background. With the larger statistical power and wider redshift coverage of Data Release 2, the preference for dynamical dark energy does not diminish relative to Data Release 1. Using both a shape-function reconstruction and non-parametric approaches with a Horndeski-motivated correlation prior, we find that the equation of state for dark energy w(z) varies with redshift. Baryon acoustic oscillation data alone yield modest constraints, but in combination with independent supernova compilations and the prior for the cosmic microwave background, they strengthen the evidence for dynamics. A Bayesian comparison of models shows moderate support for departures from Λ cold dark matter (ΛCDM) when several degrees of freedom in w(z) are allowed, corresponding to ~3σ tension with ΛCDM (and higher for some datasets). Despite methodological differences, our results are consistent with companion DESI papers, underscoring the complementarity of the approaches. Possible systematics remain under study; forthcoming DESI, Euclid and next-generation cosmic microwave background data will provide decisive tests.

cosmology↗

DOE OSTI2025

Dynamical dark energy in light of the DESI DR2 baryonic acoustic oscillations measurements

Understanding whether cosmic acceleration arises from a cosmological constant or a dynamical component is a central goal of cosmology, and the Dark Energy Spectroscopic Instrument (DESI) enables stringent tests with high-precision distance measurements. Here we analyse measurements of baryon acoustic oscillations in DESI Data Release 1 and Data Release 2 and consider type Ia supernovae and a distance prior for the cosmic microwave background. With the larger statistical power and wider redshift coverage of Data Release 2, the preference for dynamical dark energy does not diminish relative to Data Release 1. Using both a shape-function reconstruction and non-parametric approaches with a Horndeski-motivated correlation prior, we find that the equation of state for dark energy w(z) varies with redshift. Baryon acoustic oscillation data alone yield modest constraints, but in combination with independent supernova compilations and the prior for the cosmic microwave background, they strengthen the evidence for dynamics. A Bayesian comparison of models shows moderate support for departures from Λ cold dark matter (ΛCDM) when several degrees of freedom in w(z) are allowed, corresponding to ~3σ tension with ΛCDM (and higher for some datasets). Despite methodological differences, our results are consistent with companion DESI papers, underscoring the complementarity of the approaches. Possible systematics remain under study; forthcoming DESI, Euclid and next-generation cosmic microwave background data will provide decisive tests.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2022

Sample-Efficient Adaptive Calibration of Quantum Networks Using Bayesian Optimization

All physical systems employed for quantum information tasks must act as unbiased carriers of encoded quantum states. Ensuring such indistinguishability of information carriers is a major challenge in many quantum information applications, including advanced quantum communication protocols. For photons, the workhorses of quantum communication networks, it is difficult to obtain and maintain their indistinguishability because of environment-induced transformations and loss imparted by communication channels, especially in noisy scenarios. Conventional strategies to mitigate these transformations often require hardware or software overhead that is restrictive (e.g., adding noise), infeasible (e.g., on a satellite), or time-consuming for deployed networks. In this work we propose and develop resource-efficient Bayesian optimization techniques to rapidly and adaptively calibrate the indistinguishability of individual photons for quantum networks using only information derived from their measurement. To experimentally validate our approach, we demonstrate the optimization of Hong-Ou-Mandel interference between two photons-a central task in quantum networking- finding rapid, efficient, and reliable convergence towards maximal photon indistinguishability in the presence of high loss and shot noise. We expect our resource-optimized and experimentally friendly methodology will allow fast and reliable calibration of indistinguishable quanta, a necessary task in distributed quantum computing, communications, and sensing, as well as for fundamental investigations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2022

Density reconstruction in convergent high-energy-density systems using x-ray radiography and Bayesian inference

X-ray radiography is a technique frequently used to diagnose convergent high-energy-density (HED) systems, such as inertial confinement fusion implosion, and provides unique information that is not available through self-emission measurements. In this work, we investigate the scope and limits of that information using a radiography simulation combined with the Bayesian inference workflow. The accuracy of density reconstruction from simulated radiographs of spherical implosions driven with 27 kJ laser energy is assessed, including the increase or decrease in accuracy due to the addition of Lagrangian marker layers, Poisson noise, and improved prior information. This work is the first to present the full uncertainty distributions inferred from radiography analysis in HED systems and demonstrates the importance of constructing the full posterior probability density, as opposed to a point estimate, due to the modal structure of the likelihood surface introduced by typical experimental noise sources. This general methodology can be used both for robust analysis of radiographic data and for an improved design of radiography experiments by modeling the full experimental system.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2020

CheKiPEUQ Intro 1: Bayesian Parameter Estimation Considering Uncertainty or Error from both Experiments and Theory**

A common goal is extraction of physico-chemical parameter values such as pre-exponentials and activation energies from experiment. Ever increasing knowledge from experiments and computations is enabling semi-quantitative prior predictions of such values. When prior knowledge of physically realistic ranges is available, a method named Bayesian parameter estimation (BPE) enables more physically realistic parameter estimation relative to unsophisticated fitting by seeking the most probable value when considering together the uncertainties from prior knowledge, experimental data, and approximations in the model. An impediment to widespread use of BPE is a lack of understanding, training, and user-friendly software. Along with this invited publication, a general software package for BPE is being released that is user-friendly and that does not require understanding of the math behind the methodology. Overall, two previously unpublished catalysis science examples are provided along with considerations and guidelines for successful application of BPE. Following this work, BPE can become more widespread to enable extraction of physically meaningful parameter values.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2024

Bayesian Conavigation: Dynamic Designing of the Material Digital Twins via Active Learning

Scientific advancement is universally based on the dynamic interplay between theoretical insights, modeling, and experimental discoveries. However, this feedback loop is often slow, including delayed community interactions and the gradual integration of experimental data into theoretical frameworks. This challenge is particularly exacerbated in domains dealing with high-dimensional object spaces, such as molecules and complex microstructures. Hence, the integration of theory within automated and autonomous experimental setups, or theory in the loop-automated experiment, is emerging as a crucial objective for accelerating scientific research. The critical aspect is to use not only theory but also on-the-fly theory updates during the experiment. Furthermore, we introduce a method for integrating theory into the loop through Bayesian conavigation of theoretical model space and experimentation. Our approach leverages the concurrent development of surrogate models for both simulation and experimental domains at the rates determined by latencies and costs of experiments and computation, alongside the adjustment of control parameters within theoretical models to minimize epistemic uncertainty over the experimental object spaces. This methodology facilitates the creation of digital twins of material structures, encompassing both the surrogate model of behavior that includes the correlative part and the theoretical model itself. While being demonstrated here within the context of functional responses in ferroelectric materials, our approach holds promise for broader applications, such as the exploration of optical properties in nanoclusters, microstructure-dependent properties in complex materials, and properties of molecular systems.

Microscopy↗

DOE OSTI2025

Hierarchical Gaussian process-based Bayesian optimization for materials discovery in high entropy alloy spaces

Bayesian optimization (BO) is a powerful and data-efficient method for iterative materials discovery and design, particularly valuable when prior knowledge is limited, underlying functional relationships are complex or unknown, and the cost of querying the materials space is significant. Traditional BO methodologies typically utilize conventional Gaussian Processes (cGPs) to model the relationships between material inputs and properties, as well as correlations within the input space. However, cGP-BO approaches often fall short in multi-objective optimization scenarios, where they are unable to fully exploit correlations between distinct material properties. Leveraging these correlations can significantly enhance the discovery process, as information about one property can inform and improve predictions about others. Here, this study addresses this limitation by employing advanced kernel structures to capture and model multi-dimensional property correlations through multi-task (MTGPs) or deep Gaussian Processes (DGPs), thus accelerating the discovery process. We demonstrate the effectiveness of MTGP-BO and DGP-BO in rapidly and robustly solving complex materials design challenges that occur within the context of complex multi-objective optimization over FCC FeCrNiCoCu high entropy alloy (HEA) spaces, where traditional cGP-BO approaches fail. Furthermore, we highlight how the differential costs associated with querying various material properties can be strategically leveraged to make the materials discovery process more cost-efficient.

36 MATERIALS SCIENCE↗