Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian Framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

An Adaptive-Importance-Sampling-Enhanced Bayesian Approach for Topology Estimation in an Unbalanced Power Distribution System

The reliable operation of a power distribution system relies on a good prior knowledge of its topology and its system state. Although crucial, due to the lack of direct monitoring devices on the switch statuses, the topology information is often unavailable or outdated for the distribution system operators for real-time applications. Apart from the limited observability of the power distribution system, other challenges are the nonlinearity of the model, the complicated, unbalanced structure of the distribution system, and the scale of the system. To overcome the above challenges, we, in this paper, propose a Bayesian-inference framework that allows us to simultaneously estimate the topology and the state of a three-phase, unbalanced power distribution system. Specifically, by using the very limited number of measurements available that are associated with the forecast load data, we efficiently recover the full Bayesian posterior distributions of the system topology under both normal and outage operation conditions. This is performed through an adaptive importance sampling procedure that greatly alleviates the computational burden of the traditional Monte-Carlo (MC)-sampling-based approach while maintaining a good estimation accuracy. The simulations conducted on the IEEE 123-bus test system and an unbalanced 1282-bus system reveal the excellent performances of the proposed method.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Elastic Bayesian Model Calibration

Functional data are ubiquitous in scientific modeling. For instance, quantities of interest are modeled as functions of time, space, energy, density, etc. Uncertainty quantification methods for computer models with functional response have resulted in tools for emulation, sensitivity analysis, and calibration that are widely used. However, many of these tools do not perform well when the computer model’s parameters control both the amplitude variation of the functional output and its alignment (or phase variation). This paper introduces a framework for Bayesian model calibration when the model responses are misaligned functional data. The approach generates two types of data out of the misaligned functional responses: (1) aligned functions so that the amplitude variation is isolated and (2) warping functions that isolate the phase variation. These two types of data are created for the computer simulation data (both of which may be emulated) and the experimental data. The calibration approach uses both types so that it seeks to match both the amplitude and phase of the experimental data. The framework is careful to respect constraints that arise, especially when modeling phase variation, and is framed in a way that it can be done with readily available calibration software. In conclusion, we demonstrate the techniques on two simulated data examples and on two dynamic material science problems: a strength model calibration using flyer plate experiments and an equation of state model calibration using experiments performed on the Sandia National Laboratories’ Z-machine.

97 MATHEMATICS AND COMPUTING↗

Autotuning PolyBench benchmarks with LLVM Clang/Polly loop optimization pragmas using Bayesian optimization

Here, we develop a ytopt autotuning framework that leverages Bayesian optimization to explore the parameter space search and compare four different supervised learning methods within Bayesian optimization and evaluate their effectiveness. We select six of the most complex PolyBench benchmarks and apply the newly developed LLVM Clang/Polly loop optimization pragmas to the benchmarks to optimize them. We then use the autotuning framework to optimize the pragma parameters to improve their performance. The experimental results show that our autotuning approach outperforms the other compiling methods to provide the smallest execution time for the benchmarks syr2k, 3mm, heat-3d, lu, and covariance with two large datasets in 200 code evaluations for effectively searching the parameter spaces with up to 170,368 different configurations. We find that the Floyd-Warshall benchmark did not benefit from autotuning. To cope with this issue, we provide some compiler option solutions to improve the performance. Then we present loop autotuning without a user's knowledge using a simple mctree autotuning framework to further improve the performance of the Floyd-Warshall benchmark. We also extend the ytopt autotuning framework to tune a deep learning application.

79 ASTRONOMY AND ASTROPHYSICS↗

Predicting the 3D fatigue crack growth rate of small cracks using multimodal data via Bayesian networks: In-situ experiments and crystal plasticity simulations

Small crack propagation accounts for most of the fatigue life of engineering structures subject to high cycle fatigue loading conditions. Determining the fatigue crack growth rate of small cracks propagating into polycrystalline engineering alloys is critical to improving fatigue life predictions, thus lowering cost and increasing safety. In this work, cycle-by-cycle data of a small crack propagating in a beta metastable titanium alloy is available via phase and diffraction contrast tomography. Crystal plasticity simulations are used to supplement experimental data regarding the micromechanical fields ahead of the crack tip. Experimental and numerical results are combined into a multimodal dataset and sampled utilizing a non-local data mining procedure. Furthermore, to capture the propensity of body-centered cubic metals to deform according to the pencil-glide model, a non-local driving force is postulated. The proposed driving force serves as the basis to construct a data-driven probabilistic crack propagation framework using Bayesian networks as building blocks. The spatial correlation between the postulated driving force and experimental observations is obtained by analyzing the results of the proposed framework. Results show that the above correlation increases proportionally to the distance from the crack front until the edge of the plastic zone. Moreover, the predictions of the propagation framework show good agreement with experimental observations. Finally, we studied the interaction of a small crack with grain boundaries (GBs) utilizing various slip transmission criteria, revealing the tendency of a crack to cross a GB by propagating along the slip directions minimizing the residual Burgers vector within the GB.

36 MATERIALS SCIENCE↗

A Bayesian experimental design approach to structural health monitoring

Optimal system design for SHM involves two primarily challenges. The first is the derivation of a proper performance function for a given system design. The second is the development of an efficient optimization algorithm for choosing a design that maximizes, or nearly maximizes the performance function. In this paper we will outline how an SHM practitioner can construct the proper performance function by casting the entire design problem into a framework of Bayesian experimental design. The approach demonstrates how the design problem necessarily ties together all steps of the SHM process.

42 ENGINEERING↗

Extreme-Scale Bayesian Inference for Uncertainty Quantification of Complex Simulations

Uncertainty quantification (UQ)—that is, quantifying uncertainties in complex mathematical models and their large-scale computational implementations—is widely viewed as one of the outstanding challenges facing the field of CS&E over the coming decade. The EUREKA project set to address the most difficult class of UQ problems: those for which both the underlying PDE model as well as the uncertain parameters are of extreme scale. In the project we worked on these extreme-scale challenges in the following four areas: 1. Scalable parallel algorithms for sampling and characterizing the posterior distribution that exploit the structure of the underlying PDEs and parameter-to-observable map. These include structure-exploiting versions of the randomized maximum likelihood method, which aims to overcome the intractability of employing conventional MCMC methods for solving extreme-scale Bayesian inversion problems by appealing to and adapting ideas from large-scale PDE-constrained optimization, which have been very successful at exploring high-dimensional spaces. 2. Scalable parallel algorithms for construction of prior and likelihood functions based on learning methods and non-parametric density estimation. Constructing problem-specific priors remains a critical challenge in Bayesian inference, and more so in high dimensions. Another challenge is construction of likelihood functions that capture unmodeled couplings between observations and parameters. We will create parallel algorithms for non-parametric density estimation using high dimensional N-body methods and combine them with supervised learning techniques for the construction of priors and likelihood functions. 3. Bayesian inadequacy models, which augment physics models with stochastic models that represent their imperfections. The success of the Bayesian inference framework depends on the ability to represent the uncertainty due to imperfections of the mathematical model of the phenomena of interest. This is a central challenge in UQ, especially for large-scale models. We propose to develop the mathematical tools to address these challenges in the context of extreme-scale problems. 4. Parallel scalable algorithms for Bayesian optimal experimental design (OED). Bayesian inversion yields quantified uncertainties in the model parameters, which can be propagated forward through the model to yield uncertainty in outputs of interest. This opens the way for designing new experiments to reduce the uncertainties in the model parameters and model predictions. Such experimental design problems have been intractable for large-scale problems using conventional methods; we will create OED algorithms that exploit the structure of the PDE model and the parameter-to-output map to overcome these challenges. Parallel algorithms for these four problems were created, analyzed, prototyped, implemented, tuned, and scaled up for leading-edge supercomputers, including UT-Austin’s own 10 petaflops Stampede system, ANL’s Mira system, and ORNL’s Titan system. While our focus is on fundamental mathematical/computational methods and algorithms, we will assess our methods on model problems derived from several DOE mission applications, including multiscale mechanics and ice sheet dynamics.

97 MATHEMATICS AND COMPUTING↗

Multi-head physics-informed neural networks for learning functional priors and uncertainty quantification

In numerous applications, the integration of prior knowledge and historical information is essential, particularly for tasks requiring the solution of ordinary or partial differential equations (ODEs/PDEs) in data-sparse or noisy environments. For instance, achieving accurate solutions to time-dependent PDEs with limited initial condition measurements necessitates an effective strategy for embedding prior knowledge. Hard-parameter sharing architectures in neural networks (NNs) have demonstrated success in both traditional and scientific machine learning domains, facilitating the learning of informative representations. Here, in this study, we introduce a novel, yet efficient, method to enhance physics-informed neural networks (PINNs) by incorporating a multi-head structure that enables the learning of functional priors from both empirical data and governing physical laws. This prior information can then be used to address data sparsity and high-level noise in solving ODE/PDE problems with uncertainty quantification (UQ). The approach, termed Multi-Head PINN (MH-PINN), consists of a shared body NN and multiple head NNs, each corresponding to an individual PINN instance. Our framework for functional prior learning is carried out in two stages: (1) training the MH-PINNs to develop a shared body NN alongside multiple head NNs, and (2) employing these trained head NNs to estimate a prior distribution through a normalizing flow-based density estimator. The learned functional prior can then be applied as a regularization mechanism in deterministic contexts or as an informative prior within a Bayesian inference framework, aiding in the resolution of subsequent ODE/PDE tasks. We evaluate the efficacy of MH-PINNs across five benchmark problems, including a high-dimensional parametric PDE, all characterized by data sparsity or substantial noise levels. Our findings reveal that MH-PINNs deliver accurate solutions and robust UQ, demonstrating adaptability across a range of complex and challenging scenarios.

Bayesian inference↗

Comparison of tungsten versus molybdenum for double shell capsules using machine learning design optimization

Double shell targets are an alternative ignition platform for inertial confinement fusion. One design consideration for double shell targets is the choice of inner shell material to help trap radiation emitted by the hot fuel to aid ignition. Materials such as molybdenum and tungsten are of interest for the inner shell layer of the targets. While molybdenum has a lower density that could inhibit instability growth and allow for radiography and code benchmarking, tungsten has a higher density that could provide more compression and confinement. These tradeoffs have been explored using optimized designs for each material. Our previous work [Vazirani et al., “Coupling 1D xRAGE simulations with machine learning for graded inner shell design optimization in double shell capsules,” Phys. Plasmas 28, 122709 (2021); Vazirani et al., “Coupling multi-fidelity xRAGE with machine learning for graded inner shell design optimization in double shell capsules,” Phys. Plasmas 30, 062704 (2023); and Vazirani et al., “Bayesian batch optimization for molybdenum versus tungsten inertial confinement fusion double shell target design,” Stat. Anal. Data Min. 17, e11698 (2024)] resulted in a multi-fidelity Bayesian optimization framework to find yield-optimized double shell target geometries. By leveraging simulations of varying fidelities (one-dimensional and two-dimensional) to inform one another, the multi-fidelity optimization was able to optimize a design in the highest fidelity with significantly fewer simulations than would be used in a systematic parameter scan. In this work, we apply the multi-fidelity Bayesian optimization to explore the optimized designs of double shell targets with molybdenum and tungsten inner shells as well as the physics producing the high performing implosions. A physics exploration of all the simulations used in this study shows trends in designs that contribute to high yields, ion temperatures, and fuel areal densities. Comparison of molybdenum and tungsten simulations shows that they can produce similar implosion conditions with different geometries, which would be important to study in experiments. Graded density layers produce varying performances with the two materials but continue to be of interest for future studies along with studies of doped inner shell materials and applied surface roughness.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Fusion of Laboratory and Textual Data for Investigative Bioforensics

Chemical and biological forensic programs focus on the identification of a threat and acquisition of laboratory measurements to determine how a threat agent may have been produced. However, to generate investigative leads, it might also be useful to identify institutions where the same agent has been produced by the same or a very similar process, since the producer of the agent may have learned methods at a university or similar institution. We have developed a Bayesian network framework that fuses hard and soft data sources to assign probability to production practices. It combines the results of laboratory measurements with an automatic text reader to scan scientific literature and rank institutions that had published papers on the agent of interest in order of the probability that the institution has the capability to generate the sample of interest based on laboratory data. We demonstrate the Bayesian network on an example case from microbial forensics, predicting the methods used to produce Bacillus anthracis spores based on mass spectrometric measurements and identifying institutions that have a history of growing Bacillus spores using the same or highly similar methods. We illustrate that the network model can assign a higher posterior probability than expected by random chance to appropriate institutions when trained using only a small set of manually analyzed documents. This is the first example of an automated methodology to integrate experimental and textual data for the purpose of investigative forensics.

Webb-Robertson, Bobbie-Jo M.↗

ROSE: A reduced-order scattering emulator for optical models

A new generation of phenomenological optical potentials requires robust calibration and uncertainty quantification, motivating the use of Bayesian statistical methods. These Bayesian methods usually require calculating observables for thousands or even millions of parameter sets, making fast and accurate emulators highly desirable or even essential. Emulating scattering across different energies or with interactions such as optical potentials is challenging because of the nonaffine parameter dependence, meaning the parameters do not all factorize from individual operators. Here we introduce and demonstrate the reduced-order scattering emulator ( ROSE ) framework, a reduced basis emulator that can handle nonaffine problems. ROSE is fully extensible and works within the publicly available band framework software suite for calibration, model mixing, and experimental design. As a demonstration problem, we use ROSE to calibrate a realistic nucleon-target scattering model through the calculation of elastic cross sections. This problem shows the practical value of the ROSE framework for Bayesian uncertainty quantification with controlled trade-offs between emulator speed and accuracy as compared to high-fidelity solvers. Finally, planned extensions of ROSE are discussed.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Dynamic Multiplexed Control and Modeling of Optogenetic Systems Using the High-Throughput Optogenetic Platform, Lustro

The ability to control cellular processes using optogenetics is inducer-limited, with most optogenetic systems responding to blue light. To address this limitation, we leverage an integrated framework combining Lustro, a powerful high-throughput optogenetics platform, and machine learning tools to enable multiplexed control over blue light-sensitive optogenetic systems. Specifically, we identify light induction conditions for sequential activation as well as preferential activation and switching between pairs of light-sensitive split transcription factors in the budding yeast, Saccharomyces cerevisiae. We use the high-throughput data generated from Lustro to build a Bayesian optimization framework that incorporates data-driven learning, uncertainty quantification, and experimental design to enable the prediction of system behavior and the identification of optimal conditions for multiplexed control. This work lays the foundation for designing more advanced synthetic biological circuits incorporating optogenetics, where multiple circuit components can be controlled using designer light induction programs, with broad implications for biotechnology and bioengineering.

59 BASIC BIOLOGICAL SCIENCES↗

Coupling multi-fidelity xRAGE with machine learning for graded inner shell design optimization in double shell capsules

Bayesian optimization has shown promise for the design optimization of inertial confinement fusion targets. Specifically, in Vazirani et al. [Phys. Plasmas 28 , 122709 (2021)], optimal designs for double shell capsules with graded inner shells were identified using one-dimensional xRAGE simulation yield calculations. While the machine learning models were able to accurately learn and predict one-dimensional simulation target performance, using simulations with higher fidelity would improve design optimization and better match with the expected experimental performance. However, higher fidelity physics modeling, i.e., two-dimensional xRAGE simulations, requires significantly larger computational time/cost, usually at least an order of magnitude, in comparison with one-dimensional simulations. This study presents a multi-fidelity Bayesian optimization, in which the machine learning model leverages low-fidelity (one-dimensional xRAGE) and high-fidelity (two-dimensional xRAGE) simulations to more accurately predict “pre-shot” target performance with respect to the expected experimental performance. By building a multi-fidelity Bayesian optimization framework coupled with xRAGE, the low-fidelity and high-fidelity simulations are able to inform one another, such that we have: (1) improved physics modeling in comparison with using low-fidelity simulations alone, (2) reduced computational time/cost in comparison with using high-fidelity simulations alone, and (3) more confidence in the expected performance of optimized targets during real-world experiments. In the future, we plan to use this robust multi-fidelity Bayesian optimization methodology to expedite the design of graded inner shells further and eventually full capsules as a part of the current double shell campaign at the National Ignition Facility.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Toward machine-learning-assisted PW-class high-repetition-rate experiments with solid targets

We present progress in utilizing a machine learning (ML) assisted optimization framework to study the trends in a parameter space defined by spectrally shaped, high-intensity, petawatt-class (8 J, 45 fs) laser pulses interacting with solid targets and give the first simulation-based overview of predicted trends. A neural network (NN) incorporating uncertainty quantification is trained to predict the number of hot electrons generated by the laser–target interaction as a function of pulse shaping parameters. The predictions of this NN serve as the basis function for a Bayesian optimization framework to navigate this space. For post-experimental evaluation, we compare two separate neural network (NN) models. One is based solely on data from experiments, and the other is trained only on ensemble particle-in-cell simulations. Reviewing the predicted and observed trends across the experiment-capable laser parameter search space, we find that both ML models predict a maximal increase in hot electron generation at a level of approximately 12%–18%; however, no statistically significant enhancement was observed in experiments. On direct comparison of the NN models, the average discrepancy is 8.5%, with a maximum of 30%. Since shot-to-shot fluctuations in experiments affect the observations, we evaluate the behavior of our optimization framework by performing virtual experiments that vary the number of repeated observations and the noise levels. Here, we discuss the implications of such a framework for future autonomous exploration platforms in high-repetition-rate experiments.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Assessing Performance and Tradeoffs of Bioforensic Signature Systems

Chemical and biological forensic programs rely heavily on laboratory measurements to determine how a threat agent may have been produced. In addition to laboratory analyses, it may also be useful to identify institutions where the same threat agent has been produced by the same or a very similar process, since the producer of the agent may have learned methods at a university or similar institution. We developed a Bayesian network framework that combines the results of laboratory measurements with evidence from scientific literature to probabilistically rank institutions that have published papers on the agent of interest. As an example, we consider a network of three laboratory assays that are used to estimate the probabilities that a forensic sample of Yersinia pestis was produced using one of three culture media. We then apply techniques from multi-attribute decision science to assess and compare the performance of the various implementations of the Bayesian network in terms of three attributes: fidelity, document curation intensity, and consumption of the forensic sample. The mathematical approach we use to compare the various implementations is generalizable to the evaluation of other signature systems.

Watkins, Daniel M.↗

A note on minimizing time assurance tests for repairable systems

We consider assurance testing for repairable systems when supplementary information is available in addition to the data collected in the assurance test. Here, the supplementary information is incorporated using a Bayesian inferential framework. Here we consider assurance testing for a homogeneous Poisson process. In this note we consider an alternative criterion that minimizes the test time while ensuring that the requirements on the producer's and consumer's risks are met. We illustrate the use of this alternative criterion with an example.

42 ENGINEERING↗

Systematic Bayesian evaluation of resonance parameters in 19 Ne for the 15 O ⁡(𝛼, 𝛾)⁢ 19 Ne and 18 F ⁡(𝑝, 𝛼)⁢ 15 O reactions

Here, we present a comprehensive evaluation of the nuclear structure properties of 19 Ne using a novel and rigorous Bayesian statistical framework. Precise characterization of 19 Ne resonance parameters is critical for accurately determining reaction rates of the astrophysically significant 15 O ⁡(𝛼, 𝛾)⁢ 19 Ne and 18 F ⁡(𝑝, 𝛼)⁢ 15 O reactions, which govern breakout from the hot CNO cycle in x-ray bursts and influence 𝛾-ray emission in novae, respectively. By reconstructing likelihood functions from published experimental data—including asymmetric uncertainties and upper or lower limits—we derive posterior distributions for resonance energies, decay widths, and branching ratios. Our Bayesian approach systematically incorporates previously reported discrepancies among measurements, providing a statistically robust and consistent treatment of these uncertainties. The evaluated resonance parameters and associated uncertainties provide crucial input for stellar nucleosynthesis modeling, contributing to a refined understanding of explosive astrophysical phenomena.

Kim, Sohyun H. [Sungkyunkwan Univ., Suwon (Republi↗

The Langmuir probe system in the Wendelstein 7-X test divertor

Here, the design and evaluation of the Langmuir probe system used in the first divertor operation phase of Wendelstein 7-X is described. The probes are integrated into the target plates and have individually facetted surfaces to keep the angle of incidence of the magnetic field within an appropriate range for different magnetic configurations. Multiple models for the derivation of plasma parameters from current–voltage characteristics are introduced. These are analyzed with regard to their assumptions and limitations, generalized, and adapted to our use case. A detailed comparison is made to determine the most suitable model. It is found that the choice of model has a large impact, for example, resulting in a change in the inferred temperatures of up to a factor two. This evaluation is implemented in a Bayesian modeling framework and automated to allow for joint analysis with other diagnostics and a replacement of ad hoc assumptions. We rigorously treat parameter uncertainties, revealing strong correlations between them. General and flexible model formulations permit an expansion to additional effects.

47 OTHER INSTRUMENTATION↗

Exploring the physics of cesium lead halide perovskite quantum dots via Bayesian inference of the photoluminescence spectra in automated experiment

The unique optoelectronic properties of metal halide perovskite quantum dots (QDs) make them promising candidates for applications in light-emitting diodes (LEDs), scintillators, and other photonic devices. The automated micropipetting synthesis platform equipped with an optical reader enables the opportunity for high throughput synthesis and photoluminescent (PL) characterization of metal halide perovskite QDs for the first time. Here, we explore the compositional dependence of the PL behavior and stability of the combinatorial library of cesium lead halide (CsPbX 3 ) perovskites QDs via the automated platform. To study the stability of synthesized QDs in the binary and ternary configurations, we study the time-dependent PL properties using previously developed machine learning analysis. Additionally, to systematically explore the PL behavior in the ternary CsPbX 3 QDs system, we introduce the Bayesian inference framework that allows the probabilistic fit of multiple models to the PL data and establishes both optimal model and model parameter robustly. Furthermore, these behaviors can be used as a control parameter for the navigation of the multidimensional compositional spaces in automated synthesis. Furthermore, this analysis shows the nonuniformity of the PL peak behavior in the ternary CsPbX 3 QDs system. Further, the analysis confirms narrow size distribution and good quality of CsPbBr 3 QDs alloyed with low concentrations of iodide and chloride. We note that Bayesian Inference fit parameters can be further used as a control signal for navigation of the chemical spaces in automated synthesis.

36 MATERIALS SCIENCE↗