Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

The dependence of the gradients of oxygen and nitrogen-to-oxygen on stellar age in MaNGA galaxies

For this work, we derived the oxygen abundance (O/H), the nitrogen-to-oxygen (N/O) abundance ratio, and their corresponding radial gradients for a sample of 1431 galaxies from the MaNGA DR15 survey using two different realisations of the strong line method: empirical R calibration and the Bayesian model-based HII-CHI-MISTRY (HCM) code. We find that both abundance calculation methods reveal a correlation between the O/H gradient and the stellar mass of a galaxy. This relation is non-linear, with the steepest average gradients in the intermediate mass range and flatter average gradients for high- and low-mass galaxies. The relation between the N/O gradient and the stellar mass is, on average, non-linear with the steepest gradients in the intermediate mass range (log(M/M ⊙ )~10), flatter gradients for high-mass galaxies, and the flattest gradients for low-mass galaxies. However, the general trend of steepening N/O gradients for higher masses, as reported in previous studies, remains evident. We find a dependence between the O/H and N/O gradients and the galaxy mean stellar age traced by the D(4000) index. For galaxies of lower masses, both gradients are, generally, steeper for intermediate values of D(4000) and flatter for low and high values of D(4000). Only the most massive galaxies do not show this correlation. We interpret this behaviour as an evolution of the metallicity gradients with the age of stellar population. Though the galaxies with a positive slope of the D(4000) radial gradient tend to have flatter O/H and N/O gradients, as compared to those with a negative D(4000) gradient.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Data from: Comparing traditional and Bayesian approaches to ecological meta-analysis

Despite the wide application of meta-analysis in ecology, some of the traditional methods used for meta-analysis may not perform well given the type of data characteristic of ecological meta-analyses. We reviewed published meta-analyses on the ecological impacts of global climate change, evaluating the number of replicates used in the primary studies (ni) and the number of studies or records (k) that were aggregated to calculate a mean effect size. We used the results of the review in a simulation experiment to assess the performance of conventional frequentist and Bayesian meta-analysis methods for estimating a mean effect size and its uncertainty interval. Our literature review showed that ni and k were highly variable, distributions were right-skewed, and were generally small (median ni =5, median k=44). Our simulations show that the choice of method for calculating uncertainty intervals was critical for obtaining appropriate coverage (close to the nominal value of 0.95). When k was low (<40), 95% coverage was achieved by a confidence interval based on the t-distribution that uses an adjusted standard error (the Hartung-Knapp-Sidik-Jonkman, HKSJ), or by a Bayesian credible interval, whereas bootstrap or z-distribution confidence intervals had lower coverage. Despite the importance of the method to calculate the uncertainty interval, 39% of the meta-analyses reviewed did not report the method used, and of the 61% that did, 94% used a potentially problematic method, which may be a consequence of software defaults. In general, for a simple random-effects meta-analysis, the performance of the best frequentist and Bayesian methods were similar for the same combinations of factors (k and mean replication), though the Bayesian approaches had higher than nominal (>95%) coverage for the mean effect when k was very low (k<15). Our literature review suggests that many meta-analyses that used z-distribution or bootstrapping confidence intervals may have over-estimated the statistical significance of their results when the number of studies was low; more appropriate methods need to be adopted in ecological meta-analyses.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Multi-variance replica exchange SGMCMC for inverse and forward problems via Bayesian PINN

Physics-informed neural network (PINN) has been successfully applied in solving a variety of nonlinear non-convex forward and inverse problems. However, the training is challenging because of the non-convex loss functions and the multiple optima in the Bayesian inverse problem. In this work, we propose a multi-variance replica exchange stochastic gradient Langevin dynamics method to tackle the challenge of the multiple local optima in the optimization and the challenge of the multiple modal posterior distribution in the inverse problem. Replica exchange methods are capable of escaping from the local traps and accelerating the convergence; two chains with different temperatures are designed where the low temperature chain aims for the local convergence, and the target of the high temperature chain is to travel globally and explore the whole loss function entropy landscape. However, it may not be efficient to solve mathematical inversion problems by using the vanilla replica method directly since the method doubles the computational cost in evaluating the forward solvers (likelihood functions) in the two chains. To address this issue, we propose to make different assumptions on the energy function estimation and this facilities one to use solvers of different fidelities in the likelihood function evaluation. More precisely, one can use a solver with low fidelity in the high temperature chain while using a solver with high fidelity in the low temperature chain. Our proposed method significantly lowers the computational cost in the high temperature chain, meanwhile preserving the accuracy and converging very fast. Here we give an unbiased estimate of the swapping rate and give an estimation of the discretization error of the scheme. To verify our idea, we design and solve four inverse problems which have multiple modes. The proposed method is also employed to train the Bayesian PINN to solve the forward and inverse problems; faster and more accurate convergence has been observed when compared to the stochastic gradient Langevin dynamics (SGLD) method and vanilla replica exchange methods.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Dynamic, risk informed decision support systems and methods

The present disclosure is directed to a decision support system or tool based on a Bayesian Network (BN) framework. The diagnostic support tool is created by using advanced Probabilistic Risk Assessment (PRA) method(s) to construct Bayesian Networks (BNs) that form a Bayesian Decision Support Process (BDSP) to provide science-based decision support for understanding and managing events in complex systems. In an embodiment, the PRA method(s) may include Discrete Dynamic Event Trees (DDETs) and simulations.

Groth, Katrina↗
DOE OSTI2023

Bayesian High-Rank Hankel Matrix Completion for Nonlinear Synchrophasor Data Recovery

Phasor measurement units (PMUs) provide high temporal-resolution synchrophasor measurements for power system monitoring and control. The frequent data quality issues, such as missing and bad data, prevent the incorporation of synchrophasor data in real-time operations. Most existing data-driven data recovery methods assume the power system dynamics can be approximated by a linear dynamical system, and the recovery performance degrades significantly when the power system is experiencing nonlinear dynamics during significant events. Here, this paper proposes a data-driven Bayesian nonlinear synchrophasor data recovery method (Ba-NSDR) that can recover a consecutive time period of simultaneous data losses or errors across all channels, even when the underlying system is highly nonlinear. The idea is to lift the Hankel matrix of the spatial-temporal synchrophasor data to a higher dimension such that the lifted Hankel matrix is low-rank in that space and can be processed with the kernel trick. Our proposed Bayesian method then infers the probabilistic distributions of synchrophasor from the partial observations. Some distinctive features of Ba-NSDR include an uncertainty index to measure the accuracy of the recovery result and the robustness to parameter selections. Our method is verified on both synthetic and recorded event datasets.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Bayesian estimation of cross-section and errors of experiment and calculation for accurate prediction of neutronic characteristics

In some experiments, there might be a correlation of experimental errors such as an error caused by fabrication. The correlation of calculation errors also might exist among analyses of experiments. In the present study, considering these correlations, the cross-section and errors of experiment and calculation are adjusted for the accurate prediction of neutronic characteristics. The adjustment method is derived based on Bayesian theory. The 'a posteriori' distributions of cross-section and errors of experiment and calculation are obtained by the derivation. The case study is performed by using the benchmarks of light-water moderated experiments reported in ICSBEP. The error from fuel rod fabrication and measurement are included in the experiment error, and the error from the simplification of the benchmark model is included in the calculation error. Since these errors have a positive correlation among the benchmarks, the prediction accuracy is expected to be improved by considering these correlations. For the sensitivity analysis of the correlation among benchmarks, the correlation coefficient of experiment error and that of calculation error is assumed from 0.0 to 0.9. The results indicate that the prediction accuracy of the multiplication factor can be improved by increasing the correlation coefficient of experiment error and that of calculation error. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2026

Technical Report for Bayesian Optimization and Reinforcement Learning for Beam Polarization Increase in the BNL Hadron Injectors

This project developed and evaluated physics-informed Bayesian learning and machine learning (ML)-based optimization methods for improving beam polarization preservation in the BNL hadron injector chain. The work focused on uncertainty-aware digital twin modeling, Bayesian calibration of accelerator simulations using beam measurements, and data-efficient optimization strategies including Bayesian optimization and reinforcement learning. These methods were applied to injector tuning and RF control problems in realistic accelerator settings to support improved operational robustness and readiness for RHIC operations and future Electron–Ion Collider facilities. No subject inventions were disclosed under this award.

43 PARTICLE ACCELERATORS↗
DOE OSTI2025

Accelerating Hamiltonian Monte Carlo for Bayesian inference in neural networks and neural operators

Hamiltonian Monte Carlo (HMC) is a powerful and accurate method to sample from the posterior distribution in Bayesian inference. However, HMC techniques are computationally demanding for Bayesian neural networks due to the high dimensionality of the network’s parameter space and the non-convexity of their posterior distributions. Therefore, various approximation techniques, such as variational inference (VI) or stochastic gradient MCMC, are often employed to infer the posterior distribution of the network parameters. Such approximations introduce inaccuracies in the inferred distributions, resulting in unreliable uncertainty estimates. In this work, we propose a hybrid approach that combines inexpensive VI and accurate HMC methods to efficiently and accurately quantify uncertainties in neural networks and neural operators. The proposed approach leverages an initial VI training on the full network. We examine the influence of individual parameters on the prediction uncertainty, which shows that a large proportion of the parameters do not contribute substantially to uncertainty in the network predictions. This information is then used to significantly reduce the dimension of the parameter space, and HMC is performed only for the subset of network parameters that strongly influence prediction uncertainties. This yields a framework for accelerating the full batch HMC for posterior inference in neural networks. We demonstrate the efficiency and accuracy of the proposed framework on deep neural networks and operator networks, showing that inference can be performed for large networks with tens to hundreds of thousands of parameters. Finally, we show that this method can effectively learn surrogates for complex physical systems by modeling the operator that maps from upstream conditions to wall-pressure data on a cone in hypersonic flow.

Bayesian inference↗
DOE OSTI2022

Inference, Prediction, & Entropy-Rate Estimation of Continuous-Time, Discrete-Event Processes

Inferring models, predicting the future, and estimating the entropy rate of discrete-time, discrete-event processes is well-worn ground. However, a much broader class of discrete-event processes operates in continuous-time. Here, we provide new methods for inferring, predicting, and estimating them. The methods rely on an extension of Bayesian structural inference that takes advantage of neural network’s universal approximation power. Based on experiments with complex synthetic data, the methods are competitive with the state-of-the-art for prediction and entropy-rate estimation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

Bayesian analysis for estimating statistical parameter distributions of elasto-viscoplastic material models

High temperature design methods rely on constitutive models for inelastic deformation and failure typically calibrated against the mean of experimental data without considering the associated scatter. Variability may arise from the experimental data acquisition process, from heat-to-heat material property variations, or both and need to be accurately captured to predict parameter bounds leading to efficient component design. Applying the Bayesian Markov Chain Monte Carlo (MCMC) method to produce statistical models capturing the underlying uncertainty in the experimental data is an area of ongoing research interest. This work varies aspects of the Bayesian MCMC method and explores their effect on the posterior parameter distributions for a uniaxial elasto-viscoplastic damage model using synthetically generated reference data. From our analysis with the uniaxial inelastic model we determine that an informed prior distribution including different types of test conditions results in more accurate posterior parameter distributions. The parameter posterior distributions, however, do not improve when increasing the number of similar experimental data. Additionally, changing the amount of scatter in the data affects the quality of the posterior distributions, especially for the less sensitive model parameters. Moreover, we perform a sensitivity study of the model parameters against the likelihood function prior to the Bayesian analysis. The results of the sensitivity analysis help to determine the reliability of the posterior distributions and reduce the dimensionality of the problem by fixing the insensitive parameters. The comprehensive study described in this work demonstrates how to efficiently apply the Bayesian MCMC methodology to capture parameter uncertainties in high temperature inelastic material models. Quantifying these uncertainties in inelastic models will improve high temperature engineering design practices and lead to safer, more effective component designs.

42 ENGINEERING↗
DOE OSTI2025

Autonomous organic synthesis for redox flow batteries via flexible batch Bayesian optimization

Traditional trial-and-error methods for materials discovery are inefficient to meet the urgent demands posed by the rapid progression of climate change. This urgency has driven the increasing interest in integrating robotics and machine learning into materials research to accelerate experimental learning. However, idealized decision-making frameworks to achieve maximum sampling efficiency are not always compatible with high-throughput experimental workflows inside a laboratory. For multi-step chemical processes, differences in hardware capacities can complicate the digital framework by introducing constraints on the maximum number of samples in each step of the experiment, hence causing varying batch sizes in variable selection within the same batch. Therefore, designing flexible sampling algorithms is necessary to accommodate the multi-step synthesis with practical constraints unique to each high-throughput workflow. In this work, we designed and employed three strategies on a high-throughput robotic platform to optimize the sulfonation reaction of redox-active molecules used in flow batteries. Our strategies adapt to the multi-step experimental workflow, where their formulation and heating steps are separate, causing varying batch size requirements. By strategically sampling using clustering and mixed-variable batch Bayesian optimization, we were able to iteratively identify optimal conditions that maximize the yields. Our work presents a flexible approach that allows tailoring the machine learning decision-making to suit the practical constraints in individual high-throughput experimental platforms, followed by performing resource-efficient yield optimization using available open-source Python libraries.

Tamura, Clara [Univ. of Washington, Seattle, WA (U↗
DOE OSTI2020

UQTk User Manual (V.3.1.0)

The UQ Toolkit (UQTk) is a collection of libraries and tools for the quantification of uncertainty in numerical model predictions. Version 3.1.0 offers intrusive and non-intrusive methods for propagating input uncertainties through computational models, tools for sensitivity analysis, methods for sparse surrogate construction, and Bayesian inference tools for inferring parameters from experimental data. This manual discusses the download and installation process for UQTk, provides pointers to the UQ methods used in the toolkit, and describes some of the examples provided with the toolkit.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

UQTk Version 3.1.1 User Manual

The UQ Toolkit (UQTk) is a collection of libraries and tools for the quantification of uncertainty in numerical model predictions. Version 3.1.1 offers intrusive and non-intrusive methods for propagating input uncertainties through computational models, tools for sensitivity analysis, methods for sparse surrogate construction, and Bayesian inference tools for inferring parameters from experimental data. This manual discusses the download and installation process for UQTk, provides pointers to the UQ methods used in the toolkit, and describes some of the examples provided with the toolkit.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

UQTk Version 3.1.2 User Manual

The UQ Toolkit (UQTk) is a collection of libraries and tools for the quantification of uncertainty in numerical model predictions. Version 3.1.2 offers intrusive and non-intrusive methods for propagating input uncertainties through computational models, tools for sensitivity analysis, methods for sparse surrogate construction, and Bayesian inference tools for inferring parameters from experimental data. This manual discusses the download and installation process for UQTk, provides pointers to the UQ methods used in the toolkit, and describes some of the examples provided with the toolkit.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Sparsifying priors for Bayesian uncertainty quantification in model discovery

We propose a probabilistic model discovery method for identifying ordinary differential equations governing the dynamics of observed multivariate data. Our method is based on the sparse identification of nonlinear dynamics (SINDy) framework, where models are expressed as sparse linear combinations of pre-specified candidate functions. Promoting parsimony through sparsity leads to interpretable models that generalize to unknown data. Instead of targeting point estimates of the SINDy coefficients, we estimate these coefficients via sparse Bayesian inference. The resulting method, uncertainty quantification SINDy (UQ-SINDy), quantifies not only the uncertainty in the values of the SINDy coefficients due to observation errors and limited data, but also the probability of inclusion of each candidate function in the linear combination. UQ-SINDy promotes robustness against observation noise and limited data, interpretability (in terms of model selection and inclusion probabilities) and generalization capacity for out-of-sample forecast. Sparse inference for UQ-SINDy employs Markov chain Monte Carlo, and we explore two sparsifying priors: the spike and slab prior, and the regularized horseshoe prior. UQ-SINDy is shown to discover accurate models in the presence of noise and with orders-of-magnitude less data than current model discovery methods, thus providing a transformative method for real-world applications which have limited data.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Machine learning assisted bayesian inference of mix and hot-spot conditions in NIF implosions

Experiments on the National Ignition Facility (NIF) have provided clear evidence of ablator material mixing into the Hot-Spot, leading to degraded performance. However, inferring the amount of mix and Hot-Spot conditions from typical experimental observations (e.g. x-ray spectra and images) is highly challenging. Here, we have developed an analysis method that utilizes machine learning assisted Bayesian inference to find the probability distributions of the Hot-Spot and mix conditions. This approach uses a neural network, trained on an idealized 2-dimensional representation of the Hot-Spot and mix distribution, and Bayesian inference to find the statistical distributions of Hot-Spot conditions that provide a match with observations. We have tested this method with synthetic data from simulations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Applicability study of Bayesian optimization in core neutronic design using a toy model

At the Japan Atomic Energy Agency (JAEA), an innovative design approach named ARKADIA (Advanced Reactor Knowledge- and AI-aided Design Integration Approach through the whole plant life cycle) for advanced nuclear reactors is currently under development. One task in ARKADIA is to build a system that automatically optimizes core and fuel designs by conducting core neutronic and thermal-hydraulic calculations, fuel integrity evaluations, and plant dynamic analyses. This system will be implemented to automatically find an optimal design that minimizes (or maximizes) objective function defined by core performance while varying the core and fuel design parameters such as fuel pin diameter, core height and diameter. In this study, as the first step of system development, we focused only on core neutronic design and conducted a study of automatic optimization. As the optimization algorithm, Bayesian optimization (BO), an effective method for optimization problems with expensive computational cost of objective function, was utilized. The applicability of BO was studied based on single- and two-objective optimization examples of core neutronic design in a toy model. As a result, in the former, it was shown that BO can give the optimal solution, which matches the reference solution calculated by a brute force calculation well, with a small number of required calculations. Usability on core neutronic designs, where the computational cost per case is high, was confirmed. In the latter, it was found that BO can give a Pareto solutions-set that shows good agreement with the reference solution. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Recent Developments in Hydrogeologic Applications for Strain Tensor Analyses

Changes in fluid pressure deform porous media and this effect occurs in a variety of hydrogeologic processes, from the change in storage during pumping or injection to fluctuations in water levels caused by barometric pressure. We have developed instruments for measuring small strains in porous media, and we have used the resulting strain data to evaluate well testing, hydraulic fracturing, manual loading at the ground surface, and ambient hydrologic processes, like rainfall and evaporation. A particularly important application is the use of strain tensor data measured at shallow depths to analyze well tests or hydraulic fractures conducted at much greater depths. An early demonstration of this technique was conducted at the North Avant Field north of Tulsa, Oklahoma, where Pennsylvanian sandstone creates a confined aquifer and oil reservoir at a depth of 530m. We have showed that the strains caused by injecting into the aquifer could be measured at a depth of 30m and used to evaluate the properties of the aquifer. We recently expanded the array of strainmeters at the North Avant Field by deploying three more instruments at shallow depth (30m) along with a deep instrument at 520m depth in the winter, 2021. The deep instrument is deployed in shale caprock slightly above the aquifer. To our knowledge, the deep strainmeter at the North Avant Field is the deepest strainmeter ever deployed and this required refining methods originally developed for shallow deployments. The instrument was lowered to depth on oil field tubing and cemented in place using techniques and materials developed for use in oil wells. Optical fiber used to communicate with the instrument was cemented in the annulus on the outside of tubing. This is significant because the techniques we used could readily be extended to greater depth, suggesting that strainmeters can be deployed over a wide range of depths for monitoring critical subsurface processes. For example, it suggests that strainmeters could be deployed through the caprock to monitor for leaks from underlying CO2 storage reservoirs. The strainmeter array at the North Avant Field has been used to characterize deformation during a series of injection tests in the spring and summer, 2021. All the new strainmeters respond to pumping, and the strainmeters we installed earlier also responded. To our knowledge, this is the first application of well testing in a deep aquifer that was monitored by an array of strainmeters—our earlier work used strainmeters at a single location. We are currently analyzing the strain data using an analytical solution, a proxy-based Bayesian inversion algorithm, and other methods. Strainmeter data has also been used to characterize periodic pumping tests by us and Riley Blais. A periodically varying pumping rate causes both hydraulic head and strain signals that vary with the same period as the pumping. The peaks and troughs of the head in monitoring wells lag behind the peaks and troughs of the head in the pumping well, and this lag time increases with distance from the pumping well. The lag time of the pressure and the distance to the monitoring well can be used in a simple analysis to estimate the hydraulic diffusivity of the aquifer. The lag time determined from strain data can be used to estimate aquifer properties using the same analysis that works for the pressure only for strain data measured at particular locations. That is because the strain field in a confining unit advances upward, laterally and then downward even though the pressure in the underlying aquifer only advances laterally, according to our recent simulations. We have field data showing that a small periodic signal superimposed on an injection rate at the North Avant Field will create a periodic strain signal at shallow strainmeters. The field data and the recent simulations suggest that including a periodic component to injection or pumping and then monitoring the resulting strain signal could be a way to monitor the subsurface.

Murdoch, Larry↗