SEARCH · Search NASA

Results for “Bayesian Optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30

All sources NASA NTRS DOE OSTI

DOE OSTI2020

Determining Multi-Component Phase Diagrams with Desired Characteristics Using Active Learning

Herein, we demonstrate how to predict and experimentally validate phase diagrams for multi-component systems from a high-dimensional virtual space of all possible phase diagrams involving several elements based on small existing experimental data. The experimental data for bulk phases for known systems represents a sampling from this space, and screening the space allows multi-component phase diagrams with given design criteria to be built. This approach uses machine learning methods to predict phase diagrams and Bayesian experimental design to minimize experiments for refinement and validation, all within an active learning loop. The approach is proven by predicting and synthesizing the ferroelectric ceramic system (1-ω)(Ba 0.61 Ca 0.28 Sr 0.11 TiO 3 )-ω(BaTi 0.888 Zr 0.0616 Sn 0.0028 Hf 0.0476 O 3 ) with a relatively high transition temperature and triple point, as well as the NiTi-based pseudo-binary phase diagram (1-ω)(Ti 0.309 Ni 0.485 Hf 0.20 Zr 0.006 )-ω(Ti 0.309 Ni 0.485 Hf 0.07 Zr 0.068 Nb 0.068 ) designed for high transition temperature (ω ≤ 1). Each phase diagram is validated and optimized through only three new experiments. The complexity of these compounds is beyond the reach of today’s computational methods.

36 MATERIALS SCIENCE↗

DOE OSTI2020

Methods for R&D Portfolio Analysis and Evaluation (Workshop Report)

The Workshop on Methods for R&D Portfolio Analysis and Evaluation convened on 17–18 July 2019 at the National Renewable Energy Laboratory in Golden, Colorado, and examined strengths and weaknesses of the various methodologies applicable to R&D portfolio modeling, analysis, and decision support, given pragmatic constraints such as data availability, uncertainties in estimating the impact of R&D spending, and practical operational overheads. Participants employed their deep expertise in approaches such as stochastic optimization, real options, Monte-Carlo analysis, Bayesian networks, decision theory, complex systems analysis, deep uncertainty, and technology-evolution modeling to critique the initial example models developed by the project’s core team and to conduct thought experiments grounded in real-life technology models, progress data, expert elicitation, and portfolio information. This engagement of participants’ methodological expertise with the practical requirements of real-life portfolio decision support yielded ideas for improved approaches, alternative methodological hypotheses, and hybridization of methodologies that are well-grounded theoretically, computationally sound, and realistically executable given data availability and other practical constraints.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2020

Methods for R&D Portfolio Analysis and Evaluation (Workshop Report)

The Workshop on Methods for R&D Portfolio Analysis and Evaluation convened on 17-18 July 2019 at the National Renewable Energy Laboratory in Golden, Colorado, and examined strengths and weaknesses of the various methodologies applicable to R&D portfolio modeling, analysis, and decision support, given pragmatic constraints such as data availability, uncertainties in estimating the impact of R&D spending, and practical operational overheads. Participants employed their deep expertise in approaches such as stochastic optimization, real options, Monte-Carlo analysis, Bayesian networks, decision theory, complex systems analysis, deep uncertainty, and technology-evolution modeling to critique the initial example models developed by the project’s core team and to conduct thought experiments grounded in real-life technology models, progress data, expert elicitation, and portfolio information. This engagement of participants’ methodological expertise with the practical requirements of real-life portfolio decision support yielded ideas for improved approaches, alternative methodological hypotheses, and hybridization of methodologies that are well-grounded theoretically, computationally sound, and realistically executable given data availability and other practical constraints.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2020

Calibration of energy density functionals with deformed nuclei

Nuclear density functional theory is the prevalent theoretical framework for accurately describing nuclear properties at the scale of the entire chart of nuclides. Given an energy functional and a many-body scheme (e.g., single- or multireference level), the predictive power of the theory depends strongly on how the parameters of the energy functionals have been calibrated with experimental data. Expanded algorithms and computing power have enabled recent optimization protocols to include data in deformed nuclei in order to optimize the coupling constants of the energy functional. The primary motivation of this work is to test the robustness of such protocols with respect to some of the technical and numerical details of the underlying calculations, especially when the calibration explores a large parameter space. To this end, we quantify the effect of these uncertainties on both the optimization and statistical emulation of composite objective functions. We also emphasize that Bayesian calibration can provide better estimates of the theoretical errors used to define objective functions.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2023

Integrating Survival Analysis with Bayesian Statistics to Forecast the Remaining Useful Life of a Centrifugal Pump Conditional to Multiple Fault Types

To improve the viability of nuclear power plants, there is a need to reduce their operational costs. Operational costs account for a significant portion of a plant’s yearly budget, due to their scheduled-based maintenance approach. In order to reduce these costs, proactive methods are required that estimate and forecast the state of a machine in real time to optimize maintenance schedules. In this research, we use Bayesian networks to develop a framework that can forecast the remaining useful life of a centrifugal pump. To do so, we integrate survival analysis with Bayesian statistics to forecast the health of the pump conditional to its current state. We complete our research by successfully using the Bayesian network on a case study. This solution provides an informed probabilistic viewpoint of the pumping system for the purpose of predictive maintenance.

42 ENGINEERING↗

DOE OSTI2021

Bayesian Inference for Integrating Yarrowia lipolytica Multiomics Datasets with Metabolic Modeling

Optimizing the metabolism of microbial cell factories for yields and titers is a critical step for economically viable production of bioproducts and biofuels. In this process, tuning the expression of individual enzymes to obtain the desired pathway flux is a challenging step, in which data from separate multiomics techniques must be integrated with existing biological knowledge to determine where changes should be made. Following a design-build-test-learn strategy, building on recent advances in Bayesian metabolic control analysis, we identify in this work key enzymes in the oleaginous yeast Yarrowia lipolytica that correlate with the production of itaconate by integrating a metabolic model with multiomics measurements. To this extent, we quantify the uncertainty for a variety of key parameters, known as flux control coefficients (FCCs), needed to improve the bioproduction of target metabolites and statistically obtain key correlations between the measured enzymes and boundary flux. Based on the top five significant FCCs and five correlated enzymes, our results show phosphoglycerate mutase, acetyl-CoA synthetase (ACSm), carbonic anhydrase (HCO3E), pyrophosphatase (PPAm), and homoserine dehydrogenase (HSDxi) enzymes in rate-limiting reactions that can lead to increased itaconic acid production.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2019

Visualization of Theoretical Radiation Source Transmission Thru Simulated Concrete Buildings

Issac Michaud presented a talk at LANL on March 12th of 2018 and published his thesis in 2019, Michaud, I. (2019). Michaud and others, see Stefanescu, R., Hite, J., Cook, J., Smith, R. C., & Mattingly, J. (2019), have worked further on a similar problem. This is not an exhaustive list, although the references provide other related works. These works demonstrate how Bayesian analysis may be used to determine optimal locations of radiation sensors. The purpose of this document is to provide an intuition as to why and were these sensors may be located by understanding the theoretical result of radiation source transmission through concrete buildings.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

DOE OSTI2024

EFIT‐AI: Machine Learning and Artificial Intelligence Assisted Equilibrium Reconstruction for Tokamak Experiments and Burning Plasmas (Final Report)

The EFIT-AI project is creating a modern advanced equilibrium reconstruction code suitable for tokamak experiments of burning plasmas. EFIT [1,2] was the first and is the most extensively used equilibrium reconstruction code in the world. This project builds on the production-level experience and adds key elements as follows. 1. A Model Order Reduction (MOR) version of the two-dimensional (2D) Grad-Shafranov equation solver (EFIT-MORNN) using physics-informed neural networks. 2. Improved optimization and data analysis capabilities using a Bayesian framework enhanced with machine learning. 3. A MOR version of the three-dimensional (3D) perturbed equilibrium reconstruction tool.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2017

Accurate Distances to Important Spiral Galaxies: M63, M74, NGC 1291, NGC 4559, NGC 4625, and NGC 5398

Accurate distances are fundamental for interpreting various measured properties of galaxies. Surprisingly, many of the best-studied spiral galaxies in the Local Volume have distance uncertainties that are much larger than can be achieved with modern observation techniques. Using Hubble Space Telescope optical imaging, we use the tip of the red giant branch method to measure the distances to six galaxies that are included in the Spitzer Infrared Nearby Galaxies Survey program and its offspring surveys. The sample includes M63, M74, NGC 1291, NGC 4559, NGC 4625, and NGC 5398. We compare our results with distances reported to these galaxies based on a variety of methods. Depending on the technique, there can be a wide range in published distances, particularly from the Tully–Fisher relation. In addition, differences between the planetary nebular luminosity function and surface brightness fluctuation techniques can vary between galaxies, suggesting inaccuracies that cannot be explained by systematics in the calibrations. Our distances improve upon previous results, as we use a well-calibrated, stable distance indicator, precision photometry in an optimally selected field of view, and a Bayesian maximum likelihood technique that reduces measurement uncertainties.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2022

Using a surrogate-assisted Bayesian framework to calibrate the runoff-generation scheme in the Energy Exascale Earth System Model (E3SM) v1

Abstract. Runoff is a critical component of the terrestrial water cycle, and Earth system models (ESMs) are essential tools to study its spatiotemporal variability. Runoff schemes in ESMs typically include many parameters so that model calibration is necessary to improve the accuracy of simulated runoff. However, runoff calibration at a global scale is challenging because of the high computational cost and the lack of reliable observational datasets. In this study, we calibrated 11 runoff relevant parameters in the Energy Exascale Earth System Model (E3SM) Land Model (ELM) using a surrogate-assisted Bayesian framework. First, the polynomial chaos expansion machinery with Bayesian compressed sensing is used to construct computationally inexpensive surrogate models for ELM-simulated runoff at 0.5∘ × 0.5∘ for 1991–2010. The error metric between the ELM simulations and the benchmark data is selected to construct the surrogates, which facilitates efficient calibration and avoids the more conventional, but challenging, construction of high-dimensional surrogates for the ELM simulated runoff. Second, the Sobol' index sensitivity analysis is performed using the surrogate models to identify the most sensitive parameters, and our results show that, in most regions, ELM-simulated runoff is strongly sensitive to 3 of the 11 uncertain parameters. Third, a Bayesian method is used to infer the optimal values of the most sensitive parameters using an observation-based global runoff dataset as the benchmark. Our results show that model performance is significantly improved with the inferred parameter values. Although the parametric uncertainty of simulated runoff is reduced after the parameter inference, it remains comparable to the multimodel ensemble uncertainty represented by the global hydrological models in ISMIP2a. Additionally, the annual global runoff trend during the simulation period is not well constrained by the inferred parameter values, suggesting the importance of including parametric uncertainty in future runoff projections.

58 GEOSCIENCES↗

DOE OSTI2021

Bayesian sparse learning with preconditioned stochastic gradient MCMC and its applications

Deep neural networks have been successfully employed in an extensive variety of research areas, including solving partial differential equations. Despite its significant success, there are some challenges in effectively training DNN, such as avoiding overfitting in over-parameterized DNNs and accelerating the optimization in DNNs with pathological curvature. Here, we propose a Bayesian type sparse deep learning algorithm. The algorithm utilizes a set of spike-and-slab priors for the parameters in the deep neural network. The hierarchical Bayesian mixture will be trained using an adaptive empirical method. That is, one will alternatively sample from the posterior using preconditioned stochastic gradient Langevin Dynamics (PSGLD), and optimize the latent variables via stochastic approximation. The sparsity of the network is achieved while optimizing the hyperparameters with adaptive searching and penalizing. A popular SG-MCMC approach is Stochastic gradient Langevin dynamics (SGLD). However, considering the complex geometry in the model parameter space in nonconvex learning, updating parameters using a universal step size in each component as in SGLD may cause slow mixing. To address this issue, we apply a computationally manageable preconditioner in the updating rule, which provides a step-size parameter to adapt to local geometric properties. Moreover, by smoothly optimizing the hyperparameter in the preconditioning matrix, our proposed algorithm ensures a decreasing bias, which is introduced by ignoring the correction term in the preconditioned SGLD. According to the existing theoretical framework, we show that the proposed algorithm can asymptotically converge to the correct distribution with a controllable bias under mild conditions. Numerical tests are performed on both synthetic regression problems and learning solutions of elliptic PDE, which demonstrate the accuracy and efficiency of the present work.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2026

Semi-Analytical Hierarchical Bayesian Inference of Nonlinear Model Structure in Stochastic Dynamics: Applied to Compartmental Models of Infectious Diseases

A Bayesian computational framework for parsimonious inference in stochastic nonlinear dynamical systems is presented. This framework enables the concurrent estimation of system states, time-varying parameters, time-invariant parameters, and the optimal sparsity structure of the model parameters. Because differential equation-based models are often simplified mechanistic or phenomenological representations, robust inference from noisy measurement data requires explicit treatment of model error and uncertainty. Model error and time-varying parameters can be represented as random processes, enabling inference while making minimal assumptions about the underlying sources of discrepancy and variability. Adopting stochastic differential equation representations affords the model significant flexibility, but can also render it susceptible to overfitting during statistical inversion, where the inferred model may track noise rather than the underlying signal. To alleviate the effects of overfitting and to enable the discovery of the optimal sparse representation of the time-invariant parameters, a Bayesian sparse learning algorithm is embedded within the framework. This sparse learning framework adopts an approximate hierarchical Bayesian setting defined by a series of semi-analytical expressions. The model structure inference framework is validated using a stochastic compartmental model for tracking and forecasting active cases of an infectious disease. Compartmental models describe population-level infectious disease dynamics through interactions among population fractions grouped by disease state. Mathematically, such models consist of a system of coupled ordinary differential equations. This example adopts an expressive compartmental model that includes multiple possible interactions between disease states, motivated by early uncertainty surrounding COVID-19 reinfection dynamics and their implications for long-term epidemic forecasting. The sparse learning exercise permits the inference of a priori unknown epidemiological dynamics from simulated public health data, discovering the nested compartmental model that optimizes the trade-off between average data-fit and model complexity. It is shown that inducing sparsity among the model parameters eliminates redundant interactions between compartments, equivalently revealing the optimal coupling structure between differential equations.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Combined selection of the dynamic model and modeling error in nonlinear aeroelastic systems using Bayesian Inference

Here, we report a Bayesian framework for concurrent selection of physics-based models and (modeling) error models. We investigate the use of colored noise to capture the mismatch between the predictions of calibrated models and observational data that cannot be explained by measurement error alone within the context of Bayesian estimation for stochastic ordinary differential equations. Proposed models are characterized by the average data-fit, a measure of how well a model fits the measurements, and the model complexity measured using the Kullback–Leibler divergence. The use of a more complex error models increases the average data-fit but also increases the complexity of the combined model, possibly over-fitting the data. Bayesian model selection is used to find the optimal physical model as well as the optimal error model. The optimal model is defined using the evidence, where the average data-fit is balanced by the complexity of the model. The effect of colored noise process is illustrated using a nonlinear aeroelastic oscillator representing a rigid NACA0012 airfoil undergoing limit cycle oscillations due to complex fluid–structure interactions. Several quasi-steady and unsteady aerodynamic models are proposed with colored noise or white noise for the model error. The use of colored noise improves the predictive capabilities of simpler models.

42 ENGINEERING↗

DOE OSTI2018

Target tracking via recursive Bayesian state estimation in cognitive radar networks

To cope with complicated environments and stealthier targets, incorporating intelligence and cognition cycles into target tracking is of great importance in modern sensor network management. With remarkable advances in sensor techniques and deployable platforms, a sensing system has freedom to select a subset of available radars, plan their trajectories, and transmit designed waveforms. In this paper, we propose a general framework for single target tracking in cognitive networks of radars, including consideration of waveform design, path planning, and radar selection, which are separately but not jointly taken into account in existing work. The tracking procedure, built on the theories of dynamic graphical models (DGM) and recursive Bayesian state estimation (RBSE), is formulated as two iterative steps: (i) solving a combinatorial optimization problem to select the optimal subset of radars, waveforms, and locations for the next tracking instant, and (ii) acquiring the recursive Bayesian state estimation to accurately track the target. Further, an illustrative example introduces a specific scenario in 2-D space. Simulation results based on the scenario demonstrate that the proposed framework can accurately track the target under the management of the network of radars.

47 OTHER INSTRUMENTATION↗

DOE OSTI2018

Overhead longwave infrared hyperspectral material identification using radiometric models

Material detection algorithms used in hyperspectral data processing are computationally efficient but can produce relatively high numbers of false positives. Material identification performed as a secondary processing step on detected pixels can help mitigate false positives. A material identification processing chain for longwave infrared hyperspectral data of solid materials collected from airborne platforms is presented. The algorithms utilize unwhitened radiance data and Nelder–Meade numerical optimization to estimate the temperature, humidity, and ozone levels of the atmospheric profile. Pixel unmixing is done using constrained linear regression and Bayesian information criteria for model selection. The resulting identification product includes an optimal atmospheric profile and a full radiance material model that includes material temperature, abundance values, and several fit statistics. A logistic regression method utilizing the model parameters to improve identification is also presented. Furthermore, several examples are provided using modeled data at several noise levels.

58 GEOSCIENCES↗

DOE OSTI2019

Estimating Regional Methane Emissions Through Atmospheric Measurements and Inverse Modeling

In this report we describe an enhanced methodology for performing stochastic Bayesian inversions of atmospheric trace gas inversions that allows the time variation of model parameters to be inferred. We use measurements of methane atmospheric mixing ratio made in Livermore, California along with atmospheric transport modeling and published prior estimates of emissions to estimate the regional emissions of methane and the temporal variations in inferred bias parameters. We compute Bayesian model evidence and continuous rank probability score to optimize the model with respect to temporal resolution. Using two different emissions inventories, we perform inversions for a series of models with increasing temporal resolution in the model bias representation. We show that temporal variation in the model bias can improve the model fit and can also increase the likelihood that the parameterization is appropriate, as measured by the Bayesian model evidence.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2018

A Copula-Based Conditional Probabilistic Forecast Model for Wind Power Ramps

Efficient management of wind ramping characteristics can significantly reduce wind integration costs for balancing authorities. By considering the stochastic dependence of wind power ramp (WPR) features, this paper develops a conditional probabilistic wind power ramp forecast (cp-WPRF) model based on Copula theory. The WPRs dataset is constructed by extracting ramps from a large dataset of historical wind power. Each WPR feature (e.g., rate, magnitude, duration, and start-time) is separately forecasted by considering the coupling effects among different ramp features. To accurately model the marginal distributions with a copula, a Gaussian mixture model (GMM) is adopted to characterize the WPR uncertainty and features. The Canonical Maximum Likelihood (CML) method is used to estimate parameters of the multivariable copula. The optimal copula model is chosen based on the Bayesian information criterion (BIC) from each copula family. Finally, the best conditions based cp-WPRF model is determined by predictive interval (PI) based evaluation metrics. Numerical simulations on publicly available wind power data show that the developed copula-based cp-WPRF model can predict WPRs with a high level of reliability and sharpness.

17 WIND ENERGY↗

DOE OSTI2021

Sensitivity Analysis of Particle-In-Cell Modeling Parameters in Settling Bed, Bubbling Fluidized Bed and Circulating Fluidized Bed

The objective of the work presented is to perform a preliminary sensitivity analysis of particle-in-cell (PIC) model parameters when applied to settling bed, bubbling fluidized bed, and circulating fluidized bed simulations. These examples correspond to widely different flow conditions commonly seen in chemical engineering applications. Simulations were performed using the PIC method in the open-source software Multiphase Flow with Interphase eXchanges (MFiX) developed by the National Energy Technology Laboratory (NETL). As part of the non-intrusive uncertainty quantification (UQ) analysis, simulation campaigns were generated using Nodeworks. Sampling locations or settings for PIC model parameters were determined using the Latin Hypercube method. Response surfaces were created using radial basis functions (RBF), and Sobol’ indices were estimated to quantify the influence of model parameters on the quantities of interest (QoI). This study marks a first step towards systematically determining optimal ranges for model parameters used in MFiX-PIC. Based on limited experience, it is expected that these values would depend strongly on flow conditions. Given the complexity of the multiphase flow systems under analysis, a non-intrusive UQ based approach is used to identify the most influential parameters in each case. This prior knowledge will help in proposing an effective design of experiments (DoE) and determine optimal parameters through techniques such as deterministic or Bayesian calibration, which will be pursued in the future.

42 ENGINEERING↗