Search NASA⌕ Search

SEARCH · Search NASA

Results for “bayesian”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36

Bayesian calibration, validation, and uncertainty quantification of diffuse interface models of tumor growth

The idea that one can possibly develop computational models that predict the emergence, growth, or decline of tumors in living tissue is enormously intriguing as such predictions could revolutionize medicine and bring a new paradigm into the treatment and prevention of a class of the deadliest maladies affecting humankind. But at the heart of this subject is the notion of predictability itself, the ambiguity involved in selecting and implementing effective models, and the acquisition of relevant data, all factors that contribute to the difficulty of predicting such complex events as tumor growth with quantifiable uncertainty. In this work, we attempt to lay out a framework, based on Bayesian probability, for systematically addressing the questions of Validation, the process of investigating the accuracy with which a mathematical model is able to reproduce particular physical events, and Uncertainty quantification, developing measures of the degree of confidence with which a computer model predicts particular quantities of interest. For illustrative purposes, we exercise the process using virtual data for models of tumor growth based on diffuse-interface theories of mixtures utilizing virtual data.

59 BASIC BIOLOGICAL SCIENCES↗

Bayesian merging of numerical modeling and remote sensing for saltwater intrusion quantification in the Vietnamese Mekong Delta

Saltwater intrusion has become one of the most concerning issues in the Vietnamese Mekong Delta (VMD) due to its increasing impacts on agriculture and food security of Vietnam. Reliable estimation of salinity plays a crucial role to mitigate the impacts of saltwater intrusion. Here, this study developed a hybrid technique that merges satellite imagery with numerical simulations to improve the estimation of salinity in the VMD. The salinity derived from Landsat images and by numerical simulations was fused using the Bayesian inference technique. The results indicate that our technique significantly reduces the uncertainties and improves the accuracy of salinity estimates. The Nash–Sutcliffe coefficient is 0.74, which is much higher than that of numerical simulation (0.63) and Landsat estimation (0.6). The correlation coefficient between the ensemble and measured salinity is relatively high (0.88). The variance of the ensemble salinity errors (5.0 ppt 2 ) is lower than that of Landsat estimation (10.4 ppt 2 ) and numerical simulations (9.6 ppt 2 ). The proposed approach shows a great potential to combine multiple data sources of a variable of interest to improve its accuracy and reliability wherever these data are available.

54 ENVIRONMENTAL SCIENCES↗

Forecasting Multi-Wave Epidemics Through Bayesian Inference

We present a simple, near-real-time Bayesian method to infer and forecast a multiwave outbreak, and demonstrate it on the COVID-19 pandemic. The approach uses timely epidemiological data that has been widely available for COVID-19. It provides short-term forecasts of the outbreak’s evolution, which can then be used for medical resource planning. The method postulates one- and multiwave infection models, which are convolved with the incubation-period distribution to yield competing disease models. The disease models’ parameters are estimated via Markov chain Monte Carlo sampling and information-theoretic criteria are used to select between them for use in forecasting. The method is demonstrated on two- and three-wave COVID-19 outbreaks in California, New Mexico and Florida, as observed during Summer-Winter 2020. We find that the method is robust to noise, provides useful forecasts (along with uncertainty bounds) and that it reliably detected when the initial single-wave COVID-19 outbreaks transformed into successive surges as containment efforts in these states failed by the end of Spring 2020.

59 BASIC BIOLOGICAL SCIENCES↗

Bayesian hierarchical models for soil CO{sub 2} flux and leak detection at geologic sequestration sites

Proper characterizations of background soil CO{sub 2} respiration rates are critical for interpreting CO{sub 2} leakage monitoring results at geologic sequestration sites. In this paper, a method is developed for determining temperature-dependent critical values of soil CO{sub 2} flux for preliminary leak detection inference. The method is illustrated using surface CO{sub 2} flux measurements obtained from the AmeriFlux network fit with alternative models for the soil CO{sub 2} flux versus soil temperature relationship. The models are fit first to determine pooled parameter estimates across the sites, then using a Bayesian hierarchical method to obtain both global and site-specific parameter estimates. Model comparisons are made using the deviance information criterion (DIC), which considers both goodness of fit and model complexity. The hierarchical models consistently outperform the corresponding pooled models, demonstrating the need for site-specific data and estimates when determining relationships for background soil respiration. A hierarchical model that relates the square root of the CO{sub 2} flux to a quadratic function of soil temperature is found to provide the best fit for the AmeriFlux sites among the models tested. This model also yields effective prediction intervals, consistent with the upper envelope of the flux data across the modeled sites and temperature ranges. Calculation of upper prediction intervals using the proposed method can provide a basis for setting critical values in CO{sub 2} leak detection monitoring at sequestration sites.

54 ENVIRONMENTAL SCIENCES↗

A Bayesian modeling framework for crash severity effects of active traffic management systems

Transportation agencies utilize Active traffic management (ATM) systems to dynamically manage recurrent and non-recurrent congestion based on real-time conditions. While these systems have been shown to have some safety benefits, their impact on injury severity outcomes is currently uncertain. In this paper, we used full Bayesian mixed logit models to quantify the impact that ATM deployment had on crash severities. The estimation results revealed lower severities with ATM deployment. Marginal effects for ATM deployments that featured hard shoulder running (HSR) revealed lower likelihoods for severe and moderate injury crashes of 15.9 % and for minor injury crashes of 10.1 %. The likelihood of severe and moderate injury crashes and minor injury crashes reduced by 12.4 % and 8.33 % with ATM without HSR. The models were observed to be temporally transferable and had forecast error of 0.301 and 0.304 for the two models, revealing better performance with validation data. These results have implications for improving freeway crash risk at critical locations.

97 MATHEMATICS AND COMPUTING↗

Multi-objective materials bayesian optimization with active learning of design constraints: Design of ductile refractory multi-principal-element alloys

We report Bayesian Optimization (BO) has emerged as a powerful framework to efficiently explore and exploit materials design spaces. To date, most BO approaches to materials design have focused on the materials discovery problem as if it were a single expensive-to-query ‘black box’ in which the target is to optimize a single objective (i.e., material property or performance metric). Also, such approaches tend to be constraint agnostic. Here, we present a novel multi-information BO framework capable of actively learning materials design as a multiple objectives and constraints problem. We demonstrate this framework by optimally exploring a Refractory Multi-Principal-Element Alloy (MPEA) space, here specifically, the system Mo-Nb-Ti-V-W. The MPEAs are explored to optimize two density-functional theory (DFT) derived ductility indicators (Pugh’s Ratio and Cauchy pressure) while learning design constraints relevant to the manufacturing of high-temperature gas-turbine components. Alloys in the BO Pareto-front are analyzed using DFT to gain an insight into fundamental atomic and electronic underpinning for their superior performance, as evaluated within this framework.

36 MATERIALS SCIENCE↗

Hierarchical Gaussian process-based Bayesian optimization for materials discovery in high entropy alloy spaces

Bayesian optimization (BO) is a powerful and data-efficient method for iterative materials discovery and design, particularly valuable when prior knowledge is limited, underlying functional relationships are complex or unknown, and the cost of querying the materials space is significant. Traditional BO methodologies typically utilize conventional Gaussian Processes (cGPs) to model the relationships between material inputs and properties, as well as correlations within the input space. However, cGP-BO approaches often fall short in multi-objective optimization scenarios, where they are unable to fully exploit correlations between distinct material properties. Leveraging these correlations can significantly enhance the discovery process, as information about one property can inform and improve predictions about others. Here, this study addresses this limitation by employing advanced kernel structures to capture and model multi-dimensional property correlations through multi-task (MTGPs) or deep Gaussian Processes (DGPs), thus accelerating the discovery process. We demonstrate the effectiveness of MTGP-BO and DGP-BO in rapidly and robustly solving complex materials design challenges that occur within the context of complex multi-objective optimization over FCC FeCrNiCoCu high entropy alloy (HEA) spaces, where traditional cGP-BO approaches fail. Furthermore, we highlight how the differential costs associated with querying various material properties can be strategically leveraged to make the materials discovery process more cost-efficient.

36 MATERIALS SCIENCE↗

Estimation of hydraulic conductivity in a watershed using sparse multi-source data via Gaussian process regression and Bayesian experimental design

Enhanced water management systems depend on accurate estimation of subsurface hydraulic properties. However, geologic formations can vary significantly, so information from a single source (e.g., widely spaced boreholes) is insufficient in characterizing subsurface aquifer properties. Therefore, multiple sources of information are needed to complement the hydrogeology understanding of a region. Here, this study presents a numerical framework in which information from different measurement sources is combined to characterize the 3D random field in a multi-fidelity prediction model. Coupled with the model, a Bayesian experimental design was used to determine the best future sampling locations. The Upper Sangamon watershed in east-central Illinois was selected as the case study site, where the multi-fidelity Gaussian process model was used to estimate the hydraulic conductivity in the region of interest. Multi-source observation data were obtained from electrical resistivity and borehole pumping tests. The accuracy of the model prediction is dependent on the locations and the distribution of both high- and low-fidelity data. Furthermore, the multi-fidelity model was compared with the single-fidelity model. The uncertainties and confidence in the measurements and parameter estimates were quantified and used to design future cycles of data collection to further improve the confidence intervals.

54 ENVIRONMENTAL SCIENCES↗

Direct Bayesian inference for fault severity assessment in Digital-Twin-Based fault diagnosis

For applications in condition-based maintenance of nuclear systems, the assessment of fault severity is crucial. In this work, we developed a framework that allows for direct inference of the probability distributions of possible faults in a system. Here, we employed a model-based approach with model residuals generated from analytical redundancy relations provided by physics-based models of the system components. From real-time sensor readings, the values of the model residuals can be calculated, and the posterior probability distributions of the faults can be computed directly using the methods of Bayesian networks. From the posterior distribution of each fault, one can estimate the fault probability based on a chosen threshold and assess the severity of the fault. By eliminating the discretization and simplifications in middle steps, this approach allows us to leverage the available computational resources to provide more accurate fault probability estimates and severity assessments.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Using discrete Bayesian networks for diagnosing and isolating cross-level faults in HVAC systems

Fault detection and diagnosis (FDD) technologies are critical to ensure satisfactory building performance, such as reducing energy wastes and negative impacts on occupant comfort and productivity. Existing FDD technologies mainly focus on component-level FDD solutions, which could lead to mis-diagnosis of cross-level faults in heating, ventilating, and air-conditioning (HVAC) systems. Cross-level faults are those faults that occur in one component or subsystem, but cause operational abnormalities in other components or subsystems, and result in a building level performance degradation. How to effectively diagnose the root cause of a cross-level fault is the focus of this study. Here, this paper presents a novel discrete Bayesian Network (DisBN)-based method for diagnosing cross-level faults in an HVAC system commonly used in commercial buildings. A two-level DisBN structure model is developed in this study. The parameters used in the DisBN model are obtained either from expert knowledge or through machine-learning strategies from normal system operation data. Meanwhile, the probability parameters are discretized to incorporate the uncertainties associated with typical expert knowledge. Thus, the developed DisBN method addresses the challenges many other BN based FDD methods face, i.e., the lack of fault data for BN parameter training. The developed DisBN represents causal relationships between a fault and its cross-level system impacts (i.e., fault symptoms or fault indicators) by considering how fault impacts propagate across different levels in an HVAC system. A weather and schedule information-based Pattern Matching (WPM) method is employed to automatically create WPM baseline data sets for each incoming real time snapshot data from the building systems. Consequently, BN inference and real-time diagnostics are achieved by comparing incoming snapshot data and the WPM baseline data set. The proposed method is evaluated using experimental fault data collected in a campus building. Fault diagnosis results demonstrate that the WPM-DisBN method is effective at locating the root causes of cross-level faults in an HVAC system.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Revisiting thermodynamics and kinetic diffusivities of uranium–niobium with Bayesian uncertainty analysis

In this paper, thermodynamic and kinetic diffusivities of uranium–niobium (U–Nb) are re-assessed by means of the CALPHAD (CALculation of PHAse Diagram) methodology. In order to improve the consistency and reliability of the assessments, first-principles calculations are coupled with CALPHAD. In particular, heats of formation of γ -U–Nb are estimated and verified using various density-functional theory (DFT) approaches. These thermochemistry data are then used as constraints to guide the thermodynamic optimization process in such a way that the mutual-consistency between first-principles calculations and CALPHAD assessment is satisfactory. In addition, long-term aging experiments are conducted in order to generate new phase equilibria data at the γ 2 /α+γ 2 boundary. These data are meant to verify the thermodynamic model. Assessment results are generally in good agreement with experiments and previous calculations, without showing the artifacts that were observed in previous modeling. The mutual-consistent thermodynamic description is then used to evaluate atomic mobility and diffusivity of γ-U–Nb. Finally, Bayesian analysis is conducted to evaluate the uncertainty of the thermodynamic model and its impact on the system's phase stability.

36 MATERIALS SCIENCE↗

Hierarchical Bayesian estimation for adsorption isotherm parameter determination

Estimation of isotherm model parameters from experimental data is necessary in adsorption process modeling. To facilitate isotherm modeling, databases that store experimental data exist. Nevertheless, data inconsistency among different researchers must be resolved to find a single set of isotherm parameters from multiple data sets. Herein, we propose a hierarchical Bayesian estimation method to quantify the discrepancy by a multiplicative factor while simultaneously obtaining the probability distributions of a single set of isotherm parameters. This approach also allows us to identify outliers, which are data sets that are not in agreement with other sets. The proposed approach is demonstrated for the case of CO 2 adsorption in the metal-organic framework UiO-66.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Bayesian sequential optimal experimental design for nonlinear models using policy gradient reinforcement learning

We present a mathematical framework and computational methods for optimally designing a finite sequence of experiments. This sequential optimal experimental design (sOED) problem is formulated as a finite-horizon partially observable Markov decision process (POMDP) under a Bayesian setting and with information-theoretic utilities. The formulation is general and may accommodate continuous random variables, non-Gaussian posteriors, and nonlinear forward models. The sOED design policy incorporates elements of feedback and lookahead simultaneously, and we show it to generalize the commonly-used batch and greedy design strategies. We solve for the sOED policy using the policy gradient (PG) method from reinforcement learning, and provide a derivation for the PG expression in the sOED context. Adopting an actor-critic approach, the policy and value functions are parameterized using deep neural networks and improved via PG estimates produced from simulated episodes of designs and observations. The new PG-sOED algorithm is first validated on a linear-Gaussian benchmark, and then compared against other design baselines on a sensor movement problem for contaminant source inversion in a convection-diffusion field. As a result, we provide explanation for the policy behaviors using knowledge of the underlying physical process.

97 MATHEMATICS AND COMPUTING↗

Bayesian optimization for chemical products and functional materials

The design of chemical-based products and functional materials is vital to modern technologies, yet remains expensive and slow. Artificial intelligence and machine learning offer new approaches to leverage data to overcome these challenges. Herein this review focuses on recent applications of Bayesian optimization (BO) to chemical products and materials including molecular design, drug discovery, molecular modeling, electrolyte design, and additive manufacturing. Numerous examples show how BO often requires an order of magnitude fewer experiments than Edisonian search. The essential equations for BO are introduced in a self-contained primer specifically written for chemical engineers and others new to the area. Finally, the review discusses four current research directions for BO and their relevance to product and materials design.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Active learning for SNAP interatomic potentials via Bayesian predictive uncertainty

Bayesian inference with a simple Gaussian error model is used to efficiently compute prediction variances for energies, forces, and stresses in the linear SNAP interatomic potential. Here, the prediction variance is shown to have a strong correlation with the absolute error over approximately 24 orders of magnitude. Using this prediction variance, an active learning algorithm is constructed to iteratively train a potential by selecting the structures with the most uncertain properties from a pool of candidate structures. The relative importance of the energy, force, and stress errors in the objective function is shown to have a strong impact upon the trajectory of their respective net error metrics when running the active learning algorithm. Batched training of different batch sizes is also tested against singular structure updates, and it is found that batches can be used to significantly reduce the number of retraining steps required with only minor impact on the active learning trajectory.

97 MATHEMATICS AND COMPUTING↗

TensorBNN: Bayesian inference for neural networks using TensorFlow

We report that TensorBNN is a new package based on TensorFlow that implements Bayesian inference for modern neural network models. The posterior density of neural network model parameters is represented as a point cloud sampled using Hamiltonian Monte Carlo. The TensorBNN package leverages TensorFlow's architecture and its ability to use modern graphics processing units in both the training and prediction stages.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Towards robust autonomous impedance spectroscopy analysis: A calibrated hierarchical Bayesian approach for electrochemical impedance spectroscopy (EIS) inversion

Distribution-based analyses, such as the distribution of relaxation times (DRT) and the distribution of diffusion times (DDT), present model-free alternatives to equivalent circuit modeling for analysis of electrochemical impedance spectroscopy (EIS) data. However, reconstructing such distributions from noisy impedance data is an ill-posed problem that must be solved with specialized inversion algorithms, requiring careful control and tuning. Furthermore, most inversion algorithms developed to date can only solve problems of limited complexity. Herein, we present a new hierarchical Bayesian method for EIS inversion, leveraging efficient algorithms for optimization and Hamiltonian Monte Carlo (HMC) sampling to solve models of arbitrary complexity. We overcome the challenge of ad-hoc parameter tuning by encoding intrinsic characteristics of the DRT and DDT into flexible prior distributions and “pre-calibrating” the model to simulated data. This approach is versatile, highly robust to noise, and provides quantitative estimates of both the error structure of the data and the uncertainty in the recovered distributions. The model is validated with simulated data to demonstrate accurate recovery of the DRT and the DDT. The method also shows promise for simultaneous recovery of multiple distributions, raising the intriguing possibility of semi-autonomous EIS analysis and ad-hoc model construction. Finally, the practical utility of the method is illustrated with experimental data. Throughout, we draw comparisons to several recently published EIS inversion methodologies.

36 MATERIALS SCIENCE↗

Optimal sizing of battery energy storage systems for peak shaving and demand response using a degradation-aware Bayesian Optimization-Mixed-Integer Linear Programming framework

The increasing integration of renewable energy and rising electricity demand highlight the importance of battery energy storage systems for peak shaving and demand response. Unlike prior approaches that overlook operational impacts on degradation, this study proposes a Bayesian Optimization–Mixed Integer Linear Programming framework for optimal battery energy storage system sizing. In this framework, Mixed Integer Linear Programming determines short-term scheduling while a calibrated electrochemical model iteratively evaluates degradation. The central hypothesis is that the framework can efficiently identify optimal sizes that yield realistic and economically robust outcomes. The method is tested across three scenarios: peak shaving, peak shaving with energy-reduction demand response, and peak shaving with power-reduction demand response. Results show that the framework converge to the optimum within 20 iterations out of 150 possible sizes. Under baseline conditions, the framework consistently selects the smallest feasible system, minimizing unnecessary degradation costs from oversized storage. Sensitivity analyses reveal that larger systems are favored as demand rates or incentives increase. Comparisons of demand response programs indicate that power-reduction demand response offers greater economic benefits than energy-reduction demand response, although demand savings from peak shaving remain the dominant contributor to overall performance. This study demonstrates that the proposed framework balances computational tractability with degradation fidelity, identifies critical economic thresholds for investment, and offers a practical, flexible tool to guide industrial stakeholders in cost-effective battery energy storage system deployment.

Batteries↗