Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian Methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,495 records · Page 83

Data-Driven Strategies for Accelerated Materials Design

The ongoing revolution of the natural sciences by the advent of machine learning and artificial intelligence sparked significant interest in the material science community in recent years. The intrinsically high dimensionality of the space of realizable materials makes traditional approaches ineffective for large-scale explorations. Modern data science and machine learning tools developed for increasingly complicated problems are an attractive alternative. An imminent climate catastrophe calls for a clean energy transformation by overhauling current technologies within only several years of possible action available. Tackling this crisis requires the development of new materials at an unprecedented pace and scale. For example, organic photovoltaics have the potential to replace existing silicon-based materials to a large extent and open up new fields of application. In recent years, organic light-emitting diodes have emerged as state-of-the-art technology for digital screens and portable devices and are enabling new applications with flexible displays. Reticular frameworks allow the atom-precise synthesis of nanomaterials and promise to revolutionize the field by the potential to realize multifunctional nanoparticles with applications from gas storage, gas separation, and electrochemical energy storage to nanomedicine. In the recent decade, significant advances in all these fields have been facilitated by the comprehensive application of simulation and machine learning for property prediction, property optimization, and chemical space exploration enabled by considerable advances in computing power and algorithmic efficiency. In this Account, we review the most recent contributions of our group in this thriving field of machine learning for material science. We start with a summary of the most important material classes our group has been involved in, focusing on small molecules as organic electronic materials and crystalline materials. Specifically, we highlight the data-driven approaches we employed to speed up discovery and derive material design strategies. Subsequently, our focus lies on the data-driven methodologies our group has developed and employed, elaborating on high-throughput virtual screening, inverse molecular design, Bayesian optimization, and supervised learning. We discuss the general ideas, their working principles, and their use cases with examples of successful implementations in data-driven material discovery and design efforts. Furthermore, we elaborate on potential pitfalls and remaining challenges of these methods. Finally, we provide a brief outlook for the field as we foresee increasing adaptation and implementation of large scale data-driven approaches in material discovery and design campaigns.

36 MATERIALS SCIENCE↗

Cosmological limits on axions

We derive cosmological limits on two-component hot dark matter consisting of neutrinos and axions. We restrict the large-scale structure data to the safely linear regime, excluding the Lyman-{alpha} forest. We derive Bayesian credible regions in the two-parameter space consisting of m{sub a} and {sigma}m{sub v}. Marginalising over {sigma}m{sub v} provides m{sub a}<1.02 eV(95% C.L.). In the absence of axions the same data and methods give {sigma}m{sub v}<0.63 eV(95% C.L.)

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Almost medium-free measurement of the Hoyle state direct-decay component with a TPC

The structure of the Hoyle state, a highly α -clustered state at 7.65 MeV in 12 C, has long been the subject of debate. Understanding if the system comprises of three weakly interacting α particles in the 0s orbital, known as an α-condensate state, is possible by studying the decay branches of the Hoyle state. The direct decay of the Hoyle state into three α particles, rather than through the 8 Be ground state, can be identified by studying the energy partition of the three α particles arising from the decay. This paper provides details on the breakup mechanism of the Hoyle stating using a new experimental technique. Method: By using β-delayed charged-particle spectroscopy of 12 N using the Texas active target time-projection chamber, a high-sensitivity measurement of the direct 3α decay ratio can be performed without contributions from pileup events. A Bayesian approach to understanding the contribution of the direct components via a likelihood function shows that the direct component is <0.043% at the 95% confidence level. This value is in agreement with several other studies, and, here, we can demonstrate that a small nonsequential component with a decay fraction of about 10 –4 is most likely. Here, the measurement of the non-sequential component of the Hoyle state decay is performed in an almost medium-free reaction for the first time. The derived upper limit is in agreement with previous studies and demonstrates sensitivity to the absolute branching ratio. Further experimental studies would need to be combined with robust microscopic theoretical understanding of the decay dynamics to provide additional insight into the idea of the Hoyle state as an α condensate.

6 ≤ A ≤ 19↗

Real-time Event Detection Using Rank Signatures of Real-world PMU Data

Timely detection of power system events is a crucial task, which can facilitate the implementation of remedial actions to improve reliability, resiliency, and security of the system. Meanwhile, the widespread deployment of phasor measurement units (PMUs) makes it possible to develop data-driven event detection techniques. However, relying purely on data without incorporating domain knowledge for the event detection task in power systems poses substantial security and stability risks due to issues associated with data misinterpretation and model accuracy. In this regard, we propose a real-time event detection method using real-world PMU data by incorporating domain knowledge to adequately capture the event signatures. Specifically, we track the change in rank signatures of PMU data to accurately localize the events. To optimize the detection process, we incorporate an offline Bayesian optimization algorithm to tune the parameters by efficiently searching for the best values. The experiments using the real-world PMU dataset from a U.S. interconnection show that the proposed event detection approach can efficiently detect the events from PMU data streams with high accuracy.

Ghasemkhani, Amir↗

Understanding Material Strength Variabilities and Uncertainties for Component Qualification (2020 LDRD Final Report)

At its core, material specification and materials qualification require an understanding of the uncertainties in relation to a given performance metric. When simulations are used to inform the design and evaluation of these metrics, it is essential to understand the uncertainties in the underlying models and parameters that feed into those simulations. In this work, we have created a statistical framework to address uncertainties in the materials strength modeling used in integrated simulations. The framework is based on the Bayesian methodology, which allows for uncertainties to be updated as new data become available. The results of this work show how model parameters and their uncertainties can be updated as new and different types of strength data are added, as well as methods for determining which future experiment has the greatest potential to reduce the uncertainty. The statistical framework developed in this project will be utilized to assess and propagate the uncertainties in the strength models used in the programmatic simulations and to create a way to formally update those uncertainties as new data become available.

36 MATERIALS SCIENCE↗

Correlations between the Neutron Star Mass–Radius Relation and the Equation of State of Dense Matter

We develop an analytic method of inverting the Tolman–Oppenheimer–Volkoff relations to high accuracy. In principle, a specified energy density–pressure relation gives a unique mass–radius (M–R) relation and vice versa. Our method is developed from the strong correlations that are shown to exist between the neutron star mass–radius curve and the equation of state (EOS) or pressure–energy density relation. Selecting points that have masses equal to fixed fractions of the maximum mass, we find a semi-universal power-law relation between the central energy densities, pressures, sound speeds, chemical potentials, and number densities of those stars, with the maximum mass and the radii of one or more fractional maximum mass points. Rms fitting accuracies, for EOSs without large first-order phase transitions, are typically 0.5% for all quantities at all mass points. The method also works well, although less accurately, in reconstructing the EOS of hybrid stars with first-order phase transitions. These results permit, in effect, an analytic method of inverting an arbitrary M–R curve to yield its underlying EOS. We discuss applications of this inversion technique to the inference of the dense matter EOS from measurements of neutron star masses and radii as a possible alternative to traditional Bayesian approaches.

Bayesian statistics↗

Investigation of methodology for uncertainty quantification of model parameters

Quantifying the uncertainty contributors of best-estimate thermal hydraulic code is getting more and more attention in safety analysis of nuclear industry during recent decades. Yet for uncertainties of certain model parameters which may not be directly measured, the quantification process is usually subjective and inaccurate. This paper investigates the statistical methodologies in order to get the probability density function (pdf) of model parameters more objectively based on observed experimental responses. The simplification of mathematical model is described for the parameter estimation, and solutions based on Bayesian theorem and Maximum Likelihood Estimation (MLE) are classified and demonstrated for both deterministic approach and stochastic approach. As an application, the uncertainties of model parameters related to reflood phenomena implemented in RELAP5 code are quantified. It is indicated that the statistical method which is independent of best-estimate code is feasible and easy to apply. And through the check of uncertainty propagation, it demonstrates that the uncertainty bands can envelope most of the experiment measurement with advantage of accuracy. (authors)

42 ENGINEERING↗

Optimizing human activity patterns using global sensitivity analysis

Implementing realistic activity patterns for a population is crucial for modeling, for example, disease spread, supply and demand, and disaster response. Using the dynamic activity simulation engine, DASim, we generate schedules for a population that capture regular (e.g., working, eating, and sleeping) and irregular activities (e.g., shopping or going to the doctor). We use the sample entropy (SampEn) statistic to quantify a schedule’s regularity for a population. We show how to tune an activity’s regularity by adjusting SampEn, thereby making it possible to realistically design activities when creating a schedule. The tuning process sets up a computationally intractable high-dimensional optimization problem. To reduce the computational demand, we use Bayesian Gaussian process regression to compute global sensitivity indices and identify the parameters that have the greatest effect on the variance of SampEn. Here we use the harmony search (HS) global optimization algorithm to locate global optima. Our results show that HS combined with global sensitivity analysis can efficiently tune the SampEn statistic with few search iterations. We demonstrate how global sensitivity analysis can guide statistical emulation and global optimization algorithms to efficiently tune activities and generate realistic activity patterns. Finally, though our tuning methods are applied to dynamic activity schedule generation, they are general and represent a significant step in the direction of automated tuning and optimization of high-dimensional computer simulations.

97 MATHEMATICS AND COMPUTING↗

Inferring pesticide toxicity to honey bees from a field‐based feeding study using a colony model and Bayesian inference

Abstract Honey bees are crucial pollinators for agricultural crops but are threatened by a multitude of stressors including exposure to pesticides. Linking our understanding of how pesticides affect individual bees to colony‐level responses is challenging because colonies show emergent properties based on complex internal processes and interactions among individual bees. Agent‐based models that simulate honey bee colony dynamics may be a tool for scaling between individual and colony effects of a pesticide. The U.S. Environmental Protection Agency (USEPA) and U.S. Department of Agriculture (USDA) are developing the VarroaPop + Pesticide model, which simulates the dynamics of honey bee colonies and how they respond to multiple stressors, including weather, Varroa mites, and pesticides. To evaluate this model, we used Approximate Bayesian Computation to fit field data from an empirical study where honey bee colonies were fed the insecticide clothianidin. This allowed us to reproduce colony feeding study data by simulating colony demography and mortality from ingestion of contaminated food. We found that VarroaPop + Pesticide was able to fit general trends in colony population size and structure and reproduce colony declines from increasing clothianidin exposure. The model underestimated adverse effects at low exposure (36 µg/kg), however, and overestimated recovery at the highest exposure level (140 µg/kg), for the adult and pupa endpoints, suggesting that mechanisms besides oral toxicity‐induced mortality may have played a role in colony declines. The VarroaPop + Pesticide model estimates an adult oral LD 50 of 18.9 ng/bee (95% CI 10.1–32.6) based on the simulated feeding study data, which falls just above the 95% confidence intervals of values observed in laboratory toxicology studies on individual bees. Overall, our results demonstrate a novel method for analyzing colony‐level data on pesticide effects on bees and making inferences on pesticide toxicity to individual bees.

59 BASIC BIOLOGICAL SCIENCES↗

a priori uncertainty quantification of reacting turbulence closure models using Bayesian neural networks

While many physics-based closure model forms have been posited for the sub-filter scale (SFS) in large eddy simulation (LES), vast amounts of data available from direct numerical simulations (DNS) create opportunities to leverage data-driven modeling techniques. Albeit flexible, data-driven models still depend on the dataset and the functional form of the model chosen. Increased adoption of such models requires reliable uncertainty estimates both in the data-informed and out-of-distribution regimes. Here, in this work, we employ Bayesian neural networks (BNNs) to capture both epistemic and aleatoric uncertainties in a reacting flow model. In particular, we model the filtered progress variable scalar dissipation rate which plays a key role in the dynamics of turbulent premixed flames. We demonstrate that BNN models can provide unique insights about the structure of uncertainty of the data-driven closure models. We also propose a method for the incorporation of out-of-distribution information in a BNN, which can be used for out-of-distribution query detection. The efficacy of the model is demonstrated by a priori evaluation on a dataset consisting of a variety of flame conditions and fuels.

97 MATHEMATICS AND COMPUTING↗

Understanding the role of segmentation on process-structure–property predictions made via machine learning

Here, the present study investigated the effect of porosity surface determination methods on performance of machine learning models used to predict the tensile properties of AlSi10Mg processed by laser powder bed fusion from micro-computed tomography data. Machine learning models applied in this work include support vector machines, neural networks, decision trees, and Bayesian classifiers. The effects of isosurface thresholding and local gradient approaches for porosity segmentation, as well as image filtering schemes, on model precision were evaluated for samples produced under differing levels of global energy density.

36 MATERIALS SCIENCE↗

Application of stochastic Galerkin FEM to the complete electrode model of electrical impedance tomography

The aim of electrical impedance tomography is to determine the internal conductivity distribution of some physical body from boundary measurements of current and voltage. The most accurate forward model for impedance tomography is the complete electrode model, which consists of the conductivity equation coupled with boundary conditions that take into account the electrode shapes and the contact resistances at the corresponding interfaces. If the reconstruction task of impedance tomography is recast as a Bayesian inference problem, it is essential to be able to solve the complete electrode model forward problem with the conductivity and the contact resistances treated as a random field and random variables, respectively. In this work, we apply a stochastic Galerkin finite element method to the ensuing elliptic stochastic boundary value problem and compare the results with Monte Carlo simulations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A probabilistic graphical model based stochastic input model construction

Model reduction techniques have been widely used in modeling of high-dimensional stochastic input in uncertainty quantification tasks. However, the probabilistic modeling of random variables projected into reduced-order spaces presents a number of computational challenges. Due to the curse of dimensionality, the underlying dependence relationships between these random variables are difficult to capture. In this work, a probabilistic graphical model based approach is employed to learn the dependence by running a number of conditional independence tests using observation data. Thus a probabilistic model of the joint PDF is obtained and the PDF is factorized into a set of conditional distributions based on the dependence structure of the variables. The estimation of the joint PDF from data is then transformed to estimating conditional distributions under reduced dimensions. To improve the computational efficiency, a polynomial chaos expansion is further applied to represent the random field in terms of a set of standard random variables. This technique is combined with both linear and nonlinear model reduction methods. Numerical examples are presented to demonstrate the accuracy and efficiency of the probabilistic graphical model based stochastic input models. - Highlights: • Data-driven stochastic input models without the assumption of independence of the reduced random variables. • The problem is transformed to a Bayesian network structure learning problem. • Examples are given in flows in random media.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

BASS: An R Package for Fitting and Performing Sensitivity Analysis of Bayesian Adaptive Spline Surfaces

In this work, we present the R package BASS as a tool for nonparametric regression. The primary focus of the package is fitting fully Bayesian adaptive spline surface (BASS) models and performing global sensitivity analyses of these models. The BASS framework is similar to that of Bayesian multivariate adaptive regression splines (BMARS) from Denison, Mallick, and Smith (1998), but with many added features. The software is built to efficiently handle significant amounts of data with many continuous or categorical predictors and with functional response. Under our Bayesian framework, most priors are automatic but these can be modified by the user to focus on parsimony and the avoidance of overfitting. If directed to do so, the software uses parallel tempering to improve the reversible jump Markov chain Monte Carlo (RJMCMC) methods used to perform inference. We discuss the implementation of these features and present the performance of BASS in a number of analyses of simulated and real data.

97 MATHEMATICS AND COMPUTING↗

When the Details Matter – Sensitivities in PRA Calculations That Could Affect Risk-Informed Decision-Making

As the U.S. Nuclear Regulatory Commission (NRC) continues its efforts to increase its use of risk information in decision making, the detailed, quantitative results of probabilistic risk assessment (PRA) calculations are coming under increased scrutiny. Where once analysts and users were not overly concerned with figure of merit variations that were less than an order of magnitude, now factors of two or even less can spark heated debate regarding modeling approaches and assumptions. The philosophical and policy-related aspects of this situation are well-recognized by the PRA community. On the other hand, the technical implications for PRA methods and modeling have not been as widely discussed. This paper illustrates the potential numerical effects of choices as to the details of models and methods for parameter estimation with three examples: 1) the selection of the time period data for parameter estimation, and issues related to component boundary and failure mode definitions; 2) the selection of alternative diffuse prior distributions, including the constrained noninformative prior distribution, in Bayesian parameter estimation; and 3) the impact of uncertainty in calculations for recovery of offsite power.

99 GENERAL AND MISCELLANEOUS↗

On a framework for generating PoD curves assisted by numerical simulations

The Probability of Detection (PoD) curve method has emerged as an important tool for the assessment of the performance of NDE techniques, a topic of particular interest to the nuclear industry where inspection qualification is very important. The conventional experimental means of generating PoD curves though, can be expensive, requiring large data sets (covering defects and test conditions), and equipment and operator time. Several methods of achieving faster estimates for PoD curves using physics-based modelling have been developed to address this problem. Numerical modelling techniques are also attractive, especially given the ever-increasing computational power available to scientists today. Here we develop procedures for obtaining PoD curves, assisted by numerical simulation and based on Bayesian statistics. Numerical simulations are performed using Finite Element analysis for factors that are assumed to be independent, random and normally distributed. PoD curves so generated are compared with experiments on austenitic stainless steel (SS) plates with artificially created notches. We examine issues affecting the PoD curve generation process including codes, standards, distribution of defect parameters and the choice of the noise threshold. We also study the assumption of normal distribution for signal response parameters and consider strategies for dealing with data that may be more complex or sparse to justify this. These topics are addressed and illustrated through the example case of generation of PoD curves for pulse-echo ultrasonic inspection of vertical surface-breaking cracks in SS plates.

36 MATERIALS SCIENCE↗

Combining of different data pools for calculating a reliable POD for real defects

Real defects are essential for the evaluation of the reliability of non destructive testing (NDT) methods, especially in relation to the integrity of components. But in most of the cases the amount of available real defects is not sufficient to evaluate the system. Model-assisted and transfer functions are one way to handle that challenge. This study is focused on a combination of different data pools to create a sufficient amount of data for the reliability estimation. A widespread approach for calculating the Probability of Detection (POD) was used on a radiographic testing (RT) method. The highest contrast to noise ratio (CNR) of each indication is usually selected as the signal in the 'â vs. a' (signal-response) approach for RT. By combining real and artificial defects (flat bottom holes, side drill holes, flat bottom squares, notches, etc) in RT the highest signals are close to each other, but the process of creating and evaluating real defects is much more complex. The solution is seen in the combination of real and artificial data using a weighted least square approach. The weights for real or artificial data were based on the importance, the value and the different detection behavior of the different data. For comparison, the alternative combination through the Bayesian Updating was also applied. As verification, a data pool with a large amount of real data was available. In an advanced approach for evaluating the digital RT data, the size of the indication (perpendicular to the X-ray beam) was introduced as additional information. The signal now consists of the CNR and the area of the indication. The detectability is changing depending on the area of the indication, a fact that was ignored in the previous POD calculations for RT. This points out that a weighted least square approach to pool the data might no longer be adequate. The Bayesian Updating of the estimated parameters of the relationship between the signal field (the area of the indication) and the geometry of the defects is seen as the appropriate model to combine the different defect types in a useful and meaningful way. This work was carried out together with the Finnish company for spent nuclear fuel and waste management - Posiva Oy. The digital RT is one of the NDT methods that might be used for the inspection of the weld of the copper canister to be used for the spent nuclear fuel in the Scandinavian concept of final disposal.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗