Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Bayesian Inference of the Symmetry Energy of Superdense Neutron-rich Matter from Future Radius Measurements of Massive Neutron Stars

In this work, using as references the posterior probability distribution functions of the equation of state (EOS) parameters inferred from the radii of canonical neutron stars (NSs) reported by the LIGO/VIRGO and NICER Collaborations based on their observations of GW170817 and PSR J0030+0451, we investigate how future radius measurements of more massive NSs will improve our current knowledge about the EOS of superdense neutron-rich nuclear matter, especially its symmetry energy term. Within the Bayesian statistical approach using an explicitly isospin-dependent parametric EOS for the core of NSs, we infer the EOS parameters of superdense neutron-rich nuclear matter from three sets of imagined mass–radius correlation data representing typical predictions by various nuclear many-body theories, that is, the radius stays the same, decreases, or increases with increasing NS mass within ±15% between 1.4 and 2.0 M$_\odot$. The corresponding NS average density increases quickly or slowly or slightly decreases as the NS mass increases from 1.4 to 2.0 M$_\odot$. While the EOSs of symmetric nuclear matter (SNM) inferred from the three data sets are approximately the same, the corresponding symmetry energies above about twice the saturation density of nuclear matter are very different, indicating that the radii of massive NSs carry important information about the high-density behavior of nuclear symmetry energy with little influence from the remaining uncertainties of the SNM EOS at suprasaturation densities.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1979

Applications of estimation theory to inverse problems in meteorology

The paper applies iterated and non-iterated extended Kalman filters to solve two practical meteorological inversion problems. Passive microwave satellite soundings are used to infer vertical temperature profiles and cloud parameters. In both cases it is shown that improvements can be obtained over presently used techniques. Finally, the results suggest that modern multivariate nonlinear recursive estimation techniques based in a Bayesian methodology can be a valuable tool in the area of remote sounding of atmospheric parameters.

Gustafson, D. E.↗
DOE OSTI2024

Decision-making based on Markov decision process in integrated artificial reasoning framework—Part I: Theory

This paper presents a decision-making framework based on an integrated artificial reasoning framework and Markov decision process (MDP). The integrated artificial reasoning framework provides a physics-based approach that converts system information into state transition models, and the analysis result will be represented by the transition probabilities that can be used with an MDP to find a traceable and explainable optimal pathway. A dynamic Bayesian network (DBN) is well suited for representing the structure of an MDP. The causality information among process variables (or among subsystems) is mathematically represented in a DBN by the conditional probabilities of the node’s states provided different probabilities of the parent node’s states. To define node states in a physically understandable manner, we used multilevel flow modeling (MFM). An MFM follows the fundamental energy and mass conservation laws and supports the selection of process variables that represent the system of interest so that causal relations among process variables are properly captured. An MFM-based DBN supports developing state transition models in an MDP to capture the effect of process variables of system having physical relations. The operators of the target system can capture stochastic system dynamics as multiple subsystem state transitions based on their physical relations and uncertainties coming from component degradation or random failures. We analyzed a simplified exemplary system to illustrate an optimal operational policy using the suggested approach.

Markov decision process↗
DOE OSTI2025

High-Temperature Gas Sensor Materials with Properties Predicted via First-Principles Calculations with Machine Learning Modeling and Experimental Corroboration

Understanding the temperature dependence of functional properties of sensing materials is vital for their applications in combustion environments. The electron-phonon coupling that derives the electronic structure change with temperatures is a key property of interest as it affects other sensing responses. Herein, we first assess the temperature dependence of band gap renormalization in sensing materials by employing Allen-Heine-Cardona (AHC) theory with density functional theory (DFT) simulations corroborated with experimental observation. As the AHC calculations are impractical for high-throughput screening of materials, we employ data-driven Gaussian process regression to predict the parameters employed in the O’Donnell empirical model from a set of physical features. To mitigate the reliability issues arising from the small size of the dataset, we apply a Bayesian technique to improve the generalizability of the data-driven models as well as to quantify the uncertainty associated with theoretical predictions. These models capture well the overall trend of the O’Donnell parameters with respect to a reduced feature set obtained by transforming the available physical features. Quantifying the associated uncertainty helps us understand the reliability of the predictions and, therefore, the variation of bandgap as a function of temperature for other novel materials. The predicted candidates from machine learning models are further validated by experiments and DFT calculations.

bandgap renormalization↗
DOE OSTI2022

Neutrino mass and mass ordering: no conclusive evidence for normal ordering

The extraction of the neutrino mass ordering is one of the major challenges in particle physics and cosmology, not only for its implications for a fundamental theory of mass generation in nature, but also for its decisive role in the scale of future neutrinoless double beta decay experimental searches. It has been recently claimed that current oscillation, beta decay and cosmological limits on the different observables describing the neutrino mass parameter space provide robust decisive Bayesian evidence in favor of the normal ordering of the neutrino mass spectrum. We further investigate these strong claims using a rich and wide phenomenology, with different sampling techniques of the neutrino parameter space. Contrary to the findings of Jimenez et al., no decisive evidence for the normal mass ordering is found. Neutrino mass ordering analyses must rely on priors and parameterizations that are ordering-agnostic: robust results should be regarded as those in which the preference for the normal neutrino mass ordering is driven exclusively by the data, while we find a difference of up to a factor of 33 in the Bayes factors among the different priors and parameterizations exploited here. An ordering-agnostic prior would be represented by the case of parameterizations sampling over the two mass splittings and a mass scale, or those sampling over the individual neutrino masses via normal prior distributions only. In this regard, we show that the current significance in favor of the normal mass ordering should be taken as 2.7σ (i.e. moderate evidence), mostly driven by neutrino oscillation data. Let us stress that, while current data favor NO only mildly, we do not exclude the possibility that this may change in the future. Eventually, upcoming oscillation and cosmological data may (or may not) lead to a more significant exclusion of IO.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Structure prediction of epitaxial inorganic interfaces by lattice and surface matching with Ogre

We present a new version of the Ogre open source Python package with the capability to perform structure prediction of epitaxial inorganic interfaces by lattice and surface matching. In the lattice matching step, a scan over combinations of substrate and film Miller indices is performed to identify the domain-matched interfaces with the lowest mismatch. Subsequently, surface matching is conducted by Bayesian optimization to find the optimal interfacial distance and in-plane registry between the substrate and the film. For the objective function, a geometric score function is proposed based on the overlap and empty space between atomic spheres at the interface. The score function reproduces the results of density functional theory (DFT) at a fraction of the computational cost. The optimized interfaces are pre-ranked using a score function based on the similarity of the atomic environment at the interface to the bulk environment. Final ranking of the top candidate structures is performed with DFT. Ogre streamlines DFT calculations of interface energies and electronic properties by automating the construction of interface models. The application of Ogre is demonstrated for two interfaces of interest for quantum computing and spintronics, Al/InAs and Fe/InSb.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Thoughts on Analyzing Neutron Multiplicity Data

Bayesian methods offer many advantages for analyzing neutron multiplicity data. Ideally one would make nonparametric estimates of the the posterior distributions, the probabilities - given the data - for unknowns to take on particular values. Once one has the posterior, uncertainty quantification is very natural. We describe how different ways of formulating the statistical theory of fission chains are mathematically equivalent. When confronted with actual data and the burden of finite statistics, different methods of expressing the theory offer advantages for understanding the underlying source parameters from an information theory standpoint.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Revisiting MOA 2013-BLG-220L: A Solar-type Star with a Cold Super-Jupiter Companion

We present the analysis of high-resolution images of MOA-2013-BLG-220, taken with the Keck adaptive optics system six years after the initial observation, identifying the lens as a solar-type star hosting a super-Jupiter-mass planet. The masses of planets and host stars discovered by microlensing are often not determined from light-curve data, while the star–planet mass ratio and projected separation in units of Einstein ring radius are well measured. High-resolution follow-up observations after the lensing event is complete can resolve the source and lens. This allows direct measurements of flux, and the amplitude and direction of proper motion, giving strong constraints on the system parameters. Due to the high relative proper motion, μ{sub rel,Geo}=12.62±0.11 mas yr{sup −1}, the source and lens were resolved in 2019, with a separation of 77.1 ± 0.5 mas. Thus, we constrain the lens flux to K{sub Keck,lens}=17.92±0.02. By combining constraints from the model and Keck flux, we find the lens mass to be M{sub L}=0.88±0.05 M{sub ⊙} at D{sub L}=6.72±0.59 kpc. With a mass ratio of q=(3.00±0.03)×10{sup −3} the planet’s mass is determined to be M{sub P}=2.74±0.17 M{sub J} at a separation of r{sub ⊥}=3.03±0.27 au. The lens mass is much higher than the prediction made by Bayesian analysis that assumes all stars have an equal probability to host a planet of the measured mass ratio, and suggests that planets with mass ratios of a few times 10{sup −3} are more common orbiting massive stars. This demonstrates the importance of high-resolution follow-up observations for testing theories like these.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2010

Initialization and Restart in Stochastic Local Search: Computing a Most Probable Explanation in Bayesian Networks

For hard computational problems, stochastic local search has proven to be a competitive approach to finding optimal or approximately optimal problem solutions. Two key research questions for stochastic local search algorithms are: Which algorithms are effective for initialization? When should the search process be restarted? In the present work we investigate these research questions in the context of approximate computation of most probable explanations (MPEs) in Bayesian networks (BNs). We introduce a novel approach, based on the Viterbi algorithm, to explanation initialization in BNs. While the Viterbi algorithm works on sequences and trees, our approach works on BNs with arbitrary topologies. We also give a novel formalization of stochastic local search, with focus on initialization and restart, using probability theory and mixture models. Experimentally, we apply our methods to the problem of MPE computation, using a stochastic local search algorithm known as Stochastic Greedy Search. By carefully optimizing both initialization and restart, we reduce the MPE search time for application BNs by several orders of magnitude compared to using uniform at random initialization without restart. On several BNs from applications, the performance of Stochastic Greedy Search is competitive with clique tree clustering, a state-of-the-art exact algorithm used for MPE computation in BNs.

Mengshoel, Ole J.↗
DOE OSTI2020

Probabilistic Solar Power Forecasting Using Bayesian Model Averaging

There is rising interest in probabilistic forecasting to mitigate risks from solar power uncertainty, but the numerical weather prediction (NWP) ensembles readily available to system operators are often biased and underdispersed. We propose a Bayesian model averaging (BMA) post-processing method suitable for forecasting power from utility-scale photovoltaic (PV) plants at multiple time horizons up to at least the day-ahead timescale. BMA is a kernel dressing technique for NWP ensembles in which the forecast is a weighted sum of member-specific probability density functions. We tailor BMA for utility-scale PV forecasting by modeling power clipping at the AC inverter rating and advance the theory of BMA with a new beta kernel parameterization that accommodates theoretical constraints not previously addressed. BMA is demonstrated for a case study of 11 utility-scale PV plants in Texas, forecasting at hourly resolution for the complete year 2018. BMA's mixture-model approach mitigates underdispersion of the raw ensemble to significantly improve forecast calibration, while consistently outperforming an ensemble model output statistics (EMOS) parametric approach from the literature. At 4-hour lead time, the BMA post-processing achieves continuous ranked probability skill scores of 2--36% over the raw ensemble, with consistent performance at multiple lead times suitable for power system operations.

14 SOLAR ENERGY↗
DOE OSTI2022

Uncertainty-aware mixed-variable machine learning for materials design

Abstract Data-driven design shows the promise of accelerating materials discovery but is challenging due to the prohibitive cost of searching the vast design space of chemistry, structure, and synthesis methods. Bayesian optimization (BO) employs uncertainty-aware machine learning models to select promising designs to evaluate, hence reducing the cost. However, BO with mixed numerical and categorical variables, which is of particular interest in materials design, has not been well studied. In this work, we survey frequentist and Bayesian approaches to uncertainty quantification of machine learning with mixed variables. We then conduct a systematic comparative study of their performances in BO using a popular representative model from each group, the random forest-based Lolo model (frequentist) and the latent variable Gaussian process model (Bayesian). We examine the efficacy of the two models in the optimization of mathematical functions, as well as properties of structural and functional materials, where we observe performance differences as related to problem dimensionality and complexity. By investigating the machine learning models’ predictive and uncertainty estimation capabilities, we provide interpretations of the observed performance differences. Our results provide practical guidance on choosing between frequentist and Bayesian uncertainty-aware machine learning models for mixed-variable BO in materials design.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Solving Stochastic Inverse Problems for Property–Structure Linkages Using Data-Consistent Inversion and Machine Learning

Determining process–structure–property linkages is one of the key objectives in material science, and uncertainty quantification plays a critical role in understanding both process–structure and structure–property linkages. In this work, we seek to learn a distribution of microstructure parameters that are consistent in the sense that the forward propagation of this distribution through a crystal plasticity finite element model matches a target distribution on materials properties. This stochastic inversion formulation infers a distribution of acceptable/consistent microstructures, as opposed to a deterministic solution, which expands the range of feasible designs in a probabilistic manner. Furthermore, to solve this stochastic inverse problem, we employ a recently developed uncertainty quantification framework based on push-forward probability measures, which combines techniques from measure theory and Bayes’ rule to define a unique and numerically stable solution. This approach requires making an initial prediction using an initial guess for the distribution on model inputs and solving a stochastic forward problem. To reduce the computational burden in solving both stochastic forward and stochastic inverse problems, we combine this approach with a machine learning Bayesian regression model based on Gaussian processes and demonstrate the proposed methodology on two representative case studies in structure–property linkages.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Find the Gap: Black Hole Population Analysis with an Astrophysically Motivated Mass Function

We introduce a novel black hole mass function that realistically models the physics of pair-instability supernovae with a minimal number of parameters. Applying this to all events in the LIGO-Virgo Gravitational-Wave Transient Catalog 2 (GWTC-2), we detect a peak at M BHMG = 46$^{+17}_{-6}$ M ⊙ . Repeating the analysis without the black holes from the event GW190521, we find this feature at M BHMG =54± 6 M ⊙ . These results establish the edge of the anticipated "black hole mass gap" at a value compatible with the expectation from standard stellar structure theory. The mass gap manifests itself as a discontinuity in the mass function and is populated by a distinct, less-abundant population of higher-mass black holes. We find that the primary black hole population scales with power-law index -1.95 ± 0.51 (-1.97 ± 0.44) with (without) GW190521, consistent with models of star formation. Using Bayesian techniques, we establish that our mass function fits a new catalog of black hole masses approximately as well as pre-existing phenomenological mass functions. We also remark on the implications of these results for constraining or discovering new phenomena in nuclear and particle physics.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Multi-objective materials bayesian optimization with active learning of design constraints: Design of ductile refractory multi-principal-element alloys

We report Bayesian Optimization (BO) has emerged as a powerful framework to efficiently explore and exploit materials design spaces. To date, most BO approaches to materials design have focused on the materials discovery problem as if it were a single expensive-to-query ‘black box’ in which the target is to optimize a single objective (i.e., material property or performance metric). Also, such approaches tend to be constraint agnostic. Here, we present a novel multi-information BO framework capable of actively learning materials design as a multiple objectives and constraints problem. We demonstrate this framework by optimally exploring a Refractory Multi-Principal-Element Alloy (MPEA) space, here specifically, the system Mo-Nb-Ti-V-W. The MPEAs are explored to optimize two density-functional theory (DFT) derived ductility indicators (Pugh’s Ratio and Cauchy pressure) while learning design constraints relevant to the manufacturing of high-temperature gas-turbine components. Alloys in the BO Pareto-front are analyzed using DFT to gain an insight into fundamental atomic and electronic underpinning for their superior performance, as evaluated within this framework.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Bayesian estimations of orientation distribution functions from small-angle scattering enable direct prediction of mechanical stress in anisotropic materials

Properties of soft materials are influenced by their anisotropic structuring under nonequilibrium fields. Although anisotropic structure-property relationships have been extensively explored theoretically, comparison to experiments requires determination of the microstructural orientation probability distribution function (OPDF) of microstructural elements. Small angle scattering (SAS) measurements encode information about the OPDF, but tools to navigate this connection are incomplete. Here, we develop and validate an explicit framework to link arbitrary OPDFs to SAS measurements. Specifically, we propose, validate, and apply a method, maximum a posteriori scattering inference (MAPSI), whereby the OPDF may be obtained from SAS measurements using a Bayesian estimation method. Using this method, we obtain estimates of the full 3D OPDF for two model semidilute fd-virus (rodlike) dispersions at concentrations that are approximately equal to and twice the overlap concentration. From the OPDF, we calculate its second and fourth moments and compare these to predictions for a dilute suspension of rigid rods and to a recent theory for semidilute suspensions. Finally, we use both the theoretical and measured moments to calculate the stress, both for dilute and semidilute suspensions. These predictions are not only compared to each other, but also to measured values of the shear stress, and point to new insights into the behavior of suspensions of highly elongated particles in the transition between dilute and semidilute behavior. We also use this new framework to provide perspective on the connection between scalar parameterizations of scattering and the OPDF that have frequently been used in the past. Here, the new tools developed in this work provide an unprecedented path toward experimental validation of dynamical theories of rodlike colloids and polymers, and for measurement of nonequilibrium structures and stresses of other complex fluids and soft materials with SAS.

36 MATERIALS SCIENCE↗
NASA NTRS2004

Putting Priors in Mixture Density Mercer Kernels

This paper presents a new methodology for automatic knowledge driven data mining based on the theory of Mercer Kernels, which are highly nonlinear symmetric positive definite mappings from the original image space to a very high, possibly infinite dimensional feature space. We describe a new method called Mixture Density Mercer Kernels to learn kernel function directly from data, rather than using predefined kernels. These data adaptive kernels can en- code prior knowledge in the kernel using a Bayesian formulation, thus allowing for physical information to be encoded in the model. We compare the results with existing algorithms on data from the Sloan Digital Sky Survey (SDSS). The code for these experiments has been generated with the AUTOBAYES tool, which automatically generates efficient and documented C/C++ code from abstract statistical model specifications. The core of the system is a schema library which contains template for learning and knowledge discovery algorithms like different versions of EM, or numeric optimization methods like conjugate gradient methods. The template instantiation is supported by symbolic- algebraic computations, which allows AUTOBAYES to find closed-form solutions and, where possible, to integrate them into the code. The results show that the Mixture Density Mercer-Kernel described here outperforms tree-based classification in distinguishing high-redshift galaxies from low- redshift galaxies by approximately 16% on test data, bagged trees by approximately 7%, and bagged trees built on a much larger sample of data by approximately 2%.

Srivastava, Ashok N.↗
NASA NTRS2005

An Ensemble Approach to Building Mercer Kernels with Prior Information

This paper presents a new methodology for automatic knowledge driven data mining based on the theory of Mercer Kernels, which are highly nonlinear symmetric positive definite mappings from the original image space to a very high, possibly dimensional feature space. we describe a new method called Mixture Density Mercer Kernels to learn kernel function directly from data, rather than using pre-defined kernels. These data adaptive kernels can encode prior knowledge in the kernel using a Bayesian formulation, thus allowing for physical information to be encoded in the model. Specifically, we demonstrate the use of the algorithm in situations with extremely small samples of data. We compare the results with existing algorithms on data from the Sloan Digital Sky Survey (SDSS) and demonstrate the method's superior performance against standard methods. The code for these experiments has been generated with the AUTOBAYES tool, which automatically generates efficient and documented C/C++ code from abstract statistical model specifications. The core of the system is a schema library which contains templates for learning and knowledge discovery algorithms like different versions of EM, or numeric optimization methods like conjugate gradient methods. The template instantiation is supported by symbolic-algebraic computations, which allows AUTOBAYES to find closed-form solutions and, where possible, to integrate them into the code.

Srivastava, Ashok N.↗
NASA NTRS2009

A Method for Retrieving Ground Flash Fraction from Satellite Lightning Imager Data

A general theory for retrieving the fraction of ground flashes in N lightning observed by a satellite-based lightning imager is provided. An "exponential model" is applied as a physically reasonable constraint to describe the measured optical parameter distributions, and population statistics (i.e., mean, variance) are invoked to add additional constraints to the retrieval process. The retrieval itself is expressed in terms of a Bayesian inference, and the Maximum A Posteriori (MAP) solution is obtained. The approach is tested by performing simulated retrievals, and retrieval error statistics are provided. The ability to retrieve ground flash fraction has important benefits to the atmospheric chemistry community. For example, using the method to partition the existing satellite global lightning climatology into separate ground and cloud flash climatologies will improve estimates of lightning nitrogen oxides (NOx) production; this in turn will improve both regional air quality and global chemistry/climate model predictions.

Koshak, William J.↗