Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian Framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Quantifying and reducing model-form uncertainties in Reynolds-averaged Navier–Stokes simulations: A data-driven, physics-informed Bayesian approach

Despite their well-known limitations, Reynolds-Averaged Navier–Stokes (RANS) models are still the workhorse tools for turbulent flow simulations in today's engineering analysis, design and optimization. While the predictive capability of RANS models depends on many factors, for many practical flows the turbulence models are by far the largest source of uncertainty. As RANS models are used in the design and safety evaluation of many mission-critical systems such as airplanes and nuclear power plants, quantifying their model-form uncertainties has significant implications in enabling risk-informed decision-making. In this work we develop a data-driven, physics-informed Bayesian framework for quantifying model-form uncertainties in RANS simulations. Uncertainties are introduced directly to the Reynolds stresses and are represented with compact parameterization accounting for empirical prior knowledge and physical constraints (e.g., realizability, smoothness, and symmetry). An iterative ensemble Kalman method is used to assimilate the prior knowledge and observation data in a Bayesian framework, and to propagate them to posterior distributions of velocities and other Quantities of Interest (QoIs). We use two representative cases, the flow over periodic hills and the flow in a square duct, to evaluate the performance of the proposed framework. Both cases are challenging for standard RANS turbulence models. Simulation results suggest that, even with very sparse observations, the obtained posterior mean velocities and other QoIs have significantly better agreement with the benchmark data compared to the baseline results. At most locations the posterior distribution adequately captures the true model error within the developed model form uncertainty bounds. The framework is a major improvement over existing black-box, physics-neutral methods for model-form uncertainty quantification, where prior knowledge and details of the models are not exploited. This approach has potential implications in many fields in which the governing equations are well understood but the model uncertainty comes from unresolved physical processes. - Highlights: • Proposed a physics–informed framework to quantify uncertainty in RANS simulations. • Framework incorporates physical prior knowledge and observation data. • Based on a rigorous Bayesian framework yet fully utilizes physical model. • Applicable for many complex physical systems beyond turbulent flows.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Using Bayesian Inference Framework towards Identifying Gas Species and Concentration from High Temperature Resistive Sensor Array Data

High temperature gas sensors have been highly demanded for combustion process optimization and toxic emissions control, which usually suffer from poor selectivity. In order to solve this selectivity issue and identify unknown reducing gas species (CO, CH 4 , and CH 8 ) and concentrations, a high temperature resistive sensor array data set was built in this study based on 5 reported sensors. As each sensor showed specific responses towards different types of reducing gas with certain concentrations, based on which calibration curves were fitted, providing benchmark sensor array response database, then Bayesian inference framework was utilized to process the sensor array data and build a sample selection program to simultaneously identify gas species and concentration, by formulating proper likelihood between input measured sensor array response pattern of an unknown gas and each sampled sensor array response pattern in benchmark database. This algorithm shows good robustness which can accurately identify gas species and predict gas concentration with a small error of less than 10% based on limited amount of experiment data. These features indicate that Bayesian probabilistic approach is a simple and efficient way to process sensor array data, which can significantly reduce the required computational overhead and training data.

Liu, Yixin↗

Accelerated Discovery of CH 4 Uptake Capacity Metal–Organic Frameworks Using Bayesian Optimization

Abstract High‐throughput computational studies for discovery of metal–organic frameworks (MOFs) for separations and storage applications are often limited by the costs of computing thermodynamic quantities. Recent such studies at the time of writing may use ab initio results for a narrow selection of MOFs or empirical force‐field methods for larger selections. Here, a proof‐of‐concept study is conducted using Bayesian optimization on CH 4 uptake capacity of hypothetical MOFs for an existing dataset (Wilmer et al., Nature Chem. 2012, 4 , 83). It is shown that less than 0.1% of the database needs to be screened with the Bayesian optimization approach to recover the top candidate MOFs. This opens the possibility for efficient screening of MOF databases using accurate ab initio calculations for future adsorption studies on a minimal subset of MOFs. Furthermore, Bayesian optimization and the surrogate model presented here can offer interpretable material design insights and the framework will be applicable in the context of other target properties.

Taw, Eric↗

Improvement and generalization of ABCD method with Bayesian inference

To find New Physics or to refine our knowledge of the Standard Model at the LHC is an enterprise that involves many factors, such as the capabilities and the performance of the accelerator and detectors, the use and exploitation of the available information, the design of search strategies and observables, as well as the proposal of new models. We focus on the use of the information and pour our effort in re-thinking the usual data-driven ABCD method to improve it and to generalize it using Bayesian Machine Learning techniques and tools. We propose that a dataset consisting of a signal and many backgrounds is well described through a mixture model. Signal, backgrounds and their relative fractions in the sample can be well extracted by exploiting the prior knowledge and the dependence between the different observables at the event-by-event level with Bayesian tools. We show how, in contrast to the ABCD method, one can take advantage of understanding some properties of the different backgrounds and of having more than two independent observables to measure in each event. In addition, instead of regions defined through hard cuts, the Bayesian framework uses the information of continuous distribution to obtain soft-assignments of the events which are statistically more robust. To compare both methods we use a toy problem inspired by pp\to hh\to b\bar b b \bar b p p → h h → b b ‾ b b ‾ , selecting a reduced and simplified number of processes and analysing the flavor of the four jets and the invariant mass of the jet-pairs, modeled with simplified distributions. Taking advantage of all this information, and starting from a combination of biased and agnostic priors, leads us to a very good posterior once we use the Bayesian framework to exploit the data and the mutual information of the observables at the event-by-event level. We show how, in this simplified model, the Bayesian framework outperforms the ABCD method sensitivity in obtaining the signal fraction in scenarios with 1% and 0.5% true signal fractions in the dataset. We also show that the method is robust against the absence of signal. We discuss potential prospects for taking this Bayesian data-driven paradigm into more realistic scenarios.

Alvarez, Ezequiel↗

Uncertainty quantification for nuclear density functional theory and information content of new measurements

Statistical tools of uncertainty quantification can be used to assess the information content of measured observables with respect to present-day theoretical models, to estimate model errors and thereby improve predictive capability, to extrapolate beyond the regions reached by experiment, and to provide meaningful input to applications and planned measurements. To showcase new opportunities offered by such tools, we make a rigorous analysis of theoretical statistical uncertainties in nuclear density functional theory using Bayesian inference methods. By considering the recent mass measurements from the Canadian Penning Trap at Argonne National Laboratory, we demonstrate how the Bayesian analysis and a direct least-squares optimization, combined with high-performance computing, can be used to assess the information content of the new data with respect to a model based on the Skyrme energy density functional approach. Employing the posterior probability distribution computed with a Gaussian process emulator, we apply the Bayesian framework to propagate theoretical statistical uncertainties in predictions of nuclear masses, two-neutron dripline, and fission barriers. Overall, we find that the new mass measurements do not impose a constraint that is strong enough to lead to significant changes in the model parameters. In addition, the example discussed in this study sets the stage for quantifying and maximizing the impact of new measurements with respect to current modeling and guiding future experimental efforts, thus enhancing the experiment-theory cycle in the scientific method.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A Bayesian Calibration Framework with Embedded Model Error for Model Diagnostics

We study the utility and performance of a Bayesian model error embedding construction in the context of molecular dynamics modeling of metallic alloys, where we embed model error terms in existing interatomic potential model parameters. To alleviate the computational burden of this approach, we propose a framework combining likelihood approximation and Gaussian process surrogates. Here we leverage sparse Gaussian process techniques to construct a hierarchy of increasingly accurate but more expensive surrogate models. This hierarchy is then exploited by multilevel Markov chain Monte Carlo methods to efficiently sample from the target posterior distribution. We illustrate the utility of this approach by calibrating an interatomic potential model for a family of gold-copper alloys. In particular, this case study highlights effective means for dealing with computational challenges with Bayesian model error embedding in large-scale physical models, and the utility of embedded model error for model diagnostics.

Bayesian inference↗

Low Energy Analysis of NuclEar Reactions v0.0.1

This is a lightweight, easy to use Python analysis package for analyzing public low-energy nuclear reaction data relevant to understanding basic nuclear processes, often of relevance to Solar Fusion, to improve our theoretical understanding of them, and enable connections with input from lattice QCD. It performs the analysis in a Bayesian Framework and supports Bayesian Model Averaging to provide a robust uncertainty quantification.

Walker-Loud, André↗

Bayesian Fit for the NOvA Three Flavor Oscillation Analysis

NOvA is a long baseline neutrino oscillation experiment, using Fermilab's NuMI beam and a functionally identical near and far detector. NOvA measures muon neutrino disappearance and electron neutrino appearance to probe neutrino oscillation parameters, including the large neutrino mixing angle, the mass ordering, and the CP-violating phase. NOvA has developed a Bayesian analysis in addition to its Frequentist analysis, using Markov Chain Monte Carlo. This Bayesian framework allows for measurements previously difficult to make with the Frequentist framework, such as the Jarlskog invariant and the reactor mixing angle. The details and status of the Bayesian Framework will be presented, as well as latest NOvA results on measurements of three-flavor oscillation parameters.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Parsimonious Inference Information-Theoretic Foundations for a Complete Theory of Machine Learning (CIS-LDRD Project 218313 Final Technical Report)

This work examines how we may cast machine learning within a complete Bayesian framework to quantify and suppress explanatory complexity from first principles. Our investigation into both the philosophy and mathematics of rational belief leads us to emphasize the critical role of Bayesian inference in learning well-justified predictions within a rigorous and complete extended logic. The Bayesian framework allows us to coherently account for evidence in the learned plausibility of potential explanations. As an extended logic, the Bayesian paradigm regards probability as a notion of degrees of truth. In order to satisfy critical properties of probability as a coherent measure, as well as maintain consistency with binary propositional logic, we arrive at Bayes' Theorem as the only justifiable mechanism to update our beliefs to account for empiracle evidence. Yet, in the machine learning paradigm, where explanations are unconstrained algorithmic abstractions, we arrive at a critical challenge: Bayesian inference requires prior belief. Conventional approaches fail to yield a consistent framework in which we could compare prior plausibility among the infinities of potential choices in learning architectures. The difficulty of articulating well-justified prior belief over abstract models is the provinence of memorization in traditional machine learning training practices. This becomes exceptionally problematic in the context of limited datasets, when we wish to learn justifiable predictions from only a small amount of data.

97 MATHEMATICS AND COMPUTING↗

A Bayesian modeling framework for crash severity effects of active traffic management systems

Transportation agencies utilize Active traffic management (ATM) systems to dynamically manage recurrent and non-recurrent congestion based on real-time conditions. While these systems have been shown to have some safety benefits, their impact on injury severity outcomes is currently uncertain. In this paper, we used full Bayesian mixed logit models to quantify the impact that ATM deployment had on crash severities. The estimation results revealed lower severities with ATM deployment. Marginal effects for ATM deployments that featured hard shoulder running (HSR) revealed lower likelihoods for severe and moderate injury crashes of 15.9 % and for minor injury crashes of 10.1 %. The likelihood of severe and moderate injury crashes and minor injury crashes reduced by 12.4 % and 8.33 % with ATM without HSR. The models were observed to be temporally transferable and had forecast error of 0.301 and 0.304 for the two models, revealing better performance with validation data. These results have implications for improving freeway crash risk at critical locations.

97 MATHEMATICS AND COMPUTING↗

National population mapping from sparse survey data: A hierarchical Bayesian modeling framework to account for uncertainty

Population estimates are critical for government services, development projects, and public health campaigns. Such data are typically obtained through a national population and housing census. However, population estimates can quickly become inaccurate in localized areas, particularly where migration or displacement has occurred. Some conflict-affected and resource-poor countries have not conducted a census in over 10 y. We developed a hierarchical Bayesian model to estimate population numbers in small areas based on enumeration data from sample areas and nationwide information about administrative boundaries, building locations, settlement types, and other factors related to population density. We demonstrated this model by estimating population sizes in every 10- m grid cell in Nigeria with national coverage. These gridded population estimates and areal population totals derived from them are accompanied by estimates of uncertainty based on Bayesian posterior probabilities. The model had an overall error rate of 67 people per hectare (mean of absolute residuals) or 43% (using scaled residuals) for predictions in out-of-sample survey areas (approximately 3 ha each), with increased precision expected for aggregated population totals in larger areas. This statistical approach represents a significant step toward estimating populations at high resolution with national coverage in the absence of a complete and recent census, while also providing reliable estimates of uncertainty to support informed decision making.

99 GENERAL AND MISCELLANEOUS↗

STATISTICS OF MEASURING NEUTRON STAR RADII: ASSESSING A FREQUENTIST AND A BAYESIAN APPROACH

Measuring neutron star radii with spectroscopic and timing techniques relies on the combination of multiple observables to break the degeneracies between the mass and radius introduced by general relativistic effects. Here, we explore a previously used frequentist and a newly proposed Bayesian framework to obtain the most likely value and the uncertainty in such a measurement. We find that for the expected range of masses and radii and for realistic measurement errors, the frequentist approach suffers from biases that are larger than the accuracy in the radius measurement required to distinguish between the different equations of state. In contrast, in the Bayesian framework, the inferred uncertainties are larger, but the most likely values do not suffer from such biases. We also investigate ways of quantifying the degree of consistency between different spectroscopic measurements from a single source. We show that a careful assessment of the systematic uncertainties in the measurements eliminates the need for introducing ad hoc biases, which lead to artificially large inferred radii.

79 ASTRONOMY AND ASTROPHYSICS↗

Synthesis of observed and simulated rain microphysics to inform a new Bayesian statistical framework for microphysical parameterization in climate models (Final Scientific Report)

This project aimed to investigate a new approach to bulk microphysics schemes. We identified the need to move beyond the fixed structural assumptions and approximation of existing schemes. For example, most schemes assume some functional form for the rain drop size distribution (e.g. a gamma or exponential distribution). Most schemes then evolve some number of statistical moments of that distribution via various processes, such as evaporation, sedimentation, collision-coalescence, and collisional breakup. These microphysical processes, in turn, are typically some fixed functional form derived from either some other (more detailed) model, or using some single-particle rates that are then integrated over the size distribution. While these process rate functions may have some free parameters to adjust, in other cases doing so is impossible (e.g. when the process rates are analytical or piecewise solutions to some target function). Our goal was to build and test a scheme that assumed no size distribution form, and used a series of power laws as the basis for the process rates. Moments of the size distribution would be predicted, but no underlying size distribution would be specified. Any number or choice of size distribution moments could be used, and any number of power laws could be employed to model the process rates. Thus, our approach is flexible, and can seamlessly scale across levels of complexity, as demanded by the data. Bayesian inference then would provide the formalism to estimate the model parameters and structure, allowing for robust uncertainty quantification. We proposed testing this framework in idealized simulations using bin microphysical schemes as a data source. We also proposed using real data to inform our microphysics scheme, and also that we would integrate our scheme into WRF.

58 GEOSCIENCES↗

Bayesian Integration of multiscale environmental data

The software is designed for efficiently integrating large-size of multi-scale environmental data using the Bayesian framework. Suppose we need to estimate the spatial distribution of variable X with high spatial resolution. The available data include (1) direct measurements Z of the unknowns with high resolution in a subset of the spatial domain (small spatial coverage), (2) measurements C of the unknowns at the median scale, and (3) measurements A of the unknowns at the coarsest scale but with large spatial coverage. The goal is to estimate the unknowns at the fine grids by conditioning to all the available data. We first consider all the unknowns as random variables and estimate conditional probability distribution of those variables by conditioning to the limited high-resolution observations (Z). We then treat the estimated probability distribution as the prior distribution. Within the Bayesian framework, we combine the median and large-scale measurements (C and A) through likelihood functions. Since we assume that all the relevant multivariate distributions are Gaussian, the resulting posterior distribution is a multivariate Gaussian distribution. The developed software provides numerical solutions of the posterior probability distribution. The software can be extended in several different ways to solve more general multi-scale data integration problems.

CHEN, JINSONG↗

Bayesian Integration of multiscale environmental data

The software is designed for efficiently integrating large-size of multi-scale environmental data using the Bayesian framework. Suppose we need to estimate the spatial distribution of variable X with high spatial resolution. The available data include (1) direct measurements Z of the unknowns with high resolution in a subset of the spatial domain (small spatial coverage), (2) measurements C of the unknowns at the median scale, and (3) measurements A of the unknowns at the coarsest scale but with large spatial coverage. The goal is to estimate the unknowns at the fine grids by conditioning to all the available data. We first consider all the unknowns as random variables and estimate conditional probability distribution of those variables by conditioning to the limited high-resolution observations (Z). We then treat the estimated probability distribution as the prior distribution. Within the Bayesian framework, we combine the median and large-scale measurements (C and A) through likelihood functions. Since we assume that all the relevant multivariate distributions are Gaussian, the resulting posterior distribution is a multivariate Gaussian distribution. The developed software provides numerical solutions of the posterior probability distribution. The software can be extended in several different ways to solve more general multi-scale data integration problems.

CHEN, JINSONG↗

PBPK modeling of the cis- and trans-permethrin isomers and their major urinary metabolites in rats

Permethrin, a pyrethroid insecticide, is suspected to induce neuronal and hormonal disturbances in humans. The widespread exposure of the populations has been confirmed by the detection of the urinary metabolites of permethrin in biomonitoring studies. Permethrin is a chiral molecule presenting two forms, the cis and the trans isomers. Because in vitro studies indicated a metabolic interaction between the trans and cis isomers of permethrin, we adapted and calibrated a PBPK model for trans- and cis-permethrin separately in rats. The model also describes the toxicokinetics of three urinary metabolites, cis- and trans-3-(2,2 dichlorovinyl)-2,2-dimethyl-(1-cyclopropane) carboxylic acid (cis- and trans-DCCA), 3-phenoxybenzoic acid (3-PBA) and 4′OH-phenoxybenzoic acid (4′-OH-PBA). In vivo experiments performed in Sprague–Dawley rats were used to calibrate the PBPK model in a Bayesian framework. The model captured well the toxicokinetics of permethrin isomers and their metabolites including the rapid absorption, the accumulation in fat, the extensive metabolism of the parent compounds, and the rapid elimination of metabolites in urine. Average hepatic clearances in rats were estimated to be 2.4 and 5.7 L/h/kg for cis- and trans-permethrin, respectively. High concentrations of the metabolite 4′-OH-PBA were measured in urine compared to cis- and trans-DCCA and 3-PBA. The confidence in the extended PBPK model was then confirmed by good predictions of published experimental data obtained using the isomers mixture. The extended PBPK model could be extrapolated to humans to predict the internal dose of exposure to permethrin from biomonitoring data in urine. - Highlights: • A PBPK model of isomers of permethrin and its urinary metabolites was developed. • A quantitative link was established for permethrin and its biomarkers of exposure. • The bayesian framework allows getting confidence interval on the estimated parameters. • The PBPK model can be extrapolated to human and used in a reverse dosimetry context.

60 APPLIED LIFE SCIENCES↗

Development of a PBPK model of thiocyanate in rats with an extrapolation to humans: A computational study to quantify the mechanism of action of thiocyanate kinetics in thyroid

Thyroid homeostasis can be disturbed due to thiocyanate exposure from the diet or tobacco smoke. Thiocyanate inhibits both thyroidal uptake of iodide, via the sodium-iodide symporter (NIS), and thyroid hormone (TH) synthesis in the thyroid, via thyroid peroxidase (TPO), but the mode of action of thiocyanate is poorly quantified in the literature. The characterization of the link between intra-thyroidal thiocyanate concentrations and dose of exposure is crucial for assessing the risk of thyroid perturbations due to thiocyanate exposure. We developed a PBPK model for thiocyanate that describes its kinetics in the whole-body up to daily doses of 0.15 mmol/kg, with a mechanistic description of the thyroidal kinetics including NIS, passive diffusion, and TPO. The model was calibrated in a Bayesian framework using published studies in rats. Goodness-of-fit was satisfactory, especially for intra-thyroidal thiocyanate concentrations. Thiocyanate kinetic processes were quantified in vivo, including the metabolic clearance by TPO. The passive diffusion rate was found to be greater than NIS-mediated uptake rate. The model captured the dose-dependent kinetics of thiocyanate after acute and chronic exposures. Model behavior was evaluated using a Morris screening test. The distribution of thiocyanate into the thyroid was found to be determined primarily by the partition coefficient, followed by NIS and passive diffusion; the impact of the latter two mechanisms appears to increase at very low doses. Extrapolation to humans resulted in good predictions of thiocyanate kinetics during chronic exposure. The developed PBPK model can be used in risk assessment to quantify dose-response effects of thiocyanate on TH. - Highlights: • A PBPK model of thiocyanate (SCN{sup −}) was calibrated in rats in a Bayesian framework. • The intra-thyroidal kinetics of thiocyanate including NIS and TPO was modeled. • Passive diffusion rate for SCN{sup −} seemed to be greater than the NIS-mediated uptake. • The dose-dependent kinetics of SCN{sup −} was captured after an acute and chronic exposure. • The PBPK model of thiocyanate was successfully extrapolated to humans.

54 ENVIRONMENTAL SCIENCES↗