Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian model selection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

A Portfolio Approach to Massively Parallel Bayesian Optimization

One way to reduce the time of conducting optimization studies is to evaluate designs in parallel rather than just one-at-a-time. For expensive-to-evaluate black-boxes, batch versions of Bayesian optimization have been proposed. They work by building a surrogate model of the black-box to simultaneously select multiple designs via an infill criterion. Still, despite the increased availability of computing resources that enable large-scale parallelism, the strategies that work for selecting a few tens of parallel designs for evaluations become limiting due to the complexity of selecting more designs. It is even more crucial when the black-box is noisy, necessitating more evaluations as well as repeating experiments. Here we propose a scalable strategy that can keep up with massive batching natively, focused on the exploration/exploitation trade-off and a portfolio allocation. We compare the approach with related methods on noisy functions, for mono and multi-objective optimization tasks. These experiments show orders of magnitude speed improvements over existing methods with similar or better performance.

97 MATHEMATICS AND COMPUTING↗

Overview of Algorithms for Using Particle Morphology in Pre-Detonation Nuclear Forensics

A major goal in pre-detonation nuclear forensics is to infer the processing conditions and/or facility type that produced radiological material. This review paper focuses on analyses of particle size, shape, texture (“morphology”) signatures that could provide information on the provenance of interdicted materials. For example, uranium ore concentrates (UOC or yellowcake) include ammonium diuranate (ADU), ammonium uranyl carbonate (AUC), sodium diuranate (SDU), magnesium diuranate (MDU), and others, each prepared using different salts to precipitate U from solution. Once precipitated, UOCs are often dried and calcined to remove adsorbed water. The products can be allowed to react further, forming uranium oxides UO3, U3O8, or UO2 powders, whose surface morphology can be indicative of precipitation and/or calcination conditions used in their production. This review paper describes statistical issues and approaches in using quantitative analyses of measurements such as particle size and shape to infer production conditions. Statistical topics include multivariate t tests (Hotelling’s T 2 ), design of experiments, and several machine learning (ML) options including decision trees, learning vector quantization neural networks, mixture discriminant analysis, and approximate Bayesian computation (ABC). ABC is emphasized as an attractive option to include the effects of model uncertainty in the selected and fitted forward model used for inferring processing conditions.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Bayesian prior construction for uncertainty quantification in first-principles statistical mechanics

First-principles statistical mechanics enables the prediction of thermodynamic and kinetic properties of materials, but is computationally expensive. Many approaches require surrogate models to calculate energies within Monte Carlo or molecular dynamics simulations. Inexpensive surrogates such as cluster expansions enable otherwise intractable calculations by interpolating data from higher accuracy methods, such as Density Functional Theory (DFT). Surrogate models introduce uncertainty into downstream calculations, in addition to any uncertainty inherent to DFT calculations. Bayesian frameworks address this by quantifying uncertainty and incorporating expert knowledge through priors. However, constructing effective priors remains challenging. This work introduces and describes practical strategies for building Bayesian cluster expansions, focusing on basis truncation, hyperparameter selection, and ground state replication. We analyze multiple basis truncation schemes, compare cross-validation to the evidence-approximation for hyperparameter optimization, and provide methods to find and enforce ground-state-preserving models through priors. Additionally, we compare the uncertainties between different approximations to DFT (LDA, PBE, SCAN) against the uncertainty introduced with the use of cluster expansion surrogate models. These approaches are demonstrated on the BCC Li x Mg 1-x and Li x Al 1-x alloys, which are both of interest for solid-state Li batteries. Our results provide guidelines for constructing and utilizing Bayesian cluster expansions, thereby improving the transparency of materials modeling. Furthermore, the approaches and insights developed in this work can be transferred to a wide range of cluster expansion surrogate models, including the atomic cluster expansion and related machine-learned interatomic potential architectures.

Alloy theory↗

CODEX weak lensing: concentration of galaxy clusters at z ~ 0.5

Here, we present a stacked weak-lensing analysis of 27 richness selected galaxy clusters at 0.40 ≤ z ≤ 0.62 in the COnstrain Dark Energy with X-ray galaxy clusters (CODEX) survey. The fields were observed in five bands with the Canada–France–Hawaii Telescope (CFHT). We measure the stacked surface mass density profile with a 14σ significance in the radial range 0.1 < RMpch -1 < 2.5. The profile is well described by the halo model, with the main halo term following a Navarro–Frenk–White profile (NFW) profile and including the off-centring effect. We select the background sample using a conservative colour–magnitude method to reduce the potential systematic errors and contamination by cluster member galaxies. We perform a Bayesian analysis for the stacked profile and constrain the best-fitting NFW parameters M 200c =6.6$+1.0\atop{-0.8}$×10 14 h -1 M⊙ and c 200c =3.7$+0.7\atop{-0.6}$. The off-centring effect was modelled based on previous observational results found for redMaPPer Sloan Digital Sky Survey clusters. Our constraints on M200c and c200c allow us to investigate the consistency with numerical predictions and select a concentration–mass relation to describe the high richness CODEX sample. Comparing our best-fitting values for M200c and c200c with other observational surveys at different redshifts, we find no evidence for evolution in the concentration–mass relation, though it could be mitigated by particular selection functions. Similar to previous studies investigating the X-ray luminosity–mass relation, our data suggest a lower evolution than expected from self-similarity.

79 ASTRONOMY AND ASTROPHYSICS↗

A deep, multi-epoch Chandra HETG study of the ionized outflow from NGC 4051

Actively accreting supermassive black holes significantly impact the evolution of their host galaxies, truncating further star formation by expelling large fractions of gas with wide-angle outflows. The X-ray band is key to understanding how these black hole winds affect their environment, as the outflows have high temperatures ~10 5–8 K). We have developed a Bayesian framework for characterizing active galactic nucleus outflows with an improved ability to explore parameter space and perform robust model selection. We applied this framework to a new 700 ks and an archival 315 ks Chandra High Energy Transmission Gratings observation of the Seyfert galaxy NGC 4051. We have detected six absorbers intrinsic to NGC 4051. These wind components span velocities from 400 to 30000 km s -1 . We have determined that the most statistically significant wind component is purely collisionally ionized, which is the first detection of such an absorber. This wind has T ≈ 10 7 K and v ≈ 880 km s -1 and remains remarkably stable between the two epochs. Other slow components also remain stable across time. Fast outflow components change their properties between 2008 and 2016, suggesting either physical changes or clouds moving in and out of the line of sight. For one of the fast components, we obtain one of the tightest wind density measurements to date, log n/(cm -3 ) = 13.0$^{+0.01}_{-0.02}$, and determine that it is located at ~240 gravitational radii. The estimated total outflow power surpasses 5 percent of the bolometric luminosity (albeit with large uncertainties) making it important in the context of galaxy–black hole interactions.

79 ASTRONOMY AND ASTROPHYSICS↗

Bayesian Hierarchical Models for Parameter Inference with Missing Data: Supernova Cosmology Case Study [Slides]

Large scale astronomical surveys are going wider and deeper than ever before. However, astronomers, cosmologists and theorists continue to face the perennial issue that their data sets are often incomplete in magnitude space and must be carefully treated in order to avoid Malmquist bias, especially in the field of supernova cosmology. Historically, cosmological parameter inference in supernova cosmology was done using χ2 methodology; however, recent years have seen a rise in the use of Bayesian Hierarchical Models. In this presentation we develop a Bayesian Hierarchical methodology to account for magnitude limited surveys and present a specific application to cosmological parameter inference and model selection in supernova cosmology.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Empirical radius formulas for canonical neutron stars from bidirectionally selecting features of equations of state in extended Bayesian analyses of observational data

Significant advancement in Bayesian inference of nuclear equation of state (EOS) from gravitational wave and x-ray observations of neutron stars (NSs) has been made by the nuclear astrophysics community especially since GW170817. By extending the traditional Bayesian analysis which normally ends at presenting the marginalized posterior probability distribution functions (PDFs) of individual EOS parameters and their correlations (or sometimes only the Pearson correlation coefficients which are only reliably useful when the variables are linearly correlated while they are actually often not), we search for a data-driven and robust empirical formula for the radius 𝑅 1.4 of canonical NSs in terms of the characteristic EOS parameters (features). We also identify the single most important but currently poorly known EOS parameter for determining the 𝑅 1.4 . Using three regression-model-building methodologies: bidirectional stepwise feature selection, least absolute shrinkage selection operator (LASSO) regression, and neural network regression on a large set of posterior EOSs and the corresponding 𝑅 1.4 values inferred from earlier comprehensive Bayesian analyses of NS observational data, we systematically and rigorously develop the most probable 𝑅 1.4 formulas with varying statistical accuracy and technical complexity. Here, the most important EOS parameters for determining 𝑅 1.4 are found consistently in each of the feature selection processes to be (in order of decreasing importance): curvature 𝐾 sym , slope 𝐿, skewness 𝐽 sym of nuclear symmetry energy, skewness 𝐽 0 , incompressibility 𝐾 0 of symmetric nuclear matter, and the magnitude 𝐸 sym ⁡(𝜌 0 ) of symmetry energy at the saturation density 𝜌 0 of nuclear matter.

Bayesian methods↗

Towards improved characterization of high-risk releases using heterogeneous indoor sensor systems

The sudden release of toxic contaminants that reach indoor spaces can be hazardous to building occupants. For an acutely toxic contaminant, the speed of the emergency response strongly influences the consequences to occupants. The design of a real time sensor system is made challenging both by the urgency and complex nature of the event, and by the imperfect sensors and models available to describe it. In this research, we use Bayesian modeling to combine information from multiple types of sensors to improve the characterization of a release. We discuss conceptual and algorithmic considerations for selecting and fusing information from disparate sensors. To explore system performance, we use both real tracer gas data from experiments in a three story building, along with synthetic data, including information from door position sensors. The added information from door position sensors is found to be useful for many scenarios, but not always. We discuss the physical conditions and design factors that affect these results, such as the influence of the door positions on contaminant transport. We highlight potential benefits of multisensor data fusion, challenges in realizing those benefits, and opportunities for further improvement.

54 ENVIRONMENTAL SCIENCES↗

Bayesian State-Space Modeling Framework for Understanding and Predicting Golden Eagle Movements Using Telemetry Data

Predicting raptor movements through a wind power plant under given atmospheric and topographical conditions is a crucial first step in the overall goal of quantifying the risk of turbine-related collisions and mortalities. Extracting behavioral traits of golden eagles (Aquila chrysaetos) from telemetry data requires the fusion of noisy and sparse movement data (location, heading, velocity) with a stochastic mathematical representation of the eagles' decision-making processes. In this study, we framed this problem in a Bayesian state-space framework where both observations and decision-making are assumed to be stochastic processes connected through hidden states (mode of flight, intent), and the unknown model parameters are assumed to be random variables that are calibrated using the available telemetry data. This framework allowed for rigorous consideration of underlying uncertainties while allowing for both data and prior biological knowledge to contribute to a probabilistic and predictive agent-based movement model. We implemented and applied the Bayesian framework to understand movement behavior of 23 GPS-tagged golden eagles travelling in the western US for years 2019 and 2020. Our preliminary findings show that the Bayesian state-space framework provides a robust inverse modeling apparatus to decode eagle behavioral characteristics from telemetry data. This study was primarily aimed at verifying and validating the framework with selected golden eagle tracks (both long- and short-ranged), with future research aimed at extending the framework to include multi-mode flight, consideration of atmospheric data and uplift mechanisms, eagle-to-eagle interaction, and eagle-to-turbine interaction.

Bayesian modeling↗

Quantification of Type I Interferon Inhibition by Viral Proteins: Ebola Virus as a Case Study

Type I interferons (IFNs) are cytokines with both antiviral properties and protective roles in innate immune responses to viral infection. They induce an antiviral cellular state and link innate and adaptive immune responses. Yet, viruses have evolved different strategies to inhibit such host responses. One of them is the existence of viral proteins which subvert type I IFN responses to allow quick and successful viral replication, thus, sustaining the infection within a host. We propose mathematical models to characterise the intra-cellular mechanisms involved in viral protein antagonism of type I IFN responses, and compare three different molecular inhibition strategies. We study the Ebola viral protein, VP35, with this mathematical approach. Approximate Bayesian computation sequential Monte Carlo, together with experimental data and the mathematical models proposed, are used to perform model calibration, as well as model selection of the different hypotheses considered. Finally, we assess if model parameters are identifiable and discuss how such identifiability can be improved with new experimental data.

59 BASIC BIOLOGICAL SCIENCES↗

ADAPTIVE ANNEALED IMPORTANCE SAMPLING FOR MULTIMODAL POSTERIOR EXPLORATION AND MODEL SELECTION WITH APPLICATION TO EXTRASOLAR PLANET DETECTION

We describe an algorithm that can adaptively provide mixture summaries of multimodal posterior distributions. The parameter space of the involved posteriors ranges in size from a few dimensions to dozens of dimensions. This work was motivated by an astrophysical problem called extrasolar planet (exoplanet) detection, wherein the computation of stochastic integrals that are required for Bayesian model comparison is challenging. The difficulty comes from the highly nonlinear models that lead to multimodal posterior distributions. We resort to importance sampling (IS) to estimate the integrals, and thus translate the problem to be how to find a parametric approximation of the posterior. To capture the multimodal structure in the posterior, we initialize a mixture proposal distribution and then tailor its parameters elaborately to make it resemble the posterior to the greatest extent possible. We use the effective sample size (ESS) calculated based on the IS draws to measure the degree of approximation. The bigger the ESS is, the better the proposal resembles the posterior. A difficulty within this tailoring operation lies in the adjustment of the number of mixing components in the mixture proposal. Brute force methods just preset it as a large constant, which leads to an increase in the required computational resources. We provide an iterative delete/merge/add process, which works in tandem with an expectation-maximization step to tailor such a number online. The efficiency of our proposed method is tested via both simulation studies and real exoplanet data analysis.

79 ASTRONOMY AND ASTROPHYSICS↗

Diagnostic and Prognostic Tools for Residual Life Estimation in Aging Nuclear Power Plant Components

A central issue in life extension for the current fleet of light water nuclear power reactors (LWR) is the early detection and monitoring of significant materials degradation. To meet this need, nondestructive methods that are suitable for continuous monitoring over extended time periods (months to years) are needed. A related issue is the ability to estimate remaining useful life (RUL) of components and systems based on condition assessment or degradation information. Monitoring for early detection of materials degradation requires novel sensors and enhanced data integration techniques. A range of acoustic and electromagnetic measurement methods may be suitable, including acoustic microscopy, eddy current and magnetic Barkhausen emission. Prognostic methods that predict rate of degradation and remaining life based on phenomena that can be described by linear elastic fracture mechanics have been reported by several researchers. However, the challenge of predicting remaining life starting from earlier phases of degradation is largely unsolved. This paper discusses an assessment of selected diagnostic techniques, and the application of Bayesian prognostic algorithms to detection of early degradation and rate of degradation/life prediction. Such measurement and modeling methods are expected to form the basis for a new range of advanced diagnostic and prognostic approaches for assessing and monitoring life extension of ageing light water reactors.

diagnostics↗

Using a surrogate-assisted Bayesian framework to calibrate the runoff-generation scheme in the Energy Exascale Earth System Model (E3SM) v1

Abstract. Runoff is a critical component of the terrestrial water cycle, and Earth system models (ESMs) are essential tools to study its spatiotemporal variability. Runoff schemes in ESMs typically include many parameters so that model calibration is necessary to improve the accuracy of simulated runoff. However, runoff calibration at a global scale is challenging because of the high computational cost and the lack of reliable observational datasets. In this study, we calibrated 11 runoff relevant parameters in the Energy Exascale Earth System Model (E3SM) Land Model (ELM) using a surrogate-assisted Bayesian framework. First, the polynomial chaos expansion machinery with Bayesian compressed sensing is used to construct computationally inexpensive surrogate models for ELM-simulated runoff at 0.5∘ × 0.5∘ for 1991–2010. The error metric between the ELM simulations and the benchmark data is selected to construct the surrogates, which facilitates efficient calibration and avoids the more conventional, but challenging, construction of high-dimensional surrogates for the ELM simulated runoff. Second, the Sobol' index sensitivity analysis is performed using the surrogate models to identify the most sensitive parameters, and our results show that, in most regions, ELM-simulated runoff is strongly sensitive to 3 of the 11 uncertain parameters. Third, a Bayesian method is used to infer the optimal values of the most sensitive parameters using an observation-based global runoff dataset as the benchmark. Our results show that model performance is significantly improved with the inferred parameter values. Although the parametric uncertainty of simulated runoff is reduced after the parameter inference, it remains comparable to the multimodel ensemble uncertainty represented by the global hydrological models in ISMIP2a. Additionally, the annual global runoff trend during the simulation period is not well constrained by the inferred parameter values, suggesting the importance of including parametric uncertainty in future runoff projections.

58 GEOSCIENCES↗

Search for the standard model Higgs boson produced in association with a W ± boson with 7.5 fb⁻¹ integrated luminosity at CDF

We present a search for the standard model Higgs boson produced in association with a W ± boson. This search uses data corresponding to an integrated luminosity of 7.5 fb⁻¹ collected by the CDF detector at the Tevatron. We select WH→lνbb¯ candidate events with two jets, large missing transverse energy, and exactly one charged lepton. We further require that at least one jet be identified to originate from a bottom quark. Discrimination between the signal and the large background is achieved through the use of a Bayesian artificial neural network. The number of tagged events and their distributions are consistent with the standard model expectations. We observe no evidence for a Higgs boson signal and set 95% C.L. upper limits on the WH production cross section times the branching ratio to decay to bb¯ pairs, σ(pp¯→W ± H)×B(H→bb¯), relative to the rate predicted by the standard model. For the Higgs boson mass range of 100 to 150 GeV/c² we set observed (expected) upper limits from 1.34 (1.83) to 38.8 (23.4). For 115 GeV/c² the upper limit is 3.64 (2.78). The combination of the present search with an independent analysis that selects events with three jets yields more stringent limits ranging from 1.12 (1.79) to 34.4 (21.6) in the same mass range. For 115 and 125 GeV/c² the upper limits are 2.65 (2.60) and 4.36 (3.69), respectively.

Aaltonen, T.↗

Evolutionary Dynamics of West Nile Virus in the United States, 1999–2011: Phylogeny, Selection Pressure and Evolutionary Time-Scale Analysis

West Nile virus (WNV), an arbovirus maintained in a bird-mosquito enzootic cycle, can infect other vertebrates including humans. WNV was first reported in the US in 1999 where, to date, three genotypes belonging to WNV lineage I have been described (NY99, WN02, SW/WN03). We report here the WNV sequences obtained from two birds, one mosquito, and 29 selected human samples acquired during the US epidemics from 2006–2011 and our examination of the evolutionary dynamics in the open-reading frame of WNV isolates reported from 1999–2011. Maximum-likelihood and Bayesian methods were used to perform the phylogenetic analyses and selection pressure analyses were conducted with the HyPhy package. Phylogenetic analysis identified human WNV isolates within the main WNV genotypes that have circulated in the US. Within genotype SW/WN03, we have identified a cluster with strains derived from blood donors and birds from Idaho and North Dakota collected during 2006–2007, termed here MW/WN06. Using different codon-based and branch-site selection models, we detected a number of codons subjected to positive pressure in WNV genes. The mean nucleotide substitution rate for WNV isolates obtained from humans was calculated to be 5.0661024 substitutions/site/year (s/s/y). The Bayesian skyline plot shows that after a period of high genetic variability following the introduction of WNV into the US, the WNV population appears to have reached genetic stability. The establishment of WNV in the US represents a unique opportunity to understand how an arbovirus adapts and evolves in a naive environment. We describe a novel, well-supported cluster of WNV formed by strains collected from humans and birds from Idaho and North Dakota. Adequate genetic surveillance is essential to public health since new mutants could potentially affect viral pathogenesis, decrease performance of diagnostic assays, and negatively impact the efficacy of vaccines and the development of specific therapies.

59 BASIC BIOLOGICAL SCIENCES↗

Bayesian calibration, validation, and uncertainty quantification of diffuse interface models of tumor growth

The idea that one can possibly develop computational models that predict the emergence, growth, or decline of tumors in living tissue is enormously intriguing as such predictions could revolutionize medicine and bring a new paradigm into the treatment and prevention of a class of the deadliest maladies affecting humankind. But at the heart of this subject is the notion of predictability itself, the ambiguity involved in selecting and implementing effective models, and the acquisition of relevant data, all factors that contribute to the difficulty of predicting such complex events as tumor growth with quantifiable uncertainty. In this work, we attempt to lay out a framework, based on Bayesian probability, for systematically addressing the questions of Validation, the process of investigating the accuracy with which a mathematical model is able to reproduce particular physical events, and Uncertainty quantification, developing measures of the degree of confidence with which a computer model predicts particular quantities of interest. For illustrative purposes, we exercise the process using virtual data for models of tumor growth based on diffuse-interface theories of mixtures utilizing virtual data.

59 BASIC BIOLOGICAL SCIENCES↗

CheKiPEUQ Intro 2: Harnessing Uncertainties from Data Sets, Bayesian Design of Experiments in Chemical Kinetics**

When choosing experimental conditions, Bayesian statistical tools can predict the experimental choices which will yield the highest information gain. Experimental choices could be temperature, pressure, reaction time, number of measurements, reactor volume, etc.. Three example analyses are presented here, each using the software Chemical Kinetics Parameter Estimation and Uncertainty Quantification (CheKiPEUQ). Information gain is a measure of reduction of uncertainty in a model's parameters. The three chemical system examples presented each illustrate Bayesian Design of Experiments using information gain. In the first chemical example, temperature selection impacts the information gain for the free energy of reaction in a two-component equilibrium reaction. In the second example, temperature and pressure are explored for a competitive adsorption Langmuir replacement reaction system. Finally, the third example is a catalytic membrane reactor which is a culmination of the previous examples. The catalytic membrane reactor has a complex and nonlinear response in the observables which is solved by numerical evaluation. In the three examples, the experimental conditions are treated as design variables for maximizing information gain.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A CHANDRA STUDY OF TEMPERATURE DISTRIBUTIONS OF THE INTRACLUSTER MEDIUM IN 50 GALAXY CLUSTERS

To investigate the spatial distribution of the intracluster medium temperature in galaxy clusters in a quantitative way and probe the physics behind it, we analyze the X-ray spectra from a sample of 50 clusters that were observed with the Chandra ACIS instrument over the past 15 years and measure the radial temperature profiles out to 0.45r{sub 500}. We construct a physical model that takes into consideration the effects of gravitational heating, thermal history (such as radiative cooling, active galactic nucleus feedback, and thermal conduction), and work done via gas compression, and use it to fit the observed temperature profiles by running Bayesian regressions. The results show that in all cases our model provides an acceptable fit at the 68% confidence level. For further validation, we select nine clusters that have been observed with both Chandra (out to ≳0.3r{sub 500}) and Suzaku (out to ≳1.5r{sub 500}) and fit their Chandra spectra with our model. We then compare the extrapolation of the best fits with the Suzaku measurements and find that the model profiles agree with the Suzaku results very well in seven clusters. In the remaining two clusters the difference between the model and the observation is possibly caused by local thermal substructures. Our study also implies that for most of the clusters the assumption of hydrostatic equilibrium is safe out to at least 0.5r{sub 500} and the non-gravitational interactions between dark matter and its luminous counterparts is consistent with zero.

79 ASTRONOMY AND ASTROPHYSICS↗