Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian model selection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

A Bayesian Modeling Approach for Estimation of a Shape-Free Groundwater Age Distribution using Multiple Tracers

The mixing of groundwaters with different ages in aquifers, groundwater age is more appropriately represented by a distribution rather than a scalar number. To infer a groundwater age distribution from environmental tracers, a mathematical form is often assumed for the shape of the distribution and the parameters of the mathematical distribution are estimated using deterministic or stochastic inverse methods. We found that the prescription of the mathematical form limits the exploration of the age distribution to the shapes that can be described by the selected distribution. In this paper, the use of freeform histograms as groundwater age distributions is evaluated. A Bayesian Markov Chain Monte Carlo approach is used to estimate the fraction of groundwater in each histogram bin. This method was able to capture the shape of a hypothetical gamma distribution from the concentrations of four age tracers. The number of bins that can be considered in this approach is limited based on the number of tracers available. The histogram method was also tested on tracer data sets from Holten (The Netherlands; 3 H, 3 He, 85 Kr, 39 Ar) and the La Selva Biological Station (Costa-Rica; SF 6 , CFCs, 3 H, 4 He and 14 C), and compared to a number of mathematical forms. According to standard Bayesian measures of model goodness, the best mathematical distribution performs better than the histogram distributions in terms of the ability to capture the observed tracer data relative to their complexity. Among the histogram distributions, the four bin histogram performs better in most of the cases. The Monte Carlo simulations showed strong correlations in the posterior estimates of bin contributions, indicating that these bins cannot be well constrained using the available age tracers. The fact that mathematical forms overall perform better than the freeform histogram does not undermine the benefit of the freeform approach, especially for the cases where a larger amount of observed data is available and when the real groundwater distribution is more complex than can be represented by simple mathematical forms.

54 ENVIRONMENTAL SCIENCES↗

Bayesian inference for high confidence signal validation and sensor calibration assessment - 328

Online Monitoring (OLM) systems has been investigated for applications in the nuclear industry for the past two decades. These systems offer economic and technological advantages over the currently implemented time based testing methods for sensors and associated instrumentations. The advantages offered not only augment economic viability of current nuclear reactors but will be an inevitable change called for to suit the technologies of the advanced reactors (Gen III+). Irrespective, the acceptance of OLM into the regulatory structure in the U.S. is still hindered by technical and structural clarity on uncertainty quantification used by these systems. A Bayesian inference technique is implemented in the form of a residual model to quantify uncertainty in OLM predictions. The developed system used Gaussian processes to represent the OLM predictions and model inadequacy, the stationary representation of model based uncertainty. In addition, model selection techniques are used in conjunction with numerical methods such as Genetic Algorithm (GA) and Gibb's sampler to add robustness to the estimation model inadequacy, particularly in the presence of drifts and faulted conditions. The prediction model developed herein find applicability in fault detection, obtaining real values of processes after the onset of faults etc. Further development looks into the extension of current method for a multiple output scale implementation. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Estimated 55Mn and 90Zr cross section covariances in the fast neutron energy region

We completed estimates of neutron cross section covariances for {sup 55}Mn and {sup 90}Zr, from keV range to 25 MeV, considering the most important reaction channels, total, elastic, inelastic, capture, and (n,2n). The nuclear reaction model code EMPIRE was used to calculate sensitivity to model parameters by perturbation of parameters that define the optical model potential, nuclear level densities and strength of the pre-equilibrium emission. The sensitivity analysis was performed with the set of parameters which reproduces the ENDF/B-VII.0 cross sections. The experimental data were analyzed and both statistical and systematic uncertainties were extracted from almost 30 selected experiments. Then, the Bayesian code KALMAN was used to combine the sensitivity analysis and the experiments to obtain the evaluated covariance matrices.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A Behavioral Robotics Approach to Radiation Mapping Using Adaptive Sampling

Radiation mapping is a desirable task to automate because of the inherent risks involved and its tedious nature. A novel system was designed to address this by combining various existing technologies, utilizing behavior-based robotics and Bayesian optimization. The system uses a quadruped robot equipped with a manipulator and gamma detector to take measurements at locations that are selected based on the uncertainty of a surrogate model used to estimate the true radiation field. The robot uses input from the world with depth cameras to avoid collisions with the robot’s body, and unreachable points for the end effector are addressed by both allowing for a soft collision with the environment to occur, prompting the system to abandon that point, and varying the exploration tendency of the optimization based on consecutive collisions. This approach provides unique traversability and adaptability over other strategies in the literature. Experiments were performed by placing a Cesium-137 source on the ground and varying geometric setups and an optimization parameter demonstrating the adaptability to diverse environments and the increased robustness resulting from the designed behavior. The results additionally demonstrate that dynamically adjusting the optimization algorithm’s exploration tendency based on the arm’s collision history improves the system’s ability to navigate cluttered environments and construct accurate radiation maps without getting stuck in unreachable areas.

Adams, Joel↗

High-Dimensional Bayesian Optimization via Semi-Supervised Learning with Optimized Unlabeled Data Sampling

We introduce a novel semi-supervised learning approach, named Teacher-Student Bayesian Optimization (TSBO ), integrating the teacher-student paradigm into BO to minimize expensive labeled data queries for the first time. TSBO incorporates a teacher model, an unlabeled data sampler, and a student model. The student is trained on unlabeled data locations generated by the sampler, with pseudo labels predicted by the teacher. The interplay between these three components implements a unique selective regularization to the teacher in the form of student feedback. This scheme enables the teacher to predict high-quality pseudo labels, enhancing the generalization of the GP surrogate model in the search space. To fully exploit TSBO , we propose two optimized unlabeled data samplers to construct effective student feedback that well aligns with the objective of Bayesian optimization. Furthermore, we quantify and leverage the uncertainty of the teacher-student model for the provision of reliable feedback to the teacher in the presence of risky pseudo-label predictions. TSBO demonstrates significantly improved sample-efficiency in several global optimization tasks under tight labeled data budgets. The implementation is available at https://github.com/reminiscenty/TSBO-Official.

Yin, Yuxuan↗

Estimated {sup 55}Mn and {sup 90}Zr Cross Section Covariances in the Fast Neutron Energy Region

We completed estimates of neutron cross section covariances for {sup 55}Mn and {sup 90}Zr, from the keV energy range to 25 MeV, considering the most important reaction channels, total, elastic, inelastic, capture, and (n,2n). The nuclear reaction model code EMPIRE was used to calculate sensitivity to model parameters by a perturbation of parameters that define the optical model potential, nuclear level densities and strength of the pre-equilibrium emission. The sensitivity analysis was performed with the set of parameters which reproduces the ENDF/B-VII.0 cross sections. The experimental data were analyzed and both statistical and systematic uncertainties were extracted from almost 30 selected experiments. Then, the Bayesian code KALMAN was used to combine the sensitivity analysis and the experiments to obtain the evaluated covariance matrices.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A Variational Inference Approach to Inverse Problems with Gamma Hyperpriors

Hierarchical models with gamma hyperpriors provide a flexible, sparse-promoting framework to bridge L 1 and L 2 regularizations in Bayesian formulations to inverse problems. Despite the Bayesian motivation for these models, existing methodologies are limited to maximum a posteriori estimation. The potential to perform uncertainty quantification has not yet been realized. This paper introduces a variational iterative alternating scheme for hierarchical inverse problems with gamma hyperpriors. The proposed variational inference approach yields accurate reconstruction, provides meaningful uncertainty quantification, and is easy to implement. In addition, it lends itself naturally to conduct model selection for the choice of hyperparameters. Here, we illustrate the performance of our methodology in several computed examples, including a deconvolution problem and sparse identification of dynamical systems from time series data.

Bayesian shrinkage↗

Estimating methane emissions from biological and fossil‐fuel sources in the San Francisco Bay Area

Abstract We present the first sector‐specific analysis of methane (CH 4 ) emissions from the San Francisco Bay Area (SFBA) using CH 4 and volatile organic compound (VOC) measurements from six sites during September – December 2015. We apply a hierarchical Bayesian inversion to separate the biological from fossil‐fuel (natural gas and petroleum) sources using the measurements of CH 4 and selected VOCs, a source‐specific 1 km CH 4 emission model, and an atmospheric transport model. We estimate that SFBA CH 4 emissions are 166–289 Gg CH 4 /yr (at 95% confidence), 1.3–2.3 times higher than a recent inventory with much of the underestimation from landfill. Including the VOCs, 82 ± 27% of total posterior median CH 4 emissions are biological and 17 ± 3% fossil fuel, where landfill and natural gas dominate the biological and fossil‐fuel CH 4 of prior emissions, respectively.

Jeong, Seongeun↗

Quantum Chemistry-Informed Active Learning to Accelerate the Design and Discovery of Sustainable Energy Storage Materials

Here we employed Density Functional Theory (DFT) to compute oxidation potentials of 1,400 homobenzylic ether molecules to search for the ideal sustainable redoxmer design. The generated data were used to construct an active learning model based on Bayesian optimization (BO) that targets candidates with desired oxidation potentials utilizing only a minimal number of DFT calculations. The active learning model demonstrated not only significant efficiency improvement over the random selection approach but also robust capability in identifying desired candidates in an untested set of 112,000 homobenzylic ether molecules. Our findings highlight the efficacy of quantum chemistry-informed active learning to accelerate the discovery of materials with desired properties from a vast chemical space.

25 ENERGY STORAGE↗

Nuclear Data Adjustment for Nonlinear Applications in the OECD/NEA WPNCS SG14 Benchmark -- A Bayesian Inverse UQ-based Approach for Data Assimilation

The Organization for Economic Cooperation and Development (OECD) Working Party on Nuclear Criticality Safety (WPNCS) proposed a benchmark exercise to assess the performance of current nuclear data adjustment techniques applied to nonlinear applications and experiments with low correlation to applications. This work introduces Bayesian Inverse Uncertainty Quantification (IUQ) as a method for nuclear data adjustments in this benchmark, and compares IUQ to the more traditional methods of Generalized Linear Least Squares (GLLS) and Monte Carlo Bayes (MOCABA). Posterior predictions from IUQ showed agreement with GLLS and MOCABA for linear applications. When comparing GLLS, MOCABA, and IUQ posterior predictions to computed model responses using adjusted parameters, we observe that GLLS predictions fail to replicate computed response distributions for nonlinear applications, while MOCABA shows near agreement, and IUQ uses computed model responses directly. We also discuss observations on why experiments with low correlation to applications can be informative to nuclear data adjustments and identify some properties useful in selecting experiments for inclusion in nuclear data adjustment. Performance in this benchmark indicates potential for Bayesian IUQ in nuclear data adjustments.

FOS: Computer and information sciences↗

Nuclear Data Adjustment for Nonlinear Applications in the OECD/NEA WPNCS SG14 Benchmark—A Bayesian Inverse UQ-Based Approach for Data Assimilation

The Organisation for Economic Co-operation and Development Working Party on Nuclear Criticality Safety has proposed a benchmark exercise to assess the performance of current nuclear data adjustment techniques applied to nonlinear applications and experiments with low correlation to applications. This work introduces Bayesian inverse uncertainty quantification (IUQ) employing scientific machine learning surrogate models as a method for nuclear data adjustments in this benchmark, and compares IUQ to the more traditional methods of generalized linear least squares (GLLS) and Monte Carlo Bayes (MOCABA). Posterior predictions from IUQ showed agreement with GLLS and MOCABA for linear applications. Here, when comparing GLLS, MOCABA, and IUQ posterior predictions to computed model responses using adjusted parameters, we observe that the GLLS predictions failed to replicate the computed response distributions for nonlinear applications, while MOCABA showed near agreement, and IUQ used the computed model responses directly. We also discuss observations on why experiments with low correlation to applications can be informative to nuclear data adjustments and identify some properties useful in selecting experiments for inclusion in nuclear data adjustment. Performance in this benchmark indicates potential for Bayesian IUQ in nuclear data adjustments.

Bayesian calibration↗

Exploring the contamination of the DES-Y1 cluster sample with SPT-SZ selected clusters

ABSTRACT We perform a cross validation of the cluster catalogue selected by the red-sequence Matched-filter Probabilistic Percolation algorithm (redMaPPer) in Dark Energy Survey year 1 (DES-Y1) data by matching it with the Sunyaev–Zel’dovich effect (SZE) selected cluster catalogue from the South Pole Telescope SPT-SZ survey. Of the 1005 redMaPPer selected clusters with measured richness $\hat{\lambda }\gt 40$ in the joint footprint, 207 are confirmed by SPT-SZ. Using the mass information from the SZE signal, we calibrate the richness–mass relation using a Bayesian cluster population model. We find a mass trend λ ∝ MB consistent with a linear relation (B ∼ 1), no significant redshift evolution and an intrinsic scatter in richness of σλ = 0.22 ± 0.06. By considering two error models, we explore the impact of projection effects on the richness–mass modelling, confirming that such effects are not detectable at the current level of systematic uncertainties. At low richness SPT-SZ confirms fewer redMaPPer clusters than expected. We interpret this richness dependent deficit in confirmed systems as due to the increased presence at low richness of low-mass objects not correctly accounted for by our richness-mass scatter model, which we call contaminants. At a richness $\hat{\lambda }=40$, this population makes up ${\gt}12{{\ \rm per\ cent}}$ (97.5 percentile) of the total population. Extrapolating this to a measured richness $\hat{\lambda }=20$ yields ${\gt}22{{\ \rm per\ cent}}$ (97.5 percentile). With these contamination fractions, the predicted redMaPPer number counts in different plausible cosmologies are compatible with the measured abundance. The presence of such a population is also a plausible explanation for the different mass trends (B ∼ 0.75) obtained from mass calibration using purely optically selected clusters. The mean mass from stacked weak lensing (WL) measurements suggests that these low-mass contaminants are galaxy groups with masses ∼3–5 × 1013 M⊙ which are beyond the sensitivity of current SZE and X-ray surveys but a natural target for SPT-3G and eROSITA.

79 ASTRONOMY AND ASTROPHYSICS↗

WE-E-BRE-05: Ensemble of Graphical Models for Predicting Radiation Pneumontis Risk

Purpose: We propose a prior knowledge-based approach to construct an interaction graph of biological and dosimetric radiation pneumontis (RP) covariates for the purpose of developing a RP risk classifier. Methods: We recruited 59 NSCLC patients who received curative radiotherapy with minimum 6 month follow-up. 16 RP events was observed (CTCAE grade ≥2). Blood serum was collected from every patient before (pre-RT) and during RT (mid-RT). From each sample the concentration of the following five candidate biomarkers were taken as covariates: alpha-2-macroglobulin (α2M), angiotensin converting enzyme (ACE), transforming growth factor β (TGF-β), interleukin-6 (IL-6), and osteopontin (OPN). Dose-volumetric parameters were also included as covariates. The number of biological and dosimetric covariates was reduced by a variable selection scheme implemented by L1-regularized logistic regression (LASSO). Posterior probability distribution of interaction graphs between the selected variables was estimated from the data under the literature-based prior knowledge to weight more heavily the graphs that contain the expected associations. A graph ensemble was formed by averaging the most probable graphs weighted by their posterior, creating a Bayesian Network (BN)-based RP risk classifier. Results: The LASSO selected the following 7 RP covariates: (1) pre-RT concentration level of α2M, (2) α2M level mid- RT/pre-RT, (3) pre-RT IL6 level, (4) IL6 level mid-RT/pre-RT, (5) ACE mid-RT/pre-RT, (6) PTV volume, and (7) mean lung dose (MLD). The ensemble BN model achieved the maximum sensitivity/specificity of 81%/84% and outperformed univariate dosimetric predictors as shown by larger AUC values (0.78∼0.81) compared with MLD (0.61), V20 (0.65) and V30 (0.70). The ensembles obtained by incorporating the prior knowledge improved classification performance for the ensemble size 5∼50. Conclusion: We demonstrated a probabilistic ensemble method to detect robust associations between RP covariates and its potential to improve RP prediction accuracy. Our Bayesian approach to incorporate prior knowledge can enhance efficiency in searching of such associations from data. The authors acknowledge partial support by: 1) CREATE Medical Physics Research Training Network grant of the Natural Sciences and Engineering Research Council (Grant number: 432290) and 2) The Terry Fox Foundation Strategic Training Initiative for Excellence in Radiation Research for the 21st Century (EIRR21)

60 APPLIED LIFE SCIENCES↗

Bayesian model averaging for analysis of lattice field theory results

Statistical modeling is a key component in the extraction of physical results from lattice field theory calculations. Although the general models used are often strongly motivated by physics, many model variations can frequently be considered for the same lattice data. Model averaging, which amounts to a probability-weighted average over all model variations, can incorporate systematic errors associated with model choice without being overly conservative. We discuss the framework of model averaging from the perspective of Bayesian statistics, and give useful formulae and approximations for the particular case of least-squares fitting, commonly used in modeling lattice results. In addition, we frame the common problem of data subset selection (e.g. choice of minimum and maximum time separation for fitting a two-point correlation function) as a model selection problem and study model averaging as a straightforward alternative to manual selection of fit ranges. Numerical examples involving both mock and real lattice data are given.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Genetic Variability of West Nile Virus in U.S. Blood Donors from the 2012 Epidemic Season

West Nile virus (WNV) is an arbovirus maintained in nature in a bird-mosquito enzootic cycle which can also infect other vertebrates including humans. WNV is now endemic in the United States (U.S.), causing yearly outbreaks that have resulted in an estimated total of 4–5 million human infections. Over 41,700 cases of West Nile disease, including 18,810 neuroinvasive cases and 1,765 deaths, were reported to the CDC between 1999 and 2014. In 2012, the second largest West Nile outbreak in the U.S. was reported, which caused 5,674 cases and 286 deaths. WNV continues to evolve, and three major WNV lineage I genotypes (NY99, WN02, and SW/WN03) have been described in the U.S. since introduction of the virus in 1999. We report here the WNV sequences obtained from 19 human samples acquired during the 2012 U.S. outbreak and our examination of the evolutionary dynamics in WNV isolates sequenced from 1999–2012. Maximum-likelihood and Bayesian methods were used to perform the phylogenetic analyses. Selection pressure analyses were performed with the HyPhy package using the Datamonkey web-server. Using different codon-based and branch-site selection models, we detected a number of codons subjected to positive pressure in WNV genes. Thirteen of the 19 completely sequenced isolates from 10 U.S. states were genetically similar, sharing up to 55 nucleotide mutations and 4 amino acid substitutions when compared with the prototype isolate WN-NY99. Altogether, these analyses showed that following a brief contraction in 2008–2009, WNV genetic divergence in the U.S. continued to increase in 2012, and that closely related variants were found across a broad geographic range of the U.S., coincident with the second-largest WNV outbreak in U.S. history.

59 BASIC BIOLOGICAL SCIENCES↗

Detecting and Testing for Structural Error in Computer Models with Application to the Community Atmospheric Model

Bayesian calibration/inversion methods for uncertain input parameters to simulation codes have generated an increasing amount of interest in the climate community in the recent years. This approach uses multiple disparate observational datasets related to the output of the simulator of interest to yield a probabilistic constraint on the uncertain inputs (i.e. probability distribution). A major challenge in applying Bayesian calibration methods to simulation codes is related to the possible presence of a large structural error in the output fields of interest; that is, the presence of discrepancy between the observed and the simulated output that is neither explained by the uncertainty in the inputs nor the observations. We present here methods to test for and visualize structural error in an ensemble of input-perturbed simulations. The methods are based on bootstrap (resmpling) test statistics and well-known metrics to quantify the difference between two probability distributions. The proposed methods are demonstrated using selected precipitation output fields of the Community Atmospheric Model (CAM), which are compared to observations provided by the Global Precipitation Climatology Project (GPCP). The methods are found to be useful in identifying regions and seasons with a large structural error. The proposed structural error detection methodology can be used to screen multiple observational datasets of interest for structural error, making it possible to retain only the datasets with a small structural error for use in Bayesian calibration. In addition, information about the amount of structural error can be valuable to model developers.

58 GEOSCIENCES↗

CODEX weak lensing mass catalogue and implications on the mass–richness relation

The COnstrain Dark Energy with X-ray clusters (CODEX) sample contains the largest flux limited sample of X-ray clusters at 0.35 < z < 0.65. It was selected from ROSAT data in the 10 000 square degrees of overlap with BOSS, mapping a total number of 2770 high-z galaxy clusters. We present here the full results of the CFHT CODEX programme on cluster mass measurement, including a reanalysis of CFHTLS Wide data, with 25 individual lensing-constrained cluster masses. We employ lensfit shape measurement and perform a conservative colour–space selection and weighting of background galaxies. Using the combination of shape noise and an analytic covariance for intrinsic variations of cluster profiles at fixed mass due to large-scale structure, miscentring, and variations in concentration and ellipticity, we determine the likelihood of the observed shear signal as a function of true mass for each cluster. We combine 25 individual cluster mass likelihoods in a Bayesian hierarchical scheme with the inclusion of optical and X-ray selection functions to derive constraints on the slope α, normalization β, and scatter σln λ|μ of our richness–mass scaling relation model in log-space: ${\langle {\rm In}\,\, \lambda\!\!\mid\!\!\mu\rangle = \alpha\mu + \beta,} $ with μ = ln (M 200c /M piv ), and M piv = 10 14.81 M ⊙ . We find a slope $\alpha = 0.49^{+0.20}_{-0.15}$, normalization $\exp (\beta) = 84.0^{+9.2}_{-14.8}$, and $\sigma _{\ln \lambda | \mu } = 0.17^{+0.13}_{-0.09}$ using CFHT richness estimates. In comparison to other weak lensing richness–mass relations, we find the normalization of the richness statistically agreeing with the normalization of other scaling relations from a broad redshift range (0.0 < z < 0.65) and with different cluster selection (X-ray, Sunyaev–Zeldovich, and optical).

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

BOOTS: Bayesian Optimization for Optimal Test Selection

BOOTS is a package for optimal selection of candidate operating points in large-scale manufacturing applications. It is designed to optimally select operating points to maximize predicted values of product quality and resource efficiency according to a data-driven model. The package is based on the use of a multi-input multi-output (MIMO) Gaussian process model to describe the relationships between inputs (operating points) and outputs (product quality and resource efficiency). This package does not provide any site- or process-specific information.

Villez, Kris [Oak Ridge National Laboratory (ORNL)↗