Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian model selection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Nonlinear sparse Bayesian learning for physics-based models

This paper addresses the issue of overfitting while calibrating unknown parameters of over-parameterized physics-based models with noisy and incomplete observations. Here, a semi-analytical Bayesian framework of nonlinear sparse Bayesian learning (NSBL) is proposed to identify sparsity among model parameters during Bayesian inversion. NSBL offers significant advantages over machine learning algorithm of sparse Bayesian learning (SBL) for physics-based models, such as 1) the likelihood function or the posterior parameter distribution is not required to be Gaussian, and 2) prior parameter knowledge is incorporated into sparse learning (i.e. not all parameters are treated as questionable). NSBL employs the concept of automatic relevance determination (ARD) to facilitate sparsity among questionable parameters through parameterized prior distributions. The analytical tractability of NSBL is enabled by employing Gaussian ARD priors and by building a Gaussian mixture-model approximation of the posterior parameter distribution that excludes the contribution of ARD priors. Subsequently, type-II maximum likelihood is executed using Newton's method whereby the evidence and its gradient and Hessian information are computed in a semi-analytical fashion. We show numerically and analytically that SBL is a special case of NSBL for linear regression models. Subsequently, a linear regression example involving multimodality in both parameter posterior pdf and model evidence is considered to demonstrate the performance of NSBL in cases where SBL is inapplicable. Next, NSBL is applied to identify sparsity among the damping coefficients of a mass-spring-damper model of a shear building frame. These numerical studies demonstrate the robustness and efficiency of NSBL in alleviating overfitting during Bayesian inversion of nonlinear physics-based models.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

The Knotted Sky I: Planck constraints on the primordial power spectrum

Using the temperature data from Planck we search for departures from a power-law primordial power spectrum, employing Bayesian model-selection and posterior probabilities. We parametrize the spectrum with n knots located at arbitrary values of logk, with both linear and cubic splines. This formulation recovers both slow modulations and sharp transitions in the primordial spectrum. The power spectrum is well-fit by a featureless, power-law at wavenumbers k>10{sup -3} Mpc{sup -1}. A modulated primordial spectrum yields a better fit relative to ΛCDM at large scales, but there is no strong evidence for a departure from a power-law spectrum. Moreover, using simulated maps we show that a local feature at k ∼ 10{sup -3} Mpc{sup -1} can mimic the suppression of large-scale power. With multi-knot spectra we see only small changes in the posterior distributions for the other free parameters in the standard ΛCDM universe. Lastly, we investigate whether the hemispherical power asymmetry is explained by independent features in the primordial power spectrum in each ecliptic hemisphere, but find no significant differences between them.

79 ASTRONOMY AND ASTROPHYSICS↗

Prospects for distinguishing dark matter models using annual modulation

It has recently been demonstrated that, in the event of a putative signal in dark matter direct detection experiments, properly identifying the underlying dark matter-nuclei interaction promises to be a challenging task. Given the most optimistic expectations for the number counts of recoil events in the forthcoming Generation 2 experiments, differentiating between interactions that produce distinct features in the recoil energy spectra will only be possible if a strong signal is observed simultaneously on a variety of complementary targets. However, there is a wide range of viable theories that give rise to virtually identical energy spectra, and may only differ by the dependence of the recoil rate on the dark matter velocity. In this work, we investigate how degeneracy between such competing models may be broken by analyzing the time dependence of nuclear recoils, i.e. the annual modulation of the rate. For this purpose, we simulate dark matter events for a variety of interactions and experiments, and perform a Bayesian model-selection analysis on all simulated data sets, evaluating the chance of correctly identifying the input model for a given experimental setup. Lastly, we find that including information on the annual modulation of the rate may significantly enhance the ability of a single target to distinguish dark matter models with nearly degenerate recoil spectra, but only with exposures beyond the expectations of Generation 2 experiments.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Producing a BOSS CMASS sample with DES imaging

We present a sample of galaxies with the Dark Energy Survey (DES) photometry that replicates the properties of the BOSS CMASS sample. The CMASS galaxy sample has been well characterized by the Sloan Digital Sky Survey (SDSS) collaboration and was used to obtain the most powerful redshift-space galaxy clustering measurements to date. A joint analysis of redshift-space distortions (such as those probed by CMASS from SDSS) and a galaxy-galaxy lensing measurement for an equivalent sample from DES can provide powerful cosmological constraints. Unfortunately, the DES and SDSS-BOSS footprints have only minimal overlap, primarily on the celestial equator near the SDSS Stripe 82 region. Using this overlap, we build a robust Bayesian model to select CMASS-like galaxies in the remainder of the DES footprint. The newly defined DES-CMASS (DMASS) sample consists of 117,293 effective galaxies covering $1,244 {\rm deg}^2$. Through various validation tests, we show that the DMASS sample selected by this model matches well with the BOSS CMASS sample, specifically in the South Galactic cap (SGC) region that includes Stripe 82. Combining measurements of the angular correlation function and the clustering-z distribution of DMASS, we constrain the difference in mean galaxy bias and mean redshift between the BOSS CMASS and DMASS samples to be $\Delta b = 0.010^{+0.045}_{-0.052}$ and $\Delta z = \left( 3.46^{+5.48}_{-5.55} \right) \times 10^{-3}$ for the SGC portion of CMASS, and $\Delta b = 0.044^{+0.044}_{-0.043} $ and $\Delta z= ( 3.51^{+4.93}_{-5.91}) \times 10^{-3}$ for the full CMASS sample. These values indicate that the mean bias of galaxies and mean redshift in the DMASS sample is consistent with both CMASS samples within $1\sigma$.

79 ASTRONOMY AND ASTROPHYSICS↗

Hyperspectral remote sensing of plant biochemistry using Bayesian model averaging with variable and band selection

Model specification remains challenging in spectroscopy of plant biochemistry, as exemplified by the availability of various spectral indices or band combinations for estimating the same biochemical. This lack of consensus in model choice across applications argues for a paradigm shift in hyperspectral methods to address model uncertainty and misspecification. We demonstrated one such method using Bayesian model averaging (BMA), which performs variable/band selection and quantifies the relative merits of many candidate models to synthesize a weighted average model with improved predictive performances. The utility of BMA was examined using a portfolio of 27 foliage spectral–chemical datasets representing over 80 species across the globe to estimate multiple biochemical properties, including nitrogen, hydrogen, carbon, cellulose, lignin, chlorophyll (a or b), carotenoid, polar and nonpolar extractives, leaf mass per area, and equivalent water thickness. We also compared BMA with partial least squares (PLS) and stepwise multiple regression (SMR). Results showed that all the biochemicals except carotenoid were accurately estimated from hyerspectral data with R2 values > 0.80.

Zhao, Kaiguang↗

Exact and efficient hybrid Monte Carlo algorithm for accelerated Bayesian inference of gene expression models from snapshots of single-cell transcripts

Single cells exhibit a significant amount of variability in transcript levels, which arises from slow, stochastic transitions between gene expression states. Elucidating the nature of these states and understanding how transition rates are affected by different regulatory mechanisms require state-of-the-art methods to infer underlying models of gene expression from single cell data. A Bayesian approach to statistical inference is the most suitable method for model selection and uncertainty quantification of kinetic parameters using small data sets. However, this approach is impractical because current algorithms are too slow to handle typical models of gene expression. To solve this problem, we first show that time-dependent mRNA distributions of discrete-state models of gene expression are dynamic Poisson mixtures, whose mixing kernels are characterized by a piecewise deterministic Markov process. Here, we combined this analytical result with a kinetic Monte Carlo algorithm to create a hybrid numerical method that accelerates the calculation of time-dependent mRNA distributions by 1000-fold compared to current methods. We then integrated the hybrid algorithm into an existing Monte Carlo sampler to estimate the Bayesian posterior distribution of many different, competing models in a reasonable amount of time. We demonstrate that kinetic parameters can be reasonably constrained for modestly sampled data sets if the model is known a priori. If there are many competing models, Bayesian evidence can rigorously quantify the likelihood of a model relative to other models from the data. We demonstrate that Bayesian evidence selects the true model and outperforms approximate metrics typically used for model selection.

59 BASIC BIOLOGICAL SCIENCES↗

Quantifying shifts in natural selection on codon usage between protein regions: a population genetics approach

Codon usage bias (CUB), the non-uniform usage of synonymous codons, occurs across all domains of life. Adaptive CUB is hypothesized to result from various selective pressures, including selection for efficient ribosome elongation, accurate translation, mRNA secondary structure, and/or protein folding. Given the critical link between protein folding and protein function, numerous studies have analyzed the relationship between codon usage and protein structure. The results from these studies have often been contradictory, likely reflecting the differing methods used for measuring codon usage and the failure to appropriately control for confounding factors, such as differences in amino acid usage between protein structures and changes in the frequency of different structures with gene expression. Here we take an explicit population genetics approach to quantify codon-specific shifts in natural selection related to protein structure in S. cerevisiae and E. coli. Unlike other metrics of codon usage, our approach explicitly separates the effects of natural selection, scaled by gene expression, and mutation bias while naturally accounting for a region’s amino acid usage. Bayesian model comparisons suggest selection on codon usage varies only slightly between helix, sheet, and coil secondary structures and, similarly, between structured and intrinsically-disordered regions. Similarly, in contrast to previous findings, we find selection on codon usage only varies slightly at the termini of helices in E. coli. Using simulated data, we show this previous work indicating “non-optimal” codons are enriched at the beginning of helices in S. cerevisiae was due to failure to control for various confounding factors (e.g. amino acid biases, gene expression, etc.), and rather than selection to modulate cotranslational folding. Our results reveal a weak relationship between codon usage and protein structure, indicating that differences in selection on codon usage between structures are slight. In addition to the magnitude of differences in selection between protein structures being slight, the observed shifts appear to be idiosyncratic and largely codon-specific rather than systematic reversals in the nature of selection. Overall, our work demonstrates the statistical power and benefits of studying selective shifts on codon usage or other genomic features from an explicitly evolutionary approach. Limitations of this approach and future potential research avenues are discussed.

59 BASIC BIOLOGICAL SCIENCES↗

Galaxies in X-ray selected clusters and groups in Dark Energy Survey data – II. Hierarchical Bayesian modelling of the red-sequence galaxy luminosity function

Using ~100 X-ray selected clusters in the Dark Energy Survey Science Verification data, in this work we constrain the luminosity function (LF) of cluster red-sequence galaxies as a function of redshift. This is the first homogeneous optical/X-ray sample large enough to constrain the evolution of the LF simultaneously in redshift (0.1 < z < 1.05) and cluster mass ($13.5 \le \rm {log_{10}}(M_{200crit}) \sim \lt 15.0$). We pay particular attention to completeness issues and the detection limit of the galaxy sample. We then apply a hierarchical Bayesian model to fit the cluster galaxy LFs via a Schechter function, including its characteristic break (m*) to a faint end power-law slope (α). Our approach allows us to avoid known issues in similar analyses based on stacking or binning the clusters. We find weak and statistically insignificant (~1.9σ) evolution in the faint end slope α versus redshift. We also find no dependence in α or m* with the X-ray inferred cluster masses. Yet, the amplitude of the LF as a function of cluster mass is constrained to ${\sim } 20{{\ \rm per\ cent}}$ precision. As a by-product of our algorithm, we utilize the correlation between the LF and cluster mass to provide an improved estimate of the individual cluster masses as well as the scatter in true mass given the X-ray inferred masses. This technique can be applied to a larger sample of X-ray or optically selected clusters from the Dark Energy Survey, greatly improving the sensitivity of the analysis.

79 ASTRONOMY AND ASTROPHYSICS↗

Towards a fully automated algorithm driven platform for biosystems design

Large-scale data acquisition and analysis are often required in the successful implementation of the design, build, test, and learn (DBTL) cycle in biosystems design. However, it has long been hindered by experimental cost, variability, biases, and missed insights from traditional analysis methods. Here, we report the application of an integrated robotic system coupled with machine learning algorithms to fully automate the DBTL process for biosystems design. As proof of concept, we have demonstrated its capacity by optimizing the lycopene biosynthetic pathway. This fully-automated robotic platform, BioAutomata, evaluates less than 1% of possible variants while outperforming random screening by 77%. A paired predictive model and Bayesian algorithm select experiments which are performed by Illinois Biological Foundry for Advanced Biomanufacturing (iBioFAB). BioAutomata excels with black-box optimization problems, where experiments are expensive and noisy and the success of the experiment is not dependent on extensive prior knowledge of biological mechanisms.

59 BASIC BIOLOGICAL SCIENCES↗

Bayesian Analysis of Peak Ground Acceleration Attenuation Relationship

Estimation of peak ground acceleration is one of the main issues in civil and earthquake engineering practice. The Boore-Joyner-Fumal empirical formula is well known for this purpose. In this paper we propose to use the Bayesian probabilistic model class selection approach to obtain the most suitable prediction model class for the seismic attenuation formula. The optimal model class is robust in the sense that it has balance between the data fitting capability and the sensitivity to noise. A database of strong-motion records is utilized for the analysis. It turns out that the optimal model class is simpler than the full order attenuation model suggested by Boore, Joyner and Fumal (1993).

58 GEOSCIENCES↗

Cosmic acceleration from modified gravity with Palatini formalism

We study new FRW type cosmological models of modified gravity treated on the background of Palatini approach. These models are generalization of Einstein gravity by the presence of a scalar field non-minimally coupled to the curvature. The models employ Starobinsky's term in the Lagrangian and dust matter. Therefore, as a by-product, an exhausted cosmological analysis of general relativity amended by quadratic term is presented. We investigate dynamics of our models, confront them with the currently available astrophysical data as well as against ΛCDM model. We have used the dynamical system methods in order to investigate dynamics of the models. It reveals the presence of a final sudden singularity. Fitting free parameters we have demonstrated by statistical analysis that this class of models is in a very good agreement with the data (including CMB measurements) as well as with the standard ΛCDM model predictions. One has to use statefinder diagnostic in order to discriminate among them. Therefore Bayesian methods of model selection have been employed in order to indicate preferred model. Only in the light of CMB data the concordance model remains invincible.

79 ASTRONOMY AND ASTROPHYSICS↗

Impact of Statistical Learning Methods on the Predictive Power of Multivariate Normal Tissue Complication Probability Models

Purpose: To study the impact of different statistical learning methods on the prediction performance of multivariate normal tissue complication probability (NTCP) models. Methods and Materials: In this study, three learning methods, stepwise selection, least absolute shrinkage and selection operator (LASSO), and Bayesian model averaging (BMA), were used to build NTCP models of xerostomia following radiotherapy treatment for head and neck cancer. Performance of each learning method was evaluated by a repeated cross-validation scheme in order to obtain a fair comparison among methods. Results: It was found that the LASSO and BMA methods produced models with significantly better predictive power than that of the stepwise selection method. Furthermore, the LASSO method yields an easily interpretable model as the stepwise method does, in contrast to the less intuitive BMA method. Conclusions: The commonly used stepwise selection method, which is simple to execute, may be insufficient for NTCP modeling. The LASSO method is recommended.

62 RADIOLOGY AND NUCLEAR MEDICINE↗