Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model selection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

On spatial mutation-selection models

We discuss the selection procedure in the framework of mutation models. We study the regulation for stochastically developing systems based on a transformation of the initial Markov process which includes a cost functional. The transformation of initial Markov process by cost functional has an analytic realization in terms of a Kimura-Maruyama type equation for the time evolution of states or in terms of the corresponding Feynman-Kac formula on the path space. The state evolution of the system including the limiting behavior is studied for two types of mutation-selection models.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Making Steppingstones out of Stumbling Blocks: A Bayesian Model Evidence Estimator with Application to Groundwater Transport Model Selection

Bayesian model evidence (BME) is a measure of the average fit of a model to observation data given all the parameter values that the model can assume. By accounting for the trade-off between goodness-of-fit and model complexity, BME is used for model selection and model averaging purposes. For strict Bayesian computation, the theoretically unbiased Monte Carlo based numerical estimators are preferred over semi-analytical solutions. This study examines five BME numerical estimators and asks how accurate estimation of the BME is important for penalizing model complexity. The limiting cases for numerical BME estimators are the prior sampling arithmetic mean estimator (AM) and the posterior sampling harmonic mean (HM) estimator, which are straightforward to implement, yet they result in underestimation and overestimation, respectively. We also consider the path sampling methods of thermodynamic integration (TI) and steppingstone sampling (SS) that sample multiple intermediate distributions that link the prior and the posterior. Although TI and SS are theoretically unbiased estimators, they could have a bias in practice arising from numerical implementation. For example, sampling errors of some intermediate distributions can introduce bias. We propose a variant of SS, namely the multiple one-steppingstone sampling (MOSS) that is less sensitive to sampling errors. We evaluate these five estimators using a groundwater transport model selection problem. SS and MOSS give the least biased BME estimation at an efficient computational cost. If the estimated BME has a bias that covariates with the true BME, this would not be a problem because we are interested in BME ratios and not their absolute values. On the contrary, the results show that BME estimation bias can be a function of model complexity. Thus, biased BME estimation results in inaccurate penalization of more complex models, which changes the model ranking. This was less observed with SS and MOSS as with the three other methods.

54 ENVIRONMENTAL SCIENCES↗

Radiation Anomaly Detection and Classification with Bayes Model Selection

We present a new method for radiation anomaly detection that is based on Bayes Model Selection (BMS), together with models for gamma-radiation measurements from benign and threat sources. The method estimates the relative odds of pairs of such models, with the aim of supporting related hypotheses about the nature of the underlying source material. We also discuss partial optimization of the parameters in the models. The method allows measurements to be broadly categorized and screened for sources of interest in real time, a property that should improve the efficiency of mobile search or unattended monitoring operations.

Anomaly detection, Gamma-ray spectroscopy, Radiati↗

Application of Bayesian Model Selection for Metal Yield Models using ALEGRA and Dakota

This report introduces the concepts of Bayesian model selection, which provides a systematic means of calibrating and selecting an optimal model to represent a phenomenon. This has many potential applications, including for comparing constitutive models. The ideas described herein are applied to a model selection problem between different yield models for hardened steel under extreme loading conditions.

97 MATHEMATICS AND COMPUTING↗

LASSO for CALPHAD Model Selection Enables Data-Efficient Thermodynamic Modeling: An Application in Thermochemical Hydrogen Production Materials

Phenomenological CALPHAD (CALculation of PHAse Diagrams) models, widely used for multicomponent materials, often contain a considerable number of parameters and require fitting using data from a relatively small number of experimental measurements or theoretical calculations. Sometimes these parameters are introduced for the purpose of improving model fits but without clear physical justification, which leads to overparametrized models with poor generalization performance. Automated approaches for optimal model selection based on the available data therefore become critical. Here, in this work, a least absolute shrinkage and selection operator (LASSO)-based approach is developed for model selection by leveraging the linearity of the CALPHAD model with respect to its parameters to convert the model selection and fitting to a LASSO minimization problem. We demonstrate its utility for thermodynamic modeling of thermochemical hydrogen (TCH) production materials using lanthanum strontium manganite (LSM) as an example. Various TCH-relevant properties, including oxygen stoichiometry as a function of oxygen partial pressure, enthalpy of reduction, and entropy of reduction, are successfully predicted with reasonable accuracy using a minimal set of model parameters. Importantly, the model selection and fitting involve minimal human decision; it can therefore be applied to high-throughput DFT defect calculations and yield efficient workflows for TCH material modeling and optimization.

CALPHAD↗

Model selection and parameter estimation in tumor growth models using approximate Bayesian computation-ABC

Cancer is one of the most fatal diseases in the world. Governments and researchers from various areas have continuously concentrated efforts to better understand the disease and propose diagnostic and treatment techniques. The use of mathematical models of tumor growth is of great importance for the development of such techniques. Due to the variety of models nowadays available in the literature, the problems of model selection and parameter estimation come into picture, aiming at suitably predicting the patient’s status of the disease. As the available data on dependent variables of existing models might not justify the use of common likelihood functions, approximate Bayesian computation (ABC) becomes a very attractive tool for model selection and model calibration (parameter estimation) in tumor growth models. In the present study, a Monte Carlo approximate Bayesian computation (ABC) algorithm is applied to select among competing models of tumor growth, with and without chemotherapy treatment. Simulated measurements are used in this work. The results obtained show that the algorithm correctly selects the model and estimates the parameters used to generate the simulated measurements.

60 APPLIED LIFE SCIENCES↗

CMIP5 model selection for ISMIP6 ice sheet model forcing: Greenland and Antarctica

Abstract. The ice sheet model intercomparison project for CMIP6 (ISMIP6) effort brings together the ice sheet and climate modeling communities to gain understanding of the ice sheet contribution to sea level rise. ISMIP6 conducts stand-alone ice sheet experiments that use space- and time-varying forcing derived from atmosphere–ocean coupled global climate models (AOGCMs) to reflect plausible trajectories for climate projections. The goal of this study is to recommend a subset of CMIP5 AOGCMs (three core and three targeted) to produce forcing for ISMIP6 stand-alone ice sheet simulations, based on (i) their representation of current climate near Antarctica and Greenland relative to observations and (ii) their ability to sample a diversity of projected atmosphere and ocean changes over the 21st century. The selection is performed separately for Greenland and Antarctica. Model evaluation over the historical period focuses on variables used to generate ice sheet forcing. For stage (i), we combine metrics of atmosphere and surface ocean state (annual- and seasonal-mean variables over large spatial domains) with metrics of time-mean subsurface ocean temperature biases averaged over sectors of the continental shelf. For stage (ii), we maximize the diversity of climate projections among the best-performing models. Model selection is also constrained by technical limitations, such as availability of required data from RCP2.6 and RCP8.5 projections. The selected top three CMIP5 climate models are CCSM4, MIROC-ESM-CHEM, and NorESM1-M for Antarctica and HadGEM2-ES, MIROC5, and NorESM1-M for Greenland. This model selection was designed specifically for ISMIP6 but can be adapted for other applications.

54 ENVIRONMENTAL SCIENCES↗

Constraints on primordial isocurvature perturbations and spatial curvature by Bayesian model selection

We present posterior likelihoods and Bayesian model selection analysis for generalized cosmological models where the primordial perturbations include correlated adiabatic and cold dark matter isocurvature components. We perform nested sampling with flat and, for the first time, curved spatial geometries of the Universe, using data from the CMB anisotropies, the Union supernovae (SN) sample, and a combined measurement of the integrated Sachs-Wolfe effect. The CMB alone favors a 3% (positively correlated) isocurvature contribution in both the flat and curved cases. The nonadiabatic contribution to the observed CMB temperature variance is 0<{alpha}{sub T}<7% at 98% C.L. in the curved case. In the flat case, combining the CMB with SN data artificially biases the result towards the pure adiabatic {lambda}CDM concordance model, whereas in the curved case the favored level of nonadiabaticity stays at the 3% level with all combinations of data. However, the ratio of Bayes factors, or {delta}ln (evidence), is more than 5 points in favor of the flat adiabatic {lambda}CDM model, which suggests that the inclusion of the 5 extra parameters of the curved isocurvature model is not supported by the current data. The results are very sensitive to the second and third acoustic peak regions in the CMB temperature angular power: therefore a careful calibration of these data will be required before drawing decisive conclusions on the nature of primordial perturbations. Finally, we point out that the odds for the flat nonadiabatic model are 1:3 compared to the curved adiabatic model. This may suggest that it is not much less motivated to extend the concordance model with 4 isocurvature degrees of freedom than it is to study the spatially curved adiabatic model, though at the moment the model selection disfavors both of these models.

99 GENERAL AND MISCELLANEOUS↗

Model Selection for Monitoring CO2 Plume during Sequestration

The model selection method developed as part of this project mainly includes four steps: (1) assessing the connectivity/dynamic characteristics of a large prior ensemble of models, (2) model clustering using multidimensional scaling coupled with k-mean clustering, (3) model selection using the Bayes' rule in the reduced model space, (4) model expansion using iterative resampling of the posterior models. The fourth step expresses one of the advantages of the method: it provides a built-in means of quantifying the uncertainty in predictions made with the selected models. In our application to plume monitoring, by expanding the posterior space of models, the final ensemble of representations of geological model can be used to assess the uncertainty in predicting the future displacement of the CO2 plume. The software implementation of this approach is attached here.

Source record↗

Bayesian Model Selection as a Continuous-Variable Helmholtz Machine

We show that Bayesian model selection is equivalent to optimization of a suitably defined free energy. The entropy term in the free energy is defined over the space of possible model selections and model parameters for a given model. Bayesian model selection thus follows a minimum description length principle.

97 MATHEMATICS AND COMPUTING↗