Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model selection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Hyperspectral remote sensing of plant biochemistry using Bayesian model averaging with variable and band selection

Model specification remains challenging in spectroscopy of plant biochemistry, as exemplified by the availability of various spectral indices or band combinations for estimating the same biochemical. This lack of consensus in model choice across applications argues for a paradigm shift in hyperspectral methods to address model uncertainty and misspecification. We demonstrated one such method using Bayesian model averaging (BMA), which performs variable/band selection and quantifies the relative merits of many candidate models to synthesize a weighted average model with improved predictive performances. The utility of BMA was examined using a portfolio of 27 foliage spectral–chemical datasets representing over 80 species across the globe to estimate multiple biochemical properties, including nitrogen, hydrogen, carbon, cellulose, lignin, chlorophyll (a or b), carotenoid, polar and nonpolar extractives, leaf mass per area, and equivalent water thickness. We also compared BMA with partial least squares (PLS) and stepwise multiple regression (SMR). Results showed that all the biochemicals except carotenoid were accurately estimated from hyerspectral data with R2 values > 0.80.

Zhao, Kaiguang↗

Adaptive selection and validation of models of complex systems in the presence of uncertainty

This study describes versions of OPAL, the Occam-Plausibility Algorithm in which the use of Bayesian model plausibilities is replaced with information theoretic methods, such as the Akaike Information Criterion and the Bayes Information Criterion. Applications to complex systems of coarse-grained molecular models approximating atomistic models of polyethylene materials are described. All of these model selection methods take into account uncertainties in the model, the observational data, the model parameters, and the predicted quantities of interest. A comparison of the models chosen by Bayesian model selection criteria and those chosen by the information-theoretic criteria is given.

97 MATHEMATICS AND COMPUTING↗

A Parameter Subset Selection Algorithm for Mixed-Effects Models

Mixed-effects models are commonly used to statistically model phenomena that include attributes associated with a population or general underlying mechanism as well as effects specific to individuals or components of the general mechanism. This can include individual effects associated with data from multiple experiments. However, the parameterizations used to incorporate the population and individual effects are often unidentifiable in the sense that parameters are not uniquely specified by the data. As a result, the current literature focuses on model selection, by which insensitive parameters are fixed or removed from the model. Model selection methods that employ information criteria are applicable to both linear and nonlinear mixed-effects models, but such techniques are limited in that they are computationally prohibitive for large problems due to the number of possible models that must be tested. To limit the scope of possible models for model selection via information criteria, we introduce a parameter subset selection (PSS) algorithm for mixed-effects models, which orders the parameters by their significance. In conclusion, we provide examples to verify the effectiveness of the PSS algorithm and to test the performance of mixed-effects model selection that makes use of parameter subset selection.

97 MATHEMATICS AND COMPUTING↗

FY2021 Status Report on the Computing Systems for the Yucca Mountain Project TSPA-LA Models and Testing of Selected Process Models

Sandia National Laboratories continued evaluation of the total system performance assessment (TSPA) for License Application (LA) computing systems for the previously considered Yucca Mountain Project (YMP). This was done to maintain the operational readiness of the computing infrastructure (computer hardware and software) and knowledge capability for total system performance assessment) type analysis, as directed by the National Nuclear Security Administration (NNSA), DOE 2010. The FY21 task included continued operation of the cluster; maintenance of the TSPA-LA models (with GoldSim 9.60.300); continued assessment of the status of the Infiltration Model; (a process model that feeds the TSP -LA) and preliminary assessments of the Unsaturated Zone Flow Model and the Saturated Zone Flow and Transport Model Abstraction (process models that feed the TSPA-LA). The 2014 cluster and supporting software systems are currently fully operational to support TSPA-LA type analyses.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Probing Selected Morphological Models of Hydrated Nafion Using Large-Scale Molecular Dynamics Simulations

Atomistic molecular dynamics simulations were performed to study hydrated Nafion systems large enough (approximately 2 million atoms, approximately 30 nm box length) to directly observe several hydrophilic domains at the molecular level. These systems consisted of six of the most significant and relevant morphological models of Nafion to-date: (1) the cluster-channel model, (2) the parallel cylinder model, (3) the local order model, (4) the lamellar model, (5) the rod network model, and (6) a "random" model that does not directly assume any particular geometry, distribution, or morphology. Each system was initially built to closely approximate the proposed hydrophilic cluster structure in a given model. Molecular dynamics simulations were then used to observe resulting changes from and behavior of the assumed initial configurations. These simulations revealed fast intercluster "bridge" formation and network percolation in all models. Sulfonate groups were found inside these bridges and played a significant role in percolation. Sulfonates also strongly aggregated around and inside clusters. Cluster surfaces were analyzed to study the hydrophilic-hydrophobic interface. Interfacial area and cluster volume significantly increased during the simulations, and radial distribution functions and structure factors were also calculated. All nonrandom models clearly exhibited the characteristic experimental scattering peak, underscoring the insensitivity of this measurement to hydrophilic domain structure and highlighting the need for future work to clearly distinguish morphological models of Nafion.

Knox, Craig K.↗

Regression Model Term Selection for the Analysis of Strain-Gage Balance Calibration Data

The paper discusses the selection of regression model terms for the analysis of wind tunnel strain-gage balance calibration data. Different function class combinations are presented that may be used to analyze calibration data using either a non-iterative or an iterative method. The role of the intercept term in a regression model of calibration data is reviewed. In addition, useful algorithms and metrics originating from linear algebra and statistics are recommended that will help an analyst (i) to identify and avoid both linear and near-linear dependencies between regression model terms and (ii) to make sure that the selected regression model of the calibration data uses only statistically significant terms. Three different tests are suggested that may be used to objectively assess the predictive capability of the final regression model of the calibration data. These tests use both the original data points and regression model independent confirmation points. Finally, data from a simplified manual calibration of the Ames MK40 balance is used to illustrate the application of some of the metrics and tests to a realistic calibration data set.

Ulbrich, Norbert Manfred↗

High Strain-Rate Strength Experiments on Molybdenum for Constitutive Model Parameter Selection

The constitutive model parameters for molybdenum obtained from the Plansee supplier have been constrained via Strength-Stabilized Rayleigh-Taylor experiments performed at the Los Alamos Neutron Science Center. Previous Hopkinson-bar measurements have produced a degenerate family of constitutive model parameters proven in the low strain rate regime. The experiments presented here provide a constraint at strain rates from 10 4 –10 6 s -1 which is used to select a preferred set of parameters for high strain-rate applications. Further analysis is warranted including determining a global fit in parameter space using all available high and low strain-rate data available.

36 MATERIALS SCIENCE↗

FY19 Status Report on the Computing Systems for the Yucca Mountain Project TSPA-LA Models and Preliminary Testing of a Selected Process Model

Sandia National Laboratories continued evaluation of total system performance assessment (TSPA) computing systems for the previously considered Yucca Mountain Project. This was done to maintain the operational readiness of the computing infrastructure (computer hardware and software) and knowledge capability for total system performance assessment) type analysis, as directed by the National Nuclear Security Administration (NNSA), DOE 2010. The FY19 task included continued operation of the cluster; maintenance of the TSPA-LA models (with Gold Sim 9.60.300); preliminary assessment of the status of the Infiltration Model (a process model that feeds the TSPA-LA). In addition, precautionary actions were needed to extend the life of the cluster hardware. To do that, three new nodes were added to the cluster. In the event any of the original nodes fail they will be replaced with the new nodes, thereby maintaining the core capability. The 2014 cluster and supporting software systems are currently fully operational to support TSPA-LA type analysis.

97 MATHEMATICS AND COMPUTING↗

Behavior of the maximum likelihood in quantum state tomography

Quantum state tomography on a d-dimensional system demands resources that grow rapidly with d. They may be reduced by using model selection to tailor the number of parameters in the model (i.e., the size of the density matrix). Most model selection methods typically rely on a test statistic and a null theory that describes its behavior when two models are equally good. Here, we consider the loglikelihood ratio. Because of the positivity constraint ρ ≥ 0, quantum state space does not generally satisfy local asymptotic normality (LAN), meaning the classical null theory for the loglikelihood ratio (the Wilks theorem) should not be used. Thus, understanding and quantifying how positivity affects the null behavior of this test statistic is necessary for its use in model selection for state tomography. We define a new generalization of LAN, metric-projected LAN, show that quantum state space satisfies it, and derive a replacement for the Wilks theorem. In addition to enabling reliable model selection, our results shed more light on the qualitative effects of the positivity constraint on state tomography.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Phase Transitions and a Model Order Selection Criterion for Spectral Graph Clustering

One of the longstanding open problems in spectral graph clustering (SGC) is the so-called model order selection problem: automated selection of the correct number of clusters. This is equivalent to the problem of finding the number of connected components or communities in an undirected graph. Here, we propose automated model order selection (AMOS), a solution to the SGC model selection problem under a random interconnection model (RIM) using a novel selection criterion that is based on an asymptotic phase transition analysis. AMOS can more generally be applied to discovering hidden block diagonal structure in symmetric non-negative matrices. Numerical experiments on simulated graphs validate the phase transition analysis, and real-world network data is used to validate the performance of the proposed model selection procedure.

97 MATHEMATICS AND COMPUTING↗

A Rapid Approach to Modeling Species-Habitat Relationships

A growing number of species require conservation or management efforts. Success of these activities requires knowledge of the species' occurrence pattern. Species-habitat models developed from GIS data sources are commonly used to predict species occurrence but commonly used data sources are often developed for purposes other than predicting species occurrence and are of inappropriate scale and the techniques used to extract predictor variables are often time consuming and cannot be repeated easily and thus cannot efficiently reflect changing conditions. We used digital orthophotographs and a grid cell classification scheme to develop an efficient technique to extract predictor variables. We combined our classification scheme with a priori hypothesis development using expert knowledge and a previously published habitat suitability index and used an objective model selection procedure to choose candidate models. We were able to classify a large area (57,000 ha) in a fraction of the time that would be required to map vegetation and were able to test models at varying scales using a windowing process. Interpretation of the selected models confirmed existing knowledge of factors important to Florida scrub-jay habitat occupancy. The potential uses and advantages of using a grid cell classification scheme in conjunction with expert knowledge or an habitat suitability index (HSI) and an objective model selection procedure are discussed.

Carter, Geoffrey M.↗

Selective Oxidation of Acetaldehyde to Acetic Acid on Pd–Au Bimetallic Model Catalysts

Acetic acid is a widely employed reactant in the chemical industry, and it is also used as a food ingredient. Here, we report a catalytic reaction pathway for the gas-phase selective oxidation of acetaldehyde to acetic acid on a Pd–Au(111) heterogeneous model catalyst. On an oxygen precovered Pd–Au surface, acetaldehyde is selectively oxidized to acetic acid from 250 to 340 K. Using FT-IR, the formation of acetate species is detected from 160 to 260 K on this surface, which is a widely known adsorbate derived from acetic acid on metal surfaces. With higher Pd coverages, the acetaldehyde is less selectively oxidized to acetic acid, and near 375 K, CO 2 , H 2 O, CH 4 , and H 2 are evolved, evidence for the decarboxylation of acetate. Finally, in our density functional theory calculations, we confirm that the relative energy difference between the acetate state and the decarboxylated state decreases as Pd ensemble size increases.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Multiple model inference.

This paper compares three approaches for model selection: classical least squares methods, information theoretic criteria, and Bayesian approaches. Least squares methods are not model selection methods although one can select the model that yields the smallest sum-of-squared error function. Information theoretic approaches balance overfitting with model accuracy by incorporating terms that penalize more parameters with a log-likelihood term to reflect goodness of fit. Bayesian model selection involves calculating the posterior probability that each model is correct, given experimental data and prior probabilities that each model is correct. As part of this calculation, one often calibrates the parameters of each model and this is included in the Bayesian calculations. Our approach is demonstrated on a structural dynamics example with models for energy dissipation and peak force across a bolted joint. The three approaches are compared and the influence of the log-likelihood term in all approaches is discussed.

99 GENERAL AND MISCELLANEOUS↗

Evaluation of a Traditional Regression Model Term Selection Process for Balance Calibration Data Sets

Key elements of a traditional regression model term selection process for the analysis of wind tunnel strain-gage balance calibration data are discussed. The traditional process is sometimes applied when regression models of the gage outputs are needed and an analyst does not have access to a term selection algorithm. In principle, the traditional process identifies supported regression model terms of a gage output by combining an analyst's subject- matter knowledge with a visual examination of selected plots of the calibration loads. Twelve empirical rules are listed that may be used to select regression model terms. Data from the manual calibration of a force balance is used to illustrate the application of the traditional term selection process. The data example shows that the traditional process can become very complex. Its successful application highly depends on an analyst's experience and skills. Therefore, it is suggested to replace the traditional term selection process with an automated term selection algorithm. Then, objective metrics are systematically applied during the term selection that make the identification of the regression model more repeatable and less dependent on an analyst's personal skills.

strain-gage balance↗

Microbiome-enabled genomic selection improves prediction accuracy for nitrogen-related traits in maize

Root-associated microbiomes in the rhizosphere (rhizobiomes) are increasingly known to play an important role in nutrient acquisition, stress tolerance, and disease resistance of plants. However, it remains largely unclear to what extent these rhizobiomes contribute to trait variation for different genotypes and if their inclusion in the genomic selection protocol can enhance prediction accuracy. To address these questions, we developed a microbiome-enabled genomic selection method that incorporated host SNPs and amplicon sequence variants from plant rhizobiomes in a maize diversity panel under high and low nitrogen (N) field conditions. Our cross-validation results showed that the microbiome-enabled genomic selection model significantly outperformed the conventional genomic selection model for nearly all time-series traits related to plant growth and N responses, with an average relative improvement of 3.7%. The improvement was more pronounced under low N conditions (8.4–40.2% of relative improvement), consistent with the view that some beneficial microbes can enhance N nutrient uptake, particularly in low N fields. However, our study could not definitively rule out the possibility that the observed improvement is partially due to the amplicon sequence variants being influenced by microenvironments. Using a high-dimensional mediation analysis method, our study has also identified microbial mediators that establish a link between plant genotype and phenotype. Some of the detected mediator microbes were previously reported to promote plant growth. The enhanced prediction accuracy of the microbiome-enabled genomic selection models, demonstrated in a single environment, serves as a proof-of-concept for the potential application of microbiome-enabled plant breeding for sustainable agriculture.

60 APPLIED LIFE SCIENCES↗

Automatic Selection of High-Fidelity Models and Surrogates for Uncertainty Analysis

Surrogate models (SMs) with distinct features developed in the last decade provide an efficient substitute to the high-fidelity physical simulations. However, it is generally challenging to quantify the accuracy of surrogate models in a region of interest and examine reliability in the overall domain without additional system evaluations. This paper introduces a new scheme, automated adaptive model selection, to adaptively construct and quantify a set of surrogate models and automatically switch between the surrogates and a high-fidelity code. Cross-validation approaches, such as KFold, Leave One Out (LOO) and Leave P Out (LPO), are employed to assess the global accuracy of the surrogates. The switching strategy is based on local validation metrics, crowding distance, that are able to provide an assessment on the goodness of the prediction made by the surrogates. This decision metric decides whether the surrogates are good enough for a certain realization or whether the high-fidelity code needs to be executed. This new scheme has been implemented in Risk Analysis in Virtual ENvironment (RAVEN) software, which can be employed to accelerate the Probabilistic Risk Assessment (PRA) and Uncertainty Quantification (UQ) processes.

97 MATHEMATICS AND COMPUTING↗