Search NASASearch

SEARCH · Search NASA

Results for “model selection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

LASSO for CALPHAD Model Selection Enables Data-Efficient Thermodynamic Modeling: An Application in Thermochemical Hydrogen Production Materials

Phenomenological CALPHAD (CALculation of PHAse Diagrams) models, widely used for multicomponent materials, often contain a considerable number of parameters and require fitting using data from a relatively small number of experimental measurements or theoretical calculations. Sometimes these parameters are introduced for the purpose of improving model fits but without clear physical justification, which leads to overparametrized models with poor generalization performance. Automated approaches for optimal model selection based on the available data therefore become critical. Here, in this work, a least absolute shrinkage and selection operator (LASSO)-based approach is developed for model selection by leveraging the linearity of the CALPHAD model with respect to its parameters to convert the model selection and fitting to a LASSO minimization problem. We demonstrate its utility for thermodynamic modeling of thermochemical hydrogen (TCH) production materials using lanthanum strontium manganite (LSM) as an example. Various TCH-relevant properties, including oxygen stoichiometry as a function of oxygen partial pressure, enthalpy of reduction, and entropy of reduction, are successfully predicted with reasonable accuracy using a minimal set of model parameters. Importantly, the model selection and fitting involve minimal human decision; it can therefore be applied to high-throughput DFT defect calculations and yield efficient workflows for TCH material modeling and optimization.

CALPHAD

'Chain pooling' model selection as developed for the statistical analysis of a rotor burst protection experiment

A statistical decision procedure called chain pooling had been developed for model selection in fitting the results of a two-level fixed-effects full or fractional factorial experiment not having replication. The basic strategy included the use of one nominal level of significance for a preliminary test and a second nominal level of significance for the final test. The subject has been reexamined from the point of view of using as many as three successive statistical model deletion procedures in fitting the results of a single experiment. The investigation consisted of random number studies intended to simulate the results of a proposed aircraft turbine-engine rotor-burst-protection experiment. As a conservative approach, population model coefficients were chosen to represent a saturated 2 to the 4th power experiment with a distribution of parameter values unfavorable to the decision procedures. Three model selection strategies were developed.

Holms, A. G.

'Chain pooling' model selection for two-level fixed effects factorial experiments

As many as three iterated statistical model deletion procedures are considered for an experiment. Population model coefficients were chosen to simulate a saturated factorial experiment having an unfavorable distribution of parameter values. Using random number studies, three model selection strategies were developed, namely, (1) a strategy to be used in anticipation of large coefficients of variation (neighborhood of 65 percent), (2) strategy to be used in anticipation of small coefficients of variation (4 percent or less), and (3) a security regret strategy to be used in the absence of such prior knowledge.

Holms, A. G.

Chain Pooling modeling selection as developed for the statistical analysis of a rotor burst protection experiment

As many as three iterated statistical model deletion procedures were considered for an experiment. Population model coefficients were chosen to simulate a saturated 2 to the 4th power experiment having an unfavorable distribution of parameter values. Using random number studies, three model selection strategies were developed, namely, (1) a strategy to be used in anticipation of large coefficients of variation, approximately 65 percent, (2) a strategy to be sued in anticipation of small coefficients of variation, 4 percent or less, and (3) a security regret strategy to be used in the absence of such prior knowledge.

Holms, A. G.

Machine-learning interatomic potentials for interfaces in all-solid-state batteries: Perspectives on training data, model selection, and validation

Interfaces play a pivotal role in dictating the performance and reliability of all-solid-state batteries (ASSBs), where complex electro-chemo-mechanical phenomena at grain boundaries (GBs) and interfaces can lead to degradation and failure. Traditional atomistic simulation methods, such as first-principles calculations and classical molecular dynamics, face limitations in modeling these interfaces due to either high computational cost or insufficient transferability to the diverse atomic environments evolving at interfaces. Machine-learning interatomic potentials (MLIPs) have emerged as a transformative approach, enabling large-scale, high-accuracy simulations of disordered and chemically complex systems by leveraging the predictability of machine learning models trained on first-principles data. Recent applications of MLIPs have demonstrated their ability to capture intricate behaviors at ASSB interfaces, including ion transport, interfacial evolution, and degradation mechanisms, with accuracy and efficiency unattainable by conventional methods. This prospective paper presents comprehensive analysis and practical guidance for MLIP development for GBs and interfaces in ASSBs, with a focus on three key pillars: data generation, model selection, and validation. Here, we review the current state of MLIP applications for GBs and interfaces in both general and ASSB-specific materials, highlighting best practices and challenges in constructing diverse and representative datasets, choosing appropriate machine learning architectures, and rigorously validating model performance. We also discuss emerging strategies and opportunities for improved reliability and efficiency of MLIPs to simulate realistic interfaces in ASSBs.

Energy - Storage

Modeling Selective Availability of the NAVSTAR Global Positioning System

As the development of the NAVSTAR Global Positioning System (GPS) continues, there will increasingly be the need for a software centered signal model. This model must accurately generate the observed pseudorange which would typically be encountered. The observed pseudorange varies from the true geometric (slant) range due to range measurement errors. Errors in range measurement stem from a variety of hardware and environment factors. These errors are classified as either deterministic or random and, where appropriate, their models are summarized. Of particular interest is the model for Selective Availability which is derived from actual GPS data. The procedure for the determination of this model, known as the System Identification Theory, is briefly outlined. The synthesis of these error sources into the final signal model is given along with simulation results.

Braasch, Michael

Development of a research project selection model: Application to a civil helicopter research program

A model is described for planning and decision making in research project selection. Evaluations of each project's direct and indirect benefits, uncertainty in achieving these benefits, and schedule priority with resource budget and program balance constraints are considered. The combination of the interactive effect of project selection, resource allocation and scheduling considerations into one model permits tradeoff alternatives to be studied. Clients' value judgments are used in evaluating the benefits from each proposed project. The model is applied to the NASA Civil Helicopter Technology Program. Research project priorities for this program are established, strengths and weaknesses of the model are discussed, and areas of future development are recommended.

Schoultz, M. B.

Diagnosing Hybrid Systems: a Bayesian Model Selection Approach

In this paper we examine the problem of monitoring and diagnosing noisy complex dynamical systems that are modeled as hybrid systems-models of continuous behavior, interleaved by discrete transitions. In particular, we examine continuous systems with embedded supervisory controllers that experience abrupt, partial or full failure of component devices. Building on our previous work in this area (MBCG99;MBCG00), our specific focus in this paper ins on the mathematical formulation of the hybrid monitoring and diagnosis task as a Bayesian model tracking algorithm. The nonlinear dynamics of many hybrid systems present challenges to probabilistic tracking. Further, probabilistic tracking of a system for the purposes of diagnosis is problematic because the models of the system corresponding to failure modes are numerous and generally very unlikely. To focus tracking on these unlikely models and to reduce the number of potential models under consideration, we exploit logic-based techniques for qualitative model-based diagnosis to conjecture a limited initial set of consistent candidate models. In this paper we discuss alternative tracking techniques that are relevant to different classes of hybrid systems, focusing specifically on a method for tracking multiple models of nonlinear behavior simultaneously using factored sampling and conditional density propagation. To illustrate and motivate the approach described in this paper we examine the problem of monitoring and diganosing NASA's Sprint AERCam, a small spherical robotic camera unit with 12 thrusters that enable both linear and rotational motion.

McIlraith, Sheila A.

Effect of model selection on combustor performance and stability using ROCCID

The ROCket Combustor Interactive Design (ROCCID) methodology is an interactive computer program that combines previously developed combustion analysis models to calculate the combustion performance and stability of liquid rocket engines. Test data from a 213 kN (48,000 lbf) Liquid Oxygen (LOX)/RP-1 combustor with a O-F-O (oxidizer-fuel-oxidizer) triplet injector were used to characterize the predictive capabilities of the ROCCID analysis models for this injector/propellant configuration. Thirteen combustion performance and stability models have been incorporated into ROCCID, and ten of them, which have options for triplet injectors, were examined in this study. Calculations using different combinations of analysis models, with little or no anchoring, were carried out on a test matrix of operating conditions matching those of the test program. Results of the computer analyses were compared to test data, and the ability of the model combinations to correctly predict combustion stability or instability was determined. For the best model combination(s), sensitivity of the calculations to fuel drop size and mixing efficiency was examined. Error in the stability calculations due to uncertainty in the pressure interaction index (N) was examined. The recommended model combinations for this O-F-O triplet LOX/RP-1 configuration are proposed.

Giuliani, James E.

Effect of model selection on combustor performance and stability predictions using ROCCID

The ROCket Combustor Interactive Design (ROCCID) methodology is an interactive computer program that combines previously developed combustion analysis models to calculate the combustion performance and stability of liquid rocket engines. Test data from 213 kN (48,000 lbf) Liquid Oxygen (LOX)/RP-1 combustor with an O-F-O (oxidizer-fuel-oxidizer) triplet injector were used to characterize the predictive capabilities of the ROCCID analysis models for this injector/propellant configuration. Thirteen combustion performance and stability models were incorporated into ROCCID, and ten of them, which have options for triplet injectors, were examined. Calculations using different combinations of analysis models, with little or no anchoring, were carried out on a test matrix of operating combinations matching those of the test program. Results of the computer analyses were compared to test data, and the ability of the model combinations to correctly predict combustion stability or instability was determined. For the best model combination(s), sensitivity of the calculations to fuel drop size and mixing efficiency was examined. Error in the stability calculations due to uncertainty in the pressure interaction index (N) was examined. The recommended model combinations for this O-F-O triplet LOX/RP-1 configuration are proposed.

Giuliani, James E.

Influence of World and Gravity Model Selection on Surface Interacting Vehicle Simulations

A vehicle simulation is surface-interacting if the state of the vehicle (position, velocity, and acceleration) relative to the surface is important. Surface-interacting simulations perform ascent, entry, descent, landing, surface travel, or atmospheric flight. Modeling of gravity is an influential environmental factor for surface-interacting simulations. Gravity is the free-fall acceleration observed from a world-fixed frame that rotates with the world. Thus, gravity is the sum of gravitation and the centrifugal acceleration due to the world s rotation. In surface-interacting simulations, the fidelity of gravity at heights above the surface is more significant than gravity fidelity at locations in inertial space. A surface-interacting simulation cannot treat the gravity model separately from the world model, which simulates the motion and shape of the world. The world model's simulation of the world's rotation, or lack thereof, produces the centrifugal acceleration component of gravity. The world model s reproduction of the world's shape will produce different positions relative to the world center for a given height above the surface. These differences produce variations in the gravitation component of gravity. This paper examines the actual performance of world and gravity/gravitation pairs in a simulation using the Earth.

Madden, Michael M.

Effects of turbulence model selection on the prediction of complex aerodynamic flows

Numerical simulations of viscous transonic flow over a circular-arc airfoil and in a diffuser are described. The simulations are made with a new computer program designed to serve as a tool in the development of improved turbulence models for complex flows. The program incorporates zero-, one-, and two-equation eddy viscosity models and includes a variety of subsonic and supersonic boundary conditions. The airfoil flow contains a shock-separated boundary-layer interaction that has resisted previous attempts at simulation. The diffuser flow also contains a shock-boundary-layer interaction, which has not been simulated previously. Calculations using standard turbulence models, developed originally for incompressible unseparated flows, are described. Results indicate that although there are interesting differences in predictions between the various models, none of them predict the flows accurately. Suggestions for improved turbulence models are discussed.

Coakley, T. J.

Boosting Noise2Inverse via enhanced model selection for denoising computed tomography data

Synchrotron-based x-ray tomographic imaging enables the examination of the internal structure of materials at high spatial and temporal resolution. Experimental constraints can impose dose and time limits on the measurements, introducing a higher level of noise and artifacts in the reconstructed images. Deep learning has emerged as a powerful tool to remove noise from reconstructed images. Recently, the Noise2Inverse method was designed specifically for denoising reconstructed images without requiring paired noisy and clean images. This method creates multiple statistically independent reconstructions used to pair the data in which training involves transforming one reconstruction into the other, and vice versa. Originally designed to be used after a fixed number of epochs, we see in practice that this approach may not produce the optimal model and may unnecessarily waste computational resources. Therefore, we propose an alternative method of identifying the best model during training that aligns with the Noise2Inverse method. During validation, we compare the model output of the multiple reconstructions among each other. We hypothesize that the best model is the one that produces images with the highest similarity, implying a convergence in the predicted material properties and absorption values. To compare model outputs, we consider the absolute error, square error, structural similarity index (SSIM), peak signal-to-noise ratio (PSNR), and cosine similarity. We evaluate our method on two simulated tomography datasets and two, real-world, low-contrast, high-energy x-ray tomography datasets. We show our approach is more effective at determining the best model, up to an increase of 12.50% and 12.53% in SSIM and PSNR, respectively, while only requiring a fifth of the training time compared to the original approach.

CT