SEARCH · Search NASA

Results for “model selection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

All sources NASA NTRS DOE OSTI

NASA NTRS2010

TEAMS Model Analyzer

The TEAMS model analyzer is a supporting tool developed to work with models created with TEAMS (Testability, Engineering, and Maintenance System), which was developed by QSI. In an effort to reduce the time spent in the manual process that each TEAMS modeler must perform in the preparation of reporting for model reviews, a new tool has been developed as an aid to models developed in TEAMS. The software allows for the viewing, reporting, and checking of TEAMS models that are checked into the TEAMS model database. The software allows the user to selectively model in a hierarchical tree outline view that displays the components, failure modes, and ports. The reporting features allow the user to quickly gather statistics about the model, and generate an input/output report pertaining to all of the components. Rules can be automatically validated against the model, with a report generated containing resulting inconsistencies. In addition to reducing manual effort, this software also provides an automated process framework for the Verification and Validation (V&V) effort that will follow development of these models. The aid of such an automated tool would have a significant impact on the V&V process.

Tijidjian, Raffi P.↗

DOE OSTI2025

CFD Simulations of Lower Plenum Mixing

Review of model development and validation performed in the Advanced Reactor Technologies (ART) program for thermal mixing at the outlet of High Temperature Gas Reactors (HTGRs). Understanding the mixing that occurs in the lower plenum in an HTGR is necessary to facilitate design improvements and to perform reactor safety analysis. Numerical models are one possible approach to gain a better understanding of mixing in the lower plenum. Given the complexity of the geometry and the intense mixing present, it is important to perform validation of numerical models. Three models have been developed during FY2025: a porous media with Pronghorn, a Reynolds Averaged Navier Stokes (RANS) with STAR-CCM+, and a Large Eddy Simulation (LES) with NekRS. The reference facility is a scaled-down version of the lower plenum of the High Temperature Gas-Cooled Reactor - Pebble-bed Module (HTR-PM) demonstration reactor. Preliminary results of the porous media and the RANS shows general good agreement against experimental benchmark data. Future work will leverage high-fidelity results obtained through LES to guide model selection and improvements to the lower-fidelity models, with particular attention to the Pronghorn porous media.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

NASA NTRS2003

Sensitivity of the Assimilated Ozone in the UTLS to Model and Data Selection Changes

This presentation will discuss the sensitivity of assimilated ozone fields in the upper troposphere and lower stratosphere (UTLS) to a number of factors, focusing mainly on aspects of data selection and the prediction model. This is important, because assimilation represents an attempt to construct our best estimates of the true ozone field; however, inaccuracies in the UTLS ozone distribution translate into an uncertainty in factors such as the calculated radiative forcing of climate or the inferred stratosphere-troposphere exchange (STE) of ozone. The 3D ozone data assimilation system, from NASA's Global Modeling and Assimilation Office (GMAO), combines observations of total ozone column and stratospheric profiles with predictions from an off-line, parameterized chemistry and transport model (pCTM) to produce six-hourly, global analyses. The first experiments discussed assimilate ozone retrievals from the Earth-Probe Total Ozone Mapping Spectrometer (EPTOMS) and stratospheric profiles from the Solar Backscatter UltraViolet/2 (SBUV/2) instrument. The SBUV/2 ozone data have a coarse vertical resolution, with increased uncertainty below the ozone maximum, and TOMS provides only total ozone columns. Thus, the assimilated ozone profiles in the UTLS region are only weakly constrained by the incoming SBUV and TOMS data. Consequently, the assimilated ozone distribution should be sensitive to changes in inputs to the statistical analysis scheme. Sensitivity studies have been conducted to examine the responses to TOMS and SBUV/2 data selection, modifications of the forecast and observation error covariance models, and the model formulation (turning off chemistry or using different wind analyses in the pCTM). The second set of experiments includes an additional data type: ozone retrieved from infrared limb-emission by MIPAS on Envisat. These data offer not only improved vertical resolution in the stratosphere, but also give measurements in the polar night. Comparisons of the assimilated ozone fields from both sets of experiments with independent observations, primarily ozone sondes, are used to determine the impact of each of these changes. It is shown that many of the changes have a significant impact on the UTLS ozone estimates. Implications for interpretation of STE and radiative forcing of climate are discussed.

Pawson, Steven↗

DOE OSTI2025

Full-sky Models of Galactic Microwave Emission and Polarization at Subarcminute Scales for the Python Sky Model

Polarized foreground emission from the Galaxy is one of the biggest challenges facing current and upcoming cosmic microwave background (CMB) polarization experiments. We develop new models of polarized Galactic dust and synchrotron emission at CMB frequencies that draw on the latest observational constraints; that employ the “polarization fraction tensor” framework to couple intensity and polarization in a physically motivated way; and that allow for stochastic realizations of small-scale structure at subarcminute angular scales currently unconstrained by full-sky data. We implement these models into the publicly available Python Sky Model (PySM) software and additionally provide PySM interfaces to select models of dust and CO emission from the literature. We characterize the behavior of each model by quantitatively comparing it to observational constraints in both maps and power spectra, demonstrating an overall improvement over previous PySM models. Finally, we synthesize models of the various Galactic foreground components into a coherent suite of three plausible microwave skies that span a range of astrophysical complexity allowed by current data. Author contributions to this paper can be found at the end of this work.

Group, The Pan-Experiment Galactic Science↗

NASA NTRS1982

Computational modeling of multispectral remote sensing systems: Background investigations

A computational model of the deterministic and stochastic process of remote sensing has been developed based upon the results of the investigations presented. The model is used in studying concepts for improving worldwide environment and resource monitoring. A review of various atmospheric radiative transfer models is presented as well as details of the selected model. Functional forms for spectral diffuse reflectance with variability introduced are also presented. A cloud detection algorithm and the stochastic nature of remote sensing data with its implications are considered.

Aherron, R. M.↗

NASA NTRS2003

Project trades model for complex space missions

A Project Trades Model (PTM) is a collection of tools/simulations linked together to rapidly perform integrated system trade studies of performance, cost, risk, and mission effectiveness. An operating PTM captures the interactions between various targeted systems and subsystems through an exchange of computed variables of the constituent models. Selection and implementation of the order, method of interaction, model type, and envisioned operation of the ensemble of tools rpresents the key system engineering challenge of the approach. This paper describes an approach to building a PTM and using it to perform top-level system trades for a complex space mission. In particular, the PTM discussed here is for a future Mars mission involving a large rover.

web services↗

DOE OSTI2024

Predictive analytics of selections of russet potatoes

We explore the application of machine learning algorithms specifically to enhance the selection process of Russet potato (Solanum tuberosum L.) clones in breeding trials by predicting their suitability for advancement. This study addresses the challenge of efficiently identifying high-yield, disease-resistant, and climate-resilient potato varieties that meet processing industry standards. Leveraging manually collected data from trials in the state of Oregon, we investigate the potential of a wide variety of state-of-the-art binary classification models. The dataset includes 1086 clones, with data on 38 attributes recorded for each clone, focusing on yield, size, appearance, and frying characteristics, with several control varieties planted consistently across four Oregon regions from 2013 to 2021. We conduct a comprehensive analysis of the dataset that includes preprocessing, feature engineering, and imputation to address missing values. We focus on several key metrics such as accuracy, F1-score, and Matthews correlation coefficient (MCC) for model evaluation. The top-performing models, namely a feedforward neural network classifier (Neural Net), a histogram-based gradient boosting classifier (HGBC), and a support vector machine classifier (SVM), demonstrate consistent and significant results. To further validate our findings, we conducted a simulation study using the aims, data-generating mechanisms, estimands, methods, and performance measures (ADEMP) framework, simulating different data-generating scenarios to assess model robustness and performance through true positive, true negative, false positive, and false negative distributions, area under the receiver operating characteristic curve (AUC-ROC) and MCC. The simulation results highlight that non-linear models like SVM and HGBC consistently show higher AUC-ROC and MCC than logistic regression, thus outperforming the traditional linear model across various distributions, and emphasizing the importance of model selection and tuning in agricultural trials. Variable selection further enhances model performance and identifies influential features in predicting trial outcomes. The findings emphasize the potential of machine learning in streamlining the selection process for potato varieties, offering benefits such as increased efficiency, substantial cost savings, and judicious resource utilization. Our study contributes insights into precision agriculture and showcases the relevance of advanced technologies for informed decision-making in breeding programs.

60 APPLIED LIFE SCIENCES↗

NASA NTRS2013

Parameter Estimation for Compact Binary Coalescence Signals with the First Generation Gravitational-Wave Detector Network

Compact binary systems with neutron stars or black holes are one of the most promising sources for ground-based gravitational-wave detectors. Gravitational radiation encodes rich information about source physics; thus parameter estimation and model selection are crucial analysis steps for any detection candidate events. Detailed models of the anticipated waveforms enable inference on several parameters, such as component masses, spins, sky location and distance, that are essential for new astrophysical studies of these sources. However, accurate measurements of these parameters and discrimination of models describing the underlying physics are complicated by artifacts in the data, uncertainties in the waveform models and in the calibration of the detectors. Here we report such measurements on a selection of simulated signals added either in hardware or software to the data collected by the two LIGO instruments and the Virgo detector during their most recent joint science run, including a blind injection where the signal was not initially revealed to the collaboration. We exemplify the ability to extract information about the source physics on signals that cover the neutron-star and black-hole binary parameter space over the component mass range 1M25M and the full range of spin parameters. The cases reported in this study provide a snapshot of the status of parameter estimation in preparation for the operation of advanced detectors.

Aasi, J.↗

DOE OSTI2026

Physics vs structure: A systematic benchmark of learning strategies for multi-zone building thermal dynamics

Recent advances in physics-informed and data-driven machine learning promise improved thermal models for advanced building control, yet there is limited quantitative evidence on when added physics structure and architectural complexity are beneficial. Here, this work presents a systematic benchmark of five representative system identification methods for modeling multi-zone building thermal dynamics: linear state-space models, multi-layer perceptrons, neural state-space models, neural ordinary differential equations, and physically-consistent neural networks. The methods are evaluated across multiple data regimes and zone coupling strategies. Using a high-fidelity multi-zone commercial building emulator, we examine short-term and long-term prediction accuracy, computational efficiency, and ease of development. Our results reveal critical trade-offs between prediction performance, model complexity, and physical consistency. We demonstrate that decoupled, nonlinear black-box models consistently outperform coupled physics-constrained architectures in both predictive accuracy and out-of-distribution robustness in majority of the test cases for the building type considered in the study. Our findings quantify the cost of complexity in building thermal modeling and provide concrete, actionable, scenario-based guidelines for selecting model classes for control-oriented applications.

Building thermal modeling↗

DOE OSTI2026

Multi‐Model Ensembles in Ecosystem Modeling: Challenges and Best Practices for Decision‐Making

Ecosystem models are increasingly central to the decision-making for environmental policy, conservation planning, and climate-related investments. Yet, the growing reliance on Multi-Model Ensembles (MMEs) of ecosystem models by practitioners and policymakers, sometimes under tight timelines and imperfect information, has frequently outpaced the scientific rigor required to ensure ensemble reliability. Here, MMEs refer to approaches that combine targeted predictions from multiple models with the expectation of improving robustness and quantifying predictive uncertainty. Poorly designed MMEs may create a false sense of confidence and lead to suboptimal policy and market decisions. This perspective argues that robust decision-making-relevant MMEs must be grounded on two pillars: (1) rigorous Model Intercomparison Projects (MIPs), which identify inter-model agreement and disagreement, characterize model uncertainties, and evaluate robustness with observationally based benchmarks—MIPs' diagnostic evaluation is so critical that it must be needed to drive MME's decision in model selection and weighting, especially when only a limited number of models available; and (2) co-design by both stakeholders and scientists to ensure that scenarios, metrics and uncertainty requirements provide decision-relevant information. Building upon the past success and lessons from the existing MIPs-MMEs efforts (e.g., climate/Earth system/crop), we derived the theoretical basis for MMEs, addressed their specific challenges in ecosystem modeling, and highlighted proper consideration of model numbers and diversity, risk of model inter-dependence, effective calibration of model parameters, possible overdue of some ecosystem model development, critical roles of open benchmark data across a wide range of conditions, and suggested use of Artificial Intelligence to support MIPs-MMEs. We highlighted the under-recognized opportunity for MIPs and MMEs to drive scientific progress and innovation through identifying better performing models, systematic benchmarking, feedback loops, and targeted model improvement. By following actionable best practice guidelines, MMEs can evolve from ad hoc aggregation of models into a trusted backbone of environmental policy and decision-making.

ecosystem modeling↗

DOE OSTI2024

Human limits in machine learning: prediction of potato yield and disease using soil microbiome data

Abstract Background The preservation of soil health is a critical challenge in the 21st century due to its significant impact on agriculture, human health, and biodiversity. We provide one of the first comprehensive investigations into the predictive potential of machine learning models for understanding the connections between soil and biological phenotypes. We investigate an integrative framework performing accurate machine learning-based prediction of plant performance from biological, chemical, and physical properties of the soil via two models: random forest and Bayesian neural network. Results Prediction improves when we add environmental features, such as soil properties and microbial density, along with microbiome data. Different preprocessing strategies show that human decisions significantly impact predictive performance. We show that the naive total sum scaling normalization that is commonly used in microbiome research is one of the optimal strategies to maximize predictive power. Also, we find that accurately defined labels are more important than normalization, taxonomic level, or model characteristics. ML performance is limited when humans can’t classify samples accurately. Lastly, we provide domain scientists via a full model selection decision tree to identify the human choices that optimize model prediction power. Conclusions Our study highlights the importance of incorporating diverse environmental features and careful data preprocessing in enhancing the predictive power of machine learning models for soil and biological phenotype connections. This approach can significantly contribute to advancing agricultural practices and soil health management.

Aghdam, Rosa↗

NASA NTRS1981

Calculation of atmospheric loss from microwave radiometric noise temperature measurements

Microwave propagation loss in the atmosphere can be inferred from microwave radiometric noise temperature measurements. The relevant equations are given and a derivation and calculation is made assuming various physical models. Comparison is made with the commonly used lumped element atmospheric model (isothermal and uniform loss) and the model with linear temperature and exponential loss distributions. The results are useful for estimating the integral inversion differences due to the model selection. This indicates that the commonly used lumped element atmospheric model is a very good approximation with judicious choice of the effective physical temperature. For the worst case comparison, the lumped element model agrees with the variable parameter model within 0.2 dB up to a propagation loss of 3 dB.

Stelzried, C.↗

NASA NTRS1986

Implementation of and Ada real-time executive: A case study

Current Ada language implementations and runtime environments are immature, unproven and are a key risk area for real-time embedded computer system (ECS). A test-case environment is provided in which the concerns of the real-time, ECS community are addressed. A priority driven executive is selected to be implemented in the Ada programming language. The model selected is representative of real-time executives tailored for embedded systems used missile, spacecraft, and avionics applications. An Ada-based design methodology is utilized, and two designs are considered. The first of these designs requires the use of vendor supplied runtime and tasking support. An alternative high-level design is also considered for an implementation requiring no vendor supplied runtime or tasking support. The former approach is carried through to implementation.

Laird, James D.↗

NASA NTRS1985

Selection of a model of Earth's albedo radiation, practical calculation of its effect on the trajectory of a satellite

Theoretical models of Earth's albedo radiation was proposed. By comparing disturbing accelerations computed from a model to those measured in flight with the CACTUS Accelerometer, modified according to the results. Computation of the satellite orbit perturbations from a model is very long because for each position of this satellite the fluxes coming from each elementary surface of the terrestrial portion visible from the satellite must be summed. The speed of computation is increased ten times without significant loss of accuracy thanks to a stocking of some intermediate results. Now it is possible to confront the orbit perturbations computed from the selected model with the measurements of these perturbations found with satellite as LAGEOS.

Walch, J. J.↗

NASA NTRS2018

Regional Replay: A Unique Reanalysis-Based Tool for Addressing Model Error

Understanding and correcting errors in general circulation and climate models has long been part intuition and part trial and error. Efforts to diagnose the errors and provide some guidance to developers have been of some value, though such efforts, with few exceptions, have been more successful in identifying and documenting the errors in the model simulations rather than the model deficiencies that produced them. Modern atmospheric reanalyses such as MERRA-2 provide much-improved estimates of our climate system at hourly to interannual and longer time scales and have become an important tool for assessing model performance. Here we use MERRA-2 to address biases in the NASA/GMAO GEOS model by employing a "regional replay" approach developed in the GMAO. The regional replay approach constrains the model to remain close to the reanalysis over arbitrary regions and selected model variables, thus allowing us to examine how model error generated over one area is spatially translated across the globe. Several examples are given including an assessment of the global impact of errors produced over the Tibet region.

Tibet Region↗

NASA NTRS1997

RL10A-3-3A Rocket Engine Modeling Project

Two RL10A-3-3A rocket engines comprise the main propulsion system for the Centaur upper stage vehicle. Centaur is used with bod Titan and Atlas launch vehicles, carrying military and civilian payloads from high altitudes into orbit and beyond. The RL10 has delivered highly reliable service for the past 30 years. Recently, however, there have been two in-flight failures which have refocused attention on the RL10. This heightened interest has sparked a desire for an independent RL10 modeling capability within NASA and th Air Force. Pratt & Whitney, which presently has the most detailed model of the RL10, also sees merit in having an independent model which could be used as a cross-check with their own simulations. The Space Propulsion Technology Division (SPTD) at the NASA Lewis Research Center has developed a computer model of the RL10A-3-3A. A project team was formed, consisting of experts in the areas of turbomachinery, combustion, and heat transfer. The overall goal of the project was to provide a model of the entire RL10 rocket engine for government use. In the course of the project, the major engine components have been modeled using a combination of simple correlations and detailed component analysis tools (computer codes). The results of these component analyses were verified with data provided by Pratt & Whitney. Select modeling results and test data curves were then integrated to form the RL10 engine system model The purpose of this report is to introduce the reader to the RL10 rocket engine and to describe the engine system model. The RL10 engine and its application to U.S. launch vehicles are described first, followed by a summary of the SPTD project organization, goals, and accomplishments. Simulated output from the system model are shown in comparison with test and flight data for start transient, steady state, and shut-down transient operations. Detailed descriptions of all component analyses, including those not selected for integration with the system model, are included as appendices.

Binder, Michael↗

DOE OSTI2025

A comparison of probabilistic generative frameworks for molecular simulations

Generative artificial intelligence is now a widely used tool in molecular science. Despite the popularity of probabilistic generative models, numerical experiments benchmarking their performance on molecular data are lacking. Here, in this work, we introduce and explain several classes of generative models, broadly sorted into two categories: flow-based models and diffusion models. We select three representative models: neural spline flows, conditional flow matching, and denoising diffusion probabilistic models, and examine their accuracy, computational cost, and generation speed across datasets with tunable dimensionality, complexity, and modal asymmetry. Our findings are varied, with no one framework being the best for all purposes. In a nutshell, (i) neural spline flows do best at capturing mode asymmetry present in low-dimensional data, (ii) conditional flow matching outperforms other models for high-dimensional data with low complexity, and (iii) denoising diffusion probabilistic models appear the best for low-dimensional data with high complexity. Our datasets include a Gaussian mixture model and the dihedral torsion angle distribution of the Aib9 peptide, generated via a molecular dynamics simulation. We hope our taxonomy of probabilistic generative frameworks and numerical results may guide model selection for a wide range of molecular tasks.

Artificial intelligence↗

NASA NTRS2013

Analysis of Present Day and Future OH and Methane Lifetime in the ACCMIP Simulations

Results from simulations performed for the Atmospheric Chemistry and Climate Modeling Intercomparison Project (ACCMIP) are analysed to examine how OH and methane lifetime may change from present day to the future, under different climate and emissions scenarios. Present day (2000) mean tropospheric chemical lifetime derived from the ACCMIP multi-model mean is 9.8+/-1.6 yr (9.3+/-0.9 yr when only including selected models), lower than a recent observationally-based estimate, but with a similar range to previous multi-model estimates. Future model projections are based on the four Representative Concentration Pathways (RCPs), and the results also exhibit a large range. Decreases in global methane lifetime of 4.5 +/- 9.1% are simulated for the scenario with lowest radiative forcing by 2100 (RCP 2.6), while increases of 8.5+/-10.4% are simulated for the scenario with highest radiative forcing (RCP 8.5). In this scenario, the key driver of the evolution of OH and methane lifetime is methane itself, since its concentration more than doubles by 2100 and it consumes much of the OH that exists in the troposphere. Stratospheric ozone recovery, which drives tropospheric OH decreases through photolysis modifications, also plays a partial role. In the other scenarios, where methane changes are less drastic, the interplay between various competing drivers leads to smaller and more diverse OH and methane lifetime responses, which are difficult to attribute. For all scenarios, regional OH changes are even more variable, with the most robust feature being the large decreases over the remote oceans in RCP8.5. Through a regression analysis, we suggest that differences in emissions of non-methane volatile organic compounds and in the simulation of photolysis rates may be the main factors causing the differences in simulated present day OH and methane lifetime. Diversity in predicted changes between present day and future OH was found to be associated more strongly with differences in modelled temperature and stratospheric ozone changes. Finally, through perturbation experiments we calculated an OH feedback factor (F) of 1.24 from present day conditions (1.50 from 2100 RCP8.5 conditions) and a climate feedback on methane lifetime of 0.33+-0.13 yr/K, on average. Models that did not include interactive stratospheric ozone effects on photolysis showed a stronger sensitivity to climate, as they did not account for negative effects of climate-driven stratospheric ozone recovery on tropospheric OH, which would have partly offset the overall OH/methane lifetime response to climate change.

atmospheric composition↗