Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model selection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

A Bayesian analysis of HAT-P-7b using the EXONEST algorithm

The study of exoplanets (planets orbiting other stars) is revolutionizing the way we view our universe. High-precision photometric data provided by the Kepler Space Telescope (Kepler) enables not only the detection of such planets, but also their characterization. This presents a unique opportunity to apply Bayesian methods to better characterize the multitude of previously confirmed exoplanets. This paper focuses on applying the EXONEST algorithm to characterize the transiting short-period-hot-Jupiter, HAT-P-7b (also referred to as Kepler-2b). EXONEST evaluates a suite of exoplanet photometric models by applying Bayesian Model Selection, which is implemented with the MultiNest algorithm. These models take into account planetary effects, such as reflected light and thermal emissions, as well as the effect of the planetary motion on the host star, such as Doppler beaming, or boosting, of light from the reflex motion of the host star, and photometric variations due to the planet-induced ellipsoidal shape of the host star. By calculating model evidences, one can determine which model best describes the observed data, thus identifying which effects dominate the planetary system. Presented are parameter estimates and model evidences for HAT-P-7b.

79 ASTRONOMY AND ASTROPHYSICS↗

THE ENVELOPE AND EMBEDDED DISK AROUND THE CLASS 0 PROTOSTAR L1157-mm: DUAL-WAVELENGTH INTERFEROMETRIC OBSERVATIONS AND MODELING

We present dual-wavelength observations and modeling of the nearly edge-on Class 0 young stellar object L1157-mm. Using the Combined Array for Research in Millimeter-wave Astronomy, a nearly spherical structure is seen from the circumstellar envelope at the size scale of 10{sup 2}-10{sup 3} AU in both 1 mm and 3 mm dust emission. Radiative transfer modeling is performed to compare data with theoretical envelope models, including a power-law envelope model and the Terebey-Shu-Cassen model. Bayesian inference is applied for parameter estimation and information criterion is used for model selection. The results prefer the power-law envelope model against the Terebey-Shu-Cassen model. In particular, for the power-law envelope model, a steep density profile with an index of {approx}2 is inferred. Moreover, the dust opacity spectral index {beta} is estimated to be {approx}0.9, implying that grain growth has started at L1157-mm. Also, the unresolved disk component is constrained to be {approx}<40 AU in radius and {approx}<4-25 M{sub Jup} in mass. However, the estimate of the embedded disk component relies on the assumed envelope model.

79 ASTRONOMY AND ASTROPHYSICS↗

A minimal set of invariants as a systematic approach to higher order gravity models: physical and cosmological constraints

We compare higher order gravity models to observational constraints from magnitude -redshift supernova data, distance to the last scattering surface of the CMB, and Baryon Acoustic Oscillations. We follow a recently proposed systematic approach to higher order gravity models based on minimal sets of curvature invariants, and select models that pass some physical acceptability conditions (free of ghost instabilities, real and positive propagation speeds, and free of separatrices). Models that satisfy these physical and observational constraints are found in this analysis and do provide fits to the data that are very close to those of the LCDM concordance model. However, we find in that the limitation of the models considered here comes from the presence of superluminal mode propagations for the constrained parameter space of the models.

79 ASTRONOMY AND ASTROPHYSICS↗

Cosmic acceleration from modified gravity with Palatini formalism

We study new FRW type cosmological models of modified gravity treated on the background of Palatini approach. These models are generalization of Einstein gravity by the presence of a scalar field non-minimally coupled to the curvature. The models employ Starobinsky's term in the Lagrangian and dust matter. Therefore, as a by-product, an exhausted cosmological analysis of general relativity amended by quadratic term is presented. We investigate dynamics of our models, confront them with the currently available astrophysical data as well as against ΛCDM model. We have used the dynamical system methods in order to investigate dynamics of the models. It reveals the presence of a final sudden singularity. Fitting free parameters we have demonstrated by statistical analysis that this class of models is in a very good agreement with the data (including CMB measurements) as well as with the standard ΛCDM model predictions. One has to use statefinder diagnostic in order to discriminate among them. Therefore Bayesian methods of model selection have been employed in order to indicate preferred model. Only in the light of CMB data the concordance model remains invincible.

79 ASTRONOMY AND ASTROPHYSICS↗

MO-C-17A-04: Forecasting Longitudinal Changes in Oropharyngeal Tumor Morphology Throughout the Course of Head and Neck Radiation Therapy

Purpose: To generate, evaluate, and compare models that predict longitudinal changes in tumor morphology throughout the course of radiation therapy. Methods: Two morphology feature vectors were used to describe the size, shape, and position of 35 oropharyngeal GTVs at each treatment fraction during intensity-modulated radiation therapy. The feature vectors comprised the coordinates of the GTV centroids and one of two shape descriptors. One shape descriptor was based on radial distances between the GTV centroid and 614 GTV surface landmarks. The other was based on a spherical harmonic decomposition of these distances. Feature vectors over the course of therapy were described using static, linear, and mean models. The error of these models in forecasting GTV morphology was evaluated with leave-one-out cross-validation, and their accuracy was compared using Wilcoxon signed-rank tests. The effect of adjusting model parameters at 1, 2, 3, or 5 time points (adjustment points) was also evaluated. Results: The addition of a single adjustment point to the static model decreased the median error in forecasting the position of GTV surface landmarks by 1.2 mm (p<0.001). Additional adjustment points further decreased forecast error by about 0.4 mm each. The linear model decreased forecast error compared to the static model for feature vectors based on both shape descriptors (0.2 mm), while the mean model did so only for those based on the inter-landmark distances (0.2 mm). The decrease in forecast error due to adding adjustment points was greater than that due to model selection. Both effects diminished with subsequent adjustment points. Conclusion: Models of tumor morphology that include information from prior patients and/or prior treatment fractions are able to predict the tumor surface at each treatment fraction during radiation therapy. The predicted tumor morphology can be compared with patient anatomy or dose distributions, opening the possibility of anticipatory re-planning. American Legion Auxiliary Fellowship; The University of Texas Graduate School of Biomedical Sciences at Houston.

60 APPLIED LIFE SCIENCES↗

Full-sky Models of Galactic Microwave Emission and Polarization at Subarcminute Scales for the Python Sky Model

Polarized foreground emission from the Galaxy is one of the biggest challenges facing current and upcoming cosmic microwave background (CMB) polarization experiments. We develop new models of polarized Galactic dust and synchrotron emission at CMB frequencies that draw on the latest observational constraints; that employ the “polarization fraction tensor” framework to couple intensity and polarization in a physically motivated way; and that allow for stochastic realizations of small-scale structure at subarcminute angular scales currently unconstrained by full-sky data. We implement these models into the publicly available Python Sky Model (PySM) software and additionally provide PySM interfaces to select models of dust and CO emission from the literature. We characterize the behavior of each model by quantitatively comparing it to observational constraints in both maps and power spectra, demonstrating an overall improvement over previous PySM models. Finally, we synthesize models of the various Galactic foreground components into a coherent suite of three plausible microwave skies that span a range of astrophysical complexity allowed by current data. Author contributions to this paper can be found at the end of this work.

Group, The Pan-Experiment Galactic Science↗

Computational modeling of multispectral remote sensing systems: Background investigations

A computational model of the deterministic and stochastic process of remote sensing has been developed based upon the results of the investigations presented. The model is used in studying concepts for improving worldwide environment and resource monitoring. A review of various atmospheric radiative transfer models is presented as well as details of the selected model. Functional forms for spectral diffuse reflectance with variability introduced are also presented. A cloud detection algorithm and the stochastic nature of remote sensing data with its implications are considered.

Aherron, R. M.↗

Project trades model for complex space missions

A Project Trades Model (PTM) is a collection of tools/simulations linked together to rapidly perform integrated system trade studies of performance, cost, risk, and mission effectiveness. An operating PTM captures the interactions between various targeted systems and subsystems through an exchange of computed variables of the constituent models. Selection and implementation of the order, method of interaction, model type, and envisioned operation of the ensemble of tools rpresents the key system engineering challenge of the approach. This paper describes an approach to building a PTM and using it to perform top-level system trades for a complex space mission. In particular, the PTM discussed here is for a future Mars mission involving a large rover.

web services↗

Impact of Uncertainty on Calculations for Recovery from Loss of Offsite Power

Uncertainty, both aleatory and epistemic, can have a significant impact on estimated probabilities of recovering from loss of offsite power within a specified time window, and such probabilities are an input to risk-informed decisions as to the significance of inspection findings in the U.S. Nuclear Regulatory Commission’s Reactor Oversight Process. In particular, the choice of aleatory model for offsite power recovery time can have a significant impact on the estimated nonrecovery probability, especially if epistemic uncertainty regarding parameters in the aleatory model is accounted for properly. In past and current analyses, such uncertainty has largely been ignored. This paper examines the impact of both aleatory and epistemic uncertainty on the results, using modern open-source Bayesian inference software, which implements Markov chain Monte Carlo sampling. It includes examples of time-dependent convolution calculations to show the impact that uncertainty can have on this increasingly frequent type of calculation, also. The results show that the “point estimate” result, which is an input to risk-informed decisions, can easily be uncertain by a factor of 10 if both aleatory and epistemic uncertainties are considered. The paper also illustrates the use of Bayesian model selection criteria to aid in the choice of aleatory model.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Predictive analytics of selections of russet potatoes

We explore the application of machine learning algorithms specifically to enhance the selection process of Russet potato (Solanum tuberosum L.) clones in breeding trials by predicting their suitability for advancement. This study addresses the challenge of efficiently identifying high-yield, disease-resistant, and climate-resilient potato varieties that meet processing industry standards. Leveraging manually collected data from trials in the state of Oregon, we investigate the potential of a wide variety of state-of-the-art binary classification models. The dataset includes 1086 clones, with data on 38 attributes recorded for each clone, focusing on yield, size, appearance, and frying characteristics, with several control varieties planted consistently across four Oregon regions from 2013 to 2021. We conduct a comprehensive analysis of the dataset that includes preprocessing, feature engineering, and imputation to address missing values. We focus on several key metrics such as accuracy, F1-score, and Matthews correlation coefficient (MCC) for model evaluation. The top-performing models, namely a feedforward neural network classifier (Neural Net), a histogram-based gradient boosting classifier (HGBC), and a support vector machine classifier (SVM), demonstrate consistent and significant results. To further validate our findings, we conducted a simulation study using the aims, data-generating mechanisms, estimands, methods, and performance measures (ADEMP) framework, simulating different data-generating scenarios to assess model robustness and performance through true positive, true negative, false positive, and false negative distributions, area under the receiver operating characteristic curve (AUC-ROC) and MCC. The simulation results highlight that non-linear models like SVM and HGBC consistently show higher AUC-ROC and MCC than logistic regression, thus outperforming the traditional linear model across various distributions, and emphasizing the importance of model selection and tuning in agricultural trials. Variable selection further enhances model performance and identifies influential features in predicting trial outcomes. The findings emphasize the potential of machine learning in streamlining the selection process for potato varieties, offering benefits such as increased efficiency, substantial cost savings, and judicious resource utilization. Our study contributes insights into precision agriculture and showcases the relevance of advanced technologies for informed decision-making in breeding programs.

60 APPLIED LIFE SCIENCES↗

Do You See What I See? Exploring the Consequences of Luminosity Limits in Black Hole–Galaxy Evolution Studies

In studies of the connection between active galactic nuclei (AGNs) and their host galaxies, there is widespread disagreement on some key aspects of the connection. These disagreements largely stem from a lack of understanding of the nature of the full underlying AGN population. Recent attempts to probe this connection utilize both observations and simulations to correct for a missed population, but presently are limited by intrinsic biases and complicated models. We take a simple simulation for galaxy evolution and add a new prescription for AGN activity to connect galaxy growth to dark matter halo properties and AGN activity to star formation. We explicitly model selection effects to produce an “observed” AGN population for comparison with observations and empirically motivated models of the local universe. This allows us to bypass the difficulties inherent in models that attempt to infer the AGN population by inverting selection effects. We investigate the impact of selecting AGNs based on thresholds in luminosity or Eddington ratio on the “observed” AGN population. By limiting our model AGN sample in luminosity, we are able to recreate the observed local AGN luminosity function and specific star formation-stellar mass distribution, and show that using an Eddington ratio threshold introduces less bias into the sample by selecting the full range of growing black holes, despite the challenge of selecting low-mass black holes. We find that selecting AGNs using these various thresholds yield samples with different AGN host galaxy properties.

79 ASTRONOMY AND ASTROPHYSICS↗

Parameter Estimation for Compact Binary Coalescence Signals with the First Generation Gravitational-Wave Detector Network

Compact binary systems with neutron stars or black holes are one of the most promising sources for ground-based gravitational-wave detectors. Gravitational radiation encodes rich information about source physics; thus parameter estimation and model selection are crucial analysis steps for any detection candidate events. Detailed models of the anticipated waveforms enable inference on several parameters, such as component masses, spins, sky location and distance, that are essential for new astrophysical studies of these sources. However, accurate measurements of these parameters and discrimination of models describing the underlying physics are complicated by artifacts in the data, uncertainties in the waveform models and in the calibration of the detectors. Here we report such measurements on a selection of simulated signals added either in hardware or software to the data collected by the two LIGO instruments and the Virgo detector during their most recent joint science run, including a blind injection where the signal was not initially revealed to the collaboration. We exemplify the ability to extract information about the source physics on signals that cover the neutron-star and black-hole binary parameter space over the component mass range 1M25M and the full range of spin parameters. The cases reported in this study provide a snapshot of the status of parameter estimation in preparation for the operation of advanced detectors.

Aasi, J.↗

Physics vs structure: A systematic benchmark of learning strategies for multi-zone building thermal dynamics

Recent advances in physics-informed and data-driven machine learning promise improved thermal models for advanced building control, yet there is limited quantitative evidence on when added physics structure and architectural complexity are beneficial. Here, this work presents a systematic benchmark of five representative system identification methods for modeling multi-zone building thermal dynamics: linear state-space models, multi-layer perceptrons, neural state-space models, neural ordinary differential equations, and physically-consistent neural networks. The methods are evaluated across multiple data regimes and zone coupling strategies. Using a high-fidelity multi-zone commercial building emulator, we examine short-term and long-term prediction accuracy, computational efficiency, and ease of development. Our results reveal critical trade-offs between prediction performance, model complexity, and physical consistency. We demonstrate that decoupled, nonlinear black-box models consistently outperform coupled physics-constrained architectures in both predictive accuracy and out-of-distribution robustness in majority of the test cases for the building type considered in the study. Our findings quantify the cost of complexity in building thermal modeling and provide concrete, actionable, scenario-based guidelines for selecting model classes for control-oriented applications.

Building thermal modeling↗

Singling out modified gravity parameters and data sets reveals a dichotomy between Planck and lensing

ABSTRACT An important route to testing general relativity (GR) at cosmological scales is usually done by constraining modified gravity (MG) parameters added to the Einstein perturbed equations. Most studies have analysed so far constraints on pairs of MG parameters, but here, we explore constraints on one parameter at a time while fixing the other at its GR value. This allows us to analyse various models while benefiting from a stronger constraining power from the data. We also explore which specific data sets are in tension with GR. We find that models with (μ = 1, η) and (μ, η = 1) exhibit a 3.9σ and 3.8σ departure from GR when using Planck18 + Supernovae type Ia (SNe) + Baryon acoustic oscillation (BAO), while (μ, η) shows a tension of 3.4σ. We find no tension with GR for models with the MG parameter Σ fixed to its GR value. Using a Bayesian model selection analysis, we find that some one-parameter MG models are moderately favoured over ΛCDM when using all data set combinations except Planck cosmic microwave background lensing and dark energy survey data. Namely, Planck18 shows a moderate tension with GR that only increases when adding any combination of redshift space distortion, SNe, or BAO. However, adding lensing diminishes or removes these tensions, which can be attributed to the ability of lensing in constraining the MG parameter Σ. The two overall groups of data sets are found to have a dichotomy when performing consistency tests with GR, which may be due to systematic effects, lack of constraining power, or modelling. These findings warrant further investigation using more precise data from ongoing and future surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

Multi‐Model Ensembles in Ecosystem Modeling: Challenges and Best Practices for Decision‐Making

Ecosystem models are increasingly central to the decision-making for environmental policy, conservation planning, and climate-related investments. Yet, the growing reliance on Multi-Model Ensembles (MMEs) of ecosystem models by practitioners and policymakers, sometimes under tight timelines and imperfect information, has frequently outpaced the scientific rigor required to ensure ensemble reliability. Here, MMEs refer to approaches that combine targeted predictions from multiple models with the expectation of improving robustness and quantifying predictive uncertainty. Poorly designed MMEs may create a false sense of confidence and lead to suboptimal policy and market decisions. This perspective argues that robust decision-making-relevant MMEs must be grounded on two pillars: (1) rigorous Model Intercomparison Projects (MIPs), which identify inter-model agreement and disagreement, characterize model uncertainties, and evaluate robustness with observationally based benchmarks—MIPs' diagnostic evaluation is so critical that it must be needed to drive MME's decision in model selection and weighting, especially when only a limited number of models available; and (2) co-design by both stakeholders and scientists to ensure that scenarios, metrics and uncertainty requirements provide decision-relevant information. Building upon the past success and lessons from the existing MIPs-MMEs efforts (e.g., climate/Earth system/crop), we derived the theoretical basis for MMEs, addressed their specific challenges in ecosystem modeling, and highlighted proper consideration of model numbers and diversity, risk of model inter-dependence, effective calibration of model parameters, possible overdue of some ecosystem model development, critical roles of open benchmark data across a wide range of conditions, and suggested use of Artificial Intelligence to support MIPs-MMEs. We highlighted the under-recognized opportunity for MIPs and MMEs to drive scientific progress and innovation through identifying better performing models, systematic benchmarking, feedback loops, and targeted model improvement. By following actionable best practice guidelines, MMEs can evolve from ad hoc aggregation of models into a trusted backbone of environmental policy and decision-making.

ecosystem modeling↗

Human limits in machine learning: prediction of potato yield and disease using soil microbiome data

Abstract Background The preservation of soil health is a critical challenge in the 21st century due to its significant impact on agriculture, human health, and biodiversity. We provide one of the first comprehensive investigations into the predictive potential of machine learning models for understanding the connections between soil and biological phenotypes. We investigate an integrative framework performing accurate machine learning-based prediction of plant performance from biological, chemical, and physical properties of the soil via two models: random forest and Bayesian neural network. Results Prediction improves when we add environmental features, such as soil properties and microbial density, along with microbiome data. Different preprocessing strategies show that human decisions significantly impact predictive performance. We show that the naive total sum scaling normalization that is commonly used in microbiome research is one of the optimal strategies to maximize predictive power. Also, we find that accurately defined labels are more important than normalization, taxonomic level, or model characteristics. ML performance is limited when humans can’t classify samples accurately. Lastly, we provide domain scientists via a full model selection decision tree to identify the human choices that optimize model prediction power. Conclusions Our study highlights the importance of incorporating diverse environmental features and careful data preprocessing in enhancing the predictive power of machine learning models for soil and biological phenotype connections. This approach can significantly contribute to advancing agricultural practices and soil health management.

Aghdam, Rosa↗

Models, data, and scripts associated with “Prediction of Distributed River Sediment Respiration Rates using Community-Generated Data and Machine Learning”

This data package is associated with the publication “Prediction of Distributed River Sediment Respiration Rates using Community-Generated Data and Machine Learning’’ submitted to the Journal of Geophysical Research: Machine Learning and Computation (Scheibe et al. 2024). River sediment respiration observations are expensive and labor intensive to obtain and there is no physical model for predicting this quantity. The Worldwide Hydrobiogeochemisty Observation Network for Dynamic River Systems (WHONDRS) observational data set (Goldman et al.; 2020) is used to train machine learning (ML) models to predict respiration rates at unsampled sites. This repository archives training data, ML models, predictions, and model evaluation results for the purposes of reproducibility of the results in the associated manuscript and community reuse of the ML models trained in this project. One of the key challenges in this work was to find an optimum configuration for machine learning models to work with this feature-rich (i.e. 100+ possible input variables) data set. Here, we used a two-tiered approach to managing the analysis of this complex data set: 1) a stacked ensemble of ML models that can automatically optimize hyperparameters to accelerate the process of model selection and tuning and 2) feature permutation importance to iteratively select the most important features (i.e. inputs) to the ML models. The major elements of this ML workflow are modular, portable, open, and cloud-based, thus making this implementation a potential template for other applications. This data package is associated with the GitHub repository found at Please see the file level metadata (flmd; “sl-archive-whondrs_flmd.csv”) for a list of all files contained in this data package and descriptions for each. Please see the data dictionary (dd; “sl-archive-whondrs_dd.csv”) for a list of all column headers contained within comma separated value (csv) files in this data package and descriptions for each. The GitHub repository is organized into five top-level directories: (1) “input_data” holds the training data for the ML models; (2) “ml_models” holds machine learning models trained on the data in “input_data”; (3) “scripts” contains data preprocessing and postprocessing scripts and intermediate results specific to this data set that bookend the ML workflow; (4) “examples” contains the visualization of the results in this repository including plotting scripts for the manuscript (e.g., model evaluation, FPI results) and scripts for running predictions with the ML models (i.e., reusing the trained ML models); (5) “output_data” holds the overall results of the ML model on that branch. Each trained ML model resides on its own branch in the repository; this means that inputs and outputs can be different branch-to-branch. Furthermore, depending on the number of features used to train the ML models, the preprocessing and postprocessing scripts, and their intermediate results, can also be different branch-to-branch. The “main-*” branches are meant to be starting points (i.e. trunks) for each model branch (i.e. sprouts). Please see the Branch Navigation section in the top-level README.md in the GitHub repository for more details. There is also one hidden directory “.github/workflows”. This hidden directory contains information for how to run the ML workflow as an end-to-end automated GitHub Action but it is not needed for reusing the ML models archived here. Please the top-level README.md in the GitHub repository for more details on the automation.

13C↗

Energy Storage Valuation: A Review of Use Cases and Modeling Tools

An enticing prospect that drives adoption of energy storage systems (ESS) is its ability to be used in a diverse set of use cases and the potential to take advantage of multiple unique value streams. The Energy Storage Grand Challenge (ESGC) technology development pathways for storage technologies draw from a set of use cases in the electrical power system, each with their own specific cost and performance needs. In addition to the need for cost and performance improvements for storage technologies, there a need for robust valuation methods to enable effective policy, investment, business models, and resource planning. There are numerous storage valuation tools available to the public, many of which can analyze the value of an ESS project with inputs and characteristics that reflect a specific storage use case. To effectively reach ESS stakeholders that may be interested in learning about valuation models, this report will draw from publicly available tools developed by the Department of Energy (DOE) and frame their functionalities and capabilities within the context of three distinct use case families. This report examines three of the ESGC use case families in depth and provides a methodology in which interested stakeholders can determine which DOE modeling tool is best suited to value ESS for their specific case. The high-level objectives for this report include: (1) Provide specific sub use-cases for each use case family for further characterization; (2) Provide technical parameters and relevant data for three example use cases that could be used in a valuation tool; (3) Identify a list of publicly available DOE tools that can provide energy storage valuation insights for ESS use case stakeholders; (4) Provide information on the capabilities and different options in each modeling tool; (5) Make conclusions on which are best suited for valuing certain functional/performance requirements and which tools might be applicable to other use cases; and (6) Show the methodology that informs a Model Selection Platform (MSP) framework that educates stakeholders on different DOE models and provides a streamlined way to choose the right model that most closely matches their needs.

25 ENERGY STORAGE↗