Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model selection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Testing averaged cosmology with type Ia supernovae and BAO data

An important problem in precision cosmology is the determination of the effects of averaging and backreaction on observational predictions, particularly in view of the wealth of new observational data and improved statistical techniques. In this paper, we discuss the observational viability of a class of averaged cosmologies which consist of a simple parametrized phenomenological two-scale backreaction model with decoupled spatial curvature parameters. We perform a Bayesian model selection analysis and find that this class of averaged phenomenological cosmological models is favored with respect to the standard ΛCDM cosmological scenario when a joint analysis of current SNe Ia and BAO data is performed. In particular, the analysis provides observational evidence for non-trivial spatial curvature.

79 ASTRONOMY AND ASTROPHYSICS↗

Seasonal Variations in Mercury Deposition over the Yellow Sea, July 2007 through April 2008

Spatial and temporal variations of mercury, including dry and wet deposition fluxes, were assessed over Northeast Asia, targeting the Yellow Sea, using meteorology and chemistry models. Four modeling periods, each representative of one of the four seasons, were selected. Modeling results captured general patterns and behaviors, and fell within similar ranges with respect to observations. However, temporal variations of mercury were not closely matched, possibly owing to the effects of localized emissions. Modeling results indicated that dry deposition is correlated with wind speed, while wet deposition is correlated with precipitation amount. Overall, the wet deposition flux of 66 ng/m2-day was about twice as large as the dry deposition flux of 32 ng/m2-day, when averaged over the four modeling periods. Dry deposition occurred predominantly in the form of reactive gaseous mercury (RGM). In contrast, RGM accounted for only about two-thirds of wet deposition, while particulate mercury accounted for the remainder.

54 ENVIRONMENTAL SCIENCES↗

Combined selection of the dynamic model and modeling error in nonlinear aeroelastic systems using Bayesian Inference

Here, we report a Bayesian framework for concurrent selection of physics-based models and (modeling) error models. We investigate the use of colored noise to capture the mismatch between the predictions of calibrated models and observational data that cannot be explained by measurement error alone within the context of Bayesian estimation for stochastic ordinary differential equations. Proposed models are characterized by the average data-fit, a measure of how well a model fits the measurements, and the model complexity measured using the Kullback–Leibler divergence. The use of a more complex error models increases the average data-fit but also increases the complexity of the combined model, possibly over-fitting the data. Bayesian model selection is used to find the optimal physical model as well as the optimal error model. The optimal model is defined using the evidence, where the average data-fit is balanced by the complexity of the model. The effect of colored noise process is illustrated using a nonlinear aeroelastic oscillator representing a rigid NACA0012 airfoil undergoing limit cycle oscillations due to complex fluid–structure interactions. Several quasi-steady and unsteady aerodynamic models are proposed with colored noise or white noise for the model error. The use of colored noise improves the predictive capabilities of simpler models.

42 ENGINEERING↗

Candidate massive galaxies at z ~ 4 in the Dark Energy Survey

Using stellar population models, we predicted that the Dark Energy Survey (DES) - due to its special combination of area (5000 deg. sq.) and depth ($i = 24.3$) - would be in the position to detect massive ($\gtrsim 10^{11}$ M$_{\odot}$) galaxies at $z \sim 4$. We confront those theoretical calculations with the first $\sim 150$ deg. sq. of DES data reaching nominal depth. From a catalogue containing $\sim 5$ million sources, $\sim26000$ were found to have observed-frame $g-r$ vs $r-i$ colours within the locus predicted for $z \sim 4$ massive galaxies. We further removed contamination by stars and artefacts, obtaining 606 galaxies lining up by the model selection box. We obtained their photometric redshifts and physical properties by fitting model templates spanning a wide range of star formation histories, reddening and redshift. Key to constrain the models is the addition, to the optical DES bands $g$, $r$, $i$, $z$, and $Y$, of near-IR $J$, $H$, $K_{s}$ data from the Vista Hemisphere Survey. We further applied several quality cuts to the fitting results, including goodness of fit and a unimodal redshift probability distribution. We finally select 233 candidates whose photometric redshift probability distribution function peaks around $z\sim4$, have high stellar masses ($\log($M$^{*}$/M$_{\odot})\sim 11.7$ for a Salpeter IMF) and ages around 0.1 Gyr, i.e. formation redshift around 5. These properties match those of the progenitors of the most massive galaxies in the local universe. This is an ideal sample for spectroscopic follow-up to select the fraction of galaxies which is truly at high redshift. These initial results and those at the survey completion, which we shall push to higher redshifts, will set unprecedented constraints on galaxy formation, evolution, and the re-ionisation epoch.

79 ASTRONOMY AND ASTROPHYSICS↗

A comparison of probabilistic generative frameworks for molecular simulations

Generative artificial intelligence is now a widely used tool in molecular science. Despite the popularity of probabilistic generative models, numerical experiments benchmarking their performance on molecular data are lacking. Here, in this work, we introduce and explain several classes of generative models, broadly sorted into two categories: flow-based models and diffusion models. We select three representative models: neural spline flows, conditional flow matching, and denoising diffusion probabilistic models, and examine their accuracy, computational cost, and generation speed across datasets with tunable dimensionality, complexity, and modal asymmetry. Our findings are varied, with no one framework being the best for all purposes. In a nutshell, (i) neural spline flows do best at capturing mode asymmetry present in low-dimensional data, (ii) conditional flow matching outperforms other models for high-dimensional data with low complexity, and (iii) denoising diffusion probabilistic models appear the best for low-dimensional data with high complexity. Our datasets include a Gaussian mixture model and the dihedral torsion angle distribution of the Aib9 peptide, generated via a molecular dynamics simulation. We hope our taxonomy of probabilistic generative frameworks and numerical results may guide model selection for a wide range of molecular tasks.

Artificial intelligence↗

Comparing GIS-based habitat models for applications in EIA and SEA

Land use changes, urbanisation and infrastructure developments in particular, cause fragmentation of natural habitats and threaten biodiversity. Tools and measures must be adapted to assess and remedy the potential effects on biodiversity caused by human activities and developments. Within physical planning, environmental impact assessment (EIA) and strategic environmental assessment (SEA) play important roles in the prediction and assessment of biodiversity-related impacts from planned developments. However, adapted prediction tools to forecast and quantify potential impacts on biodiversity components are lacking. This study tested and compared four different GIS-based habitat models and assessed their relevance for applications in environmental assessment. The models were implemented in the Stockholm region in central Sweden and applied to data on the crested tit (Parus cristatus), a sedentary bird species of coniferous forest. All four models performed well and allowed the distribution of suitable habitats for the crested tit in the Stockholm region to be predicted. The models were also used to predict and quantify habitat loss for two regional development scenarios. The study highlighted the importance of model selection in impact prediction. Criteria that are relevant for the choice of model for predicting impacts on biodiversity were identified and discussed. Finally, the importance of environmental assessment for the preservation of biodiversity within the general frame of biodiversity conservation is emphasised.

54 ENVIRONMENTAL SCIENCES↗

Entropy Stable Discretization of Compressible Flows in Thermochemical Nonequilibrium

Entropy stable numerical methods for compressible flow have been demonstrated to exhibit better robustness than purely linearly stable methods and need less overall artificial dissipation for long simulations in subsonic and transonic flows. In this work we seek to extend these benefits to multicomponent, multitemperature flows in thermochemical nonequilibrium such as combustion and hypersonic flight. We first derive entropy functions that symmetrize the governing equations and allow stability proofs for such systems. The impact of diffusion model selection on provable entropy stability is considered in detail, including both rigorous models of irreversible thermodynamics and simplified models of greater practical interest. Based on the proven entropy functions we develop affordable, entropy conservative two-point flux functions for solution in conservation form. We derive entropy conservative fluxes for calorically and thermally perfect mixtures, with heat capacities described by either polynomials of the temperature or formulas from statistical thermodynamics.

42 ENGINEERING↗

Rapid Genetic Algorithm Optimization of a Mouse Computational Model: Benefits for Anthropomorphization of Neonatal Mouse Cardiomyocytes

While the mouse presents an invaluable experimental model organism in biology, its usefulness in cardiac arrhythmia research is limited in some aspects due to major electrophysiological differences between murine and human action potentials (APs). As previously described, these species-specific traits can be partly overcome by application of a cell-type transforming clamp (CTC) to anthropomorphize the murine cardiac AP. CTC is a hybrid experimental-computational dynamic clamp technique, in which a computationally calculated time-dependent current is inserted into a cell in real-time, to compensate for the differences between sarcolemmal currents of that cell (e.g., murine) and the desired species (e.g., human). For effective CTC performance, mismatch between the measured cell and a mathematical model used to mimic the measured AP must be minimal. We have developed a genetic algorithm (GA) approach that rapidly tunes a mathematical model to reproduce the AP of the murine cardiac myocyte under study. Compared to a prior implementation that used a template-based model selection approach, we show that GA optimization to a cell-specific model results in a much better recapitulation of the desired AP morphology with CTC. This improvement was more pronounced when anthropomorphizing neonatal mouse cardiomyocytes to human-like APs than to guinea pig APs. CTC may be useful for a wide range of applications, from screening effects of pharmaceutical compounds on ion channel activity, to exploring variations in the mouse or human genome. Rapid GA optimization of a cell-specific mathematical model improves CTC performance and may therefore expand the applicability and usage of the CTC technique.

59 BASIC BIOLOGICAL SCIENCES↗

Numerical Analysis of Novel Plate Type Heat Exchanger with Oval-Twisted Channels

The novel heat exchanger (HX) designs implementing geometrical and surface modification combinations are expected to perform better than traditional HX technologies. Applied enhancement techniques seek to achieve (1) higher overall heat transfer performance, (2) increased compactness, and (3) simplified or comparable manufacturability. One innovative enhancement technique is to generate swirling flow vortices induced by channel or tube twisting. The turbulence generated by the twisted cross-section greatly enhances the heat transfer rate with minimal increases in pressure drop. Plate-type HXs and Printed Circuit Heat Exchangers (PCHXs) are compact designs that achieve high heat transfer rates per unit volume by utilizing several small channels, which maximizes the heat transfer surface area between the hot and cold fluids. Currently, advanced manufacturing technologies enable the design and fabrication of compact-type units with complicated channel geometries to achieve the highest performance and meet the compactness criteria of innovative HX technology. The proposed HX design concept combines the compactness of plate-type HXs and twisted channels, which provide additional turbulence and flow swirl enhancement. The plate-type oval-twisted HX (PTOTHX) is a crossflow configuration, with 16 short channels on one side (for hot fluid) and 8 long channels on the perpendicular side (for cold fluid). The inlet plenums have flow guide vanes to redirect flow and produce uniformity across the various flow paths. The compact size and purportedly improved heat transfer performance of the PTOTHX investigated herein prove its viability in various applications. Some notable potential nuclear applications of the PTOTHX include reactor core, spent fuel cooling, and residual heat dissipation. To establish a reference case, circular channels (PTCHX) are also considered in the present study for comparison with (PTOTHX). This paper aims to outline the numerical analysis procedures for determining the viability of the PTOTHX by comparing its heat transfer performance with the PTCHX units. The computational study used STAR-CCM+, a commercial computational fluid dynamics (CFD) code. Sensitivity analysis and model selection studies are conducted to determine the appropriate mesh density and turbulence model to provide the reported results. Numerical analyses comparing the Nusselt number (Nu) of the PTOTHX design with a comparable HX unit, including a circular cross-section and no twisting (PTCHX), show an overall heat transfer performance increase of 29-55% for balanced flow and 29-59% for imbalanced flow. Oval-cross-sectional twisted channels induce swirling flow vortices, enhancing the working fluid's convective heat transfer capabilities.

25 ENERGY STORAGE↗

Validation of Normal Tissue Complication Probability Predictions in Individual Patient: Late Rectal Toxicity

Purpose: To perform validation of risk predictions for late rectal toxicity (LRT) in prostate cancer obtained using a new approach to synthesize published normal tissue complication data. Methods and Materials: A published study survey was performed to identify the dose-response relationships for LRT derived from nonoverlapping patient populations. To avoid mixing models based on different symptoms, the emphasis was placed on rectal bleeding. The selected models were used to compute the risk estimates of grade 2+ and grade 3+ LRT for an independent validation cohort composed of 269 prostate cancer patients with known toxicity outcomes. Risk estimates from single studies were combined to produce consolidated risk estimates. An agreement between the actuarial toxicity incidence 3 years after radiation therapy completion and single-study or consolidated risk estimates was evaluated using the concordance correlation coefficient. Goodness of fit for the consolidated risk estimates was assessed using the Hosmer-Lemeshow test. Results: A total of 16 studies of grade 2+ and 5 studies of grade 3+ LRT met the inclusion criteria. The consolidated risk estimates of grade 2+ and 3+ LRT were constructed using 3 studies each. For grade 2+ LRT, the concordance correlation coefficient for the consolidated risk estimates was 0.537 compared with 0.431 for the best-fit single study. For grade 3+ LRT, the concordance correlation coefficient for the consolidated risk estimates was 0.477 compared with 0.448 for the best-fit single study. No evidence was found for a lack of fit for the consolidated risk estimates using the Hosmer-Lemeshow test (P=.531 and P=.397 for grade 2+ and 3+ LRT, respectively). Conclusions: In a large cohort of prostate cancer patients, selected sets of consolidated risk estimates were found to be more accurate predictors of LRT than risk estimates derived from any single study.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Field-scale dynamics of planting dates in the US Corn Belt from 2000 to 2020

Crop planting dates are a dynamic feature of agricultural systems that respond to short- and long-term climate signals, crop and cultivar selection, and technology changes. Planting date records are essential for yield gap analyses, accurate crop modeling, and tracking farmer adaptations to weather and climate change. Although planting dates have high variation at local scales due to heterogeneity in farm resources and decision-making, available long-term data on planting dates is largely restricted to aggregated regional statistics or, at best, satellite-derived datasets with limited spatiotemporal extent and at resolutions unable to distinguish individual fields (> 250 m). Here, we generated retrospective annual field-scale (30 m) planting date maps for both maize and soybeans spanning 2000-2020 across a 12 state region in the United States Corn Belt based on Landsat satellite data and a large ground sample of over 28,000 maize and soybean fields. Using training data from 2015-2020 for model selection, we found that planting date predictions improved with harmonic regression of Landsat data and additional annual weather covariates. The preferred random forests model approximately doubled performance compared to a null model based on state median planting dates, capturing 47% of field-level variation for maize (mean absolute error, MAE = 7.4 days) and 44% for soybeans (MAE = 7.5 days) against held-out ground truth test data for 2008-2014. We also evaluated the full 2000-2020 dataset with state agricultural statistics, finding strong agreement with median planting dates for maize (R 2 = 0.76, MAE = 4.4 days) and slightly lower agreement for soybeans (R 2 = 0.65, MAE = 5.4 days) when aggregated to the state level. We then used this new dataset to analyze environmental determinants of planting dates at a finer-scale than previously possible, controlling for unobserved variation at the sub-state district level. We found that during 2000-2020, each standard deviation increase in rainfall delayed planting by ~ 2.5 days, and fields with higher soil productivity ratings tended to be planted earlier. We did not find meaningful trends over the last two decades in planting dates for maize or soybeans, in contrast to trends towards earlier planting dates late last century and predicted for this period in climate adaptation studies. We hypothesize increases in early season rainfall may have inhibited these shifts towards earlier planting. Remotely sensed planting dates will be a useful tool for yield gap analyses, crop simulation modeling, and ongoing assessment of climate adaptation.

54 ENVIRONMENTAL SCIENCES↗

Data-driven analysis and prediction of stable phases for high-entropy alloy design

High-entropy alloys (HEAs) represent a promising class of materials with exceptional structural and functional properties. However, their design and optimization pose challenges due to the large composition-phase space coupled with the complex and diverse nature of the phase formation dynamics. In this study, a data-driven approach that utilizes machine learning (ML) techniques to predict HEA phases and their composition-dependent phases is proposed. By employing a comprehensive dataset comprising 5692 experimental records encompassing 50 elements and 11 phase categories, we compare the performance of various ML models. Our analysis identifies the most influential features for accurate phase prediction. Furthermore, the class imbalance is addressed by employing data augmentation methods, raising the number of records to 1500 in each category, and ensuring a balanced representation of phase categories. The results show that XGBoost and Random Forest consistently outperform the other models, achieving 86% accuracy in predicting all phases. Additionally, this work provides an extensive analysis of HEA phase formers, showing the contributions of elements and features to the presence of specific phases. We also examine the impact of including different phases on ML model accuracy and feature significance. Notably, the findings underscore the need for ML model selection based on specific applications and desired predictions, as feature importance varies across models and phases. This study significantly advances the understanding of HEA phase formation, enabling targeted alloy design and fostering progress in the field of materials science.

36 MATERIALS SCIENCE↗

Propagation of Model Form Uncertainty for Thermal Hydraulics using RANS Turbulence Models in Drekar

This document summarizes the results from a level 3 milestone study within the CASL VUQ effort. It demonstrates the propagation of model form uncertainty that arises from the presence of multiple turbulence models within the context of thermal hydraulics analyses. The lack of knowledge associated with an inability to a priori identify an appropriate turbulence model is modeled as discrete epistemic uncertainty. This approach provides an alternative to model selection processes, for use when data is unavailable or inadequate for reducing the model form uncertainty. In this case, the alternative is to propagate the model form uncertainty and report UQ results that include this epistemic uncertainty source alongside other parametric sources. The study calculates epistemic intervals on aleatory statistics for several quantities of interest, where the epistemic intervals are computed using mixed continuous-discrete optimization methods and the aleatory statistics are computed using polynomial chaos expansions. We first investigate two simple algebraic test problems with multiple model forms and then deploy the methods to the Drekar thermal hydraulics application. The Drekar study employs a set of Reynolds-averaged Navier-Stokes (RANS) turbulence models, including Spalart-Allmaras and k-ε. Results highlight the utility of employing efficient mixed continuous-discrete optimizers based on surrogate emulation.

Eldred, Michael Scott↗

Overhead longwave infrared hyperspectral material identification using radiometric models

Material detection algorithms used in hyperspectral data processing are computationally efficient but can produce relatively high numbers of false positives. Material identification performed as a secondary processing step on detected pixels can help separate true and false positives. This paper presents a material identification processing chain for longwave infrared hyperspectral data of solid materials collected from airborne platforms. The algorithms utilize unwhitened radiance data and an iterative algorithm that determines the temperature, humidity, and ozone of the atmospheric profile. Pixel unmixing is done using constrained linear regression and Bayesian Information Criteria for model selection. The resulting product includes an optimal atmospheric profile and full radiance material model that includes material temperature, abundance values, and several fit statistics. A logistic regression method utilizing all model parameters to improve identification is also presented. This paper details the processing chain and provides justification for the algorithms used. Several examples are provided using modeled data at different noise levels.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Assimilation of Multiscale Data into Multifidelity Biogeochemical Models (Final Report)

Quantitative predictions of subsurface processes rely on computational models that capture, with different degrees of fidelity, complex interactions between hydrologic and biogeochemical processes. Molecular- and pore-scale models provide a high-fidelity representation of these processes but are impractical at the field scale. Reduced complexity (e.g., field-scale or data-driven) models sacrifice some degree of fidelity in favor of computational efficiency. Uncertainty and assimilation of data into model predictions, pose a question of model selection: Given a significant difference in computational cost, can a lower-fidelity model be preferable to its higher-fidelity counterpart? Since a predictive model must be computable in reasonable time it has to operate at the field scale, with molecular- and pore-scale data (obtained either from simulations or measurements) determining both the model's structure and parameters. Availability of such multi-resolution data raises a question hitherto undressed in hydrogeology: Can a coarse model dynamically ``learn'' its own structure (e.g., adjust the reaction pathways in its transport module) as more fine-scale data become available during simulations? Our results in multifidelity simulations, data assimilation, and machine learning led us to hypothesize that the answer to these questions is ``yes''. The overarching goal of this project was to confirm this hypothesis by developing scalable, computationally efficient tools for assimilation of data into multiscale models, in which fine-scale data and simulations dynamically inform and autonomously modify coarse-scale models. Our research led to nine manuscripts, three of which have been published and the other six are currently under review.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Verification and validation of developed short-term forecasting models

Recent advancements in machine learning (ML) and artificial intelligence (AI) technologies provide an opportunity for leveraging data-driven algorithms to predict future nuclear power plant (NPP) operating conditions by using recorded plant process data. Successfully implementing these models can lead to cost-reducing, conditioned-based predictive maintenance through optimized maintenance schedules and a reduction of unnecessary maintenance activities. This report discusses the verification and validation of short-term forecasting processes (i.e., data cleaning, feature selection, model optimization, and forecasting) developed in previous reports. The verification and validation (V&V) process demonstrates the expected precision and accuracy when the ML model encounters new datasets from different systems. Shapley additive explanations were used as the primary means of feature selection across these different data set. Individual models were trained for each data set, then validated through a cross-validation procedure. In this report, two different ML models were tasked to predict variables from three different plant process data sets with varying prediction horizons. The results indicate that support vector regression (SVR) outperformed long short-term memory (LSTM) neural networks in regard to each data set and each prediction horizon in this study, but further tuning and optimization could improve long short-term memory results. However, each forecasting model showed reduced performance as the prediction horizon was extended from 1 hour to 1 day ahead. Research is ongoing to evaluate the optimal input variable space, which is based on a given set of process parameters, to further improve forecasting accuracy.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Surrogate model evaluation and building energy benchmarking for commercial buildings

Building energy consumption benchmarking involves challenges associated with various energy patterns for different building types; heating, ventilating, and air-conditioning (HVAC) system types; and climates. Given significant variation in energy use patterns, accurate prediction of long-term energy use using surrogate models remains challenging. Multiple linear regression (MLR) is commonly used for building energy benchmarking because of its simple structure; however, it lacks accuracy compared to other black-box models. Although many studies have compared surrogate models and offer guidance on model selection based on metrics, they do not provide detailed analysis on improving the surrogate model accuracy. In this paper, we implement a surrogate model using polynomial ridge regression (i.e., MLR with interaction terms combined with ridge regularization) for small office and retail strip mall buildings across six HVAC system types and all climate zones, for electricity and natural gas in baseline and proposed scenarios. A simulation workflow is developed using OpenStudio TM /EnergyPlus TM to generate simulation data using measures over a wide range of efficiency inputs. Enhancements based on statistical insights are used for improving the model accuracy using filters, input transformations, and change points. Surrogate models achieved average coefficient of variation of the root mean squared error (CVRMSE) values of 2.17, 1.06, 2.05, and 3.26 for proposed electricity, proposed natural gas, baseline electricity, and baseline natural gas, respectively, with enhancements reducing CVRMSE by an average of 14.9% across all combinations. We provide model interpretation via Shapley additive explanations to determine which input variables most influence energy consumption and provide supportive arguments for enhancements.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗