Search NASA⌕ Search

SEARCH · Search NASA

Results for “generalizability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Invariant Features for Accurate Predictions of Quantum Chemical UV-vis Spectra of Organic Molecules

Including invariance of global properties of a phys-ical system as an intrinsic feature in graph neural networks (GNNs) enhances the model's robustness and generalizability and reduces the amount of training data required to obtain a desired accuracy for predictions of these properties. Existing open source GNN libraries construct invariant features only for specific GNN architectures. This precludes the generalization of invariant features to arbitrary message passing neural network (MPNN) layers which, in turn, precludes the use of these libraries for new, user-specified predictive tasks. To address this limitation, we implement invariant MPNNs into the flexible and scalable HydraGNN architecture. HydraGNN enables a seamless switch between various MPNNs in a unified layer sequence and allows for a fair comparison between the predictive performance of different MPNNs. We trained this enhanced HydraGNN archi-tecture on the ultraviolet-visible (UV-vis) spectrum of GDB-9 molecules, a feature that describes the molecule's electronic exci-tation modes, computed with time-dependent density functional tight binding (TD-DFTB) and available open source through the GDB-9-Ex dataset. We assess the robustness (i.e., accuracy and generalizability) of the predictions obtained using different invariant MPNNs with respect to different values of the full width at half maximum (FWHM) for the Gaussian smearing of the theoretical peaks. Our numerical results show that incorporating invariance in the HydraGNN architecture significantly enhances both accuracy and generalizability in predicting UV-vis spectra of organic molecules.

Baker, Justin↗

Training for Long-Duration Space Missions: A Literature Review into Skill Retention and Generalizatility

In long-duration space missions, skill retention and generalizability become ever more important as mission length increases, for it is through these capabilities that astronaut crews achieve autonomy. A framework is proposed for future research based on three types of training commonly found in operational scenarios: initial training, refresher training, and just-in-time training. One of the key points of interest identified from the body of literature is the need for a structured and quantifiable approach to characterize skill decay. Such an approach would allow gaining a deeper understanding of the mechanisms through which skill decay operates. Because simulators are used extensively in all types of training, the effects of simulator fidelity on skill retention and generalizability are paramount to understand. Some common fidelity types are defined and their effects on the human operator are discussed. From a review of the literature on all these topics, several research gaps were identified that led to three key opportunities for future research: (1) developing skill decay functions provides theoretical insights into skill decay and allows for several practical applications, such as planning refresher training, (2) the effects of simulator fidelity on skill decay functions should be investigated empirically, and (3) investigating the generalizability of skills learned in initial training to other tasks could provide space crews with greater autonomy. A cybernetic approach might give new insights.

Pieters, Marc A.↗

Establishing performance metrics for quantitative non-targeted analysis: a demonstration using per- and polyfluoroalkyl substances

Abstract Non-targeted analysis (NTA) is an increasingly popular technique for characterizing undefined chemical analytes. Generating quantitative NTA (qNTA) concentration estimates requires the use of training data from calibration “surrogates,” which can yield diminished predictive performance relative to targeted analysis. To evaluate performance differences between targeted and qNTA approaches, we defined new metrics that convey predictive accuracy, uncertainty (using 95% inverse confidence intervals), and reliability (the extent to which confidence intervals contain true values). We calculated and examined these newly defined metrics across five quantitative approaches applied to a mixture of 29 per- and polyfluoroalkyl substances (PFAS). The quantitative approaches spanned a traditional targeted design using chemical-specific calibration curves to a generalizable qNTA design using bootstrap-sampled calibration values from “global” chemical surrogates. As expected, the targeted approaches performed best, with major benefits realized from matched calibration curves and internal standard correction. In comparison to the benchmark targeted approach, the most generalizable qNTA approach (using “global” surrogates) showed a decrease in accuracy by a factor of ~4, an increase in uncertainty by a factor of ~1000, and a decrease in reliability by ~5%, on average. Using “expert-selected” surrogates ( n = 3) instead of “global” surrogates ( n = 25) for qNTA yielded improvements in predictive accuracy (by ~1.5×) and uncertainty (by ~70×) but at the cost of further-reduced reliability (by ~5%). Overall, our results illustrate the utility of qNTA approaches for a subclass of emerging contaminants and present a framework on which to develop new approaches for more complex use cases. Graphical Abstract

Pu, Shirley (ORCID:0000000201223797)↗

Building thermal dynamics modeling with deep transfer learning using a large residential smart thermostat dataset

Understanding thermal dynamics and obtaining the computational model of residential buildings enable its scaled application in energy retrofits, control optimization and decarbonization. In this paper, we present a deep learning approach to model building thermal dynamics with smart thermostat data collected from residential buildings, with the goal to investigate model generalizability. In the first stage, we developed and compared different Deep Learning architectures including Convolutional Neural Networks (CNN), Long Short-Term Memory (LSTM) models and CNN-LSTM to predict indoor air temperature in a multi-step time horizon. In the second stage, we implemented a Transfer Learning (TL) process, which aims to improve the prediction performance on a new set of buildings (targets), exploiting the knowledge of related or similar buildings (sources). Different TL strategies and source model identification methods were investigated. The study showed that the CNN-LSTM performed the best among the architectures compared, with an average Mean Absolute Error (MAE) of 0.26 °C for one-hour-ahead (twelve 5-min future steps) predictions. Furthermore, the results showed that freezing the LSTM layer and fine-tuning the other layers of the CNN-LSTM achieved the best performance among four TL strategies, which further improved the performance with respect to a machine learning approach by 10%, and proving the effectiveness and generalizability of the proposed approach. A comparison of three different source model identification methods showed that randomly selecting source models constrained by similar building characteristics can provide good TL performance while retaining simplicity comparing with other quantitative source identification methods.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Patient-Reported Outcomes After Radiation Therapy in Men With Prostate Cancer: A Systematic Review of Prognostic Tool Accuracy and Validity

Purpose: To identify, through a systematic review, all validated tools used for the prediction of patient-reported outcome measures (PROMs) in patients being treated with radiation therapy for prostate cancer, and provide a comparative summary of accuracy and generalizability. Methods and Materials: PubMed and EMBASE were searched from July 2007. Title/abstract screening, full text review, and critical appraisal were undertaken by 2 reviewers, whereas data extraction was performed by a single reviewer. Eligible articles had to provide a summary measure of accuracy and undertake internal or external validation. Tools were recommended for clinical implementation if they had been externally validated and found to have accuracy ≥70%. Results: The search strategy identified 3839 potential studies, of which 236 progressed to full text review and 22 were included. From these studies, 50 tools predicted gastrointestinal/rectal symptoms, 29 tools predicted genitourinary symptoms, 4 tools predicted erectile dysfunction, and no tools predicted quality of life. For patients treated with external beam radiation therapy, 3 tools could be recommended for the prediction of rectal toxicity, gastrointestinal toxicity, and erectile dysfunction. For patients treated with brachytherapy, 2 tools could be recommended for the prediction of urinary retention and erectile dysfunction. Conclusions: A large number of tools for the prediction of PROMs in prostate cancer patients treated with radiation therapy have been developed. Only a small minority are accurate and have been shown to be generalizable through external validation. This review provides an accessible catalogue of tools that are ready for clinical implementation as well as which should be prioritized for validation.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Route Optimization for Energy Efficient Airport Shuttle Operations - A Case Study from Dallas Fort Worth International Airport

Air travel and requisite surface traffic supporting passenger arrival/departure constitutes a significant portion of travel and emissions in cities with large airports. An airport trip can segment into three parts namely: i) travel from a location in the city to the airport; ii) travel from a parking lot or rental car center to the terminal (i.e., within the airport premises), and iii) travel inside the terminal. Depending on the airport access mode all or a part of these legs comprise a traveler’s journey to the airport. The priority of airport ground transport management teams is to provide passengers with a seamless travel experience within the airport, so it is understandable that within airport shuttle routes might not be optimized for minimizing energy consumption. Solutions that meet the dual objective of reducing energy consumption from airport shuttle operations without compromising on passenger travel experience are key to improving system efficiency. There is currently a dearth of research and tools that can inform airports in making such decisions. Addressing this need, this research effort puts forth an optimization model that generates optimal shuttle routes for a given set of constraints, and a discrete-event simulator that evaluates the optimal solutions in a stochastic environment to understand the tradeoffs between passenger wait times, and within airport shuttle energy consumption. The proposed set of tools are tested in the context of optimizing airport shuttles routes within the Dallas Fort Worth International Airport (DFW). In addition to shuttle spatial positioning, and passenger demand information, high-fidelity vehicle data was collected using data loggers installed on DFW shuttles. Results show that 20% energy reduction in shuttle operations is possible with a modest two-minute increase in average passenger wait times. The tools developed in this research effort are designed to be generalizable and can help optimize shuttle operations planning at any major airport.

air travel↗

A physics-informed and hierarchically regularized data-driven model for predicting fluid flow through porous media

This paper presents a new deep learning data-driven model for predicting structure dependent pore-fluid velocity fields in rock. The model is based on a Convolutional Auto-Encoder (CAE) artificial neural network capable of learning from image data generated by direct numerical simulations of fluid flow through pore-structures, such as by Lattice Boltzmann or molecular dynamics methods. The main novelty of the model in comparison to previous CAE-based data-driven approaches consists of three parts. The first is a methodology for decomposing the full-domain of the porous media into sub-regions, or “sub-domains”, in order to reduce the overall size of the CAE, batch process the sub-domains in parallel, and enable the CAE to learn local and generalizable nonlinear mappings of pore-fluid velocities. The second consists of embedding the finite difference solutions of the incompressible Navier-Stokes and continuity equations into convolutional layers prior to the CAE in order to provide the CAE with knowledge of fluid dynamics physics (PhyFlow). The third main novelty is that the training of the CAE is regularized with a hierarchical loss function that encourages the learning of fluid flow patterns (in a way similar to ranked modes in principal component analysis), ranking from most to least important. This is shown to increase the stability in learning, reduce over-fitting, and promote interpretability of the CAE neural network layers (HierCAE). The comprehensive new data-driven model, which we call the PhyFlow-HierCAE model, is shown to exhibit improved accuracy and generalizability of flow field predictions over conventional CAE models, attributable to the embedded physical knowledge and the hierarchical regularization, as well as realize orders of magnitude speed-ups in computation times as a surrogate for the direct numerical simulations. Examples of training and forward predictions on unseen pore-structures are provided and evaluated for data from Lattice Boltzmann and molecular dynamics simulations of pore-fluid flow. The model is shown to be a fast and accurate emulator (or “surrogate”) for predicting effective permeability of unseen pore-structures based on learning from relatively small direct numerical simulation datasets.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A weighted state redistribution algorithm for embedded boundary grids

State redistribution is an algorithm that stabilizes cut cells for embedded boundary grid methods. This work extends the earlier algorithm in several important ways. First, state redistribution is extended to three spatial dimensions. Second, we discuss several algorithmic changes and improvements motivated by the more complicated cut cell geometries that can occur in higher dimensions. In particular, we introduce a weighted version with less dissipation in an easily generalizable framework. Third, we demonstrate that state redistribution can also stabilize a solution update that includes both advective and diffusive contributions. Notably, the stabilization algorithm is shown to be effective for incompressible as well as compressible reacting flows. Finally, we discuss the implementation of the algorithm for several exascale-ready simulation codes based on AMReX, demonstrating ease of use in combination with domain decomposition, hybrid parallelism and complex physics.

97 MATHEMATICS AND COMPUTING↗

Mapping foliar photosynthetic capacity in sub-tropical and tropical forests with UAS-based imaging spectroscopy: Scaling from leaf to canopy

Accurate understanding of the variability in foliar physiological traits across landscapes is critical to improve parameterization and evaluation of terrestrial biosphere models (TBMs) that seek to represent the response of terrestrial ecosystems to a changing climate. Numerous studies suggest imaging spectroscopy can characterize foliar biochemical and morphological traits at the canopy scale, but there is only limited evidence for retrieving canopy photosynthetic capacity (e.g., maximum carboxylation rate, V c,max and maximum electron transport rate, J max ). Moreover, the effect of canopy structure within forest communities on scaling up spectra-trait relationships from leaf to canopy level is not well known. To advance the spectra-trait approach and enable the estimation of key traits using remote sensing, we collected imaging spectroscopy data from an Unoccupied Aerial System (UAS) platform over two forest sites in China (a subtropical forest in Mt. Dinghu and a tropical rainforest in Xishuangbanna). At these sites, we also collected ground measurements of leaf spectra and traits, including biochemical (leaf nitrogen, phosphorus, chlorophyll, and water content), morphological (leaf mass per area, LMA) and physiological (V c,max25 and J max25 ) traits (n=135 tree-crowns from 42 species across two sites). Using a partial least-squares regression (PLSR) approach, we built and tested spectra-trait models with repeated cross-validation. The spectral models developed with leaf spectra were directly transferred to canopy spectra to evaluate the effect of canopy structure. Here we further applied canopy spectral models to map these traits at individual tree-crown scale. The results demonstrate that (1) UAS-based canopy spectra can be used to estimate V c,max (R 2 =0.55, nRMSE=11.79%), Jmax (R 2 =0.54, nRMSE=12.34%), and five additional foliar traits (R 2 =0.38-0.60, nRMSE=10.11-13.56%) at the tree-crown scale with demonstrated generalizability across two sites; (2) canopy structure strongly affects the spectratrait relationships from leaf to canopy level, but the effects vary considerably across foliar traits and cannot be well captured by the 4SAIL canopy radiative transfer model. UAS-based imaging spectroscopy maps large variability in all foliar traits (including physiological traits) with spatially explicit information, reproducing the field-observed inter- and intra-specific variations. These results demonstrate the capability of using UAS-based imaging spectroscopy for characterizing the variability of foliar physiological traits at individual tree-crown scale over forest landscapes and highlight the similar generalizability but different biophysical mechanisms underlying spectra-trait relationships at leaf and canopy levels.

54 ENVIRONMENTAL SCIENCES↗

Development and Scale-up of Continuous Electrocatalytic Hydrogenation of Functionalized Nitro arenes, Nitriles and Unsaturated Aldehydes

Electrolysis reactors based on the filter-press architecture of redox flow batteries have proven to be effective and scalable towards the production of commercially relevant, pharmaceutical quantities of anilines (>500 kg/year) from halogen-, hydroxyl-, and carbonyl-substituted nitroarenes. Turbulent flow through the carbon felts on which the catalysts were supported facilitated scaling towards production levels because it conferred on the reactors scale-independent, plug flow-like residence time distributions and high mass transfer coefficients. Equipping the cells with micro-reference electrodes made it possible to transfer reaction conditions first developed in batch systems to the continuous flow reactors. The catalysts prepared by incipient wetness impregnation of metal salts into lightly oxidized carbon felt supports were readily generalizable.

Egbert, Jonathan D.↗

A Substrate-Integrated and Scalable Templated Approach Based on Rusted Steel for the Fabrication of Polypyrrole Nanotube Arrays

We report here a facile, generalizable, and entirely scalable approach for the fabrication of vertically aligned arrays of Fe{sub 2}O{sub 3}/polypyrrole core-shell nanostructures and polypyrrole nanotubes. Our 'all electrochemical' approach is based on the fabrication of {alpha}-Fe{sub 2}O{sub 3} nanowire arrays by the simple heat treatment of commodity low carbon steel substrates, followed by electropolymerization of conformal polypyrrole sheaths around the nanowires. Subsequently, electrochemical etching of the nanowires yields large-area vertically aligned polypyrrole nanotube arrays on the steel substrate. The developed methodology is generalizable to functionalized pyrrole monomers and represents a significant practical advance of relevance to the technological implementation of conjugated polymer nanostructures in electrochromics, electrochemical energy storage, and sensing.

36 MATERIALS SCIENCE↗

Mechanism of Catalytic O2 Reduction by Iron Tetraphenylporphyrin

The catalytic reduction of O2 to H2O is important for energy transduction in both synthetic and natural systems. Herein, we report a kinetic study of O2 reduction catalyzed by iron tetraphenylporphyrin in N,N-dimethylformamide using decamethylferrocene as a soluble reductant and para-toluenesulfonic acid (pTsOH) as the proton source. Reduction of the ferric porphyrin, [FeIII(TPP)]+ , forms the ferrous porphyrin, FeII(TPP), which binds O2 reversibly to form the ferric-superoxide porphyrin complex, FeIII(TPP)(O2 •?). The temperature dependence of both the electron transfer and O2 binding equilibrium constants have been determined. Kinetic studies over a range of concentrations and temperatures show that the catalyst resting state changes during the course of each catalytic run, necessitating the use of global kinetic modeling to extract rate constants and kinetic barriers. The rate-determining step in oxygen reduction is protonation of FeIII(TPP)(O2•?) by pTsOH, which proceeds with a substantial kinetic barrier. Computational studies indicate that this barrier for proton transfer arises from an unfavorable pre-association of the proton donor with the superoxide adduct and a transition state that requires significant desolvation of the proton donor. Together, these results are the first example of oxygen reduction by iron tetraphenylporphyrin where the pre-equilibria between ferric, ferrous, and ferric-superoxide intermediates have been quantified under catalytic conditions. This work gives a generalizable model for the mechanism of iron porphyrin-catalyzed ORR and provides an unusually complete mechanistic study of an ORR reaction. More broadly, this study also highlights the kinetic challenges for proton transfer to catalytic intermediates in organic media.

Pegis, Michael L.↗

Assessing Decadal Predictability in an Earth-System Model Using Explainable Neural Networks

We show that explainable neural networks can identify regions of oceanic variability that contribute predictability on decadal timescales in a fully coupled Earth-system model. The neural networks learn to use sea-surface temperature anomalies to predict future continental surface temperature anomalies. We then use a neural-network explainability method called layerwise relevance propagation to infer which oceanic patterns lead to accurate predictions made by the neural networks. In particular, regions within the North Atlantic Ocean and North Pacific Ocean lend the most predictability for surface temperature across continental North America. We apply the proposed methodology to decadal variability, although the concept is generalizable to other timescales of predictability. Furthermore, while our approach focuses on predictable patterns of internal variability within climate models, it should be generalizable to observational data as well. Our study contributes to the growing evidence that explainable neural networks are important tools for advancing geoscientific knowledge.

58 GEOSCIENCES↗

Stream Temperature Prediction in a Shifting Environment: Explaining the Influence of Deep Learning Architecture

Stream temperature is a fundamental control on ecosystem health. Recent efforts incorporating process guidance into deep learning models for predicting stream temperature have been shown to outperform existing statistical and physical models. This performance is in part because deep learning architectures can actively learn spatiotemporal relationships that govern how water and energy propagate through a river network. However, exploration of how spatiotemporal awareness and process guidance influence a model's generalizability under shifting environmental conditions such as climate change is limited. Here, we use Explainable Artificial Intelligence (XAI) to interrogate how differing deep learning architectures affect a model's learned spatial and temporal dependencies, and how those learned dependencies affect a model's ability to maintain high accuracy when applied to unseen environmental conditions. Using the Delaware River Basin in the northeastern United States as a test case, we compare two spatiotemporally aware process–guided deep learning models for predicting stream temperature (a recurrent graph convolution network—RGCN, and a temporal convolution graph model—Graph WaveNet). Both models achieve equally high predictive performance when testing data are well represented in the training data (test root mean squared errors of 1.64°C and 1.65°C); however, Graph WaveNet significantly outperforms RGCN in 4 out of 5 experiments where test partitions represent different types of unseen environmental conditions. XAI results show that the architecture of Graph WaveNet leads to learned spatial relationships with greater fidelity to physical processes, and that this fidelity improves the generalizability of the model when applied to shifting and/or unseen environmental conditions.

54 ENVIRONMENTAL SCIENCES↗

Geospatial mapping of distribution grid with machine learning and publicly-accessible multi-modal data

Abstract Detailed and location-aware distribution grid information is a prerequisite for various power system applications such as renewable energy integration, wildfire risk assessment, and infrastructure planning. However, a generalizable and scalable approach to obtain such information is still lacking. In this work, we develop a machine-learning-based framework to map both overhead and underground distribution grids using widely-available multi-modal data including street view images, road networks, and building maps. Benchmarked against the utility-owned distribution grid map in California, our framework achieves > 80% precision and recall on average in the geospatial mapping of grids. The framework developed with the California data can be transferred to Sub-Saharan Africa and maintain the same level of precision without fine-tuning, demonstrating its generalizability. Furthermore, our framework achieves a R 2 of 0.63 in measuring the fraction of underground power lines at the aggregate level for estimating grid exposure to wildfires. We offer the framework as an open tool for mapping and analyzing distribution grids solely based on publicly-accessible data to support the construction and maintenance of reliable and clean energy systems around the world.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Machine Learning Augmented Predictive and Generative Model for Rupture Life in Ferritic and Austenitic Steels

The Larson-Miller parameter (LMP) offers an efficient and fast scheme to estimate the creep rupture life of alloy materials for high temperature applications. However, owing to poor generalizability and dependence on the constant C, which is typically not known a-priori, estimations using the Larson-Miller parameter often result in suboptimal performance for a wide range of materials. At best it is useful in comparing alloys of similar composition. In this work, three machine learning (ML) schemes were developed for rupture life prediction for 9-12% Cr ferritic-martensitic steels and austenitic stainless steels, i.e., a hierarchical model to parameterize LMP using the LMP constant C to compute rupture life, a hierarchical model to parameterize both C and LMP to compute rupture life, and a direct prediction of rupture life. Specifically, we show that the third scheme, using a gradient boosting algorithm, can be used to train ML models for very accurate prediction of rupture life in a variety of alloys (Pear-son Correlation Coefficient > 0.9 for 9-12% Cr and > 0.8 for austenitic stainless steels). In addition, the Shapley value was used to quantify feature importance, making the model interpretable by identifying the effect of various features on the model performance. Furthermore, a variational autoencoder-based generative model was built by conditioning on the experimental dataset to sample hypothetical synthetic candidate alloys from the learnt joint distribution not existing in both 9-12 % Cr ferritic-martensitic steel and austenitic stainless steel datasets. Finally, based on the predictive and generative model, a reinforcement learning strategy has been proposed to guide experimentalists into designing better heat resistant alloys.

Mamun, Md Osman G.↗

Prediction of Optimal Drug Schedules for Controlling Autophagy

Abstract The effects of molecularly targeted drug perturbations on cellular activities and fates are difficult to predict using intuition alone because of the complex behaviors of cellular regulatory networks. An approach to overcoming this problem is to develop mathematical models for predicting drug effects. Such an approach beckons for co-development of computational methods for extracting insights useful for guiding therapy selection and optimizing drug scheduling. Here, we present and evaluate a generalizable strategy for identifying drug dosing schedules that minimize the amount of drug needed to achieve sustained suppression or elevation of an important cellular activity/process, the recycling of cytoplasmic contents through (macro)autophagy. Therapeutic targeting of autophagy is currently being evaluated in diverse clinical trials but without the benefit of a control engineering perspective. Using a nonlinear ordinary differential equation (ODE) model that accounts for activating and inhibiting influences among protein and lipid kinases that regulate autophagy (MTORC1, ULK1, AMPK and VPS34) and methods guaranteed to find locally optimal control strategies, we find optimal drug dosing schedules (open-loop controllers) for each of six classes of drugs and drug pairs. Our approach is generalizable to designing monotherapy and multi therapy drug schedules that affect different cell signaling networks of interest.

60 APPLIED LIFE SCIENCES↗