Search NASA⌕ Search

SEARCH · Search NASA

Results for “SHAP analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2022

Using an Explainable Machine Learning Approach to Characterize Earth System Model Errors: Application of SHAP Analysis to Modeling Lightning Flash Occurrence

Computational models of the Earth System are critical tools for modern scientific inquiry. Effortstoward evaluating and improving errors in representations of physical and chemical processes inthese large computational systems are commonly stymied by highly nonlinear and complexerror behavior. Recent work has shown that these errors can be effectively predicted usingmodern Artificial Intelligence (A.I.) techniques. In this work, we go beyond these previousstudies to apply an interpretable A.I. technique to not only predict model errors but also movetoward understanding the underlying reasons for successful error prediction. We use XGBoostclassification trees and SHapley Additive exPlanations (SHAP) analysis to explore the errors inthe prediction of lightning occurrence in the NASA GEOS model, a widely used Earth SystemModel. This explainable error prediction system can effectively predict the model error andindicates that the errors are strongly related to convective processes and the characteristics ofthe land surface.

Artificial intelligence↗
DOE OSTI2022

Using an Explainable Machine Learning Approach to Characterize Earth System Model Errors: Application of SHAP Analysis to Modeling Lightning Flash Occurrence

Abstract Computational models of the Earth System are critical tools for modern scientific inquiry. Efforts toward evaluating and improving errors in representations of physical and chemical processes in these large computational systems are commonly stymied by highly nonlinear and complex error behavior. Recent work has shown that these errors can be effectively predicted using modern Artificial Intelligence (A.I.) techniques. In this work, we go beyond these previous studies to apply an explainable A.I. technique to not only predict model errors but also move toward understanding the underlying reasons for successful error prediction. We use XGBoost classification trees and SHapley Additive exPlanations analysis to explore the errors in the prediction of lightning occurrence in the NASA Goddard Earth Observing System model, a widely used Earth System Model. This explainable error prediction system can effectively predict the model error and indicates that the errors are strongly related to convective processes and the characteristics of the land surface.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Analyzing the impact of design factors on solar module thermomechanical durability using interpretable machine learning techniques

Solar modules in utility-scale systems are expected to maintain decades of lifetime to rival conventional energy sources. However, cyclic thermomechanical loading often degrades their long-term performance, highlighting the importance of effective design to mitigate thermal expansion mismatches between module materials. Given the complex composition of solar modules, isolating the impact of individual components on overall durability remains a challenging task. In this work, we analyze a comprehensive data set that comprises bill-of-materials (BOM) and thermal cycling power loss from 251 distinct module designs to identify the predominant design factors and their impacts on the thermomechanical durability of modules. The methodology of our analysis combines machine learning modeling (random forest) and Shapley additive explanation (SHAP) to correlate design factors with power loss and interpret the model’s decision-making. The interpretation reveals that silicon type (monocrystalline or polycrystalline), encapsulant thickness, busbar numbers, and wafer thickness predominantly influence the degradation. With lower power loss of around 0.6% on average in the SHAP analysis, monocrystalline cells present better durability than polycrystalline cells. This finding is further substantiated by statistical testing on our raw data set. The SHAP analysis also demonstrates that while thicker encapsulants lead to reduced power loss, further increasing their thickness over around 0.6 to 0.7 mm does not yield additional benefits, particularly for the front side one. In addition, other important BOM features such as the number of busbars are analyzed. This study provides a blueprint for utilizing explainable machine learning techniques in a complex material system and can potentially guide future research on optimizing the design of solar modules.

14 SOLAR ENERGY↗
DOE OSTI2025

Uncovering Structure–Conductivity Relationships in Anion Exchange Membranes (AEMs) Using Interpretable Machine Learning

Anion exchange membranes (AEMs) play a vital role in the performance of water electrolyzers and fuel cells, yet their discovery and optimization remain challenging due to the complexity of structure–property relationships. In this study, we introduce a machine learning framework that leverages conditional graph neural networks (cGNNs) and descriptor-based models and a hybrid graph neural network (HGARE) to predict and interpret ionic conductivity. The descriptor-based pipeline employs principal component analysis (PCA), ablation, and SHAP analysis to identify factors governing anion conductivity, revealing electronic, topological, and compositional descriptors as key contributors. Beyond prediction, dimensionality reduction and clustering are performed by employing t-SNE and KMeans as well as SOM, which reveal distinct membranes clusters, some of which were enriched with high anion conductivity. Among graph-based approaches, the graph convolutional (GCN) achieved strong predictive performance, while the Hybrid Graph Autoencoder-Regressor Ensemble (HGARE) achieved the highest accuracy. Additionally, atom-level saliency maps from GCN provide spatial explanations for conductive behavior, revealing the importance of polarizable and flexible regions. This work contributes to the accelerated and data-driven design of high-performance AEMs.

Naghshnejad, Pegah [Department of Chemical Enginee↗
DOE OSTI2024

High-Throughput Screening and Accurate Prediction of Ionic Liquid Viscosities Using Interpretable Machine Learning

Ionic liquids (ILs) are a novel group of green solvents with great promise for various industrial applications, including carbon capture and lignocellulosic biomass deconstruction. However, the use of ILs at the industrial scale remains challenging due to their high viscosities at ambient temperatures. To develop ILs with lower viscosities, a systematic study of their quantitative structure–property relationship (QSPR) is desirable. Here, we developed four machine learning (ML) models to predict viscosity at various temperature and pressure ranges, trained over a wide range of ILs consisting of various cationic and anionic families. ML methods including two-factor polynomial regression (two-factor PR), support vector regression (SVR), feed-forward neural networks (FFNN), and categorical boosting (CATBoost) were developed based on features that have proven useful in previous ML studies: COSMO-RS (conductor-like screening model for real solvents)-derived surface screening charge densities (sigma profiles). FFNN and CATBoost were the most accurate in predicting IL viscosities with lower average absolute relative deviation and higher R2 values on the test set. Tanimoto similarity scores were calculated to characterize the chemical space and structural similarity of the investigated ions. Furthermore, SHapley Additive exPlanation (SHAP) analysis was employed to interpret the ML results. Temperature, the polar area of ILs, and the nonpolar regions of ions are key features that influence the viscosity predictions. Importantly, the IL viscosity prediction here is the most accurate reported to date.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Accelerating the design of lattice structures using machine learning

Lattices remain an attractive class of structures due to their design versatility; however, rapidly designing lattice structures with tailored or optimal mechanical properties remains a significant challenge. With each added design variable, the design space quickly becomes intractable. To address this challenge, research efforts have sought to combine computational approaches with machine learning (ML)-based approaches to reduce the computational cost of the design process and accelerate mechanical design. While these efforts have made substantial progress, significant challenges remain in (1) building and interpreting the ML-based surrogate models and (2) iteratively and efficiently curating training datasets for optimization tasks. Here, we address the first challenge by combining ML-based surrogate modeling and Shapley additive explanation (SHAP) analysis to interpret the impact of each design variable. We find that our ML-based surrogate models achieve excellent prediction capabilities (R 2 > 0.95) and SHAP values aid in uncovering design variables influencing performance. We address the second challenge by utilizing active learning-based methods, such as Bayesian optimization, to explore the design space and report a 5 × reduction in simulations relative to grid-based search. Collectively, these results underscore the value of building intelligent design systems that leverage ML-based methods for uncovering key design variables and accelerating design.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Explainable machine learning reveals that local structural motifs encode the thermodynamic state across the CuZr metallic glass-forming range

Metallic glasses derive their properties from the statistics of local atomic motifs rather than from long-range order, yet a quantitative, chemistry-specific link between motif populations and the underlying glassy state has remained elusive. In this work we combine large-scale molecular dynamics, Voronoi tessellation, deep neural networks, and SHapley Additive exPlanations (SHAP) to identify which local structural motifs define the glassy state of Cu—Zr metallic glasses. A dataset of 17,180 atomistic configurations spanning ten compositions (Cu 20 Zr 80 –Cu 80 Zr 20 ) and four quench rates (10 9 –10 12 K/s) is used to train a feed-forward neural network that regresses temperature across the 50–2000 K liquid–supercooled–glass range, achieving a mean absolute error of 19.89 K and R 2 = 0.9974, confirming that the local structural state is faithfully encoded in motif-level structure. SHAP analysis then reveals that a tightly coupled near-icosahedral family of motifs (coordination numbers (CN) 11–13, including the full icosahedron 001200 and its single-atom-perturbation sibling 10930) collectively encodes the thermodynamic state of the system across the full glass-forming range. The CN = 11–13 ordered members carry negative SHAP values at high populations, tracking the most deeply-quenched configurations, while 10930 shows the reversed signature consistent with its role as a soft-spot host whose population shrinks as the icosahedral network deepens. The analysis demonstrates that explainable machine learning can isolate the minimal motif vocabulary defining the glassy state and recovers the near-icosahedral building blocks previously identified by data-driven analyses of Cu—Zr. The approach provides a general, chemistry-specific route for characterizing the structural state of disordered materials.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Quantitative Analysis and Prediction of Thermal Runaway Metrics of High-Nickel Oxide Cathodes by Machine Learning Models

The pursuit of higher energy density in lithium-ion batteries has made high-nickel (Ni) layered oxides leading cathode candidates for next-generation electric vehicles. However, their poor thermal stability, particularly at Ni contents ≥ 90%, increases the risk of cathode-initiated thermal runaway. Furthermore, we present a data-driven framework combining linear and nonlinear machine learning models to predict key thermal runaway descriptors from a high-throughput differential scanning calorimetry database. With cathode composition and state of charge (SOC) as input features, the ensemble model accurately predicts peak temperature, heat release, and peak heat flow. SHAP analysis identifies Ni content and SOC as the dominant factors controlling thermal runaway temperature, while SOC primarily governs heat release and peak heat flow. Al, Mg, and Mn improve thermal stability by strengthening metal–oxygen bonding and delaying structural transformation, whereas B mainly reduces heat release through surface passivation. Validation with a new cathode composition confirms accurate prediction of SOC-dependent thermal runaway behavior and critical SOC.

25 ENERGY STORAGE↗
DOE OSTI2025

Tree-level carbon stock estimations across diverse species using multi-source remote sensing integration

Forests are critical carbon sinks, and remote sensing has been increasingly widely used for forest monitoring and biomass estimations. However, species-specific tree-level studies remain limited. In this study, we demonstrated the feasibility of integrating UAV-based LiDAR with high-resolution optical satellite imagery (0.5 m) to estimate biomass for individual trees across different species. The proposed method accurately estimated biomass for 53 trees (R² = 0.82, rRMSE = 0.44), with species-specific datasets, showing an average 25.2% increase in R² and a 14.8% reduction in rRMSE. A novel vegetation index combining forest structure parameters with vegetation indices (VIs) was developed using high-resolution multispectral satellite data (3 m) to explore its relationship with individual tree biomass. Combining forest structural parameters with VIs further improved estimation accuracy, achieving an R²of 0.89 and an rRMSE of 0.34. Species-specific datasets show an 11.6% increase in R²compared to methods without VIs, and a 22.2% improvement over methods using only VIs. SHapley Additive exPlanations (SHAP) analysis shows that the volume feature played a key role in model performance and remained stable throughout the training process. Altogether, the proposed approach enhances individual tree biomass and carbon sink estimations, showing great potential for large-scale precise forest carbon monitoring using multi-source remote sensing data.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Explainable machine learning model for multi-step forecasting of reservoir inflow with uncertainty quantification

We propose an explainable machine learning (ML) model with uncertainty quantification (UQ) to improve multi-step reservoir inflow forecasting. Traditional ML methods have challenges in forecasting inflows multiple days ahead, and lack explainability and UQ. To address these limitations, we introduce an encoder–decoder long short-term memory (ED-LSTM) network for multi-step forecasting, employ the SHapley Additive exPlanation (SHAP) technique for understanding the influence of hydrometeorological factors on inflow prediction, and develop a novel UQ method for prediction trustworthiness. We apply these methods to forecast 7-day inflow in snow-dominant and rain-driven reservoirs. The results demonstrate the effectiveness of the ED-LSTM model, with high forecasting accuracy for short lead times. Our UQ method provides reliable uncertainty estimates, covering 90% of data with a 90% confidence level. The SHAP analysis reveals the importance of historical inflow and precipitation as influential factors. These findings and methods may support reservoir operators in optimizing water resources management decisions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Accurate Machine Learning for Predicting the Viscosities of Deep Eutectic Solvents

Deep eutectic solvents (DESs) are emerging as environmentally friendly designer solvents for mass transport and heat transfer processes in industrial applications; however, the lack of accurate tools to predict and thus control their viscosities under both a range of environmental factors and formulations hinders their general application. While DESs may serve as designer solvents, with nearly unlimited combinations, this unfortunately makes it experimentally infeasible to comprehensively measure the viscosities of all DESs of potential industrial interest. To assist in the design of DESs, we have developed several new machine learning (ML) models that accurately and rapidly predict the viscosities of a diverse group of DESs at different temperatures and molar ratios using, to date, one of the most comprehensive data sets containing the properties of over 670 DESs over a wide range of temperatures (278.15–385.25 K). Three ML models, including support vector regression (SVR), feed forward neural networks (FFNNs), and categorical boosting (CatBoost), were developed to predict DES viscosity as a function of temperature and molar ratio and contrasted with multilinear and two-factor polynomial regression baselines. Further, quantum chemistry-based, COSMO-RS-derived sigma profile (σ-profile) features were used as inputs for the ML models. The CatBoost model is excellent at externally predicting DES viscosity, as indicated by high R 2 (0.99) and low root-mean-square-error (RMSE) and average absolute relative deviations (AARD) (5.22%) values for the testing data sets, and 98% of the data points lie within the 15% of AARD deviations. Furthermore, SHapley additive explanation (SHAP) analysis was employed to interpret the ML results and rationalize the viscosity predictions. The result is an ML approach that accurately predicts viscosity and will aid in accelerating the design of appropriate DESs for industrial applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Machine Learning Framework for Characterizing Processing–Structure Relationship in Block Copolymer Thin Films

The morphology of block copolymers (BCPs) critically influences material properties and applications. This work introduces a machine learning (ML)-enabled, high-throughput framework for analyzing grazing incidence small-angle X-ray scattering (GISAXS) data and atomic force microscopy (AFM) images to characterize BCP thin film morphology. A convolutional neural network was trained to classify AFM images by surface features, achieving 97% testing accuracy. Classified images were then analyzed to extract 2D grain size measurements from the samples in a high-throughput manner. ML models were trained to predict domain orientation based on processing parameters such as solvent ratio, additive type, and additive ratio. GISAXS-based properties were predicted with strong performances (R 2 > 0.75), while AFM-based property predictions were less accurate (R 2 < 0.60), likely due to the localized nature of AFM measurements compared to the bulk information captured by GISAXS. Beyond model performance, interpretability was addressed using SHapley Additive exPlanations (SHAP). SHAP analysis revealed that the additive ratio had the largest impact on morphological predictions, where additive provides the BCP chains with increased volume to rearrange into thermodynamically favorable morphologies. This interpretability helps validate model predictions and offers insight into parameter importance. Altogether, the presented framework combining high-throughput characterization and interpretable ML offers an approach to exploring and optimizing BCP thin film morphology across a broad processing landscape.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Integration of the Biot–Gassmann Fluid Substitution Method and Machine Learning-Based Velocity–Stress Relationship for Estimating In Situ Stresses

Recent advancements have shown that in situ stresses can be reliably estimated through an integrated machine/deep learning (ML/DL)-based framework, which relies on models trained and validated using true triaxial ultrasonic velocity (TUV) experimental data that involve measurements of ultrasonic velocity in saturated rocks under varying stress configurations. However, when the goal is to interpret lower frequency measurements, it may be more appropriate to run experiments on dry rocks and then obtain Biot–Gassmann-derived equivalent saturated velocities (low-frequency approximation) and employ these quantities for training ML/DL models to predict in situ stress. Whether the dispersion effect of frequency on the velocity–stress relationship substantially impacts in situ stress prediction is an important and unresolved question. This work presents an enhancement of ML/DL-based workflow by training and implementing ML/DL models using equivalent saturated acoustic velocities (low-frequency) obtained by applying Biot–Gassmann fluid substitution on the ultrasonic velocities of dry cores. The models were trained on TUV data sets derived from three subsurface cores extracted from the geothermal well 16B(78)-32 at the Utah FORGE site. Each core was subjected to 75 unique stress configurations for velocity measurement in the dry state. The ML/DL trained on the TUV data set with equivalent saturated velocities demonstrated promising performance to predict in situ stress in subsurface geological rocks using velocity–stress relationships with R 2 of 0.86, 0.971, and 0.975 and root mean squared error (RMSE) of 2.59, 1.92, and 1.80 for validation/testing phases of vertical, minimum horizontal, and maximum horizontal stress models, respectively. Additionally, interpretation and explanation by Shapley additive explanations (SHAP) analysis further improved scientific validation and model reliability for estimating in situ stresses.

colloids↗
DOE OSTI2025

Charting the chemical space of Zintl phases with graph neural networks and bonding insights

A large number of Zintl phases have been discovered by solid-state chemists driven by empirical knowledge, chemical intuition and in some cases, through serendipitous accidents. These discoveries have only scratched the surface, given the vast compositional and structural diversity that Zintl phases can accommodate. The large chemical space of Zintl phases, as well as intermetallic compounds in general, remain under-explored. Here, we use graph neural networks and the upper bound energy minimization approach to efficiently scan a large chemical space of >90 000 hypothetical Zintl phases and accurately discover 1810 new thermodynamically stable phases with 90% precision, as validated with first-principles calculations. We show that our approach is more than 2× more accurate in predicting DFT stability than M3GNet (40% precision) on the same dataset. Using a random forest model and SHAP analysis, we demonstrate the critical role of ionic bonding in the thermodynamic stability of Zintl phases. Our results not only expand the known chemical landscape of Zintl phases but also highlight the efficacy of machine learning frameworks combined with domain knowledge in uncovering chemically meaningful insights across complex intermetallics.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Short-Term Energy and Meteorological Impacts on Thanksgiving CO2 in Salt Lake City

Abstract Long-term, high-frequency atmospheric CO2 measurements at multiple sites in the Salt Lake City (SLC), Utah, reveal that annual and monthly CO2 variability aligns with a priori estimates of emissions from anthropogenic and biological sources. In this study, we investigate whether short-term fluctuations in anthropogenic emissions, as captured in the Vulcan3 dataset for the United States, can be detected in atmospheric CO2 observations. Specifically, we focus on Thanksgiving holidays, when traffic and energy usage patterns differ from the rest of November. Onroad CO2 emissions exhibit a double peak during weekday morning and evening rush hours but remain relatively low on weekends and Thanksgiving. Interestingly, CO2 mole fractions during Thanksgiving were higher than the rest of November at all SLC monitoring sites, particularly from 2008 to 2013. This increase is partially attributed to elevated energy-related emissions — especially residential sources — and meteorological factors such as weak wind speeds, cold temperature, and a low planetary boundary layer height (PBLH).&#xD;&#xD; While CO₂ emissions and mole fraction patterns align over time, notable spatial differences exist. For instance, the near-highway site in Murray shows the highest CO₂ mole fractions despite low local emissions, suggesting pollution transport via highways and wind advection. Random Forest model-based SHapley Additive exPlanations (SHAP) analysis reveals that onroad emissions dominate CO2 contributions on weekdays and weekends, while energy-related emissions play a larger role during Thanksgiving, alongside meteorological drivers such as wind speed and PBLH. Across six urban cities, CO2 emissions display a consistent pattern: residential and commercial (onroad) emissions peak during Thanksgiving (weekday) with substantial (minimal) year-to-year variability. These findings highlight that urban CO₂ variability is driven by the combined influence of emissions and meteorology, underscoring the need for integrated mitigation strategies. Additionally, multi-site measurements are essential for accurate source attribution and the development of effective policy interventions. &#xD;

Ryoo, Ju-Mee (ORCID:0000000234256296)↗