Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model interpretation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,243 records · Page 69

Comparison of Equilibrium Climate Sensitivity Estimates From Slab Ocean, 150‐Year, and Longer Simulations

We compare equilibrium climate sensitivity (ECS) estimates from pairs of long (≥ 800‐year) control and abruptly quadrupled CO2 simulations with shorter (150, 300 year) coupled atmosphere‐ocean simulations and Slab Ocean Models (SOM). Consistent with previous work, ECS estimates from shorter coupled simulations based on annual averages for years 1‐150 underestimate those from SOM (‐8% ± 13%) and long (‐14% ± 8%) simulations. Analysis of only years 21‐150 improved agreement with SOM (‐2% ± 14%) and long (‐8% ± 10%) estimates. Use of pentadal averages for years 51‐150 results in improved agreement with long simulations (‐4% ± 11%). While ECS estimates from current generation US models based on SOM and coupled annual averages of years 1‐150 range from 2.6°C to 5.3°C, estimates based longer simulations of the same models range from 3.2°C to 7.0°C. Such variations between methods argues for caution in comparison and interpretation of ECS estimates across models.

Climate sensitivity↗

ACES-GNN: can graph neural network learn to explain activity cliffs?

Graph Neural Networks (GNNs) have revolutionized molecular property prediction by leveraging graph-based representations, yet their opaque decision-making processes hinder broader adoption in drug discovery. This study introduces the Activity-Cliff-Explanation-Supervised GNN (ACES-GNN) framework, designed to simultaneously improve predictive accuracy and interpretability by integrating explanation supervision for activity cliffs (ACs) into GNN training. ACs, defined by structurally similar molecules with significant potency differences, pose challenges for traditional models due to their reliance on shared structural features. By aligning model attributions with chemist-friendly interpretations, the ACES-GNN framework bridges the gap between prediction and explanation. Validated across 30 pharmacological targets, ACES-GNN consistently enhances both predictive accuracy and attribution quality for ACs compared to unsupervised GNNs. Our results demonstrate a positive correlation between improved predictions and accurate explanations, offering a robust and adaptable framework to better understand and interpret ACs. This work underscores the potential of explanation-guided learning to advance interpretable artificial intelligence in molecular modeling and drug discovery.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

High-throughput Li plating quantification for fast-charging battery design

Fast charging of most commercial lithium-ion batteries is limited due to fear of lithium plating on the graphite anode, which is difficult to detect and poses considerable safety risk. In this report we demonstrate the power of simple, accessible and high-throughput cycling techniques to quantify irreversible Li plating spanning data from over 200 cells. We first observe the effects of energy density, charge rate, temperature and state of charge on lithium plating, use the results to refine a mature physics-based electrochemical model and provide an interpretable empirical equation for predicting the plating onset state of charge. We then explore the reversibility of lithium plating and its connection to electrolyte design for preventing irreversible Li accumulation. Finally, we design a method to quantify in situ Li plating for commercially relevant graphite|LiNi 0.5 Mn 0.3 Co 0.2 O 2 (NMC) cells and compare with results from the experimentally convenient Li|graphite configuration. The hypotheses and abundant data herein were generated primarily with equipment universal to the battery researcher, encouraging further development of innovative testing methods and data processing that enable rapid battery engineering.

25 ENERGY STORAGE↗

Feedback density and causal complexity of simulation model structure

Measures of simulation model complexity generally focus on outputs; we propose measuring the complexity of a model’s causal structure to gain insight into its fundamental character. This article introduces tools for measuring causal complexity. First, we introduce a method for developing a model’s causal structure diagram, which characterises the causal interactions present in the code. Causal structure diagrams facilitate comparison of simulation models, including those from different paradigms. Next, we develop metrics for evaluating a model’s causal complexity using its causal structure diagram. We discuss cyclomatic complexity as a measure of the intricacy of causal structure and introduce two new metrics that incorporate the concept of feedback, a fundamental component of causal structure. The first new metric introduced here is feedback density, a measure of the cycle-based interconnectedness of causal structure. The second metric combines cyclomatic complexity and feedback density into a comprehensive causal complexity measure. Finally, we demonstrate these complexity metrics on simulation models from multiple paradigms and discuss potential uses and interpretations. These tools enable direct comparison of models across paradigms and provide a mechanism for measuring and discussing complexity based on a model’s fundamental assumptions and design.

97 MATHEMATICS AND COMPUTING↗

Training custom light curve models of SN Ia subpopulations selected according to host galaxy properties

ABSTRACT Type Ia supernova (SN Ia) cosmology analyses include a luminosity step function in their distance standardization process to account for an observed yet unexplained difference in the post-standardization luminosities of SNe Ia originating from different host galaxy populations [e.g. high-mass ($M \gtrsim 10^{10} \, {\rm M}_{\odot }$) versus low-mass galaxies]. We present a novel method for including host-mass correlations in the SALT3 (Spectral Adaptive Light curve Template 3) light curve model used for standardizing SN Ia distances. We split the SALT3 training sample according to host-mass, training independent models for the low- and high-host-mass samples. Our models indicate that there are different average Si ii spectral feature strengths between the two populations, and that the average spectral energy distribution of SNe from low-mass galaxies is bluer than the high-mass counterpart. We then use our trained models to perform an SN cosmology analysis on the 3-yr spectroscopically confirmed Dark Energy Survey SN sample, treating SNe from low- and high-mass host galaxies as separate populations throughout. We find that our mass-split models reduce the Hubble residual scatter in the sample, albeit at a low statistical significance. We do find a reduction in the mass-correlated luminosity step but conclude that this arises from the model-dependent re-definition of the fiducial SN absolute magnitude rather than the models themselves. Our results stress the importance of adopting a standard definition of the SN parameters (x0, x1, c) in order to extract the most value out of the light curve modelling tools that are currently available and to correctly interpret results that are fit with different models.

Taylor, G. (ORCID:0000000157563259)↗

Using Fourier-Plane Imaging Microscopy for Determining Transition-Dipole-Moment Orientations in Organic Light-Emitting Devices

Here, we use Fourier-plane imaging microscopy (FIM) to determine the transition-dipole-moment orientation in doped organic emissive thin films. The use of FIM enables precise, sensitive, and rapid measurement of dipole orientation in the emission layer of an organic light-emitting device (OLED). An optical model of a stratified birefringent multilayer is introduced for interpreting results obtained by FIM. Using the model, we determine the average orientation of transition-dipole-moment vectors of three phosphorescent dopant emitters. The dipole alignment measured by FIM quantitatively explains the difference in OLED efficiencies using these archetype dopant molecules. FIM provides a nondestructive tool to measure and ultimately improve the outcoupling efficiency of OLEDs and other light-emitting devices.

74 ATOMIC AND MOLECULAR PHYSICS↗

PDF DECODER ANALYSIS CODE

SF-24-038"PDFdecoder", as a new application to explore parametrizations of parton distribution functions (PDFs) of the proton or other hadrons. The PDFs are fundamental quantities in particle physics which are necessary inputs to precise theoretical predictions for experiments at the Large Hadron Collider (LHC) and other facilities. As such, understanding how the PDFs are parametrized and associated uncertainties is a pressing need. The specific problem PDFdecoder confronts is the need of having a tractable and interpretably machine-learning (ML) framework to parametrize the PDFs and their uncertainties so as to understand how a given preferred parametrization is obtained. This problem has not been significantly addressed in the current literature. While other groups have used ML-based approaches to parametrize PDFs in the form of feed-forward neural networks, the question of tractability has not been explored in a PDF context. Our solution makes significant progress in this problem by using an array of encoder-decoder (essentially, autoencoder) architectures with varying constraints to the intermediate latent spaces based on interpretable physics. As a consequence, the trained models can be used as generative networks to produce interpretable predictions for the PDFs in a way that can be refined and studied further.

Hobbs, Timothy↗

Grand Unified Models

Attempts to place compact radio sources within a general interpretive framework for galactic nuclear activity, or Grand Unified Models, are reviewed. The study of superluminal motion is discussed, stressing the need for more objective methods to compare VLBI maps of compact radio sources at different epochs. Observations and arguments for and against the importance of relativistic beaming in compact radio sources are presented. The simple source model, in which the observed components move with uniform velocity along the source symmetry axis away from a stationary self-absorbed core is examined and suggestions for modifying the model are given. The parabolic spectra of blazars are discussed. The black hole model for explaining general activity in the nuclei of galaxies and radio emission and the incorporation of the apparent evolutionary properties of active galactic nuclei into grand models are also examined.

Blandford, Roger D.↗

X-Ray Variability and the Secondary Star

We discuss the history of X-ray observations of the 11 Car system, concentrating on the periodic variability discovered in the 1990s. We discuss the interpretation of these variations, concentrating on a model of the system as a "collidingwind" binary. This interpretation allows the physical and orbital parameters of eta Car and its companion star to be constrained.

Corcoran, M. F.↗

Off-Nominal Event Analysis in Autonomous Flights Based on Explainable Artificial Intelligence

A key objective in the Urban Air Mobility program at NASA is to intelligently perform an autonomous flight in a complex urban environment under all weather conditions with guaranteed levels of safety. To accomplish this, the mission manager (central decision-making module) of the vehicle needs to make informed decisions between various Courses of Action (CoA) based on its' interpretation of the inputs it receives. If an off-nominal event is detected either based on the amalgamation of sensor data or the use of machine learning models, the mission manager may greatly benefit from identification of the input features that most likely contributed to that specific event. Such an understanding is usually not possible to obtain from the classical machine learning models (deep learning) due to the inherent black box like structure. However, this understanding is achieved using eXplainable Artificial Intelligence (XAI) models that provide a human interpretable rationale for the predictions made. This work presents a game theory inspired XAI model for the off-nominal assessment of autonomous flights. The proposed approach based on Shapley values is model agnostic, provides local as well as global explanation and satisfies the four axioms (efficiency, symmetry, dummy, additivity) to achieve fair contribution. The versatility of the approach is first demonstrated on a simulated dataset in which the significance of each input to flight phase prediction is clearly identified. Subsequently, data from simulated flight trajectories are fed into the model which reveal the input features that most likely contributed to a rotor failure event thereby empowering the mission manager to take the appropriate CoA.

autonomy↗

Off-Nominal Event Analysis in Autonomous Flights Based on Explainable Artificial Intelligence

A key objective in the Urban Air Mobility program at NASA is to intelligently perform an autonomous flight in a complex urban environment under all weather conditions with guaranteed levels of safety. To accomplish this, the mission manager (central decision-making module) of the vehicle needs to make informed decisions between various Courses of Action (CoA) based on its' interpretation of the inputs it receives. If an off-nominal event is detected either based on the amalgamation of sensor data or the use of machine learning models, the mission manager may greatly benefit from identification of the input features that most likely contributed to that specific event. Such an understanding is usually not possible to obtain from the classical machine learning models (deep learning) due to the inherent black box like structure. However, this understanding is achieved using eXplainable Artificial Intelligence (XAI) models that provide a human interpretable rationale for the predictions made. This work presents a game theory inspired XAI model for the off-nominal assessment of autonomous flights. The proposed approach based on Shapley values is model agnostic, provides local as well as global explanation and satisfies the four axioms (efficiency, symmetry, dummy, additivity) to achieve fair contribution. The versatility of the approach is first demonstrated on a simulated dataset in which the significance of each input to flight phase prediction is clearly identified. Subsequently, data from simulated flight trajectories are fed into the model which reveal the input features that most likely contributed to a rotor failure event thereby empowering the mission manager to take the appropriate CoA.

autonomy↗

Composition of Magma and Characteristics of the Hydrothermal System of Newberry Volcano, Oregon, From Magnetotellurics

Abstract We use 3‐D magnetotellurics to improve our understanding of the structure and magma composition of Newberry Volcano in Oregon, USA. Newberry is a broad shield volcano with a summit caldera and strongly bimodal magmatism. Newberry has long been the subject of geothermal exploration research, but that work has focused on the volcano's west flank, leaving the caldera largely unstudied with geophysical methods until recently. Our modeling shows a relatively resistive magma reservoir of approximately 50 Ωm. Our work builds upon recent seismic models and petrological analysis to interpret Newberry's magma reservoir as a dry rhyolite with 8–11% partial melt, which matches the seismically determined melt fraction. Finding the conditions within the magma reservoir that allow the resistivity and seismic analysis to come to the same melt fraction helps us narrow down the magma temperature and composition. From this we infer a dry rhyolitic magma at 850 °C. We also image a prominent vertical conductive anomaly along the south rim below the vent that produced the most recent eruption. The anomaly extends from magma reservoir depths of 3 km to 1 km below the surface where it disperses into the caldera fill. We interpret this as the main conduit for magmatic fluids to reach Newberry's hydrothermal system. Other features that our model shows include higher conductivity along the caldera rim and a resistive older pluton on the west flank.

Bowles‐Martinez, E.↗

The Stop-and-Go Mechanism: Towards an Integrated Approach to Model Seismicity, Outgassing, Deformation, and Thermal Unrest at Active Volcanoes

Connecting the geophysical and geochemical signals recorded at and above the surface of volcanoes with source mechanisms is fundamental to understand transitions from quiescence to eruption, and to integrate the behavior of volcanoes with their regional seismotectonic and hydrological context. Some of these signals include shallow volcanic tremor, a long-lasting (minutes-to-years) ground vibration detected in volcanic areas during unrest; volcanic outgassing, which shows intriguing periodicities over multiple scales, as revealed by space-borne instruments and by ground-based, high-frequency (~1 Hz), sampling methods; inflation and deflation of volcanic edifices, commonly associated with subsurface volume changes; and large-scale (from a few to tens of km2), low-temperature, thermal anomalies, a newly-discovered signal that has been observed to emerge on volcanic flanks from months-to-years prior to gas- and magma-driven eruptions. Traditionally, these geophysical and geochemical signals have been modelled independently, which limits our interpretation of subsurface processes and thus our assessment of unrest. In this work, we show through lumped-parameter models, numerical simulations, and preliminary laboratory experiments that many of the signals recorded around volcanoes can be integrated into a common “stop-and-go” mechanism. In particular, we found that they can arise spontaneously when taking into account the feedbacks between the temporary accumulation of gas and/or magma in the crust (“stop”), and the diffusive transfer of gas and heat towards the surface (“go”). For example, we find that the “stop-and-go” mechanism can explain: (i) the emergence of monochromatic, broadband, and harmonic tremor; (ii) the periodic components commonly observed in volcanic outgassing time series; (iii) the link between large-scale thermal anomalies and shallow hydrothermal systems; (iv) the reported time lags between large-scale thermal anomalies and deformation; and (v) the breathing of potentially destructive volcanic calderas. The “stop-and-go” mechanism provides a consistent and realistic framework to link multiple geophysical and geochemical signals with the processes leading to volcanic unrest and eruption.

volcanoes↗

Making Corgis Important for Honeycomb Classification: Adversarial Attacks on Concept-based Explainability Tools

Methods for model explainability have become increasingly critical for testing the fairness and soundness of deep learning. Concept-based interpretability techniques, which use a small set of human-interpretable concept exemplars in order to measure the influence of a concept on a model's internal representation of input, are an important thread in this line of research. In this work we show that these explainability methods can suffer the same vulnerability to adversarial attacks as the models they are meant to analyze. We demonstrate this phenomenon on two well-known concept-based interpretability methods: TCAV and faceted feature visualization. We show that by leveraging the geometry of the problem and carefully perturbing the examples of the concept that is being investigated, we can radically change the output of the interpretability method. The attacks that we propose can either induce positive interpretations (polka dots are an important concept for a model when classifying zebras) or negative interpretations (stripes are not an important factor in identifying images of a zebra). Our work highlights the fact that in safety-critical applications, there is need for security around not only the machine learning pipeline but also the model interpretation process.

Brown, Davis R.↗

Hydrogen adsorption and transport in clay-rich geomaterials: Implications for large-volume underground hydrogen storage

Depleted oil and gas reservoirs, characterized by impermeable clay-rich caprocks, are promising sites for large-scale underground hydrogen storage (UHS), which is a key strategy to support hydrogen-based energy systems. However, experimental data on hydrogen storage in clay-rich geomaterials remain scarce. In this work, we experimentally investigated hydrogen adsorption and migration in clay-rich geomaterials in the presence of nitrogen and water under controlled temperatures. Experimental observations showed that hydrogen was adsorbed in dry illite. A dual-porosity transport model was developed to interpret hydrogen transport between large-pore and small-pore domains in illite. The large-pore domain is the space between clay particles (i.e., inter-particle space), whereas the small-pore domain is the nanoscale pore space between clay mineral layers (i.e., inter-layer or intra-particle space). In contrast, nitrogen showed no evidence of adsorption in dry illite because it cannot move into the small-pore domain due to the relatively large kinetic diameter, referred to as the molecular sieving effect. Here, we found that 0.7–1.3 nm is the length scale regulating this molecular sieving effect, matching the interlayer spacing in illite, suggesting that nitrogen is a promising cushion gas in UHS, which aims to maintain adequate pressure in the reservoir for economic operations. In wetted illite, hydrogen was not adsorbed into the interlayer space due to the occupation of adsorption sites by interlayer water, which highlights the critical role of the clay hydration state in controlling hydrogen-clay interactions. Additionally, hydrogen adsorption experiments on crushed shale indicated that the shale surface possessed adsorption sites more favorable for hydrogen than for nitrogen. Through these experiments, we provide new insights into hydrogen storage mechanisms in clay-rich geomaterials and offer valuable laboratory data for evaluating the performance of large-scale UHS systems.

Adsorption↗

Generative models on phase space

Deep generative models such as diffusion and flow matching are powerful machine learning tools capable of learning and sampling from high-dimensional distributions. They are particularly useful when the training data appears to be concentrated on a submanifold of the data embedding space. For high-energy physics data, consisting of collections of relativistic energy-momentum 4-vectors, this submanifold can enforce extremely strong physically-motivated priors, such as energy and momentum conservation. If these constraints are learned only approximately, rather than exactly, this can inhibit the interpretability and reliability of such generative models. To remedy this deficiency, we introduce generative models which are, by construction, confined at every step of their sampling trajectory to the manifold of massless N-particle Lorentz-invariant phase space in the center-of-momentum frame. In the case of diffusion models, the "pure noise" forward process endpoint corresponds to the uniform distribution on phase space, which provides a clear starting point from which to identify how correlations among the particles emerge during the reverse (de-noising) process. We demonstrate that our models are able to learn both few-particle and many-particle distributions with various singularity structures, paving the way for future interpretability studies using generative models trained on simulated jet data.

Bogorad, Zachary [Fermilab]↗

Protein identification from electron cryomicroscopy maps by automated model building and side-chain matching

Using single-particle electron cryo-microscopy (cryo-EM), it is possible to obtain multiple reconstructions showing the 3D structures of proteins imaged as a mixture. Here, it is shown that automatic map interpretation based on such reconstructions can be used to create atomic models of proteins as well as to match the proteins to the correct sequences and thereby to identify them. This procedure was tested using two proteins previously identified from a mixture at resolutions of 3.2 Å, as well as using 91 deposited maps with resolutions between 2 and 4.5 Å. The approach is found to be highly effective for maps obtained at resolutions of 3.5 Å and better, and to have some utility at resolutions as low as 4 Å.

59 BASIC BIOLOGICAL SCIENCES↗

Magnetic field frustration of the metal-insulator transition in V 2 O 3

Despite decades of efforts, the origin of metal-insulator transitions (MITs) in strongly correlated materials remains one of the main long-standing problems in condensed-matter physics. An archetypal example is V 2 O 3 , which undergoes simultaneous electronic, structural, and magnetic phase transitions. This remarkable feature highlights the many degrees of freedom at play in this material. In this work, acting solely on the magnetic degree of freedom, we reveal an anomalous feature in the electronic transport of V 2 O 3 : On cooling, the magnetoresistance changes from positive to negative values well above the MIT temperature, and shows divergent behavior at the transition. In this work, the effects are attributed to the magnetic field quenching antiferromagnetic fluctuations above the Néel temperature $T_N$, and preventing long-range antiferromagnetic ordering below $T_N$. In both cases, suppressing the antiferromagnetic ordering prevents the opening of the incipient electronic gap. This interpretation is supported by Hubbard model calculations which fully reproduce the experimental behavior. Our study sheds light on this classic problem providing a clear and physical interpretation of the nature of the metal-insulator transition.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗