Search NASA⌕ Search

SEARCH · Search NASA

Results for “model interpretability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

The role of chromatin state in intron retention: A case study in leveraging large scale deep learning models

Complex deep learning models trained on very large datasets have become key enabling tools for current research in natural language processing and computer vision. By providing pre-trained models that can be fine-tuned for specific applications, they enable researchers to create accurate models with minimal effort and computational resources. Large scale genomics deep learning models come in two flavors: the first are large language models of DNA sequences trained in a self-supervised fashion, similar to the corresponding natural language models; the second are supervised learning models that leverage large scale genomics datasets from ENCODE and other sources. We argue that these models are the equivalent of foundation models in natural language processing in their utility, as they encode within them chromatin state in its different aspects, providing useful representations that allow quick deployment of accurate models of gene regulation. We demonstrate this premise by leveraging the recently created Sei model to develop simple, interpretable models of intron retention, and demonstrate their advantage over models based on the DNA language model DNABERT-2. Our work also demonstrates the impact of chromatin state on the regulation of intron retention. Using representations learned by Sei, our model is able to discover the involvement of transcription factors and chromatin marks in regulating intron retention, providing better accuracy than a recently published custom model developed for this purpose.

Biochemistry & Molecular Biology↗

Non-destructive measurement and real-time monitoring of apple hardness during ultrasonic contact drying via portable NIR spectroscopy and machine learning

Portable near-infrared spectrometer in the spectral range of 900–1700 nm was evaluated for the first time to assess and monitor apple hardness in real-time during ultrasonic drying. Calibration models were developed using PLS and ANN, and their performances were evaluated by internal leave-one-out cross-validation and an external dataset. Several pre-treatments including standard normal variate (SNV), multiplicative scatter correction (MSC), Savitzky–Golay first and second derivatives were employed to examine the effects of spectral variations in hardness prediction. Seven important wavelengths were selected using weighted regression coefficients to develop a simple MLR model to facilitate the model interpretation and circumvent noise. The models using PLS, MLR, and ANN with selected wavelengths predicted the apple hardness with R 2 p of 0.91, 0.91, 0.95, and RMSEP of 14.78, 14.85, and 12.46 N, respectively. Finally, the results indicate that portable NIR spectrometers are quite promising for real-time monitoring of apple hardness during ultrasonic drying.

47 OTHER INSTRUMENTATION↗

Intense pulsed neutron emission from a compact pyroelectric driven accelerator

Intense pulsed D-D neutron emission with rates of >10{sup 10} n/s during the pulse, pulse widths of approximately hundreds of nanoseconds and neutron yields of greater than 10 000 per pulse, are demonstrated in a compact pyroelectric accelerator. The accelerator consists of a small pyroelectric LiTaO{sub 3} crystal that provides the accelerating voltage and an independent compact spark plasma ion source. The crystal voltage versus temperature is characterized and compares well with theory. Results show neutron output per pulse that scales with voltage as V{sup {approx}}{sup 1.7}. These neutron yields match a simple model of the system at low voltages but are lower than predicted at higher voltages due to charge losses not accounted for in the model. Interpretation of the data against modeling provides understanding of the accelerator and in general pyroelectric LiTaO{sub 3} crystals operated as charge limited negative high voltage targets. The findings overall serve as the proof of principle and basis for pyroelectric neutron generators that can be pulsed, giving peak neutron rates orders of magnitude greater than previous work and notably increase the potential applications of pyroelectric based neutron generators.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Micro- and meso-scale pore structure in mortar in relation to aggregate content

Mortar is often viewed as a three-phase composite consisting of aggregate, bulk paste, and an interfacial transition zone (ITZ). However, this description is inconsistent with experimental findings because of the basic assumption that larger pores are only present within the ITZ. In this paper, we use backscattered electron (BSE) imaging to investigate the micro- and meso-scale structure of mortar with varying aggregate content. The results indicate that larger pores are present not only within the ITZ but also within areas far from aggregates. This phenomenon is discussed in detail based on a series of analytical calculations, such as the effective water binder ratio and the inter-aggregate spacing. We developed a modified computer model that includes a two-phase structure for bulk paste. This model interprets previous mercury intrusion porosimetry data very well. -- Highlights: •Based on BSE, we examine the HCSS model. •We develop the HCSS-DBLB model. •We use the modified model to interpret the MIP data.

36 MATERIALS SCIENCE↗

Teaching Freight Mode Choice Models New Tricks Using Interpretable Machine Learning Methods

Understanding and forecasting the intricate freight mode choice behavior under various industry, policy, and technology contexts is essential in freight planning and policymaking. Numerous models have been developed in prior studies to provide insights into freight mode selection, the majority of which use discrete choice models such as multinomial logit (MNL) models. However, logit models often rely on linear specifications of independent variables, despite potential nonlinear relationships in the data. Moreover, there often lacks a heuristic and efficient approach to identify such complex relationships to define the logit model specifications. To fill this gap, we developed an MNL model for freight mode choice using the insights from state-of-the- art machine learning (ML) models. ML models can capture the nonlinear nature of the complex decision-making process, and recent advances in 'explainable AI' have greatly improved their interpretability. The interpretable ML methods help enhance the performance of MNL models and advance knowledge of freight mode choice. Specifically, the influential factors and their relationship with individual modes are identified using SHapley Additive exPlanations (SHAP) to improve the MNL's performance. The workflow is demonstrated in a case study of Austin, Texas, and the SHAP results reveal multiple nonlinear relationships predicted by ML models. Incorporating those relationships into MNL model specifications improves the interpretability and accuracy of the MNL model compared to a conventional MNL model. Findings from this study can be used to guide freight planning and inform policymakers and practitioners on how key factors affect freight decision-making.

ADVANCED PROPULSION SYSTEMS,MATHEMATICS AND COMPUT↗

Hierarchical Modeling and Statistical Calibration for Photometric Redshifts

The cosmological exploitation of modern photometric galaxy surveys requires both accurate (unbiased) and precise (narrow) redshift probability distributions derived from broadband photometry. Existing methodologies do not meet these requirements. Standard template fitting delivers interpretable models and errors, but lacks the flexibility to learn inaccuracies in the observed photometry or spectral templates. Machine learning addresses those issues, but requires representative training data, and the resulting models and uncertainties cannot be interpreted in the context of a physical model or outside of the training data. We present a hierarchical modeling approach simultaneously addressing the issues of flexibility, interpretability, and generalization. It combines template fitting with flexible (machine-learning-like) models to correct the spectral templates, model their redshift distributions, and recalibrate the photometric observations. By optimizing the full posterior distribution of the model and solving for its (thousands of) parameters, one can perform a global statistical calibration of the data and the spectral energy distribution (SED) model. We apply this approach to the public Dark Energy Survey Science Verification data and show that it provides more accurate and compact redshift posterior distributions than existing methods, as well as insights into residual photometric and SED systematics. Here, the model is causal and makes predictions for future data (e.g., additional photometric bandpasses), and its internal parameters and components are interpretable. This approach does not formally require the training data to be complete or representative; in principle, it can even work in regimes in which few or no spectroscopic redshifts are available.

79 ASTRONOMY AND ASTROPHYSICS↗

Sparsifying priors for Bayesian uncertainty quantification in model discovery

We propose a probabilistic model discovery method for identifying ordinary differential equations governing the dynamics of observed multivariate data. Our method is based on the sparse identification of nonlinear dynamics (SINDy) framework, where models are expressed as sparse linear combinations of pre-specified candidate functions. Promoting parsimony through sparsity leads to interpretable models that generalize to unknown data. Instead of targeting point estimates of the SINDy coefficients, we estimate these coefficients via sparse Bayesian inference. The resulting method, uncertainty quantification SINDy (UQ-SINDy), quantifies not only the uncertainty in the values of the SINDy coefficients due to observation errors and limited data, but also the probability of inclusion of each candidate function in the linear combination. UQ-SINDy promotes robustness against observation noise and limited data, interpretability (in terms of model selection and inclusion probabilities) and generalization capacity for out-of-sample forecast. Sparse inference for UQ-SINDy employs Markov chain Monte Carlo, and we explore two sparsifying priors: the spike and slab prior, and the regularized horseshoe prior. UQ-SINDy is shown to discover accurate models in the presence of noise and with orders-of-magnitude less data than current model discovery methods, thus providing a transformative method for real-world applications which have limited data.

97 MATHEMATICS AND COMPUTING↗

Search for high-mass dilepton resonances in p p collisions at s = 8 TeV with the ATLAS detector

Here, the ATLAS detector at the Large Hadron Collider is used to search for high-mass resonances decaying to dielectron or dimuon final states. Results are presented from an analysis of proton-proton (pp) collisions at a center-of-mass energy of 8 TeV corresponding to an integrated luminosity of 20.3 fb –1 in the dimuon channel. A narrow resonance with Standard Model Z couplings to fermions is excluded at 95% confidence level for masses less than 2.79 TeV in the dielectron channel, 2.53 TeV in the dimuon channel, and 2.90 TeV in the two channels combined. Limits on other model interpretations are also presented, including a grand-unification model based on the E 6 gauge group, Z* bosons, minimal Z' models, a spin-2 graviton excitation from Randall-Sundrum models, quantum black holes, and a minimal walking technicolor model with a composite Higgs boson.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Explainable Neural Architecture Search (XNAS)

Code for the paper Learning Interpretable Models Through Multi-Objective Neural Architecture Search by Zachariah Carmichael, Tim Moon, and Sam Ade Jacobs. Monumental advances in deep learning have led to unprecedented achievements across a multitude of domains. While the performance of deep neural networks is indubitable, the architectural design and interpretability of such models are nontrivial. Research has been introduced to automate the design of neural network architectures through neural architecture search (NAS). Recent progress has made these methods more pragmatic by exploiting distributed computation and novel optimization algorithms. However, there is little work in optimizing architectures for interpretability. To this end, we propose a multiobjective distributed NAS framework that optimizes for both task performance and introspection. We leverage the non-dominated sorting genetic algorithm (NSGA-II) and explainable AI (XAI) techniques to reward architectures that can be better comprehended by humans. The framework is evaluated on several image classification datasets. We demonstrate that jointly optimizing for introspection ability and task error leads to more disentangled architectures that perform within tolerable error.

Carmichael, ZachariahJ↗

SRBench++: Principled Benchmarking of Symbolic Regression With Domain-Expert Interpretation

Symbolic regression searches for analytic expressions that accurately describe studied phenomena. The main promise of this approach is that it may return an interpretable model that can be insightful to users, while maintaining high accuracy. The current standard for benchmarking these algorithms is SRBench, which evaluates methods on hundreds of datasets that are a mix of real-world and simulated processes spanning multiple domains. At present, the ability of SRBench to evaluate interpretability is limited to measuring the size of expressions on real-world data, and the exactness of model forms on synthetic data. In practice, model size is only one of many factors used by subject experts to determine how interpretable a model truly is. Furthermore, SRBench does not characterize algorithm performance on specific, challenging sub-tasks of regression such as feature selection and evasion of local minima. In this work, we propose and evaluate an approach to benchmarking SR algorithms that addresses these limitations of SRBench by 1) incorporating expert evaluations of interpretability on a domain-specific task, and 2) evaluating algorithms over distinct properties of data science tasks. We evaluate 12 modern symbolic regression algorithms on these benchmarks and present an in-depth analysis of the results, discuss current challenges of symbolic regression algorithms and highlight possible improvements for the benchmark itself.

97 MATHEMATICS AND COMPUTING↗

An effective matrix model for dynamical end of the world branes in Jackiw-Teitelboim gravity

We study Jackiw-Teitelboim gravity with dynamical end of the world branes in asymptotically nearly AdS2 spacetimes. We quantize this theory in Lorentz signature, and compute the Euclidean path integral summing over topologies including dynamical branes. The latter will be seen to exactly match with a modification of the SSS matrix model. The resolution of UV divergences in the gravitational instantons involving the branes will lead us to understand the matrix model interpretation of the Wilsonian effective theory perspective on the gravitational theory. We complete this modified SSS matrix model nonperturbatively by extending the integration contour of eigenvalues into the complex plane. Furthermore, we give a new interpretation of other phases in such matrix models. We derive an effective W(Φ) dilaton gravity, which exhibits similar physics semiclassically. In the limit of a large number of flavors of branes, the effective extremal entropy S0,eff has the form of counting the states of these branes.

2D Gravity↗

Feedback, physics, and forecasts: The emerging paradigm of machine learning-driven battery research

Machine learning (ML) is reshaping how we understand, predict, and optimize electrochemical systems. In batteries, ML accelerates discovery across chemistry, design, and operation by transforming massive experimental and simulated datasets into predictive, interpretable models. This review consolidates a decade of progress in ML-driven battery innovation, from early-cycle feature extraction to operando image analysis and physics-informed modeling. We categorize approaches by data domain and physical fidelity, emphasizing interpretable ML for diagnostics, reinforcement learning for control, and multi-objective optimization for lifetime extension strategies. Additionally, we demonstrate how integrated models accelerate discovery, reduce testing time, and guide sustainable design. Economic analyses furthermore illustrate how these advances can lower cost per cycle and improve circularity. Together, these developments chart a path toward self-optimizing, sustainable battery technologies.

artificial intelligence↗

Machine Learning Correlation of Electron Micrographs and ToF-SIMS for the Analysis of Organic Biomarkers in Mudstone

The spatial distribution of organics in geological samples can be used to determine when and how these organics were incorporated into the host rock. Mass spectrometry (MS) imaging can rapidly collect a large amount of data, but ions produced are mixed without discrimination, resulting in complex mass spectra that can be difficult to interpret. Here, we apply unsupervised and supervised machine learning (ML) to help interpret spectra from time-of-flight-secondary ion mass spectrometry (ToF-SIMS) of an organic-carbon-rich mudstone of the Middle Jurassic of England (UK). It was previously shown that the presence of sterane molecular biomarkers in this sample can be detected via ToF-SIMS (Pasterski, M. J. et al., Astrobiology 2023, 23, 936). We use unsupervised ML on scanning electron microscopy–electron dispersive spectroscopy (SEM-EDS) measurements to define compositional categories based on differences in elemental abundances. We then test the ability of four ML algorithms─k-nearest neighbors (KNN), recursive partitioning and regressive trees (RPART), eXtreme gradient boost (XGBoost), and random forest (RF)─to classify the ToF-SIM spectra using (1) the categories assigned via SEM-EDS, (2) organic and inorganic labels assigned via SEM-EDS, and (3) the presence or absence of detectable steranes in ToF-SIMS spectra. In terms of predictive accuracy and balanced accuracy, KNN was the best performing model and RPART the worst. The feature importance, or the specific features of the ToF-SIM spectra used by the models to make classifications, cannot be determined for KNN, preventing posthoc model interpretation. Nevertheless, the feature importance extracted from the other models was useful for interpreting spectra. In conclusion, we determined that some of the organic ions used to classify biomarker containing spectra may be fragment ions derived from kerogen which is abundant in this mudstone sample.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗