Search NASA⌕ Search

SEARCH · Search NASA

Results for “INTERPRETATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

Interpretation of Probabilistic Surface Ozone Forecasts: A Case Study for Philadelphia

The use of probabilistic forecasting has been growing in a variety of disciplines because of its potential to emphasize the degree of uncertainty inherent in a prediction. Interpretation of probabilistic forecasts, however, is oftentimes difficult, deterring users who may benefit from such forecasts. To encourage broader use of probabilistic forecasts in the field of air quality, a process for interpreting forecasts from a statistical probabilistic air quality surface ozone model [the Regression in Self Organizing Map (REGiS)] is demonstrated. Four procedures to convert probabilistic to deterministic forecasts are explored for the Philadelphia, Pennsylvania, metropolitan area. These procedures calibrate the predicted probability of daily maximum 8-h-average ozone exceeding a standard value by 1) estimating climatological relative frequency, 2) establishing a probability of an exceedance threshold as 50%, 3) maximizing the threat score, and 4) determining the unit bias ratio. REGiS is trained using 2000–11 ozone-season (1 May–30 September) data, calibrated using 2012–14 data, and evaluated using 2015–18 data. Assessment of the calibration data with the Pierce skill score suggests an exceedance threshold based on climatological relative frequency for the conversion from probabilistic to deterministic forecasts. Calibrated REGiS generally compares well to predictions from the U.S. national air quality model and operational “expert” forecasts over the evaluation period. For other probabilistic models and situations, different procedures of converting probabilistic to deterministic forecasts may be more beneficial. The methods presented in this paper represent an approach for operational air quality forecasters seeking to use probabilistic model output to support forecasts designed to protect public health.

Nikolay Balashov↗

Interpretable Machine Learning for Molecular Biosignatures: a Novel Single-Sample Feature Importance Method That Is Sensitive To Statistical Interactions

Isotope ratio mass spectrometry (IRMS) of volatiles (e.g., CO 2 ) promises to be a powerful tool for potential biosignature detection for future missions to ocean worlds (OW) such as Europa and Enceladus. Machine learning (ML) methods for IRMS data could enable science autonomy by onboard prediction of seawater chemistry and biosignature presence. However, ML models are likely to be complex and involve statistical interactions between features (variables), which can make predictions seem opaque and enigmatic. For ML predictions as significant as extraterrestrial biosignatures, we must place extraordinary confidence in models. It is therefore essential that these models make interpretable predictions (i.e., human-understandable) and include false-prediction diagnostics. We achieve high accuracy and interpretability in ML biosignature and seawater chemistry models for OW through a nearest-neighbors feature selection tool that detects statistical interactions between predictors, constructs interaction networks for visualization of selected features working together to make a prediction, and reports single-sample feature importance scores for false-detection diagnostics. Here we develop a novel single-sample nearest-neighbors projected distance regression(ssNPDR) feature selection method that improves upon existing single-sample algorithms through the inclusion of statistical interactions while providing false-prediction diagnostics for ML models.

geochemistry↗

Evolution, Current State of the Art, and Interpretation of Aircraft-Based Methane Emission Quantification at the Natural Gas Basin-Level

Accurately quantifying methane (CH4) emissions from the oil and gas (O&G) industry is challenging given the existence of many potential emission sources, differences in industry practices and regulations, and often incomplete or out-of-date activity data. It is thus important to regularly assess emission inventories and support improvements by deriving independent estimates using state-of-the-science approaches. Recent research has provided CH4 emission estimates from the O&G supply chains based on different measurement techniques at multiple spatio-temporal scales. Natural gas basin-scale aircraft-based atmospheric measurements indicate greater CH4 emissions than emission inventories based on up-scaling of component-/facility-level emission measurements from a relatively small sample size. Here we present results from a coordinated field study that compares concurrent CH4 emission measurements using different techniques and scales to better understand the strengths and weaknesses of each approach, with a focus on the aircraft-based estimation method. We describe the importance of (i) decades of measurement technology development, (ii) experience in designing measurement sampling strategies and aligning system boundaries, and (Hi) properly interpreting CH4 emission estimates for successfully reconciling aircraft-based measurements with emission inventories and for identifying CH4 emission mitigation potential. We illustrate that aircraft-based top-down estimates represent a brief snapshot of total basin-level CH4 emissions. Thus, a high spatio-temporally resolved bottom-up emission inventory is needed to identify key CH4 sources (including episodic sources) at the process level. While this paper provides a brief overview of the overall study design and findings, its focus is on the implementation of the aircraft measurements and its interpretation and results. A separate paper describes in more detail the overall organizational structure of the study as well as the study implications from an industry perspective.

03 NATURAL GAS↗

An Interpretable Index of Social Vulnerability to Environmental Hazards

Index-based measures of social vulnerability to environmental hazards are commonly modeled from composites of population-level risk factors. These models overlook individual context in communities' experiences of environmental hazards, producing metrics that may hinder spatial decision support for mitigating and responding to hazards. This paper introduces an interpretable, high-resolution model for generating an individual-oriented social vulnerability index (IOSVI) for the United States built on synthetic populations that couples individual and social determinants of vulnerability. The IOSVI combines an individual vulnerability index (IVI) that ranks individuals in an area’s synthetic population based on intersecting risk factors, with a social vulnerability index (SVI) based on the population’s cumulative distribution of IVI scores. Interpretability of the IOSVI procedure is demonstrated through examples of national, metropolitan, and neighborhood (census tract) level spatial variation in index scores and IVI themes, as well as an exploratory analysis examining risk factors affecting a specific sub-population (military veterans) in areas of high social and environmental vulnerability.

Tuccillo, Joe↗

MicroBooNE investigations on the photon interpretation of the MiniBooNE low energy excess

The MicroBooNE experiment is a liquid argon time projection chamber with 85-ton active volume at Fermilab, operated from 2015 to 2020 to collect neutrino data from Fermilab's Booster Neutrino Beam. One of MicroBooNE's physics goals is to investigate possible explanations of the low-energy excess observed by the MiniBooNE experiment in $\nu_{\mu}\rightarrow \nu_{e}$ neutrino oscillation measurements. MicroBooNE has performed searches to test hypothetical interpretations of the MiniBooNE low-energy excess, including the underestimation of the photon background or instrinic $\nu_{e}$ background. This thesis presents MicroBooNE's searches for two neutral current (NC) single-photon production processes that contribute to the photon background of the MiniBooNE measurement: NC $\Delta$ resonance production followed by $\Delta$ radiative decay: $\Delta \rightarrow N\gamma$, and NC coherent single-photon production. Both searches take advantage of boosted decision trees to yield efficient background rejection, and a high-statistic NC $\pi^0$ measurement to constrain dominant background, and make use of MicroBooNE's first three years of data. The NC $\Delta \rightarrow N\gamma$ measurement yielded a bound on the $\Delta$ radiative decay process at 2.3 times the predicted nominal rate at 90\% confidence level(C.L.), disfavoring a candidate photon interpretation of the MiniBooNE low-energy excess as a factor of 3.18 times the nominal NC Δ radiative decay rate at the 94.8\% C.L. The NC coherent single photon measurement leads to the world's first experimental limit on the cross-section of this process below 1 GeV, of $1.49 \times 10^{-41} \text{cm}^2$ at 90\% C.L., corresponding to 24.0 times the nominal prediction.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Nonparametric Multiparticle Set Methods for Interpreting Environmental Samples

Collection and analysis of environmental samples is commonly used by a range of stakeholders in nuclear safeguards and security contexts. While the ubiquity of samples and their transport in the environment allow regular collection, developing and demonstrating methods for analyzing these samples is difficult. In this work, an environmental sample consists of a set of one or more individual particles. Recent advances in reactor simulation have allowed us to generate data that are more representative of real-world environmental samples, enabling statistically defensible method development and testing. The most notable of these advances is a drastic increase in the number of material depletion regions, which allows our simulations to capture the variation in isotopic composition seen at length scales consistent with environmental samples. Traditional approaches for handling multiparticle samples treat each particle in the sample individually, estimating the quantity of interest (e.g., core-average burnup) resulting from measurement and analysis of signatures (e.g., nuclide assays) from each individual particle. Individual estimates are then averaged to generate a single estimate of the quantity of interest over the entire sample. In this presentation, we introduce two novel approaches for interpreting environmental samples that comprise of multiple particles: (1) the Quantile-Quantile Comparator, which uses a multivariate generalization of quantile-quantile plots for comparing unknown statistical distributions, and (2) the Set Transformer, an attention-based neural network module designed to model interactions among elements (particles) in the input set (sample). Statistically representative sampling cannot be guaranteed as samples are passively collected and are beholden to what particles are available in the environment. These new analysis methods for set-input problems are expected to be more robust than traditional approaches to issues of sampling bias where particles are not uniformly distributed throughout regions of interest, as well as generally outperform traditional approaches by jointly considering all elements in the set. We will present results comparing the performance of traditional single particle approaches and the novel Quantile-Quantile Comparator and Set Transformer for interpretation of simulated environmental samples.

Phathanapirom, Birdy↗

A multiscale design method using interpretable machine learning for phononic materials with closely interacting scales

Manipulating the dispersive characteristics of vibrational waves is beneficial for many applications, e.g., high-precision instruments. architected hierarchical phononic materials have sparked promise tunability of elastodynamic waves and vibrations over multiple frequency ranges. In this article, hierarchical unit-cells are obtained, where features at each length scale result in a band gap within a targeted frequency range. Our novel approach, the ‘‘hierarchical unit-cell template method,’’ is an interpretable machine-learning approach that uncovers global unit-cell shape/topology patterns corresponding to predefined band-gap objectives. A scale-separation effect is observed where the coarse-scale band-gap objective is mostly unaffected by the fine-scale features despite the closeness of their length scales, thus enabling an efficient hierarchical algorithm. Moreover, the hierarchical patterns revealed are not predefined or self-similar hierarchies as common in current hierarchical phononic materials. Furthermore, our approach offers a flexible and efficient method for the exploration of new regions in the hierarchical design space, extracting minimal effective patterns for inverse design in applications targeting multiple frequency ranges.

Architected materials↗

TRANSP integrated modeling code for interpretive and predictive analysis of tokamak plasmas

This paper provides a comprehensive review of the TRANSP code, a sophisticated tool for interpretive and predictive analysis of tokamak plasmas, detailing its major capabilities and features. It describes the equations for particle, power, and momentum balance analysis, as well as the poloidal field diffusion equations. The paper outlines the spatial and time grids used in TRANSP and details the equilibrium assumptions and solvers. Various models for heating and current drive and radiation, including updates to the NUBEAM model, are discussed. The handling of large-scale events such as sawtooth crashes and pellet injections is examined, along with the predictive capabilities for advancing plasma profiles. The integration of TRANSP with the ITER Integrated Modeling and Analysis Suite (IMAS) is highlighted, demonstrating enhanced data access and analysis capabilities. Additionally, the paper discusses best practices and continuous integration techniques to enhance TRANSP's robustness. The suite of TRANSP tools, designed for efficient data analysis and simulation, further supports the optimization of tokamak operations and coupling with other tokamak codes. Continuous development and support ensure that TRANSP remains a major code for the analysis of experimental data for controlled thermonuclear fusion, maintaining its critical role in supporting the optimization of tokamak operations and advancing fusion research.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

How to see hidden patterns in metamaterials with interpretable machine learning

Machine learning models can assist with metamaterials design by approximating computationally expensive simulators or solving inverse design problems. However, past work has usually relied on black box deep neural networks, whose reasoning processes are opaque and require enormous datasets that are expensive to obtain. Here, in this work, we develop two novel machine learning approaches to metamaterials discovery that have neither of these disadvantages. These approaches, called shape-frequency features and unit-cell templates, can discover 2D metamaterials with user-specified frequency band gaps. Our approaches provide logical rule-based conditions on metamaterial unit-cells that allow for interpretable reasoning processes, and generalize well across design spaces of different resolutions. The templates also provide design flexibility where users can almost freely design the fine resolution features of a unit-cell without affecting the user’s desired band gap.

36 MATERIALS SCIENCE↗

End-To-End Decentralized Transmission Line Protection in IBR-Dominated Weak Grids Using Interpretable Data-Driven Methods

Traditional transmission line protection relies on predictable synchronous-based fault signatures, which frequently fail under the non-standard, current-limited fault characteristics of Inverter-Based Resources (IBRs). This study investigates how to achieve secure, communication-free fault isolation in IBR-dominated weak grids without relying on opaque, computationally heavy "black-box" machine learning algorithms. To address this, we propose a novel, standalone, and inherently interpretable data-driven protection framework. Unlike centralized methods requiring multi-terminal communication, this decentralized approach relies solely on local measurements using a hierarchical linear-kernel Support Vector Machine (SVM). The methodology decomposes the protection task into four sequential stages that mimic traditional protection elements: fault detection and fault direction identification, fault type classification, zone classification, and location estimation. This multi-stage architecture allows for specialized feature engineering at each stage, combining high computational efficiency with logic traceability. The framework's end-to-end performance was validated via C-code and PSCAD/EMTDC co-simulation, utilizing a real-world utility network and an OEM black-box IBR model. The proposed relay achieves 97.2% overall accuracy and provides a reliable trip decision within a 2.5-cycle window. The results confirm 100% accuracy in fundamental fault detection, reliable zone selectivity across low to moderate fault resistances, and robust security against non-fault transients, proving its immediate viability for integration into commercial numerical relays.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Above zone pressure interpretation for leaky well characterization and its identification from leaky caprock/fault

Pressure transient analysis has long been used for reservoir characterization. Above-zone (AZ) pressure has been recently investigated for inferring leakage pathway characteristics in leakage events from subsurface injection operations. The recorded pressure in the AZ should be purely related to leakage and therefore it can be safely inverted to deduce leakage characteristics. It is crucial to evaluate fluid leakage through abandoned wells to plan for further measurements of leakage prevention. However, the recorded AZ leakage signal may not be related to leaky well(s). Therefore, identification and spatial investigation of well leakage is required for leakage evaluation. Here in this paper, we propose a pressure interpretation method for early detection of leaky pathways, applying two observation points in the AZ. We distinguish leaky well, fault and caprock based on their corresponding flow regime identification. We show that the pressure difference of the two observation wells can be applied as a proxy for unknown leakage rate, which is crucial for leakage identification as well as characterization. Results show that the estimated location of the leaky well, leakage coefficient, and the leakage rate are in good agreement with the actual values. The estimated leakage coefficient of the leaky well can be used to evaluate well leakage in multiphase systems such as carbon dioxide leakage in deep saline aquifers.

02 PETROLEUM↗

Fast and interpretable classification of small X-ray diffraction datasets using data augmentation and deep neural networks

X-ray diffraction (XRD) data acquisition and analysis is among the most time-consuming steps in the development cycle of novel thin-film materials. We propose a machine-learning-enabled approach to predict crystallographic dimensionality and space group from a limited number of thin-film XRD patterns. We overcome the scarce-data problem intrinsic to novel materials development by coupling a supervised machine learning approach with a model-agnostic, physics-informed data augmentation strategy using simulated data from the Inorganic Crystal Structure Database (ICSD) and experimental data. As a test case, 115 thin-film metal-halides spanning 3 dimensionalities and 7 space-groups are synthesized and classified. After testing various algorithms, we develop and implement an all convolutional neural network, with cross-validated accuracies for dimensionality and space-group classification of 93% and 89%, respectively. We propose average class activation maps, computed from a global average pooling layer, to allow high model interpretability by human experimentalists, elucidating the root-causes of misclassification. Finally, we systematically evaluate the maximum XRD pattern step size (data acquisition rate) before loss of predictive accuracy occurs, and determine it to be 0.16° 2θ, which enables an XRD pattern to be obtained and classified in 5.5 minutes or less.

36 MATERIALS SCIENCE↗

End-to-end AI framework for interpretable prediction of molecular and crystal properties

We introduce an end-to-end computational framework that allows for hyperparameter optimization using the DeepHyper library, accelerated model training, and interpretable AI inference. The framework is based on state-of-the-art AI models including CGCNN, PhysNet, SchNet, MPNN, MPNN-transformer, and TorchMD-NET. We employ these AI models along with the benchmark QM9, hMOF, and MD17 datasets to showcase how the models can predict user-specified material properties within modern computing environments. We demonstrate transferable applications in the modeling of small molecules, inorganic crystals and nanoporous metal organic frameworks with a unified, standalone framework. We have deployed and tested this framework in the ThetaGPU supercomputer at the Argonne Leadership Computing Facility, and in the Delta supercomputer at the National Center for Supercomputing Applications to provide researchers with modern tools to conduct accelerated AI-driven discovery in leadership-class computing environments. We release these digital assets as open source scientific software in GitLab, and ready-to-use Jupyter notebooks in Google Colab.

36 MATERIALS SCIENCE↗

Interpretable Data-Driven Probabilistic Power System Load Margin Assessment with Uncertain Renewable Energy and Loads

The increasing uncertainties caused by the high-penetration of stochastic renewable generation resources poses a significant threat to the power system voltage stability. To address this issue, this paper proposes a probabilistic deep kernel learning enabled surrogate model to extract the hidden relationship between uncertain sources, i.e., wind power and loads, and load margin for probabilistic load margin assessment (PLMA). Unlike other deep learning approaches, a kernel SHAP provides the sensitivity analysis as well as interpretability of the inputs to outputs influences. This allows identifying the critical factors that affect load margin so that corrective control can be initiated for stability enhancement. Numerical results carried out on the IEEE 118-bus power system demonstrate the accuracy and efficiency of the proposed data-driven PLMA scheme.

deep kernel learning↗

RX-ADS: Interpretable Anomaly Detection Using Adversarial ML for Electric Vehicle CAN Data

Recent year has brought considerable advancements in Electric Vehicles (EVs) and associated infrastructures/ communications. Intrusion Detection Systems (IDS) are widely deployed for anomaly detection in such critical infrastructures. This paper presents an Interpretable Anomaly Detection System (RX-ADS) for intrusion detection in CAN protocol communication in EVs. Contributions include: 1) window based feature extraction method; 2) deep Autoencoder based anomaly detection method; and 3) adversarial machine learning based explanation generation methodology. The presented approach was tested on two benchmark CAN datasets: OTIDS and Car Hacking. The anomaly detection performance of RX-ADS was compared against the state-of-the-art approaches on these datasets: HIDS and GIDS. The RX-ADS approach presented performance comparable to the HIDS approach (OTIDS dataset) and has outperformed HIDS and GIDS approaches (Car Hacking dataset). Further, the proposed approach was able to generate explanations for detected abnormal behaviors arising from various intrusions. Furthermore, these explanations were later validated by information used by domain experts to detect anomalies. Other advantages of RX-ADS include: 1) the method can be trained on unlabeled data; 2) explanations help experts in understanding anomalies and root course analysis, and also help with AI model debugging and diagnostics, ultimately improving user trust in AI systems.

42 ENGINEERING↗

Geometric Interpretation of the Cluster Location Problem Part I: Theory

We present a new framing of the seismic location problem using principles drawn from differential geometry. Our interpretation relies upon the common assumption that travel times observed across a network are continuous, differentiable functions of source location. In consequence, travel‐time functions constitute a differentiable map between the source region and a Riemannian manifold. The manifold is said to be the image of the source region embedded in a generally high‐dimension travel‐time vector space. A cluster of events in the source region has an image of discrete points on the manifold, that, except in the simplest cases, cannot be viewed directly. However, it is possible to project the image of a cluster into a tangent space of the manifold for direct visualization. The projection operator can be computed directly from the data without a velocity model, but produces a distorted rendering of the cluster geometry. With a model we can predict the distortions and correct them to estimate cluster geometry. We develop these points with the simplest possible example, one for which direct visualization of the manifold is possible, using the example as an introduction to the relevant concepts from differential geometry in a familiar setting. The tangent space, a local linearization of the manifold, plays a key role. We develop a metric to estimate the limits of linearization, that is, to determine when the curvature of the manifold invalidates the linear assumption. We also examine the interplay of model error, inadequate network geometry, and pick error. We then generalize our results from the simple case to the general case of 3D source regions observed by general networks. Although we do suggest a new “project and correct” method for location, we do not develop it into a practical algorithm. In conclusion, our intention rather is to highlight new analytical methods grounded in differential geometry.

East Pacific Ocean Islands↗

FAIR Data and Interpretable AI Framework for Architectured Metamaterials

Our interdisciplinary effort successfully generated FAIR (Findable, Accessible, Interoperable, and Reusable) benchmark datasets for mechanical metamaterials while introducing a novel Artificial Intelligence (AI) framework known as Learning Refined Compositional Rules (LRCR). This framework was specifically designed to bridge the gap across varying computational length scales and extract the underlying physical mechanisms that connect a material's structural geometry to its bulk acoustic properties. Historically, the discovery of such structured materials relied heavily on human intuition or opaque, black-box optimization algorithms that were difficult to generalize. By combining interpretable machine learning techniques with rigorous experimental validation, this project established clear, generalizable design guidelines for tuning wave dispersion and controlling vibrations. Ultimately, the public availability of these structured datasets and algorithms will significantly reduce computational costs and accelerate the design of advanced multi-functional acoustic devices, offering broad societal impacts across fields like aerospace engineering, telecommunications, and biomedical implant design.

36 MATERIALS SCIENCE↗

New requirements in photo interpretation.

Photo interpretation shifting, from image identification to processes of imagery associations, to meet needs of extraterrestrial investigation

PHOTOGRAPH INTERPRETATION↗