Search NASASearch

SEARCH · Search NASA

Results for “explainability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Can Organic Haze and O2 Plumes Explain Patterns of Sulfur Mass-Independent Fractionation During the Archean?

The existence of mass-independently fractionated sulfur in Archean rocks is almost universally accepted as evidence for low atmospheric O2 and O3 concentrations at that time. But the detailed patterns of the values and of the ratios / and / remain to be explained, and the mechanism for producing the mass-independent fractionation remains controversial. Here, we explore the hypothesis that the relatively low values seen during the Mid-Archean, 2.7-3.5 Ga, were caused by the presence of organic haze produced from photolysis of methane. This haze helped shield SO2 from photolysis, while at the same time providing surfaces on which unfractionated short-chain sulfur species could condense. The evolution of oxygenic photosynthesis, and the concomitant disappearance of organic haze towards the end of the Archean allowed more negatively fractionated S4 and S8 to form, thereby generating large positive fractionations in other sulfur species, including sulfate and H2S. Reduction of this sulfate to H2S by bacteria, followed by incorporation of H2S into pyrite, produced the large positive values observed in the Neoarchean rock record, 2.5-2.7 Ga.

Great Oxidation Event

The Ten Lockheed Martin Cyber-Physical Challenges: Formalized, Analyzed, and Explained

Capturing and analyzing requirements of Cyber-Physical Systems (CPS) can be challenging, since CPS models typically involve time-varying and real-valued variables, physical system dynamics, or even adaptive behavior. MATLAB/Simulinkis a development and simulation framework that is widely used in industry to capture such systems. In this paper, we report on the application of NASA Ames tools to perform end-to-end analysis of the Ten Lockheed Martin Challenge Problems (LMCPS). LMCPS is a set of industrial Simulink model benchmarks and natural language requirements developed by domain experts. Our framework, which integrates the tools FRET and COCOSIM, is used to: 1) elicit, explain, and formalize the semantics of the given natural language requirements; 2) generate verification code and monitors that can be automatically attached to the Simulink models; 3) perform verification by using SMT-based model checkers. FRET and COCOSIM are open source, and can be used by other researchers and practitioners to replicate our case study. We provide a categorization of recurring patterns in the formalization of the requirements and discuss the strengths and weaknesses of our automated verification approach.

Anastasia Mavridou

Multi-Class Anomaly Detection in Flight Data using Semi-Supervised Explainable Deep Learning Model

Identifying precursor for safety incidents in aviation data is a crucial task, yet extremely challenging. The main approach, in practice, leverages domain expertise to define expected tolerances in system’s behavior and alarm exceedance from such safety margins. However, this approach is incapable of identifying unknown risk and vulnerabilities. Machine learning has been long studied and deployed to identify precursors for such anomalies, with the great challenge of the need for sufficient labelled set of data to achieve a reliable and accurate performance. In this article, we develop an explainable deep semi-supervised model for anomaly detection in aviation, building upon recent advancements in the machine learning literature. The proposed model combines feature engineering and classification in the feature space, while leveraging all available data (labelled and unlabeled). Validating on two case studies of anomaly detection in take-off and landing phases of commercial aircraft, we show that our model is able to outperform state-of-the-art supervised anomaly detection model and reach significantly high accuracy and low false alarm with minimum amount of available labelled data.

Anomaly Detection

The Sufficient Component Cause Model Explaining Low-Dose Radiobiology through an Epidemiologic Lens

One of the major challenges in understanding space radiation-induced carcinogenesis is the uncertainty from translating radiobiological research in cellular and animal models to humans, especially at doses below 100 mSv. Biological studies have shown a host of potential outcomes at low doses in animal and cellular models. The existence of non-targeted effects as bystander and abscopal effects is well-documented from clinical research and basic science1,2,3. While some studies have shown increased effects at low doses, others have shown evidence of hormetic bystander effects, where radiation exposure may be beneficial4,5,6. Despite these varied and diverse findings, epidemiologic studies largely support the linear-no threshold (LNT) assumption used by radiation protection guidance7,8. Translational animal-to-human models have predominantly considered ratio values such as the relative biological effectiveness (RBE) and dose and dose-rate effectiveness factor (DDREF) that rely on the assumption of LNT rather than implementing specific dose-response shapes in the low-dose region, and translational cell-to-human models are uncommon. The sufficient component cause model presents an opportunity to examine biological findings at low doses from an epidemiological lens9. In this model, exposures “sufficient” to cause an outcome of interest are presented in pie charts, such that when all slices of a pie chart are fulfilled, the outcome will occur. Multiple pie charts may exist for a single outcome, illustrating individual differences9. In 1988,Greenland and Poole adapted the sufficient component cause model to incorporate interaction with other exposures (such as genetics or lifestyle factors)10. They show that a range of biological processes are possible in a population, but that an epidemiologic study will only reveal the mean outcome from the population at large10,11. Using this construct, the multiple outcomes presented in radiobiological models to date can be explained in the context of epidemiologic studies. This presentation aims to demonstrate a causal framework that can integrate radiobiological and epidemiological models to date. It is intended as a conversation starter to spur future research.

C M Milder

The Potential Outcome Model: Explaining Low-Dose Radiobiology through an Epidemiologic Lens

One of the major challenges in understanding space radiation-induced carcinogenesis is the uncertainty from translating radiobiological research in cellular and animal models to humans, especially at doses below 100 mSv. Biological studies have shown a host of potential outcomes at lowdoses in animal and cellular models. The existence of non-targeted effects as bystander and abscopal effects is well-documented from clinical research and basic science1,2,3. While some studies have shown increased effects at low doses, others have shown evidence of hormetic bystander effects, where radiation exposure may be beneficial4,5,6. Despite these varied and diverse findings, epidemiologic studies largely support the linear-no threshold (LNT) assumption used by radiation protection guidance7,8. Translational animal-to-human models have predominantly considered ratio values such as the relative biological effectiveness (RBE) and dose and dose-rate effectiveness factor (DDREF) that rely on the assumption of LNT rather than implementing specific dose-response shapes in the low-dose region, and translational cell-to-human models are uncommon. The sufficient component cause model presents an opportunity to examine biological findings at low doses from an epidemiological lens9. In this model, exposures “sufficient” to cause an outcome of interest are presented in pie charts, such that when all slices of a pie chart are fulfilled, the outcome will occur. Multiple pie charts may exist for a single outcome, illustrating individual differences9. In 1988,Greenland and Poole adapted the sufficient component cause model to incorporate interaction with other exposures (such as genetics or lifestyle factors)10. They show that a range of biological processes are possible in a population, but that an epidemiologic study will only reveal the mean outcome from the population at large10,11. Using this construct, the multiple outcomes presented in radiobiological models to date can be explained in the context of epidemiologic studies. This presentation aims to demonstrate a causal framework that can integrate radiobiological and epidemiological models to date. It is intended as a conversation starter to spur future research.

C M Milder

Canopy height and climate dryness parsimoniously explain spatial variation of unstressed stomatal conductance

The spatio-temporal variation of stomatal conductance directly regulates photosynthesis, water partitioning, and biosphere-atmosphere interactions. While many studies have focused on stomatal response to stresses, the spatial variation of unstressed stomatal conductance remains poorly determined, and is usually characterized in land surface models (LSMs) simply based on plant functional type (PFT). Here, we derived unstressed stomatal conductance at the ecosystem-scale using observations from 115 global FLUXNET sites. When aggregated by PFTs, the across-PFT pattern was highly consistent with the parameterizations of LSMs. However, PFTs alone captured only 17% of the variation in unstressed stomatal conductance across sites. Within the same PFT, unstressed stomatal conductance was negatively related to climate dryness and canopy height, which explained 45% of the total spatial variation. Our results highlight the importance of plant environment interactions in shaping stomatal traits. The trait-environment relationship established here provides an empirical approach for improved parameterizations of stomatal conductance in LSMs.

Yanlan Liu

Using an Explainable Machine Learning Approach to Characterize Earth System Model Errors: Application of SHAP Analysis to Modeling Lightning Flash Occurrence

Computational models of the Earth System are critical tools for modern scientific inquiry. Effortstoward evaluating and improving errors in representations of physical and chemical processes inthese large computational systems are commonly stymied by highly nonlinear and complexerror behavior. Recent work has shown that these errors can be effectively predicted usingmodern Artificial Intelligence (A.I.) techniques. In this work, we go beyond these previousstudies to apply an interpretable A.I. technique to not only predict model errors but also movetoward understanding the underlying reasons for successful error prediction. We use XGBoostclassification trees and SHapley Additive exPlanations (SHAP) analysis to explore the errors inthe prediction of lightning occurrence in the NASA GEOS model, a widely used Earth SystemModel. This explainable error prediction system can effectively predict the model error andindicates that the errors are strongly related to convective processes and the characteristics ofthe land surface.

Artificial intelligence

Rapid transition from primary to secondary crust building on the Moon explained by mantle overturn

Geochronology indicates a rapid transition (tens of Myrs) from primary to secondary crust building on the Moon. The processes responsible for initiating secondary magmatism, however, remain in debate. Here we test the hypothesis that the earliest secondary crust (Mg-suite) formed as a direct consequence of density-driven mantle overturn, and advance 3D mantle convection models to quantify the resulting extent of lower mantle melting. Our modeling demonstrates that overturn of thin ilmenite-bearing cumulates ≤ 100 km triggers a rapid and short-lived episode of lower mantle melting which explains the key volume, geochronological, and spatial characteristics of early secondary crust building without contributions from other energy sources, namely KREEP (potassium, rare earth elements, phosphorus, radiogenic U, Th). Observations of globally distributed Mg-suite eliminate degree-1 overturn scenarios. We propose that gravitational instabilities in magma ocean cumulate piles are major driving forces for the onset of mantle convection and secondary crust building on differentiated bodies.

Moon

Can Remotely Sensed Snow Disappearance Explain Seasonal Water Supply?

Understanding the relationship between remotely sensed snow disappearance and seasonal water supply may become vital in coming years to supplement limited ground based, in situ measurements of snow in a changing climate. For the period 2001–2019, we investigated the relationship between satellite derived Day of Snow Disappearance (DSD)—the date at which snow has completely disappeared—and the seasonal water supply, i.e., the April—July total streamflow volume, for 15 snow dominated basins across the western U.S. A Monte Carlo framework was applied, using linear regression models to evaluate the predictive skill—defined here as a model’s ability to accurately predict seasonal flow volumes—of varied predictors, including DSD and in situ snow water equivalent (SWE), across a range of spring forecast dates. In all basins there is a statistically significant relationship between mean DSD and seasonal water supply (p ≤ 0.05), with mean DSD explaining roughly half of the variance. Satellite-based model skill improves later in the forecast season, surpassing the skill of in-situ-based (SWE) models in skill in 10 of the 15 basins by the latest forecast date. We found little to no correlation between model error and basin characteristics such as elevation and the ratio of snow water equivalent to total precipitation. Despite a relatively short data record, this exploratory analysis shows promise for improving seasonal water supply prediction, in particular for snow dominated basins lacking in situ observations.

snow remote sensing

Off-Nominal Event Analysis in Autonomous Flights Based on Explainable Artificial Intelligence

A key objective in the Urban Air Mobility program at NASA is to intelligently perform an autonomous flight in a complex urban environment under all weather conditions with guaranteed levels of safety. To accomplish this, the mission manager (central decision-making module) of the vehicle needs to make informed decisions between various Courses of Action (CoA) based on its' interpretation of the inputs it receives. If an off-nominal event is detected either based on the amalgamation of sensor data or the use of machine learning models, the mission manager may greatly benefit from identification of the input features that most likely contributed to that specific event. Such an understanding is usually not possible to obtain from the classical machine learning models (deep learning) due to the inherent black box like structure. However, this understanding is achieved using eXplainable Artificial Intelligence (XAI) models that provide a human interpretable rationale for the predictions made. This work presents a game theory inspired XAI model for the off-nominal assessment of autonomous flights. The proposed approach based on Shapley values is model agnostic, provides local as well as global explanation and satisfies the four axioms (efficiency, symmetry, dummy, additivity) to achieve fair contribution. The versatility of the approach is first demonstrated on a simulated dataset in which the significance of each input to flight phase prediction is clearly identified. Subsequently, data from simulated flight trajectories are fed into the model which reveal the input features that most likely contributed to a rotor failure event thereby empowering the mission manager to take the appropriate CoA.

autonomy

Off-Nominal Event Analysis in Autonomous Flights Based on Explainable Artificial Intelligence

A key objective in the Urban Air Mobility program at NASA is to intelligently perform an autonomous flight in a complex urban environment under all weather conditions with guaranteed levels of safety. To accomplish this, the mission manager (central decision-making module) of the vehicle needs to make informed decisions between various Courses of Action (CoA) based on its' interpretation of the inputs it receives. If an off-nominal event is detected either based on the amalgamation of sensor data or the use of machine learning models, the mission manager may greatly benefit from identification of the input features that most likely contributed to that specific event. Such an understanding is usually not possible to obtain from the classical machine learning models (deep learning) due to the inherent black box like structure. However, this understanding is achieved using eXplainable Artificial Intelligence (XAI) models that provide a human interpretable rationale for the predictions made. This work presents a game theory inspired XAI model for the off-nominal assessment of autonomous flights. The proposed approach based on Shapley values is model agnostic, provides local as well as global explanation and satisfies the four axioms (efficiency, symmetry, dummy, additivity) to achieve fair contribution. The versatility of the approach is first demonstrated on a simulated dataset in which the significance of each input to flight phase prediction is clearly identified. Subsequently, data from simulated flight trajectories are fed into the model which reveal the input features that most likely contributed to a rotor failure event thereby empowering the mission manager to take the appropriate CoA.

autonomy

Explaining in Time

Explore the source record for details and available documents.

Thomas Arnold