Search NASA⌕ Search

SEARCH · Search NASA

Results for “model interpretability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Model independent interpretation of recent CR lepton data after AMS-02

We model the CR leptonic fluxes above 20 GeV in terms of a superposition of a standard and a charge symmetric extra component, which we generically describe as power-laws in momentum. We investigate under these hypotheses the compatibility between AMS-02, Fermi-LAT and PAMELA datasets on positron fraction, electron+positron spectrum and electron spectrum respectively. We find that it is possible to reconcile AMS and Fermi-LAT data within uncertainties, if energy-dependent effects are present in Fermi-LAT systematics. We also study possible deviations from charge symmetry in the extra component and find no compelling evidence for them.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Understanding the Impact of Unobservable Variables on the Performance of Predictive Models: The Need for Feature Space Partitioning and Fusion

When developing predictive models over a dataset, the model is globally optimized across the entire feature space to learn a decision boundary. However, when unobservable variables—which cannot be measured or estimated—interact with the observable variables, this can negatively impact the optimization applied to the decision boundary since the data samples introduced by unobservable variables may have little to no association with the applied global optimization. This, consequently, penalizes the entire decision boundary and model performance. This paper examines some of the detrimental effects of unobservable variables, particularly their role in creating new modes in the distribution of observable variables and reducing the separability of class distributions. Such challenges result in skewed or warped decision boundaries and decreased accuracy of model predictions, particularly for interpretable models like logistic regression and decision trees. Through two illustrative case examples, we highlight the need to address the challenges imposed by unobservable variables. We propose a strategy to mitigate these challenges by creating local regions within the feature space through partitioning. This enables the optimization of local models within the regions to overcome the impact of unobservability in different feature space localities. Research into a more sophisticated partitioning strategy and where the partition should be relative to the sample of interest is left as future work. Through the analysis of the impact of unobservability and the development of a partitioning method, we demonstrate the clear need for a partitioning strategy that integrates knowledge from multiple local models to estimate risk factors using information fusion. Thus, we establish the foundation and motivation for using partitioning and information fusion to overcome the effects of unobservability in predictive models. Formal fusion methods, such as Dempster-Shafer theory, can better leverage the information from local regions to improve the performance of interpretable predictive models in the presence of unobservable variables.

Time Series Data↗

The value of soil respiration measurements for interpreting and modeling terrestrial carbon cycling

A recent acceleration of model-data synthesis activities has leveraged many terrestrial carbon (C) datasets, but utilization of soil respiration (RS) data has not kept pace with other types such as eddy covariance (EC) fluxes and soil C stocks. Here we argue that RS data, including non-continuous measurements from survey sampling campaigns, have unrealized value and should be utilized more extensively and creatively in data synthesis and modeling activities. We identify three major challenges in interpreting RS data, and discuss opportunities to address them. The first challenge is that when RS is compared to ecosystem respiration (RECO) measured from EC towers, it is not uncommon to find substantial mismatch, indicating one or both flux methodologies are unreliable. We argue the most likely cause of mismatch is unreliable EC data, and there is an unrecognized opportunity to utilize RS for EC quality control. The second challenge is that RS integrates belowground heterotrophic (RH) and autotrophic (RA) activity, whereas modelers generally prefer partitioned fluxes, and few models include an explicit RS output. Opportunities exist to use the total RS flux for data assimilation and model benchmarking methods rather than less-certain partitioned fluxes. Pushing for more experiments that not only partition RS but also monitor the age of RA and RH, as well as for the development of belowground RA components in models, would allow for more direct comparison between measured and modeled values. The third challenge is that soil respiration is generally measured at a very different resolution than that needed for comparison to EC or ecosystem- to global-scale models. Measuring soil fluxes with finer spatial resolution and more extensive coverage, and downscaling EC fluxes to match the scale of RS, will improve chamber and tower comparisons. Opportunities also exist to estimate RH at regional scales by implementing decomposition functional types, akin to plant functional types. We conclude by discussing the benefits that wide use of RS data will bring to model development, and database developments that will make RS data more robust, useful, and broadly available to the research community.

carbon cycle↗

Machine Learning Augmented Predictive and Generative Model for Rupture Life in Ferritic and Austenitic Steels

The Larson-Miller parameter (LMP) offers an efficient and fast scheme to estimate the creep rupture life of alloy materials for high temperature applications. However, owing to poor generalizability and dependence on the constant C, which is typically not known a-priori, estimations using the Larson-Miller parameter often result in suboptimal performance for a wide range of materials. At best it is useful in comparing alloys of similar composition. In this work, three machine learning (ML) schemes were developed for rupture life prediction for 9-12% Cr ferritic-martensitic steels and austenitic stainless steels, i.e., a hierarchical model to parameterize LMP using the LMP constant C to compute rupture life, a hierarchical model to parameterize both C and LMP to compute rupture life, and a direct prediction of rupture life. Specifically, we show that the third scheme, using a gradient boosting algorithm, can be used to train ML models for very accurate prediction of rupture life in a variety of alloys (Pear-son Correlation Coefficient > 0.9 for 9-12% Cr and > 0.8 for austenitic stainless steels). In addition, the Shapley value was used to quantify feature importance, making the model interpretable by identifying the effect of various features on the model performance. Furthermore, a variational autoencoder-based generative model was built by conditioning on the experimental dataset to sample hypothetical synthetic candidate alloys from the learnt joint distribution not existing in both 9-12 % Cr ferritic-martensitic steel and austenitic stainless steel datasets. Finally, based on the predictive and generative model, a reinforcement learning strategy has been proposed to guide experimentalists into designing better heat resistant alloys.

Mamun, Md Osman G.↗

Accelerated Materials Design for Molten Salt Technologies Using Innovative High-Throughput Methods

The focus of the project is on building an innovative accelerated materials design platform for molten salt technologies using novel high-throughput methods coupled to data analytics. The main objectives is to predict a FeCrMnNi alloy compositional space with better corrosion resistance than stainless steel 316 and identify new molten salt corrosion mechanisms. The project demonstrates the feasibility to use high-throughput methods coupled to data analytics to accelerate alloy design for extreme environments applications. Using a trained and tested machine learning (ML) model, 2000 FeCrMnNi alloy corrosion rate in molten chloride salts were predicted and a compositional field with corrosion rate lower than 316 stainless steel was identified. The ML model interpretability unveiled multiple features of importance in the model prediction. Some features were expected to be of relative significance, such as work function, surface energy and alloy electronegativity, and the ML model interpretability analysis confirmed those. On the other hand, the most important feature is the diffusion coefficient of Ni in the bulk alloy which indicates that a surface diffusion mechanism plays an important role in the overall corrosion mechanism in molten salts.

36 MATERIALS SCIENCE↗

Interpretable Machine Learning for Characterizing Electric Vehicle Charging Behavior: Insights from Real-World Data

As electric vehicle (EV) adoption rises globally, concerns about the impact on aging electrical grids grow, particularly regarding the charging behavior of EV drivers. This study analyzes real-world driving and charging data from Ford battery electric vehicles (BEVs) collected between 2018 and 2019 to develop interpretable models that characterize charging behavior and quantify influencing factors. Prior research has relied on assumptions regarding driver behavior, often overlooking actual charging patterns. By employing generalized linear mixed models (GLMMs), this work offers insights into how various elements, such as next trip distance and state of charge (SOC), influence charging decisions. The dataset comprises over three million park-trip pairs from 1,997 vehicles, revealing that features related to driving behavior significantly dictate charging behavior, while infrastructure and regional factors have lesser impacts. The findings suggest that existing simulation models may oversimplify EV charging behavior assumptions. This work utilizes real-world EV driving and charging data to train interpretable models that describe charging behavior and quantify the factors most associated with how drivers use charging infrastructure. This research underscores the need for interpretable, data-driven methodologies to inform future EV infrastructure planning and grid management.

29 - ENERGY PLANNING, POLICY AND ECONOMY↗

Interpretive MHD modeling of dispersive shell pellet injection for rapid shutdown in tokamaks

Dispersive shell pellet (DSP) injection is modeled with the extended-MHD code NIMROD for interpretive insight into the results of recent DIII-D DSP experiments and to explore the dynamics of an inside-out thermal quench for disruption mitigation in tokamaks. Simulations of the pre-thermal quench (TQ) phase indicate that the upper bound for the quantity of ablated carbon shell material that will not perturb the flux surfaces is in the ballpark of, but somewhat below the experimental quantity. Even below this quantity, sufficient electrons are added to the plasma by the shell material to produce significant dilution cooling before the TQ is triggered. Simulations carried through the end of the TQ have very large amplitude MHD fluctuations (δB/B>10 -2 ) at the time of the plasma current spike associated with current profile redistribution. Finally, after the plasma current spike, which is of comparable amplitude to that measured in DIII-D experiments, none of the runaway electron test-particles whose orbits are tracked throughout the simulation remain confined.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

A SEMI-ANALYTICAL LINE TRANSFER MODEL TO INTERPRET THE SPECTRA OF GALAXY OUTFLOWS

We present a semi-analytical line transfer model, (SALT), to study the absorption and re-emission line profiles from expanding galactic envelopes. The envelopes are described as a superposition of shells with density and velocity varying with the distance from the center. We adopt the Sobolev approximation to describe the interaction between the photons escaping from each shell and the remainder of the envelope. We include the effect of multiple scatterings within each shell, properly accounting for the atomic structure of the scattering ions. We also account for the effect of a finite circular aperture on actual observations. For equal geometries and density distributions, our models reproduce the main features of the profiles generated with more complicated transfer codes. Also, our SALT line profiles nicely reproduce the typical asymmetric resonant absorption line profiles observed in starforming/starburst galaxies whereas these absorption profiles cannot be reproduced with thin shells moving at a fixed outflow velocity. We show that scattered resonant emission fills in the resonant absorption profiles, with a strength that is different for each transition. Observationally, the effect of resonant filling depends on both the outflow geometry and the size of the outflow relative to the spectroscopic aperture. Neglecting these effects will lead to incorrect values of gas covering fraction and column density. When a fluorescent channel is available, the resonant profiles alone cannot be used to infer the presence of scattered re-emission. Conversely, the presence of emission lines of fluorescent transitions reveals that emission filling cannot be neglected.

79 ASTRONOMY AND ASTROPHYSICS↗

A semiempirical model for interpreting microwave emission from semiarid land surfaces as seen from space

A radiative-transfer model for simulating microwave brightness temperatures over land surfaces is described. The model takes into account sensor viewing conditions (spacecraft altitude, viewing angle, frequency, and polarization) and atmospheric parameters over a soil surface characterized by its moisture, roughness, and temperature and covered with a layer of vegetation characterized by its temperature, water content, single scattering albedo, structure, and percent coverage. In order to reduce the influence of atmospheric and surface temperature effects, the brightness temperatures are expressed as polarization ratios that depend primarily on the soil moisture and roughness, canopy water content, and percentage of cover. The sensitivity of the polarization ratio to these parameters is investigated. Simulation of the temporal evolution of the microwave signal over semiarid areas in the African Sahel is presented and compared to actual satellite data from the SMMR instrument on Nimbus-7.

Kerr, Yann H.↗

Simplified Models for LHC New Physics Searches

This document proposes a collection of simplified models relevant to the design of new-physics searches at the LHC and the characterization of their results. Both ATLAS and CMS have already presented some results in terms of simplified models, and we encourage them to continue and expand this effort, which supplements both signature-based results and benchmark model interpretations. A simplified model is defined by an effective Lagrangian describing the interactions of a small number of new particles. Simplified models can equally well be described by a small number of masses and cross-sections. These parameters are directly related to collider physics observables, making simplified models a particularly effective framework for evaluating searches and a useful starting point for characterizing positive signals of new physics. This document serves as an official summary of the results from the 'Topologies for Early LHC Searches' workshop, held at SLAC in September of 2010, the purpose of which was to develop a set of representative models that can be used to cover all relevant phase space in experimental searches. Particular emphasis is placed on searches relevant for the first {approx} 50-500 pb{sup -1} of data and those motivated by supersymmetric models. This note largely summarizes material posted at http://lhcnewphysics.org/, which includes simplified model definitions, Monte Carlo material, and supporting contacts within the theory community. We also comment on future developments that may be useful as more data is gathered and analyzed by the experiments.

43 PARTICLE ACCELERATORS↗

Dust Model Sensitivity to Dust Source Mask, Sandblasting Efficiency, Air Density, and Land Use: Implications for Model Improvement

This study compares dust storm simulations using two commonly adopted methods for representing four important dust emission parameters. Compared to a dynamic dust source mask based on land use and vegetation cover, a static mask based solely on land use overestimates dust concentration and optical depth by a factor of 2, besides generating spurious emissions. The results reinforce that seasonal variations in vegetation cover can significantly affect dust emissions. For sandblasting efficiency, a clay-dependent semiempirical expression produces 10 times more dust than a physics-based expression. Simulations using model-predicted versus a fixed constant for air density differ by only 8%. However, this difference could range between 12 and 22% for annual simulations over global dust source regions. Simulations with updated versus old land use data, using the same dust source mask, differ twofold, indicating the significant impact of land use change on regional dust emission in central Arizona. The differences in the pairs of these simulations are generally larger than the uncertainty due to meteorology. The simulations align better with observation when using the dynamic dust source mask, the physics-based sandblasting efficiency, and the up-to-date land use data. Given the high sensitivity of dust to surface conditions, the results discussed have implications for improving the dust cycle in weather and climate models and for interpreting model intercomparisons.

Dust-emission source↗

Strongly intermittent edge plasma transport: Issues with modeling and interpretation of experimental data

An impact of blobby transport on plasma dynamics along the magnetic field lines, cross-field plasma transport including ExB drift, and the rates of atomic processes is discussed. It is shown that nonlinearities of plasma transport processes and strong intermittency associated with blobs result in the problems with both interpretation of experimental data based on averaged plasma parameters and with edge plasma modeling with two-dimensional plasma transport codes.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Recurrent Neural Network Attention Mechanisms for Interpretable System Log Anomaly Detection

Deep learning has recently demonstrated state-of-the art performance on key tasks related to the maintenance of computer systems, such as intrusion detection, denial of service attack detection, hardware and software system failures, and malware detection. In these contexts, model interpretability is vital for administrator and analyst to trust and act on the automated analysis of machine learning models. Deep learning methods have been criticized as black box oracles which allow limited insight into decision factors. In this work we seek to "bridge the gap'' between the impressive performance of deep learning models and the need for interpretable model introspection. To this end we present recurrent neural network (RNN) language models augmented with attention for anomaly detection in system logs. Our methods are generally applicable to any computer system and logging source. By incorporating attention variants into our RNN language models we create opportunities for model introspection and analysis without sacrificing state-of-the art performance. We demonstrate model performance and illustrate model interpretability on an intrusion detection task using the Los Alamos National Laboratory (LANL) cyber security dataset, reporting upward of 0.99 area under the receiver operator characteristic curve despite being trained only on a single day's worth of data.

Anomaly detection, Attention, Recurrent Neural Net↗

Modeling and interpretation of the optical and HST UV spectrum of SN 1993J

We present spherically symmetric, non-local thermodynamic equilibrium (non-LTE), expanding model atmosphere synthetic spectra of SN 1993J and compare them to the ultraviolet and optical spectra obtained simultaneously on 1993 April 15 by the Hubble Space Telescope (HST) and at Lick Observatory. We are able to fit the optical and HST near-UV spectra with a variety of compositions, but find that our best fits are obtained with an enhanced helium abundance (Y = 0.8) and significant nonthermal ionization due to gamma rays produced by the decay of Ni-56. We find the effects of X-rays produced by thermal bremsstrahlung in the circumstellar material to have little effect on the spectrum. Our current models are unable to fit the HST far-UV region, predicting too little flux and strong, unseen Fe II features.

Baron, E.↗

Design of Digital Twin Sensing Strategies Via Predictive Modeling and Interpretable Machine Learning

This work develops a methodology for sensor placement and dynamic sensor scheduling decisions for digital twins. The digital twin data assimilation is posed as a classification problem, and predictive models are used to train optimal classification trees that represent the map from observed data to estimated digital twin states. In addition to providing a rapid digital twin updating capability, the resulting classification trees yield an interpretable mathematical representation that can be queried to inform sensor placement and sensor scheduling decisions. The proposed approach is demonstrated for a structural digital twin of a 12 ft wingspan unmanned aerial vehicle. Offline, training data are generated by simulating scenarios using predictive reduced-order models of the vehicle in a range of structural states. Furthermore, these training data can be further augmented using experimental or other historical data. In operation, the trained classifier is applied to observational data from the physical vehicle, enabling rapid adaptation of the digital twin in response to changes in structural health. Within this context, we study the performance of the optimal tree classifiers and demonstrate how they enable explainable structural assessments from sparse sensor measurements and also inform optimal sensor placement.

47 OTHER INSTRUMENTATION↗

ERTS data user investigation to develop a multistage forest sampling inventory system

The author has identified the following significant results. A unique digital timber volume estimation system was developed for use with the MSS CCT tapes. The system was tested on a 64-square mile area in Northern California's Trinity Alps. The outcome of a systematic experiment, in which several possible combinations of bands 5 and 7 and a contrast measure were tried, showed that an estimated gain in precision of 50% can be obtained in a multistage sampling design. The difference between bands 5 and 7 proved to be of special importance for the estimation of biomass in the form of timber volume. In addition, an interpretation model for high flight U2 photographs was developed. A maximum multiple correlation coefficient of 0.74 was obtained for the regression model, explaining 55% of the variation in timber volume as estimated from aerial photos and ground measurments. An interpretation model for MSS color composites is in the testing stage.

Langley, P. G.↗

PBPK and population modelling to interpret urine cadmium concentrations of the French population

As cadmium accumulates mainly in kidney, urinary concentrations are considered as relevant data to assess the risk related to cadmium. The French Nutrition and Health Survey (ENNS) recorded the concentration of cadmium in the urine of the French population. However, as with all biomonitoring data, it needs to be linked to external exposure for it to be interpreted in term of sources of exposure and for risk management purposes. The objective of this work is thus to interpret the cadmium biomonitoring data of the French population in terms of dietary and cigarette smoke exposures. Dietary and smoking habits recorded in the ENNS study were combined with contamination levels in food and cigarettes to assess individual exposures. A PBPK model was used in a Bayesian population model to link this external exposure with the measured urinary concentrations. In this model, the level of the past exposure was corrected thanks to a scaling function which account for a trend in the French dietary exposure. It resulted in a modelling which was able to explain the current urinary concentrations measured in the French population through current and past exposure levels. Risk related to cadmium exposure in the general French population was then assessed from external and internal critical values corresponding to kidney effects. The model was also applied to predict the possible urinary concentrations of the French population in 2030 assuming there will be no more changes in the exposures levels. This scenario leads to significantly lower concentrations and consequently lower related risk. - Highlights: • Interpretation of urine cadmium concentrations in France • PBPK and Bayesian population modelling of cadmium exposure • Assessment of the historic time-trend of the cadmium exposure in France • Risk assessment from current and future external and internal exposure.

60 APPLIED LIFE SCIENCES↗

Stability analysis of WEST L-mode discharges with improved confinement from boron powder injection

WEST L-mode plasmas with dominant electron heating and no core torque source have observed improvements in confinement during boron (B) powder injection. These results are reminiscent of previous powder injection experiments on other devices and gaseous impurity seeding experiments on WEST. During powder injection, the stored energy increased up to 25% due to enhanced ion and electron heat and particle confinement. The improvements in confinement were not indicative of an L-H transition. To identify the dominant mechanisms and the causality chain behind these improvements in confinement, we employ interpretative modeling using METIS, predictive integrated modeling using a high-fidelity plasma simulator (HFPS), and stand-alone gyrokinetic simulations using quasi-linear gyrokinetic code. Interpretative modeling with METIS allowed for the estimation of missing data while maintaining good overall consistency with experiment. These results provided the initial conditions for fully predictive flux driven simulations using the HFPS. From these simulations, quasi-linear gyrokinetic analysis was performed at ρ = 0.5 and ρ = 0.65. Collisionality was found to be a strong candidate for the turbulence suppression mechanism at ρ = 0.5, while a combination of collisionality and the T e /T i ratio was found to be the likely mechanism at ρ = 0.65. The results additionally suggested that increased Z eff (through main ion dilution) could play a role in the improved confinement, but this could not be confirmed due to a lack of experimental measurements. The modeling framework established here can now be used to evaluate and exploit a variety of future powder injection experiments.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗