Search NASA⌕ Search

SEARCH · Search NASA

Results for “Interpretability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

In comparison with other abdominal imaging modalities, which radiologists interpret abdominal MRI?

Purpose: To assess subspecialty mix and case volumes of general and abdominal subspecialty radiologists interpreting abdominal MRI. Methods: The 2016 CMS Physician/Supplier Procedure Summary Master File was used to obtain billed counts of radiologist-interpreted abdominal fluoroscopy, US, CT, and MRI examinations. The CMS Physician and Other Supplier Public Use File was used to assess the subspecialty mix and case volume of the radiologists interpreting those examinations. Results: The fraction of all abdominal imaging examinations interpreted by generalists and abdominal subspecialty radiologists was 70.7% and 16.5% for fluoroscopy; 68.7% and 21.0% for US; 71.4% and 19.2% for CT; and 41.9% and 52.5% for MRI. In 2016, the fraction of general and abdominal radiologists interpreting > 50 fluoroscopy examinations on Medicare fee-for-service beneficiaries was 15.1% and 16.2%. For > 50 US examinations, the fraction was 61.5% and 60.5%; for > 50 CT examinations, 91.2% and 79.6%; and for > 50 MRI examinations, 4.0% and 28.5%. The fraction of abdominal imaging examinations interpreted overall by low-volume providers (those interpreting ≤ 50 examinations in 2016) was 59.5% for fluoroscopy, 17.5% for US, 6.3% for CT, and 50.6% for MRI. Conclusion: Nationally, most abdominal fluoroscopy, US, and CT examinations are interpreted by general radiologists, who have similar annual volumes of these examinations as abdominal subspecialty radiologists. In contrast, most abdominal MRI examinations are interpreted by abdominal subspecialty radiologists, who attain considerably higher volumes. These findings have implications for workforce planning and abdominal imaging fellowship design to ensure their graduates are optimally prepared to contribute to their future practices.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Physically Interpretable Neural Networks for the Geosciences: Applications to Earth System Variability

Abstract Neural networks have become increasingly prevalent within the geosciences, although a common limitation of their usage has been a lack of methods to interpret what the networks learn and how they make decisions. As such, neural networks have often been used within the geosciences to most accurately identify a desired output given a set of inputs, with the interpretation of what the network learns used as a secondary metric to ensure the network is making the right decision for the right reason. Neural network interpretation techniques have become more advanced in recent years, however, and we therefore propose that the ultimate objective of using a neural network can also be the interpretation of what the network has learned rather than the output itself. We show that the interpretation of neural networks can enable the discovery of scientifically meaningful connections within geoscientific data. In particular, we use two methods for neural network interpretation called backward optimization and layerwise relevance propagation, both of which project the decision pathways of a network back onto the original input dimensions. To the best of our knowledge, LRP has not yet been applied to geoscientific research, and we believe it has great potential in this area. We show how these interpretation techniques can be used to reliably infer scientifically meaningful information from neural networks by applying them to common climate patterns. These results suggest that combining interpretable neural networks with novel scientific hypotheses will open the door to many new avenues in neural network‐related geoscience research.

58 GEOSCIENCES↗

Theory Interpretations in PVS

The purpose of this task was to provide a mechanism for theory interpretations in a prototype verification system (PVS) so that it is possible to demonstrate the consistency of a theory by exhibiting an interpretation that validates the axioms. The mechanization makes it possible to show that one collection of theories is correctly interpreted by another collection of theories under a user-specified interpretation for the uninterpreted types and constants. A theory instance is generated and imported, while the axiom instances are generated as proof obligations to ensure that the interpretation is valid. Interpretations can be used to show that an implementation is a correct refinement of a specification, that an axiomatically defined specification is consistent, or that a axiomatically defined specification captures its intended models. In addition, the theory parameter mechanism has been extended with a notion of theory as parameter so that a theory instance can be given as an actual parameter to an imported theory. Theory interpretations can thus be used to refine an abstract specification or to demonstrate the consistency of an axiomatic theory. In this report we describe the mechanism in detail. This extension is a part of PVS version 3.0, which will be publicly released in mid-2001.

Owre, Sam↗

Effectiveness of an e-Learning Platform for Image Interpretation Education of Medical Staff and Students

Medical staff must be able to perform accurate initial interpretations of radiography to prevent diagnostic errors. Education in medical image interpretation is an ongoing need that is addressed by text-based and e-learning platforms. The effectiveness of these methods has been previously reported. Here, we describe the effectiveness of an e-learning platform used for medical image interpretation education. Ten third-year medical students without previous experience in chest radiography interpretation were provided with e-learning instructions. Accuracy of diagnosis using chest radiography was provided before and after e-learning education. We measured detection accuracy for two image groups: nodular shadow and ground-glass shadow. We also distributed the e-learning system to the two groups and analyzed the effectiveness of education for both types of image shadow. The mean correct answer rate after the 2-week e-learning period increased from 34.5 to 72.7%. Diagnosis of the ground glass shadow improved significantly more than that of the mass shadow. Education using the e-leaning platform is effective for interpretation of chest radiography results. E-learning is particularly effective for the interpretation of chest radiography images containing ground glass shadow.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Identifying geological structures through microseismic cluster and burst analyses complementing active seismic interpretation

At the Decatur carbon capture and storage site (IL, USA) CO 2 has been injected from 2011–2014 and from 2017 to present near the base of the Lower Mt. Simon Sandstone saline reservoir, resulting in microseismicity. Microseismicity is mainly located in the basement and distributed in distinct spatial clusters. The lack of significant impedance contrasts within the basement makes the interpretation of active-source seismic reflection data challenging, however, recent reprocessing allowed to resolve faults above and at the top of the basement. These faults generally do not coincide with the location of microseismic events and their continuation to the general depth of the seismic events cannot be assumed. This paper shows how the interpretation of the microseismicity can complement structural interpretations of active-source seismic reflection data. In particular, we analyze clusters and bursts (abrupt increases) of microseismicity, identify unresolved, smaller-scale weaknesses and extract statistical parameters. These parameters allow comparisons with the interpreted faults, and with fracture sets intercepted by boreholes. During injection at the Decatur site, the injection pressure was kept far below fracture pressure, nevertheless, seismic events were induced and spread far beyond the expected extent of the CO 2 plume. We argue that local stress transfers related to the CO 2 injection reactivated pre-existing fractures within the critically stressed basement. Finally, we conducted a slip tendency analysis for faults interpreted from active seismic, selected cluster, bursts and nodal planes from focal mechanisms to determine if the interpreted structures are optimally oriented with respect to the stress regime. Our results suggest that the orientation of fractures close to the injection well, generally shows slight deviations from the optimal orientation for slip. This might indicate either slight local deviations of the maximum horizontal stress azimuth from the average direction used in the analysis, or the lack of optimally oriented fractures at this location.

58 GEOSCIENCES↗

A Bayesian interpretation of inconsistency measures in cosmology

Abstract Measures of inconsistency and tension between datasets have become an essential part of cosmological analyses. It is important to accurately evaluate the significance of such tensions when present. We propose here a Bayesian interpretation of inconsistency measures that can extract information about physical inconsistencies in the presence of data scatter. This new framework is based on the conditional probability distribution of the level of physical inconsistency given the obtained value of the measure. We use the index of inconsistency as a case study to illustrate the new interpretation framework, but this can be generalized to other metrics. Importantly, there are two aspects in the quantification of inconsistency that behave differently as the number of model parameters increases. The first is the probability for the level of physical inconsistency to reach a threshold which drops with the increase of the number of parameters under consideration. The second is the actual level of physical inconsistency which remains rather insensitive to such an increase in parameters. The difference between these two aspects is often overlooked, which leads to a long-standing ambiguity: when a given inconsistency is found between two constraints, its “significance” seems to be lower when considered in a higher-dimensional parameter space. This ambiguity is resolved by the Bayesian interpretation we introduce in this work because the conditional probability distribution includes all the statistical information of the level of physical inconsistency. Finally, we apply the Bayesian interpretation to examine the (in)consistency between Planck versus the Cepheid-based local measurement, the Dark Energy Survey (DES), the Atacama Cosmology Telescope (ACT) and WMAP. We confirm and revisit the degrees of previous physical inconsistencies and show the stability of the new interpretation with respect to the number of cosmological parameters compared to the commonly used n-σ interpretation when applied to cosmological tensions in multi-parameter spaces.

Astronomy & Astrophysics↗

Balancing Trade-offs: Adaptive Differential Privacy in Interpretable Machine Learning Models

In the advancing field of machine learning, balancing accuracy, interpretability, and privacy represents a significant challenge. The problem is exacerbated by the widespread deployment of pre-trained models locally in diverse applications, which could lead to various amounts of privacy leakage. Conventional Differential Privacy strategies, in which uniform noises are applied to model gradients, guarantee data privacy at the expense of accuracy and interpretability. This paper introduces a Feature-Sensitive Adaptive Differential Privacy (FADP) framework with a unique noise-adding strategy. Noises are adaptively added based on feature importance clustering, where important features are considered for interpretability. By employing a unique masking technique, FADP selectively preserves crucial features with minimal noise interference, maintaining accuracy while enhancing interpretability. The FADP framework addresses the limitations of traditional DP methods by preserving critical channels and improving interpretability — a vital requirement in machine learning applications that demand transparency in model decisions. Through comprehensive testing, FADP is shown to balance the trade-offs among accuracy, privacy, and interpretability, marking a substantial advancement in the field of privacy-preserving machine learning.

Farhad Riya, Farhin [University of Tennessee, Knox↗

CARETS: A prototype regional environmental information system. Volume 5: Interpretation, compilation and field verification procedures in the CARETS project

The production of the CARETS map data base involved the development of a series of procedures for interpreting, compiling, and verifying data obtained from remote sensor sources. Level II land use mapping from high-altitude aircraft photography at a scale of 1:100,000 required production of a photomosaic mapping base for each of the 48, 50 x 50 km sheets, and the interpretation and coding of land use polygons on drafting film overlays. CARETS researchers also produced a series of 1970 to 1972 land use change overlays, using the 1970 land use maps and 1972 high-altitude aircraft photography. To enhance the value of the land use sheets, researchers compiled series of overlays showing i cultural features, county boundaries and census tracts, surface geology, and drainage basins. In producing Level I land use maps from Landsat imagery, at a scale I of 1:250,000, interpreters overlaid drafting film directly on Landsat color composite transparencies and interpreted on the film. They found that such interpretation involves pattern and spectral signature recognition. In studies using Landsat imagery, interpreters identified numerous areas of change but also identified extensive areas of "false change," where Landsat spectral signatures but not land use had changed.

Field verification procedures↗

A Functional Programming Interpreter

Functional Programming (FP) sup BAC87 is an alternative to conventional imperative programming languages. This thesis describes an FP interpreter implementation. Superficially, FP appears to be a simple, but very inefficient language. Its simplicity, however, allows it to be interpreted quickly. Much of the inefficiency can be removed by simple interpreter techniques. This thesis describes the Illinois Functional Programming (IFP) interpreter, an interactive functional programming implementation which runs under both MS-DOS and UNIX. The IFP interpreter allows functions to be created, executed, and debugged in an environment very similar to UNIX. IFP's speed is competitive with other interpreted languages such as BASIC.

Arch Douglas Robison↗

GeoDash: Assisting Visual Image Interpretation in Collect Earth Online by Leveraging Big Data on Google Earth Engine

Collect Earth Online (CEO) is a free and open online implementation of the FAO Collect Earth system for collaboratively collecting environmental data through the visual interpretation of Earth observation imagery. The primary collection mechanism in CEO is human interpretation of land surface characteristics in imagery served via Web Map Services (WMS). However, interpreters may not have enough contextual information to classify samples by only viewing the imagery served via WMS, be they high resolution or otherwise. To assist in the interpretation and collection processes in CEO, SERVIR, a joint NASA-USAID initiative that brings Earth observations to improve environmental decision making in developing countries, developed the GeoDash system, an embedded and critical component of CEO. GeoDash leverages Google Earth Engine (GEE) by allowing users to set up custom browser-based widgets that pull from GEE's massive public data catalog. These widgets can be quick looks of other satellite imagery, time series graphs of environmental variables, and statistics panels of the same. Users can customize widgets with any of GEE's image collections, such as the historical Landsat collection with data available since the 1970s, select date ranges, image stretch parameters, graph characteristics, and create custom layouts, all on-the-fly to support plot interpretation in CEO. This presentation focuses on the implementation and potential applications, including the back-end links to GEE and the user interface with custom widget building. GeoDash takes large data volumes and condenses them into meaningful, relevant information for interpreters. While designed initially with national and global forest resource assessments in mind, the system will complement disaster assessments, agriculture management, project monitoring and evaluation, and more.

SERVI↗

Extreme sparsification of physics-augmented neural networks for interpretable model discovery in mechanics

Data-driven constitutive modeling with neural networks has received increased interest in recent years due to its ability to easily incorporate physical and mechanistic constraints and to overcome the challenging and time-consuming task of formulating phenomenological constitutive laws that can accurately capture the observed material response. However, even though neural network-based constitutive laws have been shown to generalize proficiently, the generated representations are not easily interpretable due to their high number of trainable parameters. Sparse regression approaches exist that allow for obtaining interpretable expressions, but the user is tasked with creating a library of model forms which by construction limits their expressiveness to the functional forms provided in the libraries. Here, in this work, we propose to train regularized physics-augmented neural network-based constitutive models utilizing a smoothed version of $L^0$-regularization. This aims to maintain the trustworthiness inherited by the physical constraints, but also enables interpretability which has not been possible thus far on any type of machine learning-based constitutive model where model forms were not assumed a priori but were actually discovered. During the training process, the network simultaneously fits the training data and penalizes the number of active parameters, while also ensuring constitutive constraints such as thermodynamic consistency. We show that the method can reliably obtain interpretable and trustworthy constitutive models for compressible and incompressible hyperelasticity, yield functions, and hardening models for elastoplasticity, using synthetic and experimental data. This work aims to set a new paradigm for interpretable machine learning models in the broad area of solid mechanics where low and limited data is available along with prior knowledge of physical constraints that the learned maps need to obey. This paradigm can potentially be extended to a broader spectrum of scientific exploration.

Data-driven constitutive models↗

Precise interpretations of traditional fine-tuning measures

We uncover two precise interpretations of traditional electroweak fine-tuning (FT) measures that were historically missed. (i) a statistical interpretation : the traditional FT measure shows the change in plausibility of a model in which a parameter was exchanged for the 𝑍 boson mass relative to an untuned model in light of the 𝑍 boson mass measurement. (ii) an information-theoretic interpretation : the traditional FT measure shows the exponential of the extra information, measured in nats, relative to an untuned model that you must supply about a parameter in order to fit the 𝑍 mass. We derive the mathematical results underlying these interpretations, and explain them using examples from weak scale supersymmetry. These new interpretations allow us to rigorously define FT in particle physics and beyond, shed fresh light on the status of extensions to the Standard Model and, lastly, allow us to precisely reinterpret historical and recent studies using traditional FT measures.

electroweak symmetry breaking↗

Improving net ecosystem CO2 flux prediction using memory-based interpretable machine learning

Terrestrial ecosystems play a central role in the global carbon cycle and affect climate change. However, our predictive understanding of these systems is still limited due to their complexity and uncertainty about how key drivers and their legacy effects influence carbon fluxes. Here, we propose an interpretable Long Short-Term Memory (iLSTM) network for predicting net ecosystem CO 2 exchange (NEE) and interpreting the influence on the NEE prediction from environmental drivers and their memory effects. We consider five drivers and apply the method to three forest sites in the United States. Besides performing the prediction in each site, we also conduct transfer learning by using the iLSTM model trained in one site to predict at other sites. Results show that the iLSTM model produces good NEE predictions for all three sites and, more importantly, it provides reasonable interpretations on the input driver's importance as well as their temporal importance on the NEE prediction. Additionally, the iLSTM model demonstrates good across-site transferability in terms of both prediction accuracy and interpretability. The transferability can improve the NEE prediction in unobserved forest sites, and the interpretability advances our predictive understanding and guides process-based model development.

Liu, Siyan↗

Development of fracture diagnostic methods for fluid distribution based on quantitative interpretation of distributed acoustic sensing and distributed temperature sensing

Multistage hydraulic fracturing design on horizontal wells has significantly evolved with larger fluid volume, more fracturing stages, and tighter perforation cluster spacing to efficiently stimulate unconventional reservoirs. From the published field observations, the recent fracturing design results in complex fracture networks or swarm of fractures. Fracture treatment evaluation is extremely challenging in such a case because of the large amount of variables in well completion and stimulation design. Combined measurements from different technologies can help in fracture diagnosis. Fluid distribution, either during fracture injection or during production, directly relates to the stimulation efficiency at the cluster level and at the stage level. Because it is unlikely in the real world to distribute the injected fluid uniformly among all the clusters, we need diagnostic techniques to generate the flow profile along a lateral. Fiber-optic measurements, such as distributed acoustic sensing (DAS) and distributed temperature sensing (DTS), are currently used to diagnose downhole flow conditions. This technology allows us to qualitatively confirm the fluid flow profile and other issues occurring downhole during fracturing such as leakage through plugs. For optimizing a fracturing design, we also need to understand how the design parameters are correlated with the stimulation efficiency. In this study, we combine two sets of models of DAS and DTS data interpretation for injected fluid volume distribution. The DAS is interpreted based on an empirical correlation between fluid flow rates and frequency band energy from the acoustic signals. The DTS is interpreted by performing temperature history match-based thermal energy conservation. Because of the completely different physics behind the interpretations, the confirmation of two interpretations provides confidence in fluid distribution.

Geochemistry & Geophysics↗

Testing the reliability of interpretable neural networks in geoscience using the Madden–Julian oscillation

Abstract. We test the reliability of two neural network interpretation techniques, backward optimization and layerwise relevance propagation, within geoscientific applications by applying them to a commonly studied geophysical phenomenon, the Madden–Julian oscillation. The Madden–Julian oscillation is a multi-scale pattern within the tropical atmosphere that has been extensively studied over the past decades, which makes it an ideal test case to ensure the interpretability methods can recover the current state of knowledge regarding its spatial structure. The neural networks can, indeed, reproduce the current state of knowledge and can also provide new insights into the seasonality of the Madden–Julian oscillation and its relationships with atmospheric state variables. The neural network identifies the phase of the Madden–Julian oscillation twice as accurately as a linear regression approach, which means that nonlinearities used by the neural network are important to the structure of the Madden–Julian oscillation. Interpretations of the neural network show that it accurately captures the spatial structures of the Madden–Julian oscillation, suggest that the nonlinearities of the Madden–Julian oscillation are manifested through the uniqueness of each event, and offer physically meaningful insights into its relationship with atmospheric state variables. We also use the interpretations to identify the seasonality of the Madden–Julian oscillation and find that the conventionally defined extended seasons should be shifted later by 1 month. More generally, this study suggests that neural networks can be reliably interpreted for geoscientific applications and may thereby serve as a dependable method for testing geoscientific hypotheses.

58 GEOSCIENCES↗

The interpretation of temperature and salinity variables in numerical ocean model output and the calculation of heat fluxes and heat content

Abstract. The international Thermodynamic Equation of Seawater 2010 (TEOS-10) defined the enthalpy and entropy of seawater, thus enabling the global ocean heat content to be calculated as the volume integral of the product of in situ density, ρ, and potential enthalpy, h0 (with reference sea pressure of 0 dbar). In terms of Conservative Temperature, Θ, ocean heat content is the volume integral of ρcp0Θ, where cp0 is a constant “isobaric heat capacity”. However, many ocean models in the Coupled Model Intercomparison Project Phase 6 (CMIP6) as well as all models that contributed to earlier phases, such as CMIP5, CMIP3, CMIP2, and CMIP1, used EOS-80 (Equation of State – 1980) rather than the updated TEOS-10, so the question arises of how the salinity and temperature variables in these models should be physically interpreted, with a particular focus on comparison to TEOS-10-compliant observations. In this article we address how heat content, surface heat fluxes, and the meridional heat transport are best calculated using output from these models and how these quantities should be compared with those calculated from corresponding observations. We conclude that even though a model uses the EOS-80, which expects potential temperature as its input temperature, the most appropriate interpretation of the model's temperature variable is actually Conservative Temperature. This perhaps unexpected interpretation is needed to ensure that the air–sea heat flux that leaves and arrives in atmosphere and sea ice models is the same as that which arrives in and leaves the ocean model. We also show that the salinity variable carried by present TEOS-10-based models is Preformed Salinity, while the salinity variable of EOS-80-based models is also proportional to Preformed Salinity. These interpretations of the salinity and temperature variables in ocean models are an update on the comprehensive Griffies et al. (2016) paper that discusses the interpretation of many aspects of coupled Earth system models.

54 ENVIRONMENTAL SCIENCES↗

Interpretation of geographic patterns in simulated orbital television imagery of earth resources

In order to better determine the effects of the television imagery characteristics upon the interpretation of geographic patterns obtainable from orbital television sensors, and in order to better evaluate the influences of alternative sensor system parameters such as changes in orbital altitudes or scan line rates, a team of three professional interpreters independently mapped thematically the selected geographic phenomena that they could detect in orbital television imagery produced on a fourteen inch monitor and recorded photographically for analysis. Three thematic maps were compiled by each interpreter. The maps were: (1) transportation patterns; (2) other land use; and (3) physical regions. The results from the three interpreters are compared, agreements noted, and differences analyzed for cause such as disagreement on identification of phenomenon, visual acuity, differences in interpretation techniques, and differing professional backgrounds.

Latham, J. P.↗

SLAR image interpretation keys for geographic analysis

A means for side-looking airborne radar (SLAR) imagery to become a more widely used data source in geoscience and agriculture is suggested by providing interpretation keys as an easily implemented interpretation model. Interpretation problems faced by the researcher wishing to employ SLAR are specifically described, and the use of various types of image interpretation keys to overcome these problems is suggested. With examples drawn from agriculture and vegetation mapping, direct and associate dichotomous image interpretation keys are discussed and methods of constructing keys are outlined. Initial testing of the keys, key-based automated decision rules, and the role of the keys in an information system for agriculture are developed.

Coiner, J. C.↗