Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model interpretation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,063 records · Page 59

Physics-informed, empirically constrained machine learning for designing Fe-9Cr alloys

<span style="font-family: Calibri, sans-serif; font-size: 12pt;">Materials data analytics can be used to significantly shorten development time of specialized alloys needed for next generation energy applications. Incorporation of the domain knowledge into deep-learning graph structure via fuzzy pre-training and causal process imitation presents a viable approach to developing accurate data-driven models and reliable alloy design tools, with limited datasets. It was demonstrated that the domain knowledge-based empirical constraints not only inhibit overfitting but also allow training more accurate and reliable ML models with improved transparency of the output interpretation. In this study, alloy tensile properties were interpreted with three competing virtual-microstructure models.</span>

Romanov, Vyacheslav↗

Deciphering enhancer sequence using thermodynamics-based models and convolutional neural networks

Abstract Deciphering the sequence-function relationship encoded in enhancers holds the key to interpreting non-coding variants and understanding mechanisms of transcriptomic variation. Several quantitative models exist for predicting enhancer function and underlying mechanisms; however, there has been no systematic comparison of these models characterizing their relative strengths and shortcomings. Here, we interrogated a rich data set of neuroectodermal enhancers in Drosophila, representing cis- and trans- sources of expression variation, with a suite of biophysical and machine learning models. We performed rigorous comparisons of thermodynamics-based models implementing different mechanisms of activation, repression and cooperativity. Moreover, we developed a convolutional neural network (CNN) model, called CoNSEPT, that learns enhancer ‘grammar’ in an unbiased manner. CoNSEPT is the first general-purpose CNN tool for predicting enhancer function in varying conditions, such as different cell types and experimental conditions, and we show that such complex models can suggest interpretable mechanisms. We found model-based evidence for mechanisms previously established for the studied system, including cooperative activation and short-range repression. The data also favored one hypothesized activation mechanism over another and suggested an intriguing role for a direct, distance-independent repression mechanism. Our modeling shows that while fundamentally different models can yield similar fits to data, they vary in their utility for mechanistic inference. CoNSEPT is freely available at: https://github.com/PayamDiba/CoNSEPT.

59 BASIC BIOLOGICAL SCIENCES↗

Importance of Engineered and Learned Molecular Representations in Predicting Organic Reactivity, Selectivity, and Chemical Properties

Machine-readable chemical structure representations are foundational in all attempts to harness machine learning for the prediction of reactivities, selectivities, and chemical properties directly from molecular structure. The featurization of discrete chemical structures into a continuous vector space is a critical phase undertaken before model selection, and the development of new ways to quantitatively encode molecules is an active area of research. Here, we highlight the application and suitability of different representations, from expert-guided “engineered” descriptors to automatically “learned” features, in different prediction tasks relevant to organic and organometallic chemistry, where differing amounts of training data are available. These tasks include statistical models of stereo- and enantioselectivity, thermochemistry, and kinetics developed using experimental and quantum chemical data. The use of expert-guided molecular descriptors provides an opportunity to incorporate chemical knowledge, domain expertise, and physical constraints into statistical modeling. In applications to stereoselective organic and organometallic catalysis, where data sets may be relatively small and 3D-geometries and conformations play an important role, mechanistically informed features can be used successfully to obtain predictive statistical models that are also chemically interpretable. We provide an overview of several recent applications of this approach to obtain quantitative models for reactivity and selectivity, where topological descriptors, quantum mechanical calculations of electronic and steric properties, along with conformational ensembles, all feature as essential ingredients of the molecular representations used. Alternatively, more flexible, general-purpose molecular representations such as attributed molecular graphs can be used with machine learning approaches to learn the complex relationship between a structure and prediction target. This approach has the potential to out-perform more traditional representation methods such as “hand-crafted” molecular descriptors, particularly as data set sizes grow. One area where this is particularly relevant is in the use of large sets of quantum mechanical data to train quantitative structure–property relationships. A general approach toward curating useful data sets and training highly accurate graph neural network models is discussed in the context of organic bond dissociation enthalpies, where this strategy outperforms regression using precomputed descriptors. Finally, we describe how graph neural network predictions can be incorporated into mechanistically informed statistical models of chemical reactivity and selectivity. Once trained, this approach avoids the expensive computational overhead associated with quantum mechanical calculations, while maintaining chemical interpretability. We illustrate examples for which fast predictions of bond dissociation enthalpy and of the identities of radicals formed through cleavage of a molecule’s weakest bond are used in simple physical models of site-selectivity and reactivity.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Electronic Structure Theory and Novel Materials

This grant supported research on electronic structure and materials theory, with focus on three main issues: (i) novel techniques to deal with correlation in the electronic ground-state, (ii) topological materials, (iii) the phase diagram of lattice spin models. Regarding (i), we applied to the homogeneous electron liquid an approach that we previously developed in the context of molecular systems. In this scheme the electronic occupation probabilities and the natural spin orbitals are used to construct an approximate two-body density matrix for the electronic ground-state. Regarding (ii) we used standard electronic structure methods based on density functional theory to model topological materials and interpret experimental observations. Finally, regarding (iii) we further developed a numerical approach to compute the renormalized couplings within real space renormalization group theory in the context of lattice spin models. The main findings were the following. (i) We found that with our approximate two-body density matrix, which works well for small molecules, is not sufficiently accurate for condensed phase systems. Missing a systematic way of improving on the adopted approximations, we decided not to pursue this approach. (ii) We performed two studies. In one, we investigated the influence of Te defects on the topological properties of a WTe2 monolayer, finding that while Te vacancies, even in modest concentration, destroy the topological character, Te adatoms do not, consistent with a recent experiment. In another study, we predicted Weyl semimetal character and strong anomalous Hall effect in the Heusler compensated ferrimagnet Ti2MnAl. (iii) We developed a new Monte Carlo method to do real space renormalization group calculations for lattice spin models. We subsequently extended the scheme to deal with lattice spin models in presence of quenched disorder, finding that the approach can distinguish systems with finite and strong disorder. In the finite disorder case, the method allows one to find with good approximation the critical coupling distribution and the critical exponents.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Application of theoretical models to active and passive remote sensing of saline ice

The random medium model is used to interpret the polarimetric active and passive measurements of saline ice. The ice layer is described as a host ice medium embedded with randomly distributed inhomogeneities, and the underlying sea water is considered as a homogeneous half-space. The scatterers in the ice layer are modeled with an ellipsoidal correlation function. The orientation of the scatterers is vertically aligned and azimuthally random. The strong permittivity fluctuation theory is used to calculate the effective permittivity and the distorted Born approximation is used to obtain the polarimetric scattering coefficients. Thermal emissions based on the reciprocity and energy conservation principles are calculated. The effects of the random roughness at the air-ice, and ice-water interfaces are explained by adding the surface scattering to the volume scattering return incoherently. The theoretical model, which has been successfully applied to analyze the radar backscatter data of first-year sea ice, is used to interpret the measurements performed in the Cold Regions Research and Engineering Laboratory's CRRELEX program.

Han, H. C.↗

Preliminary findings of the Viking gas exchange experiment and a model for Martian surface chemistry

Earlier results reported from the Viking Lander-1 experiment are reexamined and interpreted in terms of a model of the Martian soil surface morphology and chemistry. Major events in the gas exchange experiment (GEX) first cycle are tabulated and data are presented on the sample processing and transport environments experienced by the soil samples. Oxygen and CO2 evolved from humidified Martian soil in GEX and slight changes in N2 present are investigated. A soil model involving iron oxide coating on silicate material is entertained to yield a mechanistic explanation of the experimental findings, and invocation of biotic processes is eschewed.

Oyama, V. I.↗

Using an Explainable Machine Learning Approach to Characterize Earth System Model Errors: Application of SHAP Analysis to Modeling Lightning Flash Occurrence

Computational models of the Earth System are critical tools for modern scientific inquiry. Effortstoward evaluating and improving errors in representations of physical and chemical processes inthese large computational systems are commonly stymied by highly nonlinear and complexerror behavior. Recent work has shown that these errors can be effectively predicted usingmodern Artificial Intelligence (A.I.) techniques. In this work, we go beyond these previousstudies to apply an interpretable A.I. technique to not only predict model errors but also movetoward understanding the underlying reasons for successful error prediction. We use XGBoostclassification trees and SHapley Additive exPlanations (SHAP) analysis to explore the errors inthe prediction of lightning occurrence in the NASA GEOS model, a widely used Earth SystemModel. This explainable error prediction system can effectively predict the model error andindicates that the errors are strongly related to convective processes and the characteristics ofthe land surface.

Artificial intelligence↗

Characterization of Spall in Hard Rock from Observations and Simulations of the Source Physics Experiment Phase I

In this work, spall signals from the Source Physics Experiments are presented, analyzed, and modeled for insight to the explosion source. The observed signal is similar in nature to nearby historical nuclear explosions, and the surface force-time history or velocity can be interpreted with the same model. We use the models for peak spall velocity, spalled mass, and spall depth and radius derived from historical nuclear explosions to parameterize the physical force-time history model from Stump (1985) and show that this parameterized model can be used for spall prediction. The spall signal is also investigated with a numerical continuum model that incorporates gravity. Peak velocity and dwell time are well predicted, and the multiple slap-down phases are captured if one includes a weak near-surface layer similar to the geologic observation.

58 GEOSCIENCES↗

Updates to Relevance Vector Machine: Multiclass Classification, Variable Selection, and Proof-of-Concept Application to Safeguards Fresh Fuel Verification using List-Mode Neutron Collar Data

To expand the capabilities of safeguards authorities to verify the integrity of fresh fuel assemblies, Oak Ridge National Laboratory has retrofit the existing electronics of the JCC-71 uranium neutron coincidence collar, which contains 18 3 He neutron detectors and an external 241 AmLi(α, n) neutron interrogation source arranged to surround a fresh nuclear fuel assembly. The new electronics system allows analysts to record list-mode neutron multiplicity data in addition to the singles and doubles rates that are currently measured. Based on previous proof-of-concept research, analysis of these new data will identify off-normal fuel configurations in an assembly and characterize or localize the specific partial fuel defects. The purpose of this report it to document the analysis algorithm development and then to demonstrate its capability for the safeguards verification of fresh fuel assemblies using list mode neutron collar data. To analyze the complex list-mode data collected with the upgraded uranium neutron collar, multivariate classification algorithms are being developed using a novel classification method, the relevance vector machine. This approach may be applied to multiclass problems to estimate the probability that test data belongs to one of many possible classes of data. In addition, our method identifies the most useful variables/channels for making predictions, which illuminates the basis for the model’s predictions, and this interpretability is largely unique among data analytics methods. Variable selection occurs during model training and parameter tuning and does not need any external hyperparameter tuning routines. Finally, we apply the modified relevance vector machine to a simulated dataset of list-mode neutron collar data generated with the radiation transport code MCNP. The method can correctly identify off-normal fuel configurations, categorize the data according to four fuel defect scenarios, and rank the channels in the data according to prediction utility. For nuclear safeguards applications, it is concluded that this method has the potential to increase the sensitivity and reliability to detect missing fuel rods from a standard 17 x 17 Pressurized Water Reactor (PWR) fresh fuel assembly. Within this analysis, “off-normal” (i.e., missing fuel rods) were correctly classified in 17 simulated test scenarios with one quarter (25%) of the fresh fuel rods missing using a training data set of 58 simulated measurements.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Thermal model for time-domain thermoreflectance experiments in a laser-flash geometry

Time-domain thermoreflectance (TDTR) is a well-established pump–probe method for measuring thermal conductivity and interface conductance of multilayers. Interpreting signals in a TDTR experiment requires a thermal model. In standard front/front TDTR experiments, both pump and probe beams typically irradiate the surface of a multilayer. As a result, existing thermal models for interpreting thermoreflectance experiments assume that the pump and probe beams both interact with the surface layer. Here, we present a frequency-domain solution to the heat-diffusion equation of a multilayer in response to nonhomogeneous laser heating. This model allows analysis of experiments where the pump and probe beams irradiate opposite sides of a multilayer. We call such a geometry a front/back experiment to differentiate such experiments from standard TDTR experiments. As an example, we consider a 60nm amorphous Si film. We consider how signals differ in a front/front vs front/back geometry and compare thermal model predictions to experimental data.

Peng, Wanyue↗

The SeaHorn Verification Framework

In this paper, we present SeaHorn, a software verification framework. The key distinguishing feature of SeaHorn is its modular design that separates the concerns of the syntax of the programming language, its operational semantics, and the verification semantics. SeaHorn encompasses several novelties: it (a) encodes verification conditions using an efficient yet precise inter-procedural technique, (b) provides flexibility in the verification semantics to allow different levels of precision, (c) leverages the state-of-the-art in software model checking and abstract interpretation for verification, and (d) uses Horn-clauses as an intermediate language to represent verification conditions which simplifies interfacing with multiple verification tools based on Horn-clauses. SeaHorn provides users with a powerful verification tool and researchers with an extensible and customizable framework for experimenting with new software verification techniques. The effectiveness and scalability of SeaHorn are demonstrated by an extensive experimental evaluation using benchmarks from SV-COMP 2015 and real avionics code.

Model Checking↗

Developing a common approach for classifying building stock energy models

Buildings contribute 40% of global greenhouse gas emissions; therefore, strategies that can substantially reduce emissions from the building stock are key components of broader efforts to mitigate climate change and achieve sustainable development goals. Models that represent the energy use of the building stock at scale under various scenarios of technology deployment have become essential tools for the development and assessment of such strategies. Within the past decade, the capabilities of building stock energy models have improved considerably, while model transferability and sharing has increased. Given these advancements, a new scheme for classifying building stock energy models is needed to facilitate communication of modeling approaches and the handling of important model dimensions. In this article, we present a new building stock energy model classification framework that leverages international modeling expertise from the participants of the International Energy Agency's Annex 70 on Building Energy Epidemiology. Drawing from existing classification studies, here we propose a multi-layer quadrant scheme that classifies modeling techniques by their design (top-down or bottom-up) and degree of transparency (black-box or white-box); hybrid techniques are also addressed. The quadrant scheme is unique from previous classification approaches in its non-hierarchical organization, coverage of and ability to incorporate emerging modeling techniques, and treatment of additional modeling dimensions. The new classification framework will be complemented by a reporting protocol and online registry of existing models as part of ongoing work in Annex 70 to increase the interpretability and utility of building stock energy models for energy policy making.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Complementing a continuum thermodynamic approach to constitutive modeling with symbolic regression

Here, an interpretable machine learning method, physics-informed genetic programming-based symbolic regression (P-GPSR), is integrated into a continuum thermodynamic approach to developing constitutive models. The proposed strategy for combining a thermodynamic analysis with P-GPSR is demonstrated by generating a yield function for an idealized material with voids, i.e., the Gurson yield function. First, a thermodynamic-based analysis is used to derive model requirements that are exploited in a custom P-GPSR implementation as fitness criteria or are strongly enforced in the solution. The P-GPSR implementation improved accuracy, generalizability, and training time compared to the same GPSR code without physics-informed fitness criteria. The yield function generated through the P-GPSR framework is in the form of a composite function that describes a class of materials and is characteristically more interpretable than GPSR-derived equations. The physical significance of the input functions learned by P-GPSR within the composite function is acquired from the thermodynamic analysis. Fundamental explanations of why the implemented P-GPSR capabilities improve results over a conventional GPSR algorithm are provided.

42 ENGINEERING↗

Spatial distribution of pressure resonance in compressible cavity flow

The development of the unsteady pressure field on the floor of a rectangular cavity was studied at Mach 0.9 using high-frequency pressure-sensitive paint. Power spectral amplitudes at each cavity resonance exhibit a spatial distribution with a streamwise-oscillatory pattern; additional maxima and minima appear as the mode number is increased. This spatial distribution also appears in the propagation velocity of modal pressure disturbances. This behavior was tied to the superposition of a downstream-propagating shear-layer disturbance and an upstream-propagating acoustic wave of different amplitudes and convection velocities, consistent with the classical Rossiter model. The summation of these waves generates a net downstream-traveling wave whose amplitude and phase velocity are modulated by a fixed envelope within the cavity. This traveling-wave interpretation of the Rossiter model correctly predicts the instantaneous modal pressure behavior in the cavity. Here, subtle spanwise variations in the modal pressure behavior were also observed, which could be attributed to a shift in the resonance pattern as a result of spillage effects at the edges of the finite-width cavity.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Dynamic pressure model derived from an observation by Sakigake for Comet Halley on 31 December, 1985

An outstanding disconnection event (DE)-like knot was observed on 31 Dec. 1985 in P/Halley's tail. Analysis of the Sakigake/IMF data reveals that comet Halley did not encounter the heliospheric neutral sheet on the day, demanding a new explanation of the DE-like event. During this event, the comet encountered a high-speed solar wind from a coronal hole tongue of the Sun. The event can be explained by a dynamic pressure model, according to which the DE-like plasmoid was caused by a sudden increase in the dynamic pressure of the solar wind. A simulation result is found to support this interpretation. The dynamic pressure model for a comet can be compared with the mechanism of a possible geotail disturbance during a spacecraft triggered auroral substorm.

Saito, Takao↗

Application of theoretical models to active and passive remote sensing of saline ice

The random medium model is used to interpret the polarimetric active and passive measurements of saline ice. The ice layer is described as a host ice medium embedded with randomly distributed inhomogeneities, and the underlying sea water is considered as a homogeneous half-space. The scatterers in the ice layer are modeled with an ellipsoidal correlation function. The orientation of the scatterers is vertically aligned and azimuthally random. The strong permittivity fluctuation theory is employed to calculate the effective permittivity and the distorted Born approximation is used to obtain the polarimetric scattering coefficients. We also calculate the thermal emissions based on the reciprocity and energy conservation principles. The effects of the random roughness at the air-ice, and ice-water interfaces are accounted for by adding the surface scattering to the volume scattering return incoherently. The above theoretical model, which has been successfully applied to analyze the radar backscatter data of the first-year sea ice near Point Barrow, AK, is used to interpret the measurements performed in the CRRELEX program.

Han, H. C.↗

A Universal Machine Learning Model for Elemental Grain Boundary Energies

The grain boundary (GB) energy has a profound influence on the grain growth and properties of polycrystalline metals. Here, we show that the energy of a GB, normalized by the bulk cohesive energy, can be described purely by four geometric features. By machine learning on a large computed database of 361 small Σ (Σ<10) GBs of more than 50 metals, we develop a model that can predict the grain boundary energies to within a mean absolute error of 0.13 J m –2 . More importantly, this universal GB energy model can be extrapolated to the energies of high Σ GBs without loss in accuracy. These results highlight the importance of capturing fundamental scaling physics and domain knowledge in the design of interpretable, extrapolatable machine learning models for materials science.

36 MATERIALS SCIENCE↗

Measurable characteristics of lysozyme crystal growth

The behavior of protein crystal growth is estimated from measurements performed at both the microscopic and molecular levels. In the absence of solutal flow, it was determined that a model that balances the macromolecular flux toward the crystal surface with the flux of the crystal surface well characterizes crystal growth observed using microscopic methods. Namely, it was determined that the model provides accurate estimates for the crystal-growth velocities upon evaluation of crystal-growth measurements obtained in time. Growth velocities thus determined as a function of solution supersaturation were further interpreted using established deterministic models. From analyses of crystal-growth velocities, it was found that the mode of crystal growth varies with respect to increasing solution supersaturation, possibly owing to kinetic roughening. To verify further the hypothesis of kinetic roughening, crystal growth at the molecular level was examined using atomic force microscopy (AFM). From the AFM measurements, it was found that the magnitude of surface-height fluctuations, h(x), increases with increasing solution supersaturation. In contrast, the estimated characteristic length, xi, decreases rapidly upon increasing solution supersaturation. It was conjectured that the magnitude of both h(x) and xi could possibly determine the mode of crystal growth. Although the data precede any exact theory, the non-critical divergence of h(x) and xi with respect to increasing solution supersaturation was nevertheless preliminarily established. Moreover, approximate models to account for behavior of both h(x) and xi are also presented.

Muramidase/chemistry↗