Search NASA⌕ Search

SEARCH · Search NASA

Results for “Explainable deep learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

131 records · Page 8

Active causal learning for decoding chemical complexities with targeted interventions

Abstract Predicting and enhancing inherent properties based on molecular structures is paramount to design tasks in medicine, materials science, and environmental management. Most of the current machine learning and deep learning approaches have become standard for predictions, but they face challenges when applied across different datasets due to reliance on correlations between molecular representation and target properties. These approaches typically depend on large datasets to capture the diversity within the chemical space, facilitating a more accurate approximation, interpolation, or extrapolation of the chemical behavior of molecules. In our research, we introduce an active learning approach that discerns underlying cause-effect relationships through strategic sampling with the use of a graph loss function. This method identifies the smallest subset of the dataset capable of encoding the most information representative of a much larger chemical space. The identified causal relations are then leveraged to conduct systematic interventions, optimizing the design task within a chemical space that the models have not encountered previously. While our implementation focused on the QM9 quantum-chemical dataset for a specific design task—finding molecules with a large dipole moment—our active causal learning approach, driven by intelligent sampling and interventions, holds potential for broader applications in molecular, materials design and discovery.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

How Low Can You Go? Using Synthetic 3D Imagery to Drastically Reduce Real-World Training Data for Object Detection

Deep convolutional neural networks (DCNNs) currently provide state-of-the-art performance on image classification and object detection tasks, and there are many global security mission areas where such models could be extremely useful. Crucially, the success of these models is driven in large part by the widespread availability of high-quality open source data sets such as Image Net, Common Objects in Context (COCO), and KITTI, which contain millions of images with thousands of unique labels. However, global security relevant objects-of-interest can be difficult to obtain: relevant events are low frequency and high consequence; the content of relevant images is sensitive; and adversaries and proliferators seek to obscure their activities. For these cases where exemplar data is hard to come-by, even fine-tuning an existing model with available data can be effectively impossible. Recent work demonstrated that models can be trained using a combination of real-world and synthetic images generated from 3D representations; that such models can exceed the performance of models trained using real-world data alone; and that the generated images need not be perfectly realistic (Tremblay, et al., 2018). However, this approach still required hundreds to thousands of real-world images for training and fine tuning, which for sparse, global security-relevant datasets can be an unrealistic hurdle. In this research, we validate the performance and behavior of DCNN models as we drive the number of real-world images used for training object detection tasks down to a minimal set. We perform multiple experiments to identify the best approach to train DCNNs from an extremely small set of real-world images. In doing so, we: Develop state-of-the-art, parameterized 3D models based on real-world images and sample from their parameters to increase the variance in synthetic image training data; Use machine learning explainability techniques to highlight and correct through targeted training the biases that result from training using completely synthetic images; and Validate our results by comparing the performance of the models trained on synthetic data to one another, and to a control model created by fine-tuning an existing ImageNet-trained model with a limited number (hundreds) of real-world images.

97 MATHEMATICS AND COMPUTING↗

Robust In-Situ Strain Measurements to Monitor CO 2 Storage

The goal of this project was to develop and demonstrate robust instrumentation to monitor the in-situ strain tensor in order to improve the reliability and security of CO 2 storage in geologic formations. We met the original goals of the project and the major overarching accomplishment is the advancement of strain tensor monitoring from an intriguing concept to a commercially available technology with a solid foundation of novel instruments supported by theoretical analyses and validation experiments. The main accomplishments of the project are summarized below. We designed, built and evaluated nine new optical fiber strainmeters and tiltmeters using Michelson interferometers to measure deformation with ultra-high resolution at both shallow and deep point locations in the subsurface. These are the robust strainmeters that motivated the title of the project. We designed, built and evaluated a novel method of measuring distributed strain in optical fibers with nanostrain resolution, and cm-scale location, and sampling into the seismic band. The new method is called Coherence-length-gated Microwave Photonics Interfereometry (CMPI). CMPI technology has advantages over existing commercial DAS and DSS methods. We developed and demonstrated capabilities to deploy instruments in the field and used them to measure strain caused by ambient signals like barometric pressure and tides, as well as induced signals like surface loading and pore pressure changes from pumping tests. We deployed a working strainmeter at 1,700 ft depth, slightly above an active reservoir. This is to our knowledge the greatest depth a strainmeter has been deployed and the techniques we used can readily be extended to greater depths. Optical fiber borehole tensor strainmeter techology was advanced from a TRL 4 at the start, to a TRL of 7 at the conclusion of the project. The project included advances in simulations and theoretical analyses. We developed and demonstrated a computational workflow that uses machine learning to reduce the computational requirements and make it practical to use Bayesian inversion to solve large numerical poroelastic analyses needed to interpret strain tensor field data. We evaluated the strain tensor fields and time series that would be caused by leaks of CO 2 or other fluids from reservoirs. These simulations demonstrated that signals from leaks could be measured with instruments developed for the project, opening a potentially new method for ensuring storage security. We showed that strains in caprock can be used to estimate pressure in a reservoir. This avoids the need to drill monitoring wells into the reservoir, and it expands the capabilities of monitoring in the caprock. The project includes a derivation and application of a novel analytical solution to the strains in the vicinity of a pressurized poroelastic inclusion. This solution explains field data measured during injeciton tests at the North Avant Field, and it will simplify future interpretation of strain tensor data. The project included a broad range of experiments, and of the most significant is the characterization of the strain tensor at an array three strainmeters during six injection tests at the North Avant Field, Oklahoma. This demonstrated repeatability of the strain signal measured by the new instruments developed for the project, and it showed similarities between the strain signal at shallow depths and pressure in the underlying reservoir. We also demonstrated that useful strain data can be measured at reservoir depths. This confirms that strain tensor data can be measured throughout the caprock over a reservoir. The project demonstrated the feasibility of using the strain tensor and distributed strain measured in caprock during a variety of different well tests where the pumping rate was constant, sinusoidal and positive, or a periodic square wave with zero net rate. This further strengthens the validity of using strain data to characterize reservoirs and aquifers. We also demonstrated that strain caused be fluctuations of air pressure and water pressure in the vadose zone can be measured and interpreted, suggesting that high resolution distributed strain measurements hold promise for monitoring the vadose zone. The project partially supported nine graduate students in the Environmental Engineering, Hydrogeology, Electrical Engineering programs at Clemson University. The research was described in nine journal papers, 23 talks and conference abstracts. Additional journal papers are in preparation. A new company called Tensora was started to provide strainmeter technology for commercial applications.

01 COAL, LIGNITE, AND PEAT↗

Baseflow Identification via Explainable AI With Kolmogorov‐Arnold Networks

Abstract Hydrological models often involve constitutive laws that may not be optimal in every application. We propose to replace such laws with the Kolmogorov‐Arnold networks (KANs), a class of neural networks designed to identify symbolic expressions. We demonstrate KAN's potential on the problem of baseflow identification, a notoriously challenging task plagued by significant uncertainty. KAN‐derived functional dependencies of the baseflow components on the aridity index outperform their original counterparts; they demonstrate that water availability, rather than potential evapotranspiration, drives baseflow by constraining actual evapotranspiration under arid conditions. On a test set, they increase the Nash‐Sutcliffe efficiency (NSE) by 65%, decrease the root mean squared error by 29%, and increase the Kling‐Gupta efficiency by 34%. This superior performance is achieved while reducing the number of fitting parameters from three to two. Next, we use data from 378 catchments across the continental United States to refine the water‐balance equation at the mean‐annual scale. The KAN‐derived equations based on the refined water balance outperform both the current aridity index model, with up to a 105% increase in NSE, and the KAN‐derived equations based on the original water balance. While the performance of our model and tree‐based machine learning methods is similar, KANs offer the advantage of simplicity and transparency and require no specific software or computational tools. This case study focuses on the aridity index formulation, but the approach is flexible and transferable to other hydrological processes. Plain Language Summary Equations used in hydrologic model are often suboptimal, resulting in reduced prediction accuracy and efficiency. We implemented Kolmogorov‐Arnold networks (KAN), a machine learning algorithm for deriving symbolic formulations, to estimate groundwater recharge and showed that it outperforms an existing state‐of‐the‐art semi‐empirical formulation. In hydrology, Nash‐Sutcliffe efficiency (NSE), root mean squared error (RMSE), and Kling‐Gupta efficiency (KGE) are commonly used to evaluate model performance. Higher NSE and KGE values indicate better performance, while lower RMSE values are preferable. Our results show that NSE increased by 71%, RMSE decreased by 32%, and KGE improved by 25%. In addition, KAN identifies an optimal functional form and can be used to derive new analytical formulas using the prior knowledge. The KAN‐inspired equation outperformed the original formulation and reduced the fitting parameters. Furthermore, we refined the water‐balance equation at the mean‐annual scale and showed that, based on the new water‐balance equation, KAN can derive new formulations that are superior to the original aridity index formulations (up to 105% increase in NSE) and KAN‐derived equations based on the original water balance. These findings highlight the significant potential of KAN to advance the scientific understanding of a wide range of hydrologic processes. Key Points Kolmogorov‐Arnold networks (KANs) enhance interpretability of machine‐learned hydrological models KAN‐derived symbolic formulations outperform state‐of‐the‐art semi‐empirical aridity indices KAN‐identified functional form yields an analytical index with fewer fitting parameters and improved performance

baseflow↗

Topics in Theoretical Physics

This award supported a broadly based research effort in theoretical particle physics, including research aimed at uncovering the laws of nature at short (subatomic) and long (cosmological) distances. These theoretical developments apply to experiments in laboratories such as CERN, the facility that operates the Large Hadron Collider outside Geneva, as well as to cosmological investigations done using telescopes and satellites. The results reported here apply to physics beyond the so-called Standard Model of particle physics; physics of high energy collisions such as those observed at the Large Hadron Collider; theoretical and mathematical tools and frameworks for describing the laws of nature at short distances; cosmology and astrophysics; and analytic and computational methods to solve theories of short distance physics. Some specific research accomplishments include + Theories of the electroweak interactions, the forces that give rise to many forms of radioactive decay; + Physics of the recently discovered Higgs boson. + Models and phenomenology of dark matter, the mysterious component of the universe, that has so far been detected only by its gravitational effects. + High energy particles in astrophysics and cosmology. + Algorithmic research and Computational methods for physics of and beyond the Standard Model. + Theory and applications of relativity and its possible limitations. + Topological effects in field theory and cosmology. + Conformally invariant systems and AdS/CFT. This award also supported significant training of students and postdoctoral fellows to lead the research effort in particle theory for the coming decades. These students and fellows worked closely with other members of the group as well as theoretical and experimental colleagues throughout the physics community. Many of the research projects funded by this grant arose in response to recently obtained experimental results in the areas of particle physics and cosmology. We describe a few of these below. Relativity is founded on a symmetry property of nature called "Lorentz Invariance". Like all symmetry properties, it is essential to determine precisely how symmetric nature actually is; that is, do the laws of nature fully respect the symmetry or is there room for tiny symmetry violating effects? An important consequence of Lorentz invariance is the existence of a universal limiting velocity for all physical particles. Light travels at this limiting velocity so it is frequently referred to as simply "the speed of light", but relativity requires that ALL particles travel more slowly than this speed. Once the Higgs particle was discovered in 2012 a natural question was whether or not this particle's speed was consistent with relativity. Although the speed of the Higgs particle is not measurable directly, Cohen has shown that, if the maximal speed of the Higgs particle was not precisely the same as the speed of light, then the Higgs would have some unusual properties. In some cases the Higgs would be unstable to some unusual decay modes; in other cases the interactions of the Higgs with other particles would change the properties of these other particles in ways that could be observed in so-called cosmic rays, very energetic particles (such as photons, protons and other atomic nuclei) coming from space. Once these particles hit the upper atmosphere they produce a "shower" of particles that can be seen by ground-based instruments. If the Higgs has a maximal speed that differs even a tiny bit from the speed of light these showers would look quite different from what is observed. In this way Cohen was able to establish that the Higgs travels with a maximal speed that cannot differ from the speed of light by more than one part in a thousand-trillion. This is by far the most precisely determined property of the Higgs particle. Cohen and Schmaltz reviewed evidence from the Large Hadron Collider (LHC), a particle physics experiment operating at the CERN laboratory near Geneva, for a new particle sometimes called a W'. This evidence included certain unexpected by-products in collisions of protons at very high energy. While the evidence was not significant enough to claim a discovery, it was sufficiently intriguing that many particle theorists worked to construct explanations for this signal. Cohen and Schmaltz were able to determine that such explanations are highly constrained by previous experiments involving collisions of very energetic particles. Nevertheless they were able to construct a theory that adequately explains the LHC data and remain consistent with prior experiments. Their explanation predicts the existence of yet another new particle, called a Z', with a mass slightly greater than that of the W'. This additional particle, if it exists, should be seen as more data is collected from the LHC. Amusingly, there is one collision by-product that has already been seen by the CMS experiment at the LHC that supports the existence of this new particle; however, it is not unlikely that this single event is a so-called "background" event, that is a somewhat atypical by-product of a conventional Standard Model process. This theory for the anomalous LHC data will either be confirmed or excluded with further data-taking at the LHC. The ratio of the number of electrons produced in bottom quark decays over the number of muons produced has been measured at the LHC. This ratio is interesting because it can be predicted very precisely from a basic property of the Standard Model: lepton universality. If lepton universality is correct, the ratio of electrons to muons is predicted to be equal to 1. The first measurements of this ratio find a value different from 1 with a statistical significance of about 3 standard deviations. Schmaltz and collaborator proposed a new extension of the Standard Model which can explain the new data. In addition, Schmaltz and collaborators proposed several new measurements of ratios of decay rates which can confirm or rule out the surprising results from the earlier LHC data. The most recent and precise measurements of the cosmic microwave background from the Planck satellite, from a combination of measurements of the dark matter distribution in the universe, and from a measurement of the expansion rate of the universe today show some disagreement when interpreted in terms of the so-called LambdaCDM model. Schmaltz and collaborators proposed an alternative model to LambdaCDM in which the usual cold dark matter is replaced by a new ``dark sector". This sector consists of a cold dark matter particle which interacts with a newly postulated dark radiation component of the universe. The dark radiation can help explain the discrepancy in measurements of the expansion rate, and the dark matter interactions subtly modify the clumping of dark matter at large scales, thus potentially explaining both kinds of tensions in the data. In two publications Schmaltz described the new model and then performed a precision comparison of the predictions of the model with all currently available cosmological data. The results favor the new model at the level of three standard deviations with current data. Quantum Field Theory (QFT) is the language we use to describe quantum systems which are consistent with Einstein’s theory of Special Relativity. In particular, the requirement of Einstein’s theory that signals not travel faster than the speed of light constrains the types of interactions which particles can engage in. One consequence of relativity is that these interactions cannot preserve particle number. The stronger the interactions, the more severe the particle number violation in a given Relativistic QFT. When particle number violation is strong, it becomes very difficult to adequately parameterize the quantum wave function (which characterizes the state of a quantum system). For example, though we can formulate the QFT which describes the strong force as a set of interactions between quark and gluon particles, we have no clear idea how to express the proton state in terms of these quarks and gluons. This is because the proton, though a bound state of quarks and gluons, is not a state of a fixed number of particles due to strong interactions. Yet, understanding the proton state is very important in order to theoretically predict the reaction rates observed at the LHC in Geneva, which is a proton-proton collider. Katz has formulated a new approach to QFT, which among other things offers a way to adequately approximate the quantum wave function of a bound state at strong coupling. The approximation scheme is related to the fact that any sensible QFT (including that of the strong interactions) is at short distances approximately self-similar upon rescaling of space and time. It turns out that keeping track of the response upon this rescaling is important in efficiently parameterizing the state. Katz and collaborators have used this observation to approximate the state of the proton in toy versions of the strong force. In the late 60s Sheldon Glashow, Abdus Salam and Steven Weinberg (1979 Nobel Prize awardees) proposed a theory unifying weak and electromagnetic interaction which assumed the existence of new particles, the W and Z bosons. The W and Z bosons were eventually detected in high-energy collision in a particle accelerator at CERN, and the recent discovery of the Higgs meson at the Large Hadron Collider (LHC), always at CERN, completed the picture. However, deep theoretical considerations indicate that the theory by Glashow, Weinberg and Salam, often referred to as "the standard model" cannot be the whole story: the existence of new particles and new interactions at yet higher energies is widely anticipated. The experiments at the LHC are looking for these, while theorists, like Brower, Rebbi and collaborators, are investigating models for these new interactions. Working in a large national collaboration with access to the most powerful DOE computers Brower, Rebbi and colleagues have been using calculational techniques, similar to those successfully employed for many years to investigate the interactions among quarks in nucleons, to study theories that can describe the expected "beyond the standard model" (BSM) interactions. Their results, which include also a model for dark matter, have been published in several refereed papers in prestigious journals. Various ideas in topologically interesting field theories predict hypothetical objects such as fractional charges and Majorana excitations. However, such fascinating objects have not been seen in particle physics. Nevertheless, these objects demonstrate possible phenomena that quantum field theory can support. Pi used condensed matter physics as a laboratory to study possible realizations and observable effects of these objects predicted by quantum field theory. In recent times there has developed considerable interest among condensed matter field theorists in precisely the same geometrical and topological structures, which were first discovered in particle physics field theories. From particle physicists' point of view, this is an interesting development, since condensed matter provides an arena in which one can concretely realize particle physics ideas. Moreover, particle physicists can learn new ideas from condensed matter physics. Higgs phenomenon is precisely an important particle physics realization of condensed matter ideas. In contrast to the small distance characterizing condensed matter systems, field theory also describes large distance physics characterizing cosmology. Pi worked on various geometrical effects in the standard theory of cosmology, viz general relativity.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗