Search NASA⌕ Search

SEARCH · Search NASA

Results for “Explainable AI”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

AI-accelerated protein-ligand docking for SARS-CoV-2 is 100-fold faster with no significant change in detection

Protein-ligand docking is a computational method for identifying drug leads. The method is capable of narrowing a vast library of compounds down to a tractable size for downstream simulation or experimental testing and is widely used in drug discovery. While there has been progress in accelerating scoring of compounds with artificial intelligence, few works have bridged these successes back to the virtual screening community in terms of utility and forward-looking development. We demonstrate the power of high-speed ML models by scoring 1 billion molecules in under a day (50 k predictions per GPU seconds). We showcase a workflow for docking utilizing surrogate AI-based models as a pre-filter to a standard docking workflow. Our workflow is ten times faster at screening a library of compounds than the standard technique, with an error rate less than 0.01% of detecting the underlying best scoring 0.1% of compounds. Our analysis of the speedup explains that another order of magnitude speedup must come from model accuracy rather than computing speed. In order to drive another order of magnitude of acceleration, we share a benchmark dataset consisting of 200 million 3D complex structures and 2D structure scores across a consistent set of 13 million “in-stock” molecules over 15 receptors, or binding sites, across the SARS-CoV-2 proteome. We believe this is strong evidence for the community to begin focusing on improving the accuracy of surrogate models to improve the ability to screen massive compound libraries 100 × or even 1000 × faster than current techniques and reduce missing top hits. The technique outlined aims to be a fast drop-in replacement for docking for screening billion-scale molecular libraries.

59 BASIC BIOLOGICAL SCIENCES↗

Explaining and predicting human behavior and social dynamics in simulated virtual worlds: reproducibility, generalizability, and robustness of causal discovery methods

Ground Truth program was designed to evaluate social science modeling approaches using simulation test beds with ground truth intentionally and systematically embedded to understand and model complex Human Domain systems and their dynamics Lazer et al. (Science 369:1060–1062, 2020). Our multidisciplinary team of data scientists, statisticians, experts in Artificial Intelligence (AI) and visual analytics had a unique role on the program to investigate accuracy, reproducibility, generalizability, and robustness of the state-of-the-art (SOTA) causal structure learning approaches applied to fully observed and sampled simulated data across virtual worlds. In addition, we analyzed the feasibility of using machine learning models to predict future social behavior with and without causal knowledge explicitly embedded. In this paper, we first present our causal modeling approach to discover the causal structure of four virtual worlds produced by the simulation teams—Urban Life, Financial Governance, Disaster and Geopolitical Conflict. Our approach adapts the state-of-the-art causal discovery (including ensemble models), machine learning, data analytics, and visualization techniques to allow a human-machine team to reverse-engineer the true causal relations from sampled and fully observed data. We next present our reproducibility analysis of two research methods team’s performance using a range of causal discovery models applied to both sampled and fully observed data, and analyze their effectiveness and limitations. We further investigate the generalizability and robustness to sampling of the SOTA causal discovery approaches on additional simulated datasets with known ground truth. Our results reveal the limitations of existing causal modeling approaches when applied to large-scale, noisy, high-dimensional data with unobserved variables and unknown relationships between them. We show that the SOTA causal models explored in our experiments are not designed to take advantage from vasts amounts of data and have difficulty recovering ground truth when latent confounders are present; they do not generalize well across simulation scenarios and are not robust to sampling; they are vulnerable to data and modeling assumptions, and therefore, the results are hard to reproduce. Finally, when we outline lessons learned and provide recommendations to improve models for causal discovery and prediction of human social behavior from observational data, we highlight the importance of learning data to knowledge representations or transformations to improve causal discovery and describe the benefit of causal feature selection for predictive and prescriptive modeling.

97 MATHEMATICS AND COMPUTING↗

Interactions Between Lightning and Ship Traffic

It is important to understand connections between society and the natural environment for anticipating hazards and anthropogenic effects on the Earth system. In this study, we conduct a detailed exploration of interactions between oceanic thunderstorms and maritime traffic. Shipping traffic produces aerosols that perturb the otherwise “clean” ocean environment. Prior work proposed these aerosol effects as the cause of increased lightning over certain shipping lanes. However, introducing tall grounded objects into a high electric field environment might also facilitate lightning discharges, as we see with upward lightning over land. We consider both possibilities. Our analyses of the thunderstorms responsible for enhanced lightning activity over the shipping lane with the clearest anthropogenic signal indicate that the enhancement results from an increased frequency of lightning-producing storms. Observed variations in thunderstorm microphysics between the shipping lane and nearby oceans are small compared to natural factors such as the Indian monsoon, and are on the same scale as the local variability in the data. By contrast, matching lightning stroke data with ship transponder events in oceanic regions where public data are available reveals a strong signal from direct ship interactions. Lightning is 15× (66×) more likely to occur at a ship location compared to 2 km (25 km) away. These results highlight the central role of direct ship interactions in explaining lightning enhancements over shipping lanes. We also document the frequency of these direct lightning interactions across various categories of vessels and on individual ships present in the public data.

54 ENVIRONMENTAL SCIENCES↗

Toward a microscopic picture of hadronization and multi-parton processes

This project advanced the understanding of how quarks and gluons produced in high-energy collisions transform into the hadrons observed in particle detectors, a fundamental process known as quantum chromodynamics (QCD) hadronization. By combining theoretical calculations, quantum simulation methods, and modern AI techniques, the research developed new tools to study multi-parton dynamics and nonperturbative effects that are essential for interpreting data from current and future nuclear physics experiments. Key outcomes include new theoretical frameworks for jet and hadron measurements, pioneering quantum simulation algorithms for real-time dynamics in field theories, and the development of advanced machine-learning models, such as diffusion models and explainable classifiers, to simulate and analyze collider events. These results are directly relevant to experiments at Jefferson Lab, Brookhaven National Laboratory, and the future Electron-Ion Collider, and they also have a broader impact in areas such as quantum information science and data-driven modeling of complex systems. The project supported the training of graduate students and postdoctoral fellows and contributed to the broader scientific community through publications, workshops, and collaborative activities. Overall, this work provides new insights into the microscopic mechanisms of hadron formation and establishes a foundation for future studies at the intersection of nuclear physics, artificial intelligence, and quantum computing.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Learning from learning machines: improving the predictive power of energy-water-land nexus models with insights from complex measured and simulated data

Focal Area(s): Insights gleaned from complex data (observed and simulated) using AI; Predictive modeling through the use of AI techniques and AI-derived model components, including physics- and knowledge-informed models; Energy-water-land nexus and integrated energy systems – models of MultiSector dynamics. Science Challenge: Scientific communities are in need of tools for the computational integration of physics-based models, experimental data, and empirical/observational studies across a broad range of temporal and spatial scales to explore and meet EESSD grand challenges. We require AI algorithms for the discovery of process-drivers in the Earth-energy-human system and to link them with complex measured and simulated data. We aim to understand the energy-water-land nexus, particularly under extreme forcing scenarios and rare events, leveraging scale-aware AI process models, including probabilistic uncertainties, and benefiting from the emerging 5G-enabled landscape-scale sensing and edge computing capabilities. These models are needed to identify instabilities and tipping points that manifest extreme system behaviors with consequences for integrated energy systems and the environment. This work requires fundamental advances in uncertainty quantification, in particular, to identify and model unlikely but catastrophic outliers. Specifically, we need models that are interpretable to domain scientists and, essentially, explainable to public and private stake holders.

54 ENVIRONMENTAL SCIENCES↗

Enabling integrated AI control on DIII-D: a control system design with state-of-the-art experiments

We present the design and application of a general algorithm for Prediction And Control using MAchiNe learning (PACMAN) in DIII-D. Machine learning (ML)-based predictors and controllers have shown great promise in achieving regimes in which traditional controllers fail, such as tearing mode (TM) free scenarios, ELM-free scenarios and stable advanced tokamak conditions. The architecture presented here was deployed on DIII-D to facilitate the end-to-end implementation of advanced control experiments, from diagnostic processing to final actuation commands. This paper describes the detailed design of the algorithm and explains the motivation behind each design point. We also describe several successful ML control experiments in DIII-D using this algorithm, including a reinforcement learning controller targeting advanced non-inductive plasmas, a wide-pedestal quiescent H-mode ELM predictor, an Alfvén Eigenmode controller, a Model Predictive Control plasma profile controller and a state-machine TM predictor-controller. There is also discussion on guiding principles for real-time ML controller design and implementation.

machine learning↗

Machine Learning meets Algebraic Combinatorics: A Suite of Benchmark Datasets to Accelerate AI for Mathematics Research

The use of benchmark datasets has become an important engine of progress in machine learning (ML) over the past 15 years. Recently there has been growing interest in utilizing machine learning to drive advances in research-level mathematics. However, off-the-shelf solutions often fail to deliver the types of insights required by mathematicians. This suggests the need for new ML methods specifically designed with mathematics in mind. The question then is: what benchmarks should the community use to evaluate these? On the one hand, toy problems such as learning the multiplicative structure of small finite groups have become popular in the mechanistic interpretability community whose perspective on explainability aligns well with the needs of mathematicians. While toy datasets are a useful benchmark for initial work, they lack the scale, complexity, and sophistication of many of the principal objects of study in modern mathematics. To address this, we introduce a new collection of benchmark datasets, Algebraic Combinatorics Benchmarks (ACBench), representing either classic or open problems in algebraic combinatorics, a subfield of mathematics that studies discrete structures arising from abstract algebra. After describing the datasets, we discuss the challenges involved in constructing “good” mathematics benchmarks, describe baseline model performance, and discuss some of the insights these datasets can provide that may be of interest even to those who are not interested in mathematics research itself.

97 MATHEMATICS AND COMPUTING↗

The MERRA-2 Aerosol Reanalysis, 1980 Onward. Part II: Evaluation and Case Studies

The Modern-Era Retrospective Analysis for Research and Applications, Version 2 (MERRA-2) is NASA’s latest reanalysis for the satellite era (1980-present) using the Goddard Earth Observing System version 5 (GEOS-5) Earth system model. MERRA-2 provides several improvements over its predecessor (MERRA), including the inclusion of interactive aerosols for the entire period. In addition to assimilating bias-corrected Aerosol Optical Depth (AOD) from the Moderate Resolution Imaging Spectroradiometer (MODIS) on the Terra and Aqua satellites, it also includes the assimilation of bias-corrected AOD from Advanced Very High Resolution Spectroradiometer (AVHRR) instruments, Multi-angle Imaging SpectroRadiometer (MISR) AOD over bright surfaces, and ground-based Aerosol Robotic Network (AERONET) AOD. This paper is the second of a pair that summarizes our efforts to assess the quality of the MERRA-2 aerosol assimilation. In this study, we first follow previous work performed with version 1 of the MERRA Aerosol Reanalysis (MERRAero) using independent observations. The evaluation of MERRA-2 Absorption Aerosol Optical Depth (AAOD) and ultra-violet Aerosol Index (UV-AI) against the Ozone Monitoring Instrument (OMI) observations show good agreement, particularly over dusty regions where our previous efforts improved model aerosol optical properties. Next, we find that aerosol assimilation system improves the aerosol vertical structure when compared to estimates from the same version of the model without AOD assimilation. A similar conclusion is found for MERRA-2 aerosol surface fine particulate matter (PM (sub 2.5)). However, deficiencies in the forward model such as missing emissions noted during the MERRAero study still explain the MERRA-2 PM(sub 2.5) bias relative to observations over the United States. Finally, to illustrate successes and weaknesses of the AOD assimilation, we focus on the performance of the MERRA-2 aerosol system during several major aerosol events: the Mount Pinatubo eruption in 1991, a Saharan dust event and transportation over the Atlantic Ocean during April 2010, the Rim Fire of summer 2013 in California, and an extreme pollution event over China in January 2013. We conclude with a summary that points to best practices for utilizing the MERRA-2 aerosol reanalysis in future studies.

V Buchard↗

cGAS-like receptors sense RNA and control 3'2'-cGAMP signalling in Drosophila

Cyclic GMP–AMP synthase (cGAS) is a cytosolic DNA sensor that produces the second messenger cG[2'–5']pA[3'–5']p (2'3'-cGAMP) and controls activation of innate immunity in mammalian cells. Animal genomes typically encode multiple proteins with predicted homology to cGAS, but the function of these uncharacterized enzymes is unknown. Here we show that cGAS-like receptors (cGLRs) are innate immune sensors that are capable of recognizing divergent molecular patterns and catalysing synthesis of distinct nucleotide second messenger signals. Crystal structures of human and insect cGLRs reveal a nucleotidyltransferase signalling core shared with cGAS and a diversified primary ligand-binding surface modified with notable insertions and deletions. We demonstrate that surface remodelling of cGLRs enables altered ligand specificity and used a forward biochemical screen to identify cGLR1 as a double-stranded RNA sensor in the model organism Drosophila melanogaster. We show that RNA recognition activates Drosophila cGLR1 to synthesize the novel product cG[3'–5']pA[2'–5']p (3'2'-cGAMP). A crystal structure of Drosophila stimulator of interferon genes (dSTING) in complex with 3'2'-cGAMP explains selective isomer recognition, and 3'2'-cGAMP induces an enhanced antiviral state in vivo that protects from viral infection. Similar to radiation of Toll-like receptors in pathogen immunity, our results establish cGLRs as a diverse family of metazoan pattern recognition receptors.

59 BASIC BIOLOGICAL SCIENCES↗

The case for digital twins in metal additive manufacturing

The digital twin (DT) is a relatively new concept that is finding increased acceptance in industry. A DT is generally considered as comprising a physical entity, its virtual replica, and two-way digital data communications in-between. Its primary purpose is to leverage the process intelligence captured within digital models—or usually their faster-solving surrogates—towards generating increased value from the physical entities. The surrogate models are created using machine learning based on data obtained from the field, experiments and digital models, which may be physics-based or statistics-based. Anomaly detection and correction, and diagnostic closed-loop process control are examples of how a process DT can be deployed. In the manufacturing industry, its use can achieve improvements in product quality and process productivity. Metal additive manufacturing (AM) stands to gain tremendously from the use of DTs. This is because the AM process is inherently chaotic, resulting in poor repeatability. However, a DT acting in a supervisory role can inject certainty into the process by actively keeping it within bounds through real-time control commands. Closed-loop feedforward control is achieved by observing the process through sensors that monitor critical parameters and, if there are any deviations from their respective optimal ranges, suitable corrective actions are triggered. The type of corrective action (e.g. a change in laser power or a modification to the scanning speed) and its magnitude are determined by interrogating the surrogate models. Because of their artificial intelligence (AI)-endowed predictive capabilities, which allow them to foresee a future state of the physical twin (e.g. the AM process), DTs proactively take context-sensitive preventative steps, whereas traditional closed-loop feedback control is usually reactive. Apart from assisting a build process in real-time, a DT can help with planning the build of a part by pinpointing the optimum processing window relevant to the desired outcome. Again, the surrogate models are consulted to obtain the required information. In this article, we explain how the application of DTs to the metal AM process can significantly widen its application space by making the process more repeatable (through quality assurance) and cheaper (by getting builds right the first time).

36 MATERIALS SCIENCE↗

Knowledge based systems: A preliminary survey of selected issues and techniques

It is only recently that research in Artificial Intelligence (AI) is accomplishing practical results. Most of these results can be attributed to the design and use of expert systems (or Knowledge-Based Systems, KBS) - problem-solving computer programs that can reach a level of performance comparable to that of a human expert in some specialized problem domain. But many computer systems designed to see images, hear sounds, and recognize speech are still in a fairly early stage of development. In this report, a preliminary survey of recent work in the KBS is reported, explaining KBS concepts and issues and techniques used to construct them. Application considerations to construct the KBS and potential KBS research areas are identified. A case study (MYCIN) of a KBS is also provided.

Dominick, Wayne D.↗

Towards the next generation of Geospatial Artificial Intelligence

Geospatial Artificial Intelligence (GeoAI), as the integration of geospatial studies and AI, has become one of the fastest-developing research directions in spatial data science and geography. This rapid change in the field calls for a deeper understanding of the recent developments and envision where the field is going in the near future. In this work, we provide a quantitative analysis of the GeoAI literature from the spatial, temporal, and semantic aspects. We briefly discuss the history of AI and GeoAI by highlighting some pioneering work. Then we discuss the current landscape of GeoAI by selecting five representative subdomains including remote sensing, urban computing, Earth system science, cartography, and geospatial semantics. Finally, we highlight several unique future research directions of GeoAI which are classified into two groups: GeoAI method development challenges and GeoAI Ethics challenges. Topics include heterogeneity-aware GeoAI, knowledge-guided GeoAI, spatial representation learning, geo-foundation models, fairness-aware GeoAI, privacy-aware GeoAI, as well as interpretable and explainable GeoAI. We hope our review of GeoAI’s past, present, and future is comprehensive and can enlighten the next generation of GeoAI research.

58 GEOSCIENCES↗

Effectively Using Remote I/O For Work Composition in Distributed Workflows

Distributed scientific workflows are becoming more important with the interest in incorporating AI into their loops. A critical programming and performance question is how to compose workflow tasks when data is produced on one system but must be consumed on another. Since the dominant technique is composition with remote I/O, this paper explores its performance expectations. We describe BigFlowSim, a workflow I/O simulator that captures key implementation choices for remote I/O, including intensity, reuse, locality, access pattern, and data movement.With BigFlowSim, we generate a synthetic benchmark. We quantify the effects of each parameter with a performance sensitivity study. We explain trends in terms of data movement reduction and show that, under certain conditions, it is possible to establish a total order among most parameters. We apply these insights to a high energy physics workflow, Belle II Monte Carlo and simulate several I/O optimizations. Speedups range from 5% to 2×, without changing compute time.

Friese, Ryan D.↗

Label Identification from Statistical Tabulation (LIST) temporal extendability study

The author has identified the following significant results. The most apparent contributors to the problem of poor temporal extension of LIST are the drastic changes in the brightness keys and an inadequate set of AI responses in Phase 3. The brightness trajectories change drastically from Phase 3 to the transition year (TY). Removing brightness channels from the discriminant does not completely correct the lack of extendability. Removing brightness increases the accuracy of the extension from Phase 3 to TY from 57.7 percent to 64.18 percent. The removal of the Al keys increases accuracy to 65.76 percent. Although the latter increase appears insignificant when compared to the first, the removal of only the Al keys increased accuracy to 63.58 percent. Proper weighting of the responses explains 73.8 percent of the ground truth labels but only 56.7 percent of the Al labels. By contrast, the TY responses which were weighted to explain the TY ground truth labels fared equally well, explaining 73.6 percent of those labels and 87.1 percent of the Al labels.

Dennis, T. B.↗

Surfactant-Specific AI-Driven Molecular Design: Integrating Generative Models, Predictive Modeling, and Reinforcement Learning for Tailored Surfactant Synthesis

Molecular design is a critical aspect of various scientific and industrial fields, where the properties of molecules hold significant importance. In this study, a 3-fold methodology design is presented that leverages the power of generative artificial intelligence (AI), predictive modeling, and reinforcement learning to create tailored molecules with desired properties. This model synergistically combines deep learning techniques with Self-Referencing Embedded Strings (SELFIES) molecular representation to build a generative model that generates valid molecules and a graphical neural network model that accurately forecasts molecular properties. The Variational Autoencoder (VAE) coupled with reinforcement learning helps refine molecule generation based on targeted attributes. Data from an experimental study involving surfactants were used to test the framework. A validation of the structural integrity of the molecules generated was conducted, and Tanimoto similarities were used to quantify the similarity and diversity between the original and generated molecular structures. Also, saliency maps for the generated surfactants were produced to identify the features explaining the property values. Lastly, molecular dynamics simulations were used to validate the stability of the generated molecules. The results showed that the proposed framework can effectively produce valid molecules within the set property threshold value.

36 MATERIALS SCIENCE↗

Signatures of Chemical Evolution in Protostellar Nebulae

A decade ago observers began to take serious notice of the presence of crystalline silicate grains in the dust flowing away from some comets. While crystallinity had been seen in such objects previously, starting with the recognitions by Campins and Ryan (1990) that the 10 micron feature of Comet Halley resembled that of the mineral forsterite, most such observations were either ignored or dismissed as no path to explain such crystalline grains was available in the literature. When it was first suggested that an outward flow must be present to carry annealed silicate grains from the innermost regions of the Solar Nebula out to the regions where comets could form (Nuth, 1999; 2001) this suggestion was also dismissed because no such transport mechanism was known at the time. Since then not only have new models of nebular dynamics demonstrated the reality of long distance outward transport (Ciesla, 2007; 2008; 2009) but examination of older models (Boss, 2004) showed that such transport had been present but had gone unrecognized for many years. The most unassailable evidence for outward nebular transport came with the return of the Stardust samples from Comet Wild2, a Kuiper-belt comet that contained micron-scale grains of high temperature minerals resembling the Calcium-Aluminum Inclusions found in primitive meteorites (Zolensky et aI., 2006) that formed at T > 1400K. Now that outward transport in protostellar nebulae has been firmly established, a re-examination of its consequences for nebular gas is in order that takes into account both the factors that regulate both the outward flow as well as those that likely control the chemical composition of the gas. Laboratory studies of surface catalyzed reactions suggest that a trend toward more highly reduced carbon and nitrogen compounds in the gas phase should be correlated with a general increase in the crystallinity of the dust (Nuth et aI., 2000), but is such a trend actually observable? Unlike the Fischer-Tropsch or the Haber-Bosch reactions used in industry, the surface catalyzed reactions seen in our laboratory do not produce a simple product stream of methane or ammonia, respectively. Instead, such reactions produce a wide range of both aliphatic and aromatic hydrocarbons, as well as reduced nitrogen compounds such as ammonia, amines, amides and imides, as gas phase products together with a heavy, macromolecular, kerogen-like surface coating that remains on the grains. While CO and N2 will certainly be depleted by conversion into more complex and less volatile species via reaction on grain surfaces, it may be very difficult to monitor such changes from outside the system.

Nuth, Joseph A., III↗

Expert system validation in prolog

An overview of the Expert System Validation Assistant (EVA) is being implemented in Prolog at the Lockheed AI Center. Prolog was chosen to facilitate rapid prototyping of the structure and logic checkers and since February 1987, we have implemented code to check for irrelevance, subsumption, duplication, deadends, unreachability, and cycles. The architecture chosen is extremely flexible and expansible, yet concise and complementary with the normal interactive style of Prolog. The foundation of the system is in the connection graph representation. Rules and facts are modeled as nodes in the graph and arcs indicate common patterns between rules. The basic activity of the validation system is then a traversal of the connection graph, searching for various patterns the system recognizes as erroneous. To aid in specifying these patterns, a metalanguage is developed, providing the user with the basic facilities required to reason about the expert system. Using the metalanguage, the user can, for example, give the Prolog inference engine the goal of finding inconsistent conclusions among the rules, and Prolog will search the graph intantiations which can match the definition of inconsistency. Examples of code for some of the checkers are provided and the algorithms explained. Technical highlights include automatic construction of a connection graph, demonstration of the use of metalanguage, the A* algorithm modified to detect all unique cycles, general-purpose stacks in Prolog, and a general-purpose database browser with pattern completion.

Stock, Todd↗