Search NASA⌕ Search

SEARCH · Search NASA

Results for “active machine learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

Deep Learning for Full Waveform Inversion of Elastic Active-Source Seismic Data to Estimate P-Wave Velocity Models

Seismic imaging methods are critical for Global Security and Energy & Homeland Security missions and activities that rely on subsurface characterization, but traditional methods remain computationally expensive and require significant labor hours and expertise to execute. Within the past few years, machine learning (ML), namely deep learning (DL), has been used to develop data-driven end-to-end full waveform inversion (FWI) methods to estimate 2D P-wave velocity (Vp) models in a fraction of the time as conventional FWI. These methods, however, are trained on simplistic acoustic wave seismic data and Vp models that are not realistic nor representative of real-world observations, leaving a large gap between the state-of-the-art and deployable, feasible, and practical DL FWI methods. Here, we generate a synthetic active-source, 3D, elastic wave seismic data set and a variety of Vp models with realistic geologic structure for training DL FWI methods. We evaluate six different methods that have performed well for acoustic DL FWI or medical imaging tasks using our more realistic dataset. We find that these six trained models do not match the performance of published acoustic end-to-end DL FWI methods, indicating more training data may be needed, physics may need to be incorporated to achieve good accuracy at the sacrifice of the end-to-end advantage, and/or novel methods need to be developed to enable end-to-end DL FWI methods to perform well for real-world seismic data.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Using machine learning to improve land use/cover characterization and projection for scenario-based global modeling

The characterization of the land surface in models is critical for robust estimation of the water cycle and associated extremes. Land use determines water demand, and land cover affects water availability. The interaction between water demand and availability is the key determinant of whether systems are resilient to variability in the overall water cycle. Furthermore, activities such as irrigation and deforestation or afforestation may influence regional to global precipitation patterns, depending on the extent of the activity. Thus this proposed work aims to address the following question: How does integrated land use/cover data and improved land use/cover projection, as informed by machine learning approaches, better resolve human-earth system resilience to water cycle variability and extremes?

54 ENVIRONMENTAL SCIENCES↗

Determining Multi-Component Phase Diagrams with Desired Characteristics Using Active Learning

Herein, we demonstrate how to predict and experimentally validate phase diagrams for multi-component systems from a high-dimensional virtual space of all possible phase diagrams involving several elements based on small existing experimental data. The experimental data for bulk phases for known systems represents a sampling from this space, and screening the space allows multi-component phase diagrams with given design criteria to be built. This approach uses machine learning methods to predict phase diagrams and Bayesian experimental design to minimize experiments for refinement and validation, all within an active learning loop. The approach is proven by predicting and synthesizing the ferroelectric ceramic system (1-ω)(Ba 0.61 Ca 0.28 Sr 0.11 TiO 3 )-ω(BaTi 0.888 Zr 0.0616 Sn 0.0028 Hf 0.0476 O 3 ) with a relatively high transition temperature and triple point, as well as the NiTi-based pseudo-binary phase diagram (1-ω)(Ti 0.309 Ni 0.485 Hf 0.20 Zr 0.006 )-ω(Ti 0.309 Ni 0.485 Hf 0.07 Zr 0.068 Nb 0.068 ) designed for high transition temperature (ω ≤ 1). Each phase diagram is validated and optimized through only three new experiments. The complexity of these compounds is beyond the reach of today’s computational methods.

36 MATERIALS SCIENCE↗

Machine learning to predict final fire size at the time of ignition

Fires in boreal forests of Alaska are changing, threatening human health and ecosystems. Given expected increases in fire activity with climate warming, insight into the controls on fire size from the time of ignition is necessary. Such insight may be increasingly useful for fire management, especially in cases where many ignitions occur in a short time period. Here we investigated the controls and predictability of final fire size at the time of ignition. Using decision trees, we show that ignitions can be classified as leading to small, medium or large fires with 50.4 ± 5.2% accuracy. This was accomplished using two variables: vapour pressure deficit and the fraction of spruce cover near the ignition point. The model predicted that 40% of ignitions would lead to large fires, and those ultimately accounted for 75% of the total burned area. Other machine learning classification algorithms, including random forests and multi-layer perceptrons, were tested but did not outperform the simpler decision tree model. Applying the model to areas with intensive human management resulted in overprediction of large fires, as expected. This type of simple classification system could offer insight into optimal resource allocation, helping to maintain a historical fire regime and protect Alaskan ecosystems.

54 ENVIRONMENTAL SCIENCES↗

Artificial Intelligence for Digital Security and Protections

Proper functioning of nuclear power plants relies on a mix of well-regulated human and machine-driven workflows. This regulation supports nuclear safety through a series of processes and many of the tasks that support these processes have a repetitive nature that make artificial intelligence (AI) informed by machine learning (ML) a potential aid in a variety of tasks. AI is being evaluated for activities that include inspections, fuel processing, monitoring, and other activities. The introduction of any new technology presents a potential new attack vector. In the case of AI/ML, there are many attacks that have already been discovered and over time the attacks can be expected to follow the growth pattern observed in cyber security. While future planning is necessary, current efforts need to be established now to predict the threat emergence over the next year 10 years and mitigate potential threats. Based on these observations, AI/ML will need to become trustworthy, which corresponds to techniques and procedures that emphasize AI explainability along with resilience techniques to data, algorithms, models, and systems. This kind of system robustness is the foundation for defenses against AI/ML-specific attacks. Attempting to look forward and take a broad view of capabilities provides input to research roadmaps and the ability to distill vulnerabilities into specific use cases may provide greater assistance in understanding the technology benefits while introducing new risks. The impact of current and future AI in three areas—capabilities, challenges, and recovery strategies—represents an initial attempt at balancing both.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

High throughput exploration of the oxidation landscape in high entropy alloys

We report high entropy alloys (HEAs) have gained interest for structural applications in extreme environments. With a potentially vast chemical and phase space, there are significant opportunities to discover superior performing alloys. Crucial for most high-temperature applications is understanding and mitigating the oxidation behavior of these chemically complex alloys. Most experimental and computational HEA studies have focused on a limited set of compositions and only a fraction these compositions have been characterized for oxidation. We present a high-throughput framework that utilizes density-functional theory (DFT) in concert with a combined machine-learning model and grand-canonical linear programming for assessing phase stability, phase-fraction, chemical activity and high-temperature survivability of arbitrary HEAs. This framework considers temperature dependent contributions to the Gibbs energy of the competing phases arising from short-range order and vibrational entropy. We demonstrate the effectiveness of the framework by assessing the thermodynamic stability, oxidation behavior, chemical activity, and phase decomposition of body-centered cubic Mo-W-Ta-Ti-Zr refractory HEAs. A total of 51 compositions were analyzed and ranked in order of their survivability based on the Pareto-front analysis. Oxidation was performed at 1373 K on fours samples in air showing the difference in oxidation behavior determined experimentally through scale thickness and their mass changes. The insights on oxidation behavior presented in this work will enable the fast assessment of technologically useful HEAs needed for future structural application in extreme conditions

36 MATERIALS SCIENCE↗

Nuclear quantum effects of metal surface-mediated C–H activation

The nuclear quantum effects of surface-mediated C–H activation of surface CH 3 are considered for the pristine Pt(111) and Au(111) surfaces at 300 K. The kinetic barriers without nuclear quantum effects are calculated using both static density functional theory calculations and ab initio molecular dynamics. Static calculations are performed using the harmonic approximation while the free energy pathway is calculated using enhanced sampling molecular dynamics. Machine learning potentials are trained using generated datasets and validated against the ab initio molecular dynamics generated free energy pathways. The machine learning potentials are used to perform centroid molecular dynamics to consider the nuclear quantum effects of C–H activation. Nuclear quantum effects are found to have a very significant effect on the free energy pathway, with reduced importance at higher temperatures and in the CD 3 case.

Bunting, Rhys J. [Lawrence Livermore National Labo↗

Subspace-Driven Learning for Anomaly Detection in Process Transients

Nuclear power plant (NPP) monitoring and diagnostic centers are actively investigating and implementing automated anomaly detection algorithms to help plants catch anomalies sooner, thereby preventing or reducing the duration of unexpected shutdowns. Current machine learning-based anomaly detection methods are expected to be highly effective during stable, full-power operations because NPPs typically operate as baseload power generators, meaning there are extensive operating data available from plant equipment. However, it is expected that anomaly detection methods will face significant challenges during transient conditions (i.e., when power output falls below full power) because plants only occasionally operate at these lower power levels, generating sparse transient operational data, and resulting in false alarms or missed detections. Here, to address this issue, transfer learning is used, which for this problem leverages knowledge (in the form of learned features) from stable, full-power operations to improve detection accuracy during transient conditions, even with limited data. In this effort, a novel subspace approach is developed to transfer a subset of the data features from full power operation to transients. This approach is validated through experiments using synthetic data and was found to outperform two baseline transfer learning approaches in anomaly detection performance across a range of amounts of transient data used in the training process.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

From machine learning to chemical insight: Darwinian chance and the stability of charge carriers in flow batteries

In chemistry, rationalizing and predicting reaction behavior in complex environments is challenging, but this knowledge is required for practical applications and materials advancement. Here, we focus on one such example that uses organic molecules as redox-active materials in electrochemical energy storage. In flow batteries, these molecules (also known as redoxmers) serve as charge carriers, and exceptional chemical stability in all states of charge is required for long-term use. Here, we show how machine learning combined with chemist's knowledge can be used to reveal patterns in the reactivity of charged redoxmers by providing mechanistically tractable clues.

25 ENERGY STORAGE↗

Interpretable design of Ir-free trimetallic electrocatalysts for ammonia oxidation with graph neural networks

The electrochemical ammonia oxidation to dinitrogen as a means for energy and environmental applications is a key technology toward the realization of a sustainable nitrogen cycle. The state-of-the-art metal catalysts including Pt and its bimetallics with Ir show promising activity, albeit suffering from high overpotentials for appreciable current densities and the soaring price of precious metals. Herein, the immense design space of ternary Pt alloy nanostructures is explored by graph neural networks trained on ab initio data for concurrently predicting site reactivity, surface stability, and catalyst synthesizability descriptors. Among a few Ir-free candidates that emerge from the active learning workflow, Pt 3 Ru-M (M: Fe, Co, or Ni) alloys were successfully synthesized and experimentally verified to be more active toward ammonia oxidation than Pt, Pt 3 Ir, and Pt 3 Ru. More importantly, feature attribution analyses using the machine-learned representation of site motifs provide fundamental insights into chemical bonding at metal surfaces and shed light on design strategies for high-performance catalytic systems beyond the d-band center metric of binding sites.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

High-throughput calculations of catalytic properties of bimetallic alloy surfaces

Abstract A comprehensive database of chemical properties on a vast set of transition metal surfaces has the potential to accelerate the discovery of novel catalytic materials for energy and industrial applications. In this data descriptor, we present such an extensive study of chemisorption properties of important adsorbates - e.g., C, O, N, H, S, CH x , OH, NH, and S H - on 2,035 bimetallic alloy surfaces in 5 different stoichiometric ratios, i.e., 0%, 25%, 50%, 75%, and 100%. To our knowledge, it is the first systematic study to compile the adsorption properties of such a well-defined, large chemical space of catalytic interest. We propose that a collection of catalytic properties of this magnitude can assist with the development of machine learning enabled surrogate models in theoretical catalysis research to design robust catalysts with high activity for challenging chemical transformations. This database is made publicly available through the platform www.Catalysis-hub.org for easy retrieval of the data for further scientific analysis.

36 MATERIALS SCIENCE↗

SOMAS: a platform for data-driven material discovery in redox flow battery development

Abstract Aqueous organic redox flow batteries offer an environmentally benign, tunable, and safe route to large-scale energy storage. The energy density is one of the key performance parameters of organic redox flow batteries, which critically depends on the solubility of the redox-active molecule in water. Prediction of aqueous solubility remains a challenge in chemistry. Recently, machine learning models have been developed for molecular properties prediction in chemistry and material science. The fidelity of a machine learning model critically depends on the diversity, accuracy, and abundancy of the training datasets. We build a comprehensive open access organic molecular database “Solubility of Organic Molecules in Aqueous Solution” (SOMAS) containing about 12,000 molecules that covers wider chemical and solubility regimes suitable for aqueous organic redox flow battery development efforts. In addition to experimental solubility, we also provide eight distinctive quantum descriptors including optimized geometry derived from high-throughput density functional theory calculations along with six molecular descriptors for each molecule. SOMAS builds a critical foundation for future efforts in artificial intelligence-based solubility prediction models.

25 ENERGY STORAGE↗

Jumpstart Opportunities to Unleash Leadership in Energy Storage (JOULES)

Current-generation Li-ion batteries with cobalt- and nickel-containing cathodes and graphite anodes are approaching performance and cost limits. In this program, 24M Technologies, Inc. (24M) is teaming with the Massachusetts Institute of Technology (MIT) and University of Michigan (UM) to develop low cost and fast charging sodium metal batteries with good low-temperature performance and high energy density, building upon previous work performed under ARPA-E programs. Key achievements include optimization of solid electrolyte and anode current collector, optimized cathode active materials, development of high-performance electrolyte formulations, and integration of these components into full cells. The cell design incorporates (1) an ultra-thick cathode (>9 mAh/cm 2 ) comprising advanced cobalt-free, sodium cathode active material, (2) advanced fast-charging electrolyte (up to 12 mS/cm) developed using machine learning and automated high-throughput screening technology by UM, and (3) ceramic modified separator that enable smooth Na transport and deposition, developed at MIT, enabling a high-energy density anode-free configuration and maximizing the energy density of sodium batteries. The team has successfully combined these approaches to sodium chemistry and paved the way to meeting the fast-charging, high-energy density, and low-cost requirements of next-generation drone, electric vertical take-off and -landing, and electric vehicle batteries. Performance for anode-free sodium cells developed under this program is more powerful than the commercial Li-ion batteries. The final deliverable cell design has achieved over 300 Wh/kg and volumetric energy density above 800 Wh/L (Table 1). Additionally, the team has achieved over (1) a lifetime of 340 cycles, (2) 80% capacity retention at -20 °C (compared 25 °C), and (3) the ability to fast charge to 80% SOC in 20 minutes.

25 ENERGY STORAGE↗

A Comprehensive Investigation of Active Learning Strategies for Conducting Anti-Cancer Drug Screening

It is well-known that cancers of the same histology type can respond differently to a treatment. Thus, computational drug response prediction is of paramount importance for both preclinical drug screening studies and clinical treatment design. To build drug response prediction models, treatment response data need to be generated through screening experiments and used as input to train the prediction models. In this study, we investigate various active learning strategies of selecting experiments to generate response data for the purposes of (1) improving the performance of drug response prediction models built on the data and (2) identifying effective treatments. Here, we focus on constructing drug-specific response prediction models for cancer cell lines. Various approaches have been designed and applied to select cell lines for screening, including a random, greedy, uncertainty, diversity, combination of greedy and uncertainty, sampling-based hybrid, and iteration-based hybrid approach. All of these approaches are evaluated and compared using two criteria: (1) the number of identified hits that are selected experiments validated to be responsive, and (2) the performance of the response prediction model trained on the data of selected experiments. The analysis was conducted for 57 drugs and the results show a significant improvement on identifying hits using active learning approaches compared with the random and greedy sampling method. Active learning approaches also show an improvement on response prediction performance for some of the drugs and analysis runs compared with the greedy sampling method.

60 APPLIED LIFE SCIENCES↗

Combining active learning suggestions

We study the problem of combining active learning suggestions to identify informative training examples by empirically comparing methods on benchmark datasets. Many active learning heuristics for classification problems have been proposed to help us pick which instance to annotate next. But what is the optimal heuristic for a particular source of data? Motivated by the success of methods that combine predictors, we combine active learners with bandit algorithms and rank aggregation methods. We demonstrate that a combination of active learners outperforms passive learning in large benchmark datasets and removes the need to pick a particular active learner a priori. We discuss challenges to finding good rewards for bandit approaches and show that rank aggregation performs well.

97 MATHEMATICS AND COMPUTING↗

Hybridizing Machine Learning and Physically-based Earth System Models to Improve Prediction of Multivariate Extreme Events (AI Exploration of Wildland Fire Prediction)

Focal Areas: This project responds to two focal areas identified in the DOE Call for AI4ESP White Papers: 1) Predictive modeling through the use of artificial intelligence (AI) techniques, and 2) insights gleaned from complex data using explainable AI and big data analytics. Science Challenge: Large wildland fires (hereafter wildfires) appearing as high-impact compound climate extreme events are closely related to hydroclimate and water cycle extremes that modulate surface fuel supply and combustibility. These compound events have multivariate climatic features (e.g., temperature, precipitation, relative humidity, wind, lightning) and societal drivers (e.g., forest management, land use change, human caused ignitions). Meanwhile, they induce strong feedbacks to the coupled atmosphere, biosphere, and hydrosphere by perturbing regional and global radiation budget as well as ecological, biogeochemical, and water cycles across multiple spatiotemporal scales. The nonlinear interactions between these natural and anthropogenic components of the Earth system are too complex to be completely and adequately represented in today’s Earth system models (ESMs). The inherent stochastic nature of fire activity at all scales further increases the difficulty of its prediction using ESMs that are usually developed from deterministic equations and parameterizations. Besides, concurrence of long-term (decadal to interdecadal) global climate change and fire regime shifts overlapping with short-term (intraseasonal to interannual) variations of regional fire weather and burning activity confound predictability of these compound extreme events. We propose to address the above scientific challenges by using machine learning (ML)-based data-driven modeling techniques to integrate observations and physically-based ESMs’ simulations in a computationally efficient hybrid prediction system. This prediction system is supposed to characterize the wildfire’s sensitivity to climate and exogenous drivers at high resolution (~ 0.25°) on subseasonal to seasonal (S2S) timescales providing improved predictability and explainability. We will use the system to help identify: (1) What are the computational elements of a hybrid system needed to predict compound climate extreme events such as global wildfires? (2) What are the key drivers (either natural or anthropogenic) that modulate short-term variations of multivariate fire weather and burning activity over different regions? How can one take advantage of those driver-response relationships to improve the predictability of large wildfires on S2S time scales? (3) What are the underlying physical mechanisms and sources of improved predictability? Which ML techniques are optimal in revealing and adapting these mechanisms?

54 ENVIRONMENTAL SCIENCES↗

Event Definition for the Automated Detection of Nuclear Proliferation Activities

In FY2020, Savannah River National Laboratory (SRNL) in collaboration with the Discovery Analytics Center (DAC) at Virginia Polytechnic Institute and State University (VT) began developing a demonstration prototype system that uses multiple machine learning and data analytic methods on largescale open data sources to identify new, developing, or undeclared nuclear programs. One of the most challenging aspects of applying machine learning techniques to such a problem is the high likelihood of extremely sparse data from disparate sources. To overcome this challenge, the current work will use a strategic combination of supervised, semi-supervised, and unsupervised learning techniques to ingest and fuse data streams to make a forecast of nuclear activities in a targeted geospatial location. Identifying potential data sources and training supervised learning algorithms is dependent upon the development of a robust foundation of targeted event domains that fundamentally define the nuclear activities of interest. This report documents the definition of a hierarchical structure for both nuclear activity and event domains that will be used to guide the research team in development or use of existing semantic dictionaries that are instrumental to searching, parsing, and categorizing events for the forecasting system’s use.

97 MATHEMATICS AND COMPUTING↗

Interpretable machine learning for knowledge generation in heterogeneous catalysis

Most applications of machine learning in heterogeneous catalysis thus far have used black-box models to predict computable physical properties (descriptors), such as adsorption or formation energies, that can be related to catalytic performance (that is, activity or stability). Here, extracting meaningful physical insights from these black-box models has proved challenging, as the internal logic of these black-box models is not readily interpretable due to their high degree of complexity. Interpretable machine learning methods that merge the predictive capacity of black-box models with the physical interpretability of physics-based models offer an alternative to black-box models. In this Perspective, we discuss the various interpretable machine learning methods available to catalysis researchers, highlight the potential of interpretable machine learning to accelerate hypothesis formation and knowledge generation, and outline critical challenges and opportunities for interpretable machine learning in heterogeneous catalysis.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗