Search NASA⌕ Search

SEARCH · Search NASA

Results for “structured machine learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,639 records · Page 91

Kohn–Sham accuracy from orbital-free density functional theory via Δ-machine learning

Here, we present a Δ-machine learning model for obtaining Kohn–Sham accuracy from orbital-free density functional theory (DFT) calculations. In particular, we employ a machine-learned force field (MLFF) scheme based on the kernel method to capture the difference between Kohn–Sham and orbital-free DFT energies/forces. We implement this model in the context of on-the-fly molecular dynamics simulations and study its accuracy, performance, and sensitivity to parameters for representative systems. We find that the formalism not only improves the accuracy of Thomas–Fermi–von Weizsäcker orbital-free energies and forces by more than two orders of magnitude but is also more accurate than MLFFs based solely on Kohn–Sham DFT while being more efficient and less sensitive to model parameters. We apply the framework to study the structure of molten Al 0.88 Si 0.12 , the results suggesting no aggregation of Si atoms, in agreement with a previous Kohn–Sham study performed at an order of magnitude smaller length and time scales.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Infrared spectroscopy data- and physics-driven machine learning for characterizing surface microstructure of complex materials

There is a need to characterize complex materials and their dynamics under reaction conditions to accelerate materials design. Adsorbate vibrational excitations are selective to adsorbate/surface interactions and infrared (IR) spectra associated with activating adsorbate vibrational modes are accurate, capture details of most modes, and can be obtained operando. Current interpretation depends on heuristic peak assignments for simple spectra, precluding the possibility of obtaining detailed structural information. Here, we combine data-based approaches with chemistry-dependent problem formulation to develop physics-driven surrogate models that generate synthetic IR spectra from first-principles calculations. Using synthetic IR spectra of carbon monoxide on platinum, we implement multinomial regression via neural network ensembles to learn probability distributions functions (pdfs) that describe adsorption sites and quantify uncertainty. We use these pdfs to infer detailed surface microstructure from experimental spectra and extend this methodology to other systems as a first step towards characterizing complex interfaces and closing the materials gap.

Science & Technology - Other Topics↗

Training models using forces computed by stochastic electronic structure methods

Abstract Quantum Monte Carlo (QMC) can play a very important role in generating accurate data needed for constructing potential energy surfaces. We argue that QMC has advantages in terms of a smaller systematic bias and an ability to cover phase space more completely. The stochastic noise can ease the training of the machine learning model. We discuss how stochastic errors affect the generation of effective models by analyzing the errors within a linear least squares procedure, finding that there is an advantage to having many relatively imprecise data points for constructing models. We then analyze the effect of noise on a model of many-body silicon finding that noise in some situations improves the resulting model. We then study the effect of QMC noise on two machine learning models of dense hydrogen used in a recent study of its phase diagram. The noise enables us to estimate the errors in the model. We conclude with a discussion of future research problems.

Ceperley, David M. (ORCID:0000000150826271)↗

Organismic materials for beyond von Neumann machines

The elementary basis of intelligence in organisms with a central nervous system includes neurons and synapses and their complex interconnections forming neural circuits. In non-neural organisms such as slime mold with gel-like media, viscosity modulation enables adaptation to changing environments. At a larger scale, collective intelligence emerges via social interactions and feedback in animal colonies. Learning and memory are therefore multi-scale features that evolve as a result of constant interactions with the environment. There is growing interest in emulating such features of intelligence in computing machines and autonomous systems. Materials that can respond to their environment in a manner similar to organisms (referred to as "organismic materials") therefore may be of interest as hardware components in artificial intelligence machines. In this brief review, we present a class of semiconductors called correlated oxides as candidates for learning machines. The term "correlated" refers to the fact that electrons in such lattices strongly interact and the ground state is not what is predicted by classical band theory. Such materials can undergo insulator-metal transitions at near ambient conditions under external stimuli such as thermal or electrical fields, strain, and chemical doping. Depending on the mechanism driving the transition, intermediate states can be metastable with different volatilities, and the time scales of phase change can be controlled over many orders of magnitude. The change in electronic properties can be sharp or gradual, leading to digital or analog behavior. These properties enable the realization of artificial neurons and synapses and emulate the associative and non-associative learning characteristics found in various organisms. We examine microscopic properties concerning electronic and structural transitions leading to collective behavior and theoretical treatments of the ground state and dynamical response, showcasing VO 2 as a model system. Next, we briefly review algorithms designed from the plasticity demonstrated by phase changing systems. Finally, we conclude the brief review with suggestions for future research toward realizing non-von Neumann machines.

42 ENGINEERING↗

Forecasting Commercial Building Electricity Consumption, Zone Airflow and Zone Temperature: Update - Development of a Generalized Machine Learning Approach

The U.S. power grid is being transformed to make it smarter, more efficient, and cleaner. This transformation is leading to the addition of a significant of energy generated by distributed, variable, and renewable resources. Because of the variable nature of renewable generation, the short- and long-term supply and demand imbalances are less predictable, and conventional approaches to mitigating the imbalances will be less efficient or cost effective. To address this challenge and to support the mission and the vision of the U.S. Department of Energy’s (DOE’s) Office of Energy Efficiency and Renewable Energy (EERE) Building Technologies Office has developed a Grid-Interactive Efficient Building Strategy. The strategy focuses on simultaneously improving building energy efficiency and supporting reliability and resilience of the electric grid more efficiently and at a lower cost. In addition, EERE and DOE’s Office of Electricity created an initiative led by DOE and supported by the national laboratories under the Grid Modernization Lab Consortium structure to enhance grid modernization. The work reported in this document is part of the first set of projects funded under the initiative to design, develop, and validate scalable transactive control technologies for the commercial buildings sector. Transactive controls requires the ability of individual end-use loads to express flexibility as a function of a transactive signal (e.g., price). Empirical grey- and black-box models have been widely used to express flexibility. Although this approach is generally easy to construct and simple to use, it does not capture non-linear behavior that some end-use loads represent. Therefore, Pacific Northwest National Laboratory (PNNL) with support from Western Washington University conducted this research to explore the use of deep machine learning (ML) techniques. The work reported in this document is limited to forecasting whole building electricity consumption, the zone airflow and the zone temperature predictions.

24 POWER TRANSMISSION AND DISTRIBUTION↗

High-throughput characterization of Lu-doped zirconia

Lu-doped zirconia (LuDZ) was reported in the 1960s to be a poor oxygen ion conductor. However, we identified this system as worthy of reexamination based on the results of a machine learning-based screen for promising oxygen ion conductors, further supported by a physical argument: because Lu is the heaviest and smallest of the lanthanides, it should offer the possibility of high conductivity due to its high polarizability and size compatibility with the zirconia structure. Here the relationship between dopant concentration and conductivity in the LuDZ system was determined using a high throughput experimental methodology in which spatially resolved conductivity was measured across a compositionally graded film, spanning from Zr 0.93 Lu 0.07 O 1.965 to Zr 0.82 Lu 0.18 O 1.91 . The conductivity broadly peaks with composition at 15 cation % Lu, coinciding with the approximate phase boundary of the fully stabilized cubic phase. The composition-dependent conductivity measurements reveal a surprising increase in activation energy for ion transport with increasing Lu content with no change in this trend at the composition of the conductivity maximum. The pre-exponential factor increases sharply with Lu content, but displays a distinct plateau once the conductivity maximum composition is attained. At 500 °C, the conductivity of Zr 0.85 Lu 0.15 O 1.925 is 2 × 10 –3 S cm –1 , approaching that of optimally doped Sc-stabilized zirconia, which has the highest reported conductivity among zirconia compounds. In comparison to other oxide ion conductors, Lu-stabilized zirconia offers the advantage over ceria of negligible electronic conductivity and is easier to process than (La,Sr)(Ga,Mg)O 3-δ .

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Real-time insight into the multistage mechanism of nanoparticle exsolution from a perovskite host surface

In exsolution, nanoparticles form by emerging from oxide hosts by application of redox driving forces, leading to transformative advances in stability, activity, and efficiency over deposition techniques, and resulting in a wide range of new opportunities for catalytic, energy and net-zero-related technologies. However, the mechanism of exsolved nanoparticle nucleation and perovskite structural evolution, has, to date, remained unclear. Herein, we shed light on this elusive process by following in real time Ir nanoparticle emergence from a SrTiO 3 host oxide lattice, using in situ high-resolution electron microscopy in combination with computational simulations and machine learning analytics. We show that nucleation occurs via atom clustering, in tandem with host evolution, revealing the participation of surface defects and host lattice restructuring in trapping Ir atoms to initiate nanoparticle formation and growth. These insights provide a theoretical platform and practical recommendations to further the development of highly functional and broadly applicable exsolvable materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A first-principles machine-learning force field for heterogeneous ice nucleation on microcline feldspar

The formation of ice in the atmosphere affects precipitation and cloud properties, and plays a key role in the climate of our planet. Although ice can form directly from liquid water at deeply supercooled conditions, the presence of foreign particles can aid ice formation at much warmer temperatures. Over the past decade, experiments have highlighted the remarkable efficiency of feldspar minerals as ice nuclei compared to other particles present in the atmosphere. However, the exact mechanism of ice formation on feldspar surfaces has yet to be fully understood. Here, we develop a first-principles machine-learning model for the potential energy surface aimed at studying ice nucleation at microcline feldspar surfaces. The model is able to reproduce with high-fidelity the energies and forces derived from density-functional theory (DFT) based on the SCAN exchange and correlation functional. Our training set includes configurations of bulk supercooled water, hexagonal and cubic ice, microcline, and fully-hydroxylated feldspar surfaces exposed to vacuum, liquid water, and ice. In this work, we apply the machine-learning force field to study different fully-hydroxylated terminations of the (100), (010), and (001) surfaces of microcline exposed to vacuum. Our calculations suggest that terminations that do not minimize the number of broken bonds are preferred in vacuum. We also study the structure of supercooled liquid water in contact with microcline surfaces, and find that water density correlations extend up to around 10 Å from the surfaces. Finally, we show that the force field maintains a high accuracy during the simulation of ice formation at microcline surfaces, even for large systems of around 30,000 atoms. Future work will be directed towards the calculation of nucleation free energy barriers and rates using the force field developed herein, and understanding the role of different microcline surfaces on ice nucleation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Spectral Clustering-Based Partitioning of Large-Scale Power Electronics-Based Power Systems for Small-Signal Stability Analysis

The nodal admittance matrix (NAM)-based approach is well-suited for small-signal stability analysis of large-scale power electronics-based power systems (PEPSs), as it preserves the system structure through its admittance matrix. Previous studies have explored partitioning such systems into subareas and interconnections to reduce computational burden; however, they lacked a formal algorithmic procedure for determining feasible partitions. While several grid partitioning methods, such as those based on graph theory or machine learning, exist in the literature, they cannot be directly applied to NAM-based analysis due to differing objectives and constraints. Here, this paper addresses this gap by presenting a systematic, step-by-step procedure for applying a spectral partitioning algorithm that yields a division of the system into subareas suitable for NAM-based analysis. The computational complexity of the proposed method is also derived to demonstrate its efficiency and justify the practicality of the resulting subarea decomposition. The performance of the partitioning method is evaluated by applying the spectral clustering-derived subareas and interconnections to the NAM-based partitioning approach on a 140-bus system. Computational times for the full-system and partitioned NAM analyses are compared using MATLAB. Additionally, PSCAD simulations of the complete system and partitioned subareas are carried out to verify the effectiveness of the proposed method.

Nupur [Univ. of Tennessee, Knoxville, TN (United S↗

Temporal Cyber Attack Detection.

Rigorous characterization of the performance and generalization ability of cyber defense systems is extremely difficult, making it hard to gauge uncertainty, and thus, confidence. This difficulty largely stems from a lack of labeled attack data that fully explores the potential adversarial space. Currently, performance of cyber defense systems is typically evaluated in a qualitative manner by manually inspecting the results of the system on live data and adjusting as needed. Additionally, machine learning has shown promise in deriving models that automatically learn indicators of compromise that are more robust than analyst-derived detectors. However, to generate these models, most algorithms require large amounts of labeled data (i.e., examples of attacks). Algorithms that do not require annotated data to derive models are similarly at a disadvantage, because labeled data is still necessary when evaluating performance. In this work, we explore the use of temporal generative models to learn cyber attack graph representations and automatically generate data for experimentation and evaluation. Training and evaluating cyber systems and machine learning models requires significant, annotated data, which is typically collected and labeled by hand for one-off experiments. Automatically generating such data helps derive/evaluate detection models and ensures reproducibility of results. Experimentally, we demonstrate the efficacy of generative sequence analysis techniques on learning the structure of attack graphs, based on a realistic example. These derived models can then be used to generate more data. Additionally, we provide a roadmap for future research efforts in this area.

97 MATHEMATICS AND COMPUTING↗

Materials genome innovation for computational software (magics) center

Functional layered material (LM) architectures will dominate nanomaterials science in this century. We have developed theory, modeling, simulation, and software and data tools that enhance understanding and AI guide synthesis, enable characterization of complex structures, and improve capabilities in the predictive design and growth of LMs. Research at the Center has focused on: Computational synthesis and characterization: AI guided synthesis and experimental synthesis of stacked LMs with tailored properties via optimized chemical vapor deposition (CVD) growth and liquid-phase exfoliation; study defects, edges, grain boundaries, wrinkling of atomic layers and their effects on chemical, mechanical, electrical, and optical properties. Far-from-equilibrium processes: Joint experimental and simulation based probe of electronic processes with NAQMD and ultrafast X-ray free-electron laser (XFEL) and ultrafast electron diffraction (UED) facilities at Stanford. Experimentally validate NAQMD by ultrafast electron diffraction and X-ray spectroscopy studies of structural and excited state dynamics, shape fluctuations, and phonon dynamics. Scalable software: Simulation engines for desktop-to-exascale platforms using low-overhead, linear-scaling QMD algorithms; divide-conquer-recombine NAQMD with electronic excitations; extended-Lagrangian reactive molecular dynamics (RMD), machine learning (ML) based neural-network quantum molecular dynamics (NNQMD), and super-state accelerated molecular dynamics (AMD) and kinetic Monte Carlo codes; thermal and electrical transport software; and design 3D architectures of LMs with desired functionality using scalable software. Distribution of software and data, and training: Software and simulation-experimental data generated within the Center are distributed to the materials science community via Berkeley Materials Project (MP) framework. We have also organized three workshops for software distribution and training at USC (Nov. 2017, Mar. 2018) and Gaithersburg, MD (Nov. 2018) to train researchers, with the last one in focused on underrepresented groups, in collaboration with Howard University which is one of the largest HBCUs. The Center supported a total of 46 personnel and 6 undergraduate students. These include 14 faculty, 11 postdoctoral research associates, 20 graduate research assistants, and mentored 6 undergraduate students. This resulted in the publications of 63 research papers that include 46 publications on Reactive and Quantum Dynamics Simulations, 13 publications on Machine Learning for Quantum Materials, and 4 publications on Quantum Computing.

2D Materials↗

Augmenting Molecular Graphs with Geometries via Machine Learning Interatomic Potentials

Accurate molecular property predictions require 3D geometries, which are typically obtained using expensive methods such as density functional theory (DFT). Here, we attempt to obtain molecular geometries by relying solely on machine learning interatomic potential (MLIP) models. To this end, we first curate a large-scale molecular relaxation dataset comprising 3.5 million molecules and 300 million snapshots. Then MLIP pre-trained models are trained with supervised learning to predict energy and forces given 3D molecular structures. Once trained, we show that the pre-trained models can be used in different ways to obtain geometries either explicitly or implicitly. First, it can be used to obtain approximate low-energy 3D geometries via geometry optimization. While these geometries do not consistently reach DFT-level chemical accuracy or convergence, they can still improve downstream performance compared to non-relaxed structures. To mitigate potential biases and enhance downstream predictions, we introduce geometry fine-tuning based on the relaxed 3D geometries. Second, the pre-trained models can be directly fine-tuned for property prediction when ground truth 3D geometries are available. Our results demonstrate that MLIP pre-trained models trained on relaxation data can learn transferable molecular representations to improve downstream molecular property prediction and can provide practically valuable but approximate molecular geometries that benefit property predictions. Our code is publicly available at: https://github.com/divelab/AIRS/.

Fu, Cong [Texas A & M Univ., College Station, TX (↗

Locally coupled open subsystems: A formalism for affordable electronic structure calculations featuring fractional charges and size consistency

This manuscript introduces a methodology (within the Born-Oppenheimer picture) to compute electronic ground-state properties of molecules and solids/surfaces with fractionally occupied components. Given a user-defined division of the molecule into subsystems, our theory uses an auxiliary global Hamiltonian that is defined as the sum of subsystem Hamiltonians, plus the spatial integral of a second-quantized local operator that allows the electrons to be transferred between subsystems. This electron transfer operator depends on a local potential that can be determined using density functional approximations and/or other techniques such as machine learning. The present framework employs superpositions of tensor-product wave functions, which can satisfy size consistency and avoid spurious fractional charges at large bond distances. The electronic population of each subsystem is in general a positive real number and is obtained from wave-function amplitudes, which are calculated by means of ground-state matrix diagonalization (or matrix propagation in the time-dependent case). Furthermore, our method can provide pathways to explore charge-transfer effects in environments where dividing the molecule into subsystems is convenient and to develop computationally affordable electronic structure algorithms.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Representing local atomic environment using descriptors based on local correlations

Statistical learning of material properties is an emerging topic of research and has been tremendously successful in areas such as representing complex energy landscapes as well as in technologically relevant areas, like identification of better catalysts and electronic materials. However, analysis of large data sets to efficiently learn characteristic features of a complex energy landscape, for example, depends on the ability of descriptors to effectively screen different local atomic environments. Thus, discovering appropriate descriptors of bulk or defect properties and the functional dependence of such properties on these descriptors remains a difficult and tedious process. To this end, we develop here a framework to generate descriptors based on many-body correlations that can effectively capture intrinsic geometric features of the local environment of an atom. These descriptors are based on the spectrum of two-body, three-body, four-body, and higher order correlations between an atom and its neighbors and are evaluated by calculating the corresponding two-body, three-body, and four-body overlap integrals. They are invariant to global translation, global rotation, reflection, and permutations of atomic indices. By systematically testing the ability to capture the local atomic environment, it is shown that the local correlation descriptors are able to successfully reconstruct structures containing 10-25 atoms which was previously not possible.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Interpretable Deep Learning for Advancing Field-Enhanced Catalysis

This DOE Early Career project developed a physics-informed, interpretable AI-and-modeling framework to understand and exploit electric-field effects in heterogeneous catalysis, with ammonia cracking and synthesis as a representative pathway. The team built and validated methods to map local electric fields on metal surfaces and nanoparticles, showing that low-coordination features (tips/edges/corners) can concentrate fields by several-fold relative to flat facets. Using DFT-generated datasets, the project created physics-guided machine learning models that rapidly predict local electric fields and field-dependent adsorption energetics with near-DFT accuracy while reducing computational cost by orders of magnitude. These predictions were integrated with microkinetic modeling to quantify how field-dipole interactions reshape reaction energetics and mechanisms, enabling large increases in predicted catalytic rates and substantial reductions in operating temperature under favorable field conditions. To accelerate discovery of earth-abundant catalysts, the project combined interpretable ML screening (with electronic-structure descriptors identified as key drivers) with a generative inverse-design workflow based on diffusion models and physics constraints. The resulting closed-loop approach, linking simulation, mechanistic modeling, and AI, provides reusable tools and datasets for designing catalysts and operating conditions in field-enhanced catalysis, with broad relevance to electrostatic catalysis, plasma catalysis, electrocatalysis, and other energy-related chemical transformations.

30 DIRECT ENERGY CONVERSION↗

Phase behavior of continuous-space systems: A supervised machine learning approach

The phase behavior of complex fluids is a challenging problem for molecular simulations. Supervised machine learning (ML) methods have shown potential for identifying the phase boundaries of lattice models. In this work, we extend these ML methods to continuous-space systems. We propose a convolutional neural network model that utilizes grid-interpolated coordinates of molecules as input data of ML and optimizes the search for phase transitions with different filter sizes. We test the method for the phase diagram of two off-lattice models, namely, the Widom–Rowlinson model and a symmetric freely jointed polymer blend, for which results are available from standard molecular simulations techniques. The ML results show good agreement with results of previous simulation studies with the added advantage that there is no critical slowing down. We find that understanding intermediate structures near a phase transition and including them in the training set is important to obtain the phase boundary near the critical point. The method is quite general and easy to implement and could find wide application to study the phase behavior of complex fluids.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Improving the chances of successful protein structure determination with a random forest classifier

Using an extended set of protein features calculated separately for protein surface and interior, a new version of XtalPred based on a random forest classifier achieves a significant improvement in predicting the success of structure determination from the primary amino-acid sequence. Obtaining diffraction quality crystals remains one of the major bottlenecks in structural biology. The ability to predict the chances of crystallization from the amino-acid sequence of the protein can, at least partly, address this problem by allowing a crystallographer to select homologs that are more likely to succeed and/or to modify the sequence of the target to avoid features that are detrimental to successful crystallization. In 2007, the now widely used XtalPred algorithm [Slabinski et al. (2007 ▶), Protein Sci.16, 2472–2482] was developed. XtalPred classifies proteins into five ‘crystallization classes’ based on a simple statistical analysis of the physicochemical features of a protein. Here, towards the same goal, advanced machine-learning methods are applied and, in addition, the predictive potential of additional protein features such as predicted surface ruggedness, hydrophobicity, side-chain entropy of surface residues and amino-acid composition of the predicted protein surface are tested. The new XtalPred-RF (random forest) achieves significant improvement of the prediction of crystallization success over the original XtalPred. To illustrate this, XtalPred-RF was tested by revisiting target selection from 271 Pfam families targeted by the Joint Center for Structural Genomics (JCSG) in PSI-2, and it was estimated that the number of targets entered into the protein-production and crystallization pipeline could have been reduced by 30% without lowering the number of families for which the first structures were solved. The prediction improvement depends on the subset of targets used as a testing set and reaches 100% (i.e. twofold) for the top class of predicted targets.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Discovery of Energy Storage Molecular Materials Using Quantum Chemistry-Guided Multiobjective Bayesian Optimization

Redox flow batteries (RFBs) are a promising technology for stationary energy storage applications due to their flexible design, scalability, and low cost. In RFBs, energy is carried in flowable redoxactive materials (redoxmers) which are stored externally and pumped to the cell during operation. Further improvements in the energy density of RFBs necessitates redoxmer designs with wider redox potential windows and higher solubility. Additionally, designing redoxmers with a fluorescence-enabled self-reporting functionality allows monitoring of the state of health of RFBs. To accelerate the discovery of redoxmers with desired properties, state-of-the- art machine learning ( ML) methods, such as multiobjective Bayesian optimization (MBO), are useful. Here, we first employed density functional theory calculations to generate a database of reduction potentials, solvation free energies, and absorption wavelengths for 1400 redoxmer molecules based on a 2,1,3-benzothiadiazole (BzNSN) core structure. From the computed properties, we identified 22 Pareto-optimal molecules that represent best trade-off among all of the desired properties. We further utilized these data to develop and benchmark an MBO approach to identify candidates quickly and efficiently with multiple targeted properties. With MBO, optimal candidates from the 1400-molecule data set can be identified at least 15 times more efficiently compared to the brute force or random selection approach. Importantly, we utilized this approach for discovering promising redoxmers from an unseen database of 1 million BzNSN-based molecules, where we discovered 16 new Pareto-optimal molecules with significant improvements in properties over the initial 1400 molecules. Furthermore, we anticipate that this active learning technique is general and can be utilized for the discovery of any class of functional materials that satisfies multiple desired property criteria.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗