Search NASA⌕ Search

Engineering topics

Messerly, Richard

Publications and source records attributed to Messerly, Richard.

Learning together: Towards foundation models for machine learning interatomic potentials with meta-learning

Abstract The development of machine learning models has led to an abundance of datasets containing quantum mechanical (QM) calculations for molecular and material systems. However, traditional training methods for machine learning models are unable to leverage the plethora of data available as they require that each dataset be generated using the same QM method. Taking machine learning interatomic potentials (MLIPs) as an example, we show that meta-learning techniques, a recent advancement from the machine learning community, can be used to fit multiple levels of QM theory in the same training process. Meta-learning changes the training procedure to learn a representation that can be easily re-trained to new tasks with small amounts of data. We then demonstrate that meta-learning enables simultaneously training to multiple large organic molecule datasets. As a proof of concept, we examine the performance of a MLIP refit to a small drug-like molecule and show that pre-training potentials to multiple levels of theory with meta-learning improves performance. This difference in performance can be seen both in the reduced error and in the improved smoothness of the potential energy surface produced. We therefore show that meta-learning can utilize existing datasets with inconsistent QM levels of theory to produce models that are better at specializing to new datasets. This opens new routes for creating pre-trained, foundation models for interatomic potentials.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Synergy of semiempirical models and machine learning in computational chemistry

Catalyzed by enormous success in the industrial sector, many research programs have been exploring data-driven, machine learning approaches. Performance can be poor when the model is extrapolated to new regions of chemical space, e.g., new bonding types, new many-body interactions. Another important limitation is the spatial locality assumption in model architecture, and this limitation cannot be overcome with larger or more diverse datasets. The outlined challenges are primarily associated with the lack of electronic structure information in surrogate models such as interatomic potentials. Given the fast development of machine learning and computational chemistry methods, we expect some limitations of surrogate models to be addressed in the near future; nevertheless spatial locality assumption will likely remain a limiting factor for their transferability. Here, we suggest focusing on an equally important effort—design of physics-informed models that leverage the domain knowledge and employ machine learning only as a corrective tool. In the context of material science, we will focus on semi-empirical quantum mechanics, using machine learning to predict corrections to the reduced-order Hamiltonian model parameters. The resulting models are broadly applicable, retain the speed of semiempirical chemistry, and frequently achieve accuracy on par with much more expensive ab initio calculations. These early results indicate that future work, in which machine learning and quantum chemistry methods are developed jointly, may provide the best of all worlds for chemistry applications that demand both high accuracy and high numerical efficiency.

36 MATERIALS SCIENCE↗

Uncertainty-driven dynamics for active learning of interatomic potentials

Machine learning (ML) models, if trained to data sets of high-fidelity quantum simulations, produce accurate and efficient interatomic potentials. Active learning (AL) is a powerful tool to iteratively generate diverse data sets. In this approach, the ML model provides an uncertainty estimate along with its prediction for each new atomic configuration. If the uncertainty estimate passes a certain threshold, then the configuration is included in the data set. Here we develop a strategy to more rapidly discover configurations that meaningfully augment the training data set. The approach, uncertainty-driven dynamics for active learning (UDD-AL), modifies the potential energy surface used in molecular dynamics simulations to favor regions of configuration space for which there is large model uncertainty. The performance of UDD-AL is demonstrated for two AL tasks: sampling the conformational space of glycine and sampling the promotion of proton transfer in acetylacetone. The method is shown to efficiently explore the chemically relevant configuration space, which may be inaccessible using regular dynamical sampling at target temperature conditions.

97 MATHEMATICS AND COMPUTING↗

Investigation of structural effects of aromatic compounds on sooting tendency with mechanistic insight into ethylphenol isomers

Small aromatic molecules with oxygen-containing functional groups are a promising class of fuel additives, as they can be readily sourced from depolymerized lignin. These oxygenated aromatic compounds (OACs) show a lower sooting tendency than aromatic hydrocarbons, but OACs having alkyl groups such as ethylphenol show a higher sooting tendency than other OACs such as phenol and anisole, despite the oxygen moiety. In this study, we investigate the relationship between chemical structure and soot precursor formation to explain observed differences in the sooting tendency of OACs and to gain insight into how alkyl or oxygenated substituents on the aromatic ring affect soot precursor formation. The weakest bond for 15 aromatic compounds was identified and cleavage of these bonds was shown to generate either benzyl or phenoxy radicals. A linear relationship between standard enthalpy of formation (ΔH f o ) of these radicals and the yield sooting index (YSI) was found, and thus ΔH f ° can be applied as a metric to estimate YSIs of various aromatic compounds; higher ΔH f o of a radical indicates an increase in the radical reactivity and leads to more soot precursor formation. Flow reactor experiments were performed for 2-ethylphenol and 3-ethylphenol to elucidate how ortho and meta substitution effects the sooting tendency. Soot precursors were identified from the experiment and their formation pathways were investigated computationally. 2-ethylphenol produces more oxygenated products than 3-ethylphenol since the ortho position has increased resonance stabilization of radical intermediates, which leads to lower YSI. Overall, these results further inform the selection of potential biomass-derived fuel blendstocks that have favorable sooting tendencies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Reactive Molecular Dynamics Simulations and Quantum Chemistry Calculations To Investigate Soot-Relevant Reaction Pathways for Hexylamine Isomers

Sooting tendencies of a series of nitrogen-containing hydrocarbons (NHCs) have been recently characterized experimentally using the yield sooting index (YSI) methodology. This work aims to identify soot-relevant reaction pathways for three selected C6H15N amines, namely, dipropylamine (DPA), diisopropylamine (DIPA), and 3,3-dimethylbutylamine (DMBA) using ReaxFF molecular dynamics (MD) simulations and quantum mechanical (QM) calculations and to interpret the experimentally observed trends. ReaxFF MD simulations are performed to determine the important intermediate species and radicals involved in the fuel decomposition and soot formation processes. QM calculations are employed to extensively search for chemical reactions involving these species and radicals based on the ReaxFF MD results and also to quantitatively characterize the potential energy surfaces. Specifically, ReaxFF simulations are carried out in the NVT ensemble at 1400, 1600, and 1800 K, where soot has been identified to form in the YSI experiment. These simulations account for the interactions among test fuel molecules and pre-existing radicals and intermediate species generated from rich methane combustion, using a recently proposed simulation framework. ReaxFF simulations predict that the reactivity of the amines decrease in the order DIPA > DPA > DMBA, independent of temperature. Both QM calculations and ReaxFF simulations predict that C2H4, C3H6, and C4H8 are the main nonaromatic soot precursors formed during the decomposition of DPA, DIPA, and DMBA, respectively, and the associated reaction pathways are identified for each amine. Both theoretical methods predict that sooting tendency increases in the order DPA, DIPA, and DMBA, consistent with the experimentally measured trend in YSI. This work demonstrates that sooting tendencies and soot-relevant reaction pathways of fuels with unknown chemical kinetics can be identified efficiently through combined ReaxFF and QM simulations. Overall, predictions from ReaxFF simulations and QM calculations are consistent, in terms of fuel reactivity, major intermediates, and major nonaromatic soot precursors.

fuel decomposition↗