Linear graphlet models for accurate and interpretable cheminformatics
The surprising effectiveness of topology in the chemical sciences: graphlets in our open-source library, , provide accurate white-box 2D chemical property prediction.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
The surprising effectiveness of topology in the chemical sciences: graphlets in our open-source library, , provide accurate white-box 2D chemical property prediction.
Abstract The development and design of energy materials are essential for improving the efficiency, sustainability, and durability of energy systems to address climate change issues. However, optimizing and developing energy materials can be challenging due to large and complex search spaces. With the advancements in computational power and algorithms over the past decade, machine learning (ML) techniques are being widely applied in various industrial and research areas for different purposes. The energy material community has increasingly leveraged ML to accelerate property predictions and design processes. This article aims to provide a comprehensive review of research in different energy material fields that employ ML techniques. It begins with foundational concepts and a broad overview of ML applications in energy material research, followed by examples of successful ML applications in energy material design. We also discuss the current challenges of ML in energy material design and our perspectives. Our viewpoint is that ML will be an integral component of energy materials research, but data scarcity, lack of tailored ML algorithms, and challenges in experimentally realizing ML-predicted candidates are major barriers that still need to be overcome.
This report documents the initial algorithm that could be used by the Waste Treatment and Immobilization Plant (WTP) in batching high-level waste (HLW) and glass-forming chemicals (GFCs) in the HLW melter feed preparation vessel (MFPV) (HFP-VSL-00001 and -00005). Not all Hanford tank waste can be accommodated by the models developed for this report and significant expansion of the model boundaries could be achievable to reduce the WTP mission life and total canister production count. The immobilized HLW (IHLW) must meet a series of constraints to be acceptable for disposal in the Monitored Geologic Repository, which are contained in the Specification 1 of the Contract (DOE 2000), the Waste Acceptance Product Specifications (WAPS, DOE 1996), and the Waste Acceptance System Requirements Document (WASRD, DOE 2007). The IHLW Waste Form Compliance Plan (WCP, 24590-HLW-PL-RT-07-0001, Rev 3) specifies that the formulation algorithm will be developed and used to comply with the constraints associated with glass composition and properties. This report is not an engineering calculation, does not provide design input, and is not an engineering study. Algorithm inputs include the chemical analyses of the blended HLW in the HLW blend vessel (HBV) (HLP-VSL-00028, the volume and composition of the MFPV heel, the volume and composition of the MFPV after waste addition, the volume and composition of MFPV batch after GFC addition, the compositions of individual GFCs, and the mass of glass in each canister. In addition to these inputs, uncertainties in the HLW composition and processing parameters are included in the algorithm. Using the above inputs, the algorithm calculates the following outputs: 1) the volume of HLW to be transferred from the HBV to the MFPV, 2) the mass of each GFC for addition to the MFPV, 3) the composition of the glass that will be produced along with uncertainties, and 4) the predicted properties, with associated uncertainties, of the resulting IHLW. The algorithm uses the property-composition models to calculate properties with associated uncertainties and compares them with various constraints to ensure that a processable feed is formulated and a compliant IHLW is produced. The GFC additions are determined using an optimization approach to provide high confidence that the HLW glass will meet all product quality requirements and key processing constraints. For most HLW batches there are many possible glass compositions that meet all constraints. In these cases, the glass composition is optimized for a series of target component concentrations and target property values. The algorithm also incorporates process measurement and product quality uncertainties, based on the work of Piepel et al. (2005). Estimates of the various process and measurement uncertainties that affect glass compositions and predicted glass properties have been previously reported (Piepel et al. 2005, 2006) and the impacts of these estimated uncertainties on the IHLW composition envelope that meets product quality and processing-related properties with sufficient confidence were evaluated. The details of work performed to date to develop this initial GFC addition and batching algorithm are summarized in Sections 4 and 5. An example data set is used to illustrate the calculations of the algorithm summarized in Section 6. Finally, in Section 7, there is a statement of the required work to achieve a final operational IHLW formulation control algorithm. This report is not an engineering calculation, does not provide design input, and is not an engineering study.
Efficient methods for searching the chemical space of molecular compounds are needed to automate and accelerate the design of new functional molecules such as pharmaceuticals. Given the high cost in both resources and time for experimental efforts, computational approaches play a key role in guiding the selection of promising molecules for further investigation. Here, we construct a workflow to accelerate design by combining approximate quantum chemical methods [i.e. density-functional tight-binding (DFTB)], a graph convolutional neural network (GCNN) surrogate model for chemical property prediction, and a masked language model (MLM) for molecule generation. Property data from the DFTB calculations are used to train the surrogate model; the surrogate model is used to score candidates generated by the MLM. The surrogate reduces computation time by orders of magnitude compared to the DFTB calculations, enabling an increased search of chemical space. Furthermore, the MLM generates a diverse set of chemical modifications based on pre-training from a large compound library. We utilize the workflow to search for near-infrared photoactive molecules by minimizing the predicted HOMO-LUMO gap as the target property. Our results show that the workflow can generate optimized molecules outside of the original training set, which suggests that iterations of the workflow could be useful for searching vast chemical spaces in a wide range of design problems.
Knowledge of the physical properties of ionic liquids (ILs), such as the surface tension and speed of sound, is important for both industrial and research applications. Unfortunately, technical challenges and costs limit exhaustive experimental screening efforts of ILs for these critical properties. Previous work has demonstrated that the use of quantum-mechanics-based thermochemical property prediction tools, such as the conductor-like screening model for real solvents, when combined with machine learning (ML) approaches, may provide an alternative pathway to guide the rapid screening and design of ILs for desired physiochemical properties. However, the question of which machine-learning approaches are most appropriate remains. In the present study, we examine how different ML architectures, ranging from tree-based approaches to feed-forward artificial neural networks, perform in generating nonlinear multivariate quantitative structure–property relationship models for the prediction of the temperature- and pressure-dependent surface tension of and speed of sound in ILs over a wide range of surface tensions (16.9–76.2 mN/m) and speeds of sound (1009.7–1992 m/s). The ML models are further interrogated using the powerful interpretation method, shapley additive explanations. We find that several different ML models provide high accuracy, according to traditional statistical metrics. The decision tree-based approaches appear to be the most accurate and precise, with extreme gradient-boosting trees and gradient-boosting trees being the best performers. However, our results also indicate that the promise of using machine-learning to gain deep insights into the underlying physics driving structure–property relationships in ILs may still be somewhat premature.
The predictive power of density functional theory for materials properties can be improved without increasing the overall computational complexity by extending the generalized gradient approximation (GGA) for electronic exchange and correlation to density functionals depending on the electronic kinetic energy density in addition to the charge density and its gradient, resulting in a meta-GGA. Here, we propose an empirical meta-GGA model that is based both on physical constraints and on experimental and quantum chemistry reference data. Overall, the resulting optimized meta-GGA MCML yields improved surface and gas phase reaction energetics without sacrificing the accuracy of bulk property predictions of existing meta-GGA approaches.
With over 20 years of high-resolution surface irradiance data covering most of the western hemisphere, the National Solar Radiation Database (NSRDB) is a vital public data asset. The NSRDB uses a two-step Physical Solar Model (PSM) that explicitly considers the effects of clouds and other atmospheric variables on radiative transfer. High-quality physical and optical cloud properties derived from satellite imagery are perhaps the most important data inputs to the PSM, representing the greatest source of radiation attenuation and scattering. However, traditional methods for cloud property retrieval have their own limitations and are unable to accurately predict cloud properties outside of nominal conditions. We introduce a physics-guided neural network that can accurately predict cloud properties when traditional methods fail or are inaccurate. Using this framework, we show reductions in relative Root Mean Square Error (RMSE) for Global Horizontal Irradiance (GHI) up to 13 percentage points for timesteps that previously had missing or low-quality cloud property data. We expect that this methodology will be effective in improving the quality of cloud property and solar irradiance data in the NSRDB.
With over 20 years of high-resolution surface irradiance data covering most of the western hemisphere, the National Solar Radiation Database (NSRDB) is a vital public data asset. The NSRDB uses a two-step Physical Solar Model (PSM) that explicitly considers the effects of clouds and other atmospheric variables on radiative transfer. High-quality physical and optical cloud properties derived from satellite imagery are perhaps the most important data input to the PSM, representing the greatest source of radiation attenuation and scattering. However, traditional methods for cloud property retrieval have their own limitations and are unable to accurately predict cloud properties outside of nominal conditions. We introduce a physics-guided neural network that can accurately predict cloud properties when traditional methods fail or are inaccurate. Using this framework, we show reductions in relative Root Mean Square Error (RMSE) for Global Horizontal Irradiance (GHI) up to 13 percentage points for timesteps that previously had missing or low-quality cloud property data. We expect that this methodology will be effective in improving the quality of cloud property and solar irradiance data in the NSRDB.
On the one hand, multi-principal element alloys (MPEAs) have created a paradigm shift in alloy design due to large compositional space, whereas on the other, they have presented enormous computational challenges for theory-based materials design, especially density functional theory (DFT), which is inherently computationally expensive even for traditional dilute alloys. In this paper, we present a machine learning framework, namely PREDICT (PRedict properties from Existing Database In Complex alloys Territory), that opens a pathway to predict elastic constants in large compositional space with little computational expense. The framework only relies on the DFT database of binary alloys and predicts Voigt–Reuss–Hill Young’s modulus, shear modulus, bulk modulus, elastic constants, and Poisson’s ratio in MPEAs. We show that the key descriptors of elastic constants are the A–B bond length and cohesive energy. The framework can predict elastic constants in hypothetical compositions as long as the constituent elements are present in the database, thereby enabling property exploration in multi-compositional systems. We illustrate predictions in a FCC Ni-Cu-Au-Pd-Pt system.
In this article, the development of nanoporous metals and metallic composites through dealloying processes presents significant opportunities in materials engineering. However, designing multicomponent precursor alloys and establishing corresponding processing methods that yield predictable compositions and nanostructures remain a complex challenge. This article explores how machine learning (ML)-augmented computational and experimental methodologies can tackle these challenges by predicting precursor alloy compositions, final nanoporous structures, and mechanical properties, while integrating ML-enabled autonomous experimentation for material design and quantification. We highlight recent advancements in applying ML to nanostructured materials design via dealloying and discuss how techniques from other nanomaterial designs can be adapted for improved control over morphological and compositional outcomes in nanoporous and nanocomposite materials. Furthermore, we explore the role of ML in autonomous synchrotron x-ray experimentation, enabling real-time feedback between modeling and experimental setups. ML-driven approaches to microstructure characterization and mechanical property prediction are also examined, with a focus on modeling and advanced imaging techniques such as three-dimensional nanotomography. Finally, this article outlines future directions for ML-enhanced materials science, emphasizing the exploration of high-dimensional parameter spaces and the incorporation of materials kinetics into processing and property evaluation, ultimately advancing the design of nanoporous structures and materials science.
Recent developments have enabled material extrusion additive manufacturing of thermoset-based composite inks on the large scale. In addition, printing out-of-plane components is of broad interest to the polymer material extrusion community. Here, we address some of the challenges associated with both large-scale and out-of-plane thermoset material extrusion additive manufacturing by studying the height at which thin overhanging walls collapse. Walls at a range of overhang angles were printed until they collapsed. An optical camera captured the profile of each wall throughout the print, allowing the collapse height to be identified and the geometric fidelity to the programmed angle to be evaluated. Using previously measured rheological properties, predictive models were generated to approximate the collapse height and profile of the deflected walls. First, an analytical model was created to predict the height at which the walls would yield. The analytical model assumes the walls exhibit a perfectly linear profile; however, experiments proved this assumption to be false. Therefore, a finite element simulation was developed to account for the elastic deflection that occurs during printing. The finite element simulation predicts both the yield height and the deflected profile after the deposition of each layer. For the properties of the thermoset ink used here, the yield height predicted by the analytical model and finite element simulation are virtually identical. These predictions match experimental data reasonably well, but minor errors are observed. Accounting for the fully plastic moment appears to explain the small mismatch between experimental data and predictions. Additionally, the finite element simulation provides an excellent prediction of the deflected profile before the wall begins to collapse. Finally, by demonstrating that the collapse height and deflected profile of thin overhanging walls can be predicted, this work illustrates how the soft viscoelastic properties of thermoset-based composite inks limit the scale of a key feature required to print some nonplanar components. It also provides a basis to tailor in-process curing systems to suppress deflection and collapse of thin overhanging walls.
Predicting properties such as heating value, ash fusion temperature, and mineral ash composition from Laser-Induced Breakdown Spectroscopy (LIBS) data can make gasifiers more flexible to different feedstocks. Understanding these feedstock properties in-situ improves feedstock conversion modelling methods that allow for consistent operation, higher carbon conversion, and reduced fouling and erosion rates. The purpose of this study is to demonstrate methods for model creation that take LIBS data as predictor features and estimate higher order material properties as a function of feedstock material properties. Six samples were chosen to represent a mixture of abundant and carbon rich waste materials. LIBS measurements were performed on these samples for elemental wavelengths and intensity values. Laboratory analytical results were obtained for each sample’s heating value, proximate and ultimate analysis, mineral ash composition, ash fusion temperatures, and viscosity temperatures. Thermal conductivity was measured using a HotDisk TPS 2500S. LIBS measurements were processed and used as predictor features for machine learning (ML) models to predict the sample’s material properties. Predictor feature selection algorithms, particularly minimum redundancy maximum relevance (mRMR), reduced the dimensionality of ML models. Many modelling methods such as Gaussian process regression (GPR), regression tree, neural networks (NN), and support vector machines (SVM) were demonstrated to be effective at predicting higher order properties; however, mRMR with GPR stood out as a clear winning combination.
The recent rapid rise in data-driven practices in the materials science domain has led to the development of efficient, generalizable, and accurate approaches for several applications, including: material property prediction, mining (micro)structure- property and (micro)structure-processing relationships, and characterization of material microstructures. Central to the materials science domain is linking microstructure to properties and performance, and critical to building such linkages is understanding how microstructures evolve as a function of environmental exposure or processing conditions (e.g., time, temperature, applied stress or strain, irradiation). This preview article summarizes recent work on the development of recurrent neural networks for predicting spatio-temporal microstructure evolution detailed by Yang et al in their manuscript entitled 'Self-supervised Learning and Prediction of Microstructure Evolution with Recurrent Neural Networks'.
Artificial intelligence (AI) based approaches are beginning to impact several domains of human life, science and technology. Polymer informatics is one such domain where AI and machine learning (ML) tools are being used in the efficient development, design and discovery of polymers. Surrogate models are trained on available polymer data for instant property prediction, allowing screening of promising polymer candidates with specific target property requirements. Questions regarding synthesizability, and potential (retro)synthesis steps to create a target polymer, are being explored using statistical means. Data-driven strategies to tackle unique challenges resulting from the extraordinary chemical and physical diversity of polymers at small and large scales are being explored. Other major hurdles for polymer informatics are the lack of widespread availability of curated and organized data, and approaches to create machine-readable representations that capture not just the structure of complex polymeric situations but also synthesis and processing conditions. Methods to solve inverse problems, wherein polymer recommendations are made using advanced AI algorithms that meet application targets, are being investigated. As various parts of the burgeoning polymer informatics ecosystem mature and become integrated, efficiency improvements, accelerated discoveries and increased productivity can result. Here in this paper, we review emergent components of this polymer informatics ecosystem and discuss imminent challenges and opportunities.
Rapidly determining structure–property correlations in materials is an important challenge in better understanding fundamental mechanisms and greatly assists in materials design. In microscopy, imaging data provides a direct measurement of the local structure, while spectroscopic measurements provide relevant functional property information. Deep kernel active learning approaches have been utilized to rapidly map local structure to functional properties in microscopy experiments, but are computationally expensive for multi-dimensional and correlated output spaces. Here, we present an alternative lightweight curiosity algorithm which actively samples regions with unexplored structure–property relations, utilizing a deep-learning based surrogate model for error prediction. We show that the algorithm outperforms random sampling for predicting properties from structures, and provides a convenient tool for efficient mapping of structure–property relationships in materials science.
Predicting properties of inorganic materials is a heavily researched topic, with several new prediction approaches emerging as competitors. One such competitor is graph neural networks, which leverage the structure of the graph to aid in the prediction process. In this work, we propose integration of neuromorphic computation into the graph neural network pipeline. We call this approach Neuromorphic Graph Learning (NGL). We utilize the NGL approach to leverage evolutionary algorithms and a novel Spike Pipeline for Raster Analysis (SPIRE) for the prediction of band gap in inorganic materials.
The inverse design of novel molecules with a desirable optoelectronic property requires consideration of the vast chemical spaces associated with varying chemical composition and molecular size. First principles-based property predictions have become increasingly helpful for assisting the selection of promising candidate chemical species for subsequent experimental validation. However, a brute-force computational screening of the entire chemical space is decidedly impossible. To alleviate the computational burden and accelerate rational molecular design, we here present an iterative deep learning workflow that combines (i) the density-functional tight-binding method for dynamic generation of property training data, (ii) a graph convolutional neural network surrogate model for rapid and reliable predictions of chemical and physical properties, and (iii) a masked language model. As proof of principle, we employ our workflow in the iterative generation of novel molecules with a target energy gap between the highest occupied molecular orbital (HOMO) and the lowest unoccupied molecular orbital (LUMO).
Thermal conductivity, specific heat, viscosity, and density are critical properties for understanding thermal hydraulics of heat transfer fluids (HTFs) like molten salts. These properties are important for design and safe operation of any HTF loop. These characterizations are required to benchmark computational chemical models that are used to predict properties, but existent data are limited. These measurements are extremely difficult to make due to the operating temperature range and corrosive properties of the salt.Density measurements are needed to predict volumetric behavior. Thermal expansion mismatches can cause mechanical failure of structural materials and important components that are in contact with the molten salt. All of these properties are related to heat transfer in HTFs. The heat generated in a reactor must be high enough to derive power; however it should not be so hot that it cannot be safely removed via the HTF at an appropriate rate. It is important to understand the thermal hydraulics required to operate at the desired power generation level and to avoid situations in which thermal shifts can damage components,cause failure of structural materials, and/or lead to accidents. Understanding these thermal properties can aid in component and process design and can contribute to optimized operational and safety parameters.