Search NASA⌕ Search

SEARCH · Search NASA

Results for “property prediction models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Coupling physics in machine learning to predict properties of high-temperatures alloys

Abstract High-temperature alloy design requires a concurrent consideration of multiple mechanisms at different length scales. We propose a workflow that couples highly relevant physics into machine learning (ML) to predict properties of complex high-temperature alloys with an example of the 9–12 wt% Cr steels yield strength. We have incorporated synthetic alloy features that capture microstructure and phase transformations into the dataset. Identified high impact features that affect yield strength of 9Cr from correlation analysis agree well with the generally accepted strengthening mechanism. As a part of the verification process, the consistency of sub-datasets has been extensively evaluated with respect to temperature and then refined for the boundary conditions of trained ML models. The predicted yield strength of 9Cr steels using the ML models is in excellent agreement with experiments. The current approach introduces physically meaningful constraints in interrogating the trained ML models to predict properties of hypothetical alloys when applied to data-driven materials.

36 MATERIALS SCIENCE↗

Understanding Twinning and Deformation in High Entropy Alloys

A combination of high strength and high ductility has been observed in multi-principal element alloys due to twin formation attributed to low stacking fault energy (SFE). In the pursuit of low SFE alloys, a key bottleneck is the lack of understanding of the composition–SFE cor- relations that would guide tailoring SFE via alloy composition. Using density functional theory (DFT), we show that dopant radius, which have been postulated as a key descriptor for SFE in dilute alloys, does not fully explain SFE trends across different host metals. Instead, charge density is a much more central descriptor. It allows us to (1) explain contrasting SFE trends in Ni and Cu host metals due to various dopants in dilute concentrations, (2) explain the large SFE variations observed in the literature even within a given alloy composition due to the nearest neighbor environments in “model” concentrated alloys, and (3) develop a machine learning model that can be used to predict SFEs in multi-elemental alloys. This model opens a possibility to use charge density as a descriptor for predicting SFE in alloys. Furthermore, a descriptor-less machine learning (ML) model based only on charge density images extracted from density functional theory (DFT) is developed to predict stacking fault energies (SFE) in concentrated alloys. The model is based on convolutional neural networks (CNNs) as one of the promising ML techniques for dealing with complex images and data. Identification of correct descriptors is a key bottleneck to develop ML models for predicting materials properties. Often, in most ML models, textbook physical descriptors such as atomic radius, valence charge and electronegativity are used as descriptors which have limitations because these properties change in concentrated alloys when multiple elements are mixed to form a solid solution. We illustrate that, within the scope of DFT, the search for descriptors can be circumvented by electronic charge density, which is the backbone of the Kohn-Sham DFT and describes the system completely. The performance of our model is demonstrated by predicting SFE of concentrated alloys with an RMSE and R2 of 6.18 mJ/m2 and 0.87, respectively, validating the accuracy of the proposed approach.

36 MATERIALS SCIENCE↗

Structure-aware graph neural network based deep transfer learning framework for enhanced predictive analytics on diverse materials datasets

Abstract Modern data mining methods have demonstrated effectiveness in comprehending and predicting materials properties. An essential component in the process of materials discovery is to know which material(s) will possess desirable properties. For many materials properties, performing experiments and density functional theory computations are costly and time-consuming. Hence, it is challenging to build accurate predictive models for such properties using conventional data mining methods due to the small amount of available data. Here we present a framework for materials property prediction tasks using structure information that leverages graph neural network-based architecture along with deep-transfer-learning techniques to drastically improve the model’s predictive ability on diverse materials (3D/2D, inorganic/organic, computational/experimental) data. We evaluated the proposed framework in cross-property and cross-materials class scenarios using 115 datasets to find that transfer learning models outperform the models trained from scratch in 104 cases, i.e., ≈90%, with additional benefits in performance for extrapolation problems. We believe the proposed framework can be widely useful in accelerating materials discovery in materials science.

Chemistry↗

Charge-density based convolutional neural networks for stacking fault energy prediction in concentrated alloys

A descriptor-less machine learning (ML) model based only on charge density images extracted from density functional theory (DFT) is developed to predict stacking fault energies (SFE) in concentrated alloys. The model is based on convolutional neural networks (CNNs) as one of the promising ML techniques for dealing with complex images and data. Identification of correct descriptors is a key bottleneck to develop ML models for predicting materials properties. Often, in most ML models, textbook physical descriptors such as atomic radius, valence charge and electronegativity are used as descriptors which have limitations because these properties change in concentrated alloys when multiple elements are mixed to form a solid solution. Here, we illustrate that, within the scope of DFT, the search for descriptors can be circumvented by electronic charge density, which is the backbone of the Kohn-Sham DFT and describes the system completely. The performance of our model is demonstrated by predicting SFE of concentrated alloys with an RMSE and R 2 of 6.18 mJ/m 2 and 0.87, respectively, validating the accuracy of the proposed approach.

36 MATERIALS SCIENCE↗

A Method for Producing Hierarchical and Statistically Calibrated Predictions of Nuclear Material Properties from Existing Models

Computer vision-based analysis of micrographs of nuclear materials is an emerging technique for property prediction, synthetic route identification, and other material analysis tasks. These analysis tasks play a pivotal role in many material characterization applications such as signature development for treaty verification, process optimization, etc. The backbone in many of the recent computer vision-based techniques is a deep learning model, which takes a fixed-size set of pixels and provides a class prediction for that set of pixels. For example, previous work developed a deep convolutional neural network (CNN) to predict the synthetic route from a 256 px x 256 px patch taken from a larger image of uranium ore concentrates. In this work, we present several methods for first calibrating these models in a manner that they can provide accurate probabilities of their predictions’ veracity, and several methods of combining these probabilities. Overall, the combination of these two steps into a pipeline allows for full-image and even full-sample (where a sample has many images) predictions with associated confidence values. Finally, we show that one can also use the patch predictions and confidence to produce a visualization to map predicted constituents through the image. Results and examples for predicting and mapping uranium ore concentrates’ synthetic process from imagery will be presented.

artificial intelligence↗

Dashboard for Visualizing Molecular Property Prediction Machine Learning Results

This is a dashboard for exploring the results of machine learning models for predicting molecular properties from molecular structure. It includes tools for: 1. Modifying molecules to observe the change in predicted properties 2. Exploring the relationship between molecular structure and predicted properties 3. Recommending structurally similar molecules with improved properties 4. Exploring the impact of data subsampling on model performance metrics

Xu, Audrey↗

Impact of Domain Knowledge on the Property Prediction of Specialized Machine Learning Models

Developing transferable machine learning models is trending in data-driven materials research. However, how to apply such models to a specific research domain remains unclear. Here, in this work, we choose high-entropy materials as a platform with a specialized data set containing 145,323 DFT-relaxed materials. This data set is used to explore the role of domain-specific knowledge in training effective models. Our tests with three representative graph neural network architectures indicate the model complexity has much smaller influence on performance than the data itself. Specifically, the consideration of low-energy atomic ordering, structures with diverse elemental coverage, and high-order interactions significantly influences the model performance. We also find that domain knowledge-driven sampling can greatly enhance unsupervised learning techniques. This research highlights that developing specialized data sets is more beneficial than further complicating deep learning architectures. Additionally, physics-inspired sampling algorithms are crucially needed for better machine learning models for a specific materials research domain.

36 MATERIALS SCIENCE↗

Properties, Theory, and Measurements for Understanding the Function of Heavy Elements (Project 20180474CR, Final Technical Report)

The FY18-20 Laboratory Directed Research and Development (LDRD) funded Properties, Theory, and Measurements for Understanding the Function of Heavy Elements Project aim has been to advance heavy element science in a comprehensive project connecting targeted research with Los Alamos mission imperatives. The mechanisms for project implementation were (1) support of a multi-year broad-based postdoctoral fellows project, (2) a summer student fellows research project and two seminar series, and (3) organization of structured workshops and integrated educational and career development opportunities. The project was successfully administered by the Glenn T. Seaborg Institute (GTSI) for Transactinium Science and has shown to be an exceptional investment in supporting the Los Alamos National Laboratory (LANL) mission areas requiring heavy element and actinide science by attracting and funding the future generation of scientists and engineers. This project exhibited its value across the laboratory in heavy element and actinide science areas include materials, material properties, signatures, modeling, predictions, fabrication, detection, disposal, global security implications, forensics, and the specialized science surrounding plutonium, uranium, and their surrogates as fuels for energy and nuclear weapons. In this report, the GTSI project staff documents the “high return on investment” implementation as measured against the successes of previous actinide research and science-based projects and as evidenced by the retention of 30% of G.T. Seaborg Postdoctoral Fellows as permanent employees. With additional funding through LDRD Reserve funding during this project period, the GTSI expanded its support for heavy element and actinide science research with a Visiting Research Seaborg Scholar and a Rapid Response Small Projects call. These innovations have served to advance GTSI pursuits as communicated in our FY21-23 LDRD Proposal Project#: 20210527CR Seaborg Institute: Center for Advancing Actinide Science and Technology at LANL

36 MATERIALS SCIENCE↗

Pore-Scale Dynamics of Liquid CO2–Water Displacement in 2D Axisymmetric Porous Micromodels Under Strong Drainage and Weak Imbibition Conditions: High-Speed μPIV Measurements

Resolving pore-scale transient flow dynamics is crucial to understanding the physics underlying multiphase flow in porous media and informing large-scale predictive models. Surface properties of the porous matrix play an important role in controlling such physics, yet interfacial mechanisms remain poorly understood, in part due to a lack of direct observations. This study reports on an experimental investigation of the pore-scale flow dynamics of liquid CO 2 and water in two-dimensional (2D) circular porous micromodels with different surface characteristics employing high-speed microscopic particle image velocimetry (μPIV). The design of the micromodel minimized side boundary effects due to the limited size of the domain. The high-speed μPIV technique resolved the spatial and temporal dynamics of multiphase flow of CO 2 and water under reservoir-relevant conditions, for both drainage and imbibition scenarios. When CO 2 displaced water in a hydrophilic micromodel (i.e., drainage), unstable capillary fingering occurred and the pore flow was dominated by successive pore-scale burst events (i.e., Haines jumps). When the same experiment was repeated in a nearly neutral wetting micromodel (i.e., weak imbibition), flow instability and fluctuations were virtually eliminated, leading to a more compact displacement pattern. Energy balance analysis indicates that the conversion efficiency between surface energy and external work is less than 30%, and that kinetic energy is a disproportionately smaller contributor to the energy budget. This is true even during a Haines jump event, which induces velocities typically two orders of magnitude higher than the bulk velocity. These novel measurements further enabled direct observations of the meniscus displacement, revealing a significant alteration of the pore filling mechanisms during drainage and imbibition. While the former typically featured burst events, which often occur only at one of the several throats connecting a pore, the latter is typically dominated by a cooperative filling mechanism involving simultaneous invasion of a pore from multiple throats. This cooperative filling mechanism leads to merging of two interfaces and releases surface energy, causing instantaneous high-speed events that are similar, yet fundamentally different from, burst events. Finally, pore-scale velocity fields were statistically analyzed to provide a quantitative measure of the role of capillary effects in these pore flows.

Li, Yaofa↗

Discovery of multi-functional polyimides through high-throughput screening using explainable machine learning

Polyimides have been widely used in modern industries because of their excellent mechanical and thermal properties, e.g., high-temperature fuel cells, displays, and aerospace composites. However, it usually takes decades of experimental efforts to develop a successful product. Aiming to expedite the discovery of high-performance polyimides, we utilize computational methods of machine learning (ML) and molecular dynamics (MD) simulations. Our study provides compelling evidence for the effectiveness of a data-driven approach in discovering novel polyimides. We first build a comprehensive library of more than 8 million hypothetical polyimides based on the polycondensation of existing dianhydride and diamine/diisocyanate molecules. Then we establish multiple ML models for the thermal and mechanical properties of polyimides based on their experimentally reported values, including glass transition temperature, Young’s modulus, and tensile yield strength. The obtained ML models demonstrate excellent predictive performance in identifying the key chemical substructures influencing the thermal and mechanical properties of polyimides. The use of explainable machine learning describes the effect of chemical substructures on individual properties, from which human experts can understand the cause of the ML model decision. Applying the well-trained ML models, we obtain property predictions of the 8 million hypothetical polyimides. Then, we screen the whole hypothetical dataset and identify three (3) best-performing novel polyimides that have better-combined properties than existing ones through Pareto frontier analysis. For an easy query of the discovered high-performing polyimides, we also create an online platform https://polyimide-explorer.herokuapp.com/ that embeds the developed ML model with interactive visualization. Furthermore, we validate the ML predictions through all-atom MD simulations and examine their synthesizability. The MD simulations are in good agreement with the ML predictions and the three novel polyimides are predicted to be easy to synthesize via Schuffenhauer’s synthetic accessibility score. Following the proposed ML guidance, we successfully synthesized a novel polyimide and the experimentally obtained high glass transition/thermal decomposition temperature demonstrated its excellent thermal stability. Here our study demonstrates an efficient way to expedite the discovery of novel polymers using ML prediction and MD validation. The high-throughput screening of a large computational dataset can serve as a general approach for new material discovery in other polymeric material exploration problems, such as organic photovoltaics, polymer membranes, and dielectrics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Guiding the Design of Heterogeneous Electrode Microstructures for Li-Ion Batteries: Microscopic Imaging, Predictive Modeling, and Machine Learning

Electrochemical and mechanical properties of lithium-ion battery materials are heavily dependent on their 3D microstructure characteristics. A quantitative understanding of the role played by stochastic microstructures is critical for the prediction of material properties and for guiding synthesis processes. Furthermore, tailoring microstructure morphology is also a viable way of achieving optimal electrochemical and mechanical performances of lithium-ion cells. To facilitate the establishment of microstructure-resolved modeling and design methods, a review covering spatially and temporally resolved imaging of microstructure and electrochemical phenomena, microstructure statistical characterization and stochastic reconstruction, microstructure-resolved modeling for property prediction, and machine learning for microstructure design is presented here. The perspectives on the unresolved challenges and opportunities in applying experimental data, modeling, and machine learning to improve the understanding of materials and identify paths toward enhanced performance of lithium-ion cells are presented.

25 ENERGY STORAGE↗

Adaptive Conformer Sampling for Property Prediction Using the Conductor-like Screening Model for Real Solvents

The valorization of lignocellulose-derived bioproducts requires effective separation from excessive water. Liquid–liquid extraction is a promising low-energy separation technology, but effective extraction requires solvent selection based on the thermodynamic properties of the bioproduct and solvent components. We propose a computational framework for predicting such properties by developing an adaptive conformer selection approach for use with COSMO-RS (conductor-like screening model for real solvents) calculations. In this framework, molecular dynamics simulations are used to generate many molecular structures (conformers) at representative temperatures in varying solvent environments. Conformers are then clustered based on structural metrics in a low-dimensional space and selected using a mixed-integer quadratic programming problem to iteratively insert a sampled conformer. At each iteration, we determine bioproduct properties using COSMO-RS. Here, we demonstrate the capability of the proposed framework on representative bioproducts to show convergence of the adaptive sampling toward experimentally measured properties with fewer calculations than required by random conformer sampling, enabling the improved screening of solvent systems for liquid-phase separation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Can a simple topological-constraints-based model predict the initial dissolution rate of borosilicate and aluminosilicate glasses?

Tuning glass composition to obtain targeted properties generally relies on empirical approaches. However, a deep understanding of the physical and chemical mechanisms linking glass composition to its structure and properties would enable developing reliable predictive models. Indeed, although empirical models are usually able to interpolate composition–property relationships within a given compositional envelope, they often fail at extrapolating predictions far from their training domain. Here, as an alternative route to empirical models, we show that a structural descriptor based on the number of topological constraints per atom can be used to predict the initial dissolution rate of aluminosilicate and borosilicate glasses after being parameterized on different families of glasses (specific series of borosilicate glasses). Sixteen glasses belonging to these families were studied and their initial dissolution rates were determined at 90 °C and pH 90 °C = 9, covering rates spanning over 5 orders of magnitude. The model based on topological constraints was trained based on seven select borosilicate glasses (R 2 = 0.997) and used to predict the dissolution rate of nine additional borosilicate and aluminosilicate glasses. We show that, provided that corrections are made for high alkali content glasses that dissolve incongruently (preferential release of Na), the model gives reasonable predictions, even far from its training domain.

36 MATERIALS SCIENCE↗

Isobutanol Octane Blending Model with Gasoline: Cooperative Research and Development Final Report, CRADA Number CRD-17-00689

The purpose of this agreement between the National Renewable Energy Laboratory (NREL) and Gevo, under the DOE Small Business Vouchers Pilot, is to develop a predictive octane blending model for isobutanol and blendstocks for oxygenated blending (BOBs). Validated models of ethanol octane blending effects are currently used in refinery blending models. While it is known that isobutanol increases octane when blended into BOBs, the effect is non-linear, and dependent on hydrocarbon blendstock properties. Because no predictive model currently exists for isobutanol and BOBs, blenders must perform expensive and time-consuming tests to determine the octane effect on each batch of finished fuel. NREL will make basic measurements of research octane number (RON) and motor octane number (MON) of finished gasoline-isobutanol blends prepared in a broad range of BOBs. The key properties and detailed composition of BOBs utilized will be measured by NREL. Using these measured fuel properties, NREL will develop a predictive octane blending model for isobutanol in BOBs that can be used by terminals to further reduce barriers to market penetration of isobutanol.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

The ANI-1ccx and ANI-1x data sets, coupled-cluster and density functional theory properties for molecules

Abstract Maximum diversification of data is a central theme in building generalized and accurate machine learning (ML) models. In chemistry, ML has been used to develop models for predicting molecular properties, for example quantum mechanics (QM) calculated potential energy surfaces and atomic charge models. The ANI-1x and ANI-1ccx ML-based general-purpose potentials for organic molecules were developed through active learning; an automated data diversification process. Here, we describe the ANI-1x and ANI-1ccx data sets. To demonstrate data diversity, we visualize it with a dimensionality reduction scheme, and contrast against existing data sets. The ANI-1x data set contains multiple QM properties from 5 M density functional theory calculations, while the ANI-1ccx data set contains 500 k data points obtained with an accurate CCSD(T)/CBS extrapolation. Approximately 14 million CPU core-hours were expended to generate this data. Multiple QM calculated properties for the chemical elements C, H, N, and O are provided: energies, atomic forces, multipole moments, atomic charges, etc. We provide this data to the community to aid research and development of ML models for chemistry.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

3D-equivariant graph neural networks for protein model quality assessment

Quality assessment (QA) of predicted protein tertiary structure models plays an important role in ranking and using them. With the recent development of deep learning end-to-end protein structure prediction techniques for generating highly confident tertiary structures for most proteins, it is important to explore corresponding QA strategies to evaluate and select the structural models predicted by them since these models have better quality and different properties than the models predicted by traditional tertiary structure prediction methods. We develop EnQA, a novel graph-based 3D-equivariant neural network method that is equivariant to rotation and translation of 3D objects to estimate the accuracy of protein structural models by leveraging the structural features acquired from the state-of-the-art tertiary structure prediction method—AlphaFold2. We train and test the method on both traditional model datasets (e.g. the datasets of the Critical Assessment of Techniques for Protein Structure Prediction) and a new dataset of high-quality structural models predicted only by AlphaFold2 for the proteins whose experimental structures were released recently. Our approach achieves state-of-the-art performance on protein structural models predicted by both traditional protein structure prediction methods and the latest end-to-end deep learning method—AlphaFold2. It performs even better than the model QA scores provided by AlphaFold2 itself. The results illustrate that the 3D-equivariant graph neural network is a promising approach to the evaluation of protein structural models. Integrating AlphaFold2 features with other complementary sequence and structural features is important for improving protein model QA.

59 BASIC BIOLOGICAL SCIENCES↗