Search NASA⌕ Search

SEARCH · Search NASA

Results for “property prediction models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Uncertainty quantification of a deep learning fuel property prediction model

Deep learning models are being widely used in the field of combustion. Given the black-box nature of typical neural network based models, uncertainty quantification (UQ) is critical to ensure the reliability of predictions as well as the training datasets, and for a principled quantification of noise and its various sources. Deep learning surrogate models for predicting properties of chemical compounds and mixtures have been recently shown to be promising for enabling data-driven fuel design and optimization, with the ultimate goal of improving efficiency and lowering emissions from combustion engines. In this study, UQ is performed for a multi-task deep learning model that simultaneously predicts the research octane number (RON), Motor Octane Number (MON), and Yield Sooting Index (YSI) of pure components and multicomponent blends. The deep learning model is comprised of three smaller networks: Extractor 1, Extractor 2, and Predictor, and a mixing operator. The molecular fingerprints of individual components are encoded via Extractor 1 and Extractor 2, the mixing operator generates fingerprints for mixtures/blends based on linear mixing operation, and the predictor maps the fingerprint to the target properties. Two different classes of UQ methods, Monte Carlo ensemble methods and Bayesian neural networks (BNNs), are employed for quantifying the epistemic uncertainty. Combinations of Bernoulli and Gaussian distributions with DropConnect and DropOut techniques are explored as ensemble methods. All the DropConnect, DropOut and Bayesian layers are applied to the predictor network. Aleatoric uncertainty is modeled by assuming that each data point has an independent uncertainty associated with it. The results of the UQ study are further analyzed to compare the performance of BNN and ensemble methods. Although this study is confined to UQ of fuel property prediction, the methodologies are applicable to other deep learning frameworks that are being widely used in the combustion community.

33 ADVANCED PROPULSION SYSTEMS↗

Evaluating causal‐based feature selection for fuel property prediction models

Abstract In‐silico screening of novel biofuel molecules based on chemical and fuel properties is a critical first step in the biofuel evaluation process due to the significant volumes of samples required for experimental testing, the destructive nature of engine tests, and the costs associated with bench‐scale synthesis of novel fuels. Predictive models are limited by training sets of few existing measurements, often containing similar classes of molecules that represent just a subset of the potential molecular fuel space. Software tools can be used to generate every possible molecular descriptor for use as input features, but most of these features are largely irrelevant and training models on datasets with higher dimensionality than size tends to yield poor predictive performance. Feature selection has been shown to improve machine learning models, but correlation‐based feature selection fails to provide scientific insight into the underlying mechanisms that determine structure–property relationships. The implementation of causal discovery in feature selection could potentially inform the biofuel design process while also improving model prediction accuracy and robustness to new data. In this study, we investigate the benefits causal‐based feature selection might have on both model performance and identification of key molecular substructures. We found that causal‐based feature selection performed on par with alternative filtration methods, and that a structural causal model provides valuable scientific insights into the relationships between molecular substructures and fuel properties.

Nguyen, Bernard↗

Assessing the Accuracy of Property Model Predictions for Cost Optimization of Desalination Technologies

Accurate modeling of seawater thermophysical and thermodynamic properties is critical for optimizing desalination processes. This study compares three seawater property models, a Reaktoro multicomponent model, the thermophysical seawater properties library from the Massachusetts Institute of Technology, and a simplified sodium chloride model, in the context of levelized cost of water (LCOW) minimization for reverse osmosis (RO) and mechanical vapor compression systems. Process simulations and cost optimizations reveal that although all three models yield comparable LCOW and specific energy consumption (SEC) estimates under baseline conditions, deviations among their predictions increase with salinity. Relative differences in LCOW and SEC reach up to 6% and 8%, respectively. RO results show greater variability due to differences in osmotic pressure predictions, which affect pressure constraints at high recoveries. Computational performance varies substantially; specifically, Reaktoro simulations are up to 28 times slower than empirical models due to their detailed equilibrium calculations. These results suggest that empirical models offer acceptable accuracy for routine desalination process design, while Reaktoro provides advantages in scenarios requiring detailed speciation, such as scaling or pH adjustment studies. These findings underscore the importance of selecting appropriate property models based on the modeling objective of desalination applications and motivate future work integrating thermodynamic rigor with empirical efficiency.

Physical and chemical properties↗

A comparison of arcjet plume properties to model predictions

This paper describes an experimental study of the plasma plume properties of a 1 kW class hydrogen arcjet thruster and the comparison of measured temperature and velocity field to model predictions. The experiments are based on laser-induced fluorescence excitation of the Balmer-alpha transition. The model is based on a single-fluid magnetohydrodynamic description of the flow originally developed to predict arcjet thruster performance. Excellent agreement between model predictions and experimental velocity is found, despite the complex nature of the flow. Measured and predicted exit plane temperatures are in disagreement by as much as 2000K over a range of operating conditions. The possible sources for this discrepancy are discussed.

Cappelli, M. A.↗

A structured framework for predicting sustainable aviation fuel properties using liquid-phase FTIR and machine learning

Sustainable aviation fuels have the potential to improve efficiency, reduce emissions, and enhance energy security. To help identify viable sustainable aviation fuels and accelerate research, machine learning models have been developed to predict relevant physicochemical properties. However, many models have limited applicability, leverage data from complex analytical techniques with confined spectral ranges, or use feature decomposition methods that offer limited interpretability. Using liquid-phase Fourier Transform Infrared (FTIR) spectra, this study presents a structured method for creating accurate and interpretable property prediction models for neat molecules, aviation fuels, and blends. Liquid FTIR spectra can be collected quickly and consistently, offering high reliability, sensitivity, and component specificity using less than 2 ml of sample. The method first decomposes FTIR spectra into fundamental building blocks using non-negative matrix factorization (NMF) to enable scientific analysis of FTIR spectra attributes and fuel properties. The NMF features are then used to create five ensemble models for predicting final boiling point, flash point, freezing point, density at 15°C, and kinematic viscosity at -20°C. All models were trained using experimental property data from neat molecules, aviation fuels, and blends. The models accurately predict key properties across a broad range of neat molecules and representative fuels and blends, while enabling interpretation of relationships between compositional elements, such as functional groups or chemical classes, and their resulting properties. This demonstrates strong potential to support sustainable aviation fuel research and development. The models and data are available on an interactive web tool.

Fourier transform infrared spectroscopy↗

A Deep Multimodal Representation Learning Framework for Accurate Molecular Properties Prediction

Drug discovery is a complex and challenging process, requiring the optimization of candidate compounds to identify those with the potential to become safe and effective drugs. Predicting molecular properties is an indispensable step in the drug discovery pipeline. Traditionally, this process is costly and time-intensive, involving multiple rounds of experiments and clinical trials, rendering it impractical for every candidate compound. Deep learning techniques have emerged as a promising approach to drug discovery to reduce the cost and time required to identify novel drugs. However, prevalent research in deep learning models focused on predicting molecular properties has primarily fixated on single-modal models, which utilize a single modality of data, neglecting the potential benefits of combining different data modalities. To overcome this limitation, we introduce MRL-Mol: a deep \textbf{M}ultimodal \textbf{R}epresentation \textbf{L}earning framework for accurate \textbf{Mol}ecular properties prediction. MRL-Mol harnesses three data modalities: sequence, graph, and image, augmenting the depth of comprehension. Leveraging a large-scale unlabeled dataset~($\sim$1M unique molecules), we pretrain MRL-Mol to extract inter- and intra-modal information. Our study demonstrates the superior performance of MRL-Mol in predicting molecular properties across six benchmark datasets, including both classification and regression tasks. Notably, MRL-Mol outperforms other state-of-the-art molecular properties prediction models. These findings suggest that by combining information from multiple data modalities, MRL-Mol can comprehend molecules better than single-modal deep learning models and identify molecular properties with better accuracy.

Yang, Yuxin↗

Glass Design Using Machine Learning Property Models with Prediction Uncertainties: Nuclear Waste Glass Formulation

The United States Department of Energy is responsible for managing the legacy nuclear waste stored in underground tanks at the Hanford Site. The waste will be separately vitrified as low-activity waste and high-level waste fractions. Waste glass formulation algorithms have been traditionally developed using partial quadratic mixture property-composition models. Recently, machine learning (ML) techniques have been used to predict glass properties and discover new glass materials for nuclear waste vitrification, and these advancements can be utilized to improve waste glass composition design. In this proof-of-principle study, ML algorithms such as Gaussian process regression (GPR) were used to interpolate glass properties (e.g., viscosity, electrical conductivity, chemical durability). After selecting appropriate sets of GPR hyper-parameters for each property, an optimization program was developed to formulate glass compositions to maximize waste loading while simultaneously satisfying property within constraints. The results of the ML-based waste loadings and glass compositions were compared to those obtained using the traditional methods. Comparing to the previous glass design framework, the ML-based optimization methods offer improved glass designs and a streamlined approach to generation of optimally designed data and near real-time updates.

glass formulation, machine learning, constraints, ↗

A predictive model for failure properties of thermoset resins

A predictive model for the three-dimensional failure behavior of engineering polymers has been developed in a recent NASA-sponsored research program. This model acknowledges the underlying molecular deformation mechanisms and thus accounts for the effects of different chemical compositions, crosslink density, functionality of the curing agent, etc., on the complete nonlinear stress-strain response including yield. The material parameters required by the model can be determined from test-tube quantities of a new resin in only a few days. Thus, we can obtain a first-order prediction of the applicability of a new resin for an advanced aerospace application without synthesizing the large quantities of material needed for failure testing. This technology will effect order-of-magnitude reductions in the time and expense required to develop new engineering polymers.

Caruthers, James M.↗

A systematic method for selecting molecular descriptors as features when training models for predicting physiochemical properties

Machine learning has proven to be a powerful tool for accelerating biofuel development. Although numerous models are available to predict a range of properties using chemical descriptors, there is a trade-off between interpretability and performance. Neural networks provide predictive models with high accuracy at the expense of some interpretability, while simpler models such as linear regression often lack in accuracy. In addition to model architecture, feature selection is also critical for developing interpretable and accurate predictive models. We present a method for systematically selecting molecular descriptor features and developing interpretable machine learning models without sacrificing accuracy. Our method simplifies the process of selecting features by reducing feature multicollinearity and enables discoveries of new relationships between global properties and molecular descriptors. To demonstrate our approach, we developed models for predicting melting point, boiling point, flash point, yield sooting index, and net heat of combustion with the help of the Tree-based Pipeline Optimization Tool (TPOT). For training, we used publicly available experimental data for up to 8351 molecules. Our models accurately predict various molecular properties for organic molecules (mean absolute percent error (MAPE) ranges from 3.3% to 10.5%) and provide a set of features that are well-correlated to the property. This method enables researchers to explore sets of features that significantly contribute to the prediction of the property, offering new scientific insights. To help accelerate early stage biofuel research and development, we also integrated the data and models into a open-source, interactive web tool.

09 BIOMASS FUELS↗

Comparison of Multiscale Method of Cells-Based Models for Predicting Elastic Properties of Filament Wound C/C-SiC

Three different multiscale models, based on the method of cells (generalized and high fidelity) micromechanics models were developed and used to predict the elastic properties of C/C-SiC composites. In particular, the following multiscale modeling strategies were employed: Concurrent multiscale modeling of all phases using the generalized method of cells, synergistic (two-way coupling in space) multiscale modeling with the generalized method of cells, and hierarchical (one-way coupling in space) multiscale modeling with the high fidelity generalized method of cells. The three models are validated against data from a hierarchical multiscale finite element model in the literature for a repeating unit cell of C/C-SiC. Furthermore, the multiscale models are used in conjunction with classical lamination theory to predict the stiffness of C/C-SiC plates manufactured via a wet filament winding and liquid silicon infiltration process recently developed by the German Aerospace Institute.

multiscale modeling↗

Transferring a Molecular Foundation Model for Polymer Property Predictions

Transformer-based large language models have remarkable potential to accelerate design optimization for applications such as drug development and material discovery. Self-supervised pretraining of transformer models requires large-scale data sets, which are often sparsely populated in topical areas such as polymer science. Further, state-of-the-art approaches for polymers conduct data augmentation to generate additional samples but unavoidably incur extra computational costs. In contrast, large-scale open-source data sets are available for small molecules and provide a potential solution to data scarcity through transfer learning. In this work, we show that using transformers pretrained on small molecules and fine-tuned on polymer properties achieves comparable accuracy to those trained on augmented polymer data sets for a series of benchmark prediction tasks.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A Model for Predicting Thermoelectric Properties of Bi2Te3

A parameterized orthogonal tight-binding mathematical model of the quantum electronic structure of the bismuth telluride molecule has been devised for use in conjunction with a semiclassical transport model in predicting the thermoelectric properties of doped bismuth telluride. This model is expected to be useful in designing and analyzing Bi2Te3 thermoelectric devices, including ones that contain such nano - structures as quantum wells and wires. In addition, the understanding gained in the use of this model can be expected to lead to the development of better models that could be useful for developing other thermoelectric materials and devices having enhanced thermoelectric properties. Bi2Te3 is one of the best bulk thermoelectric materials and is widely used in commercial thermoelectric devices. Most prior theoretical studies of the thermoelectric properties of Bi2Te3 have involved either continuum models or ab-initio models. Continuum models are computationally very efficient, but do not account for atomic-level effects. Ab-initio models are atomistic by definition, but do not scale well in that computation times increase excessively with increasing numbers of atoms. The present tight-binding model bridges the gap between the well-scalable but non-atomistic continuum models and the atomistic but poorly scalable ab-initio models: The present tight-binding model is atomistic, yet also computationally efficient because of the reduced (relative to an ab-initio model) number of basis orbitals and flexible parameterization of the Hamiltonian.

Lee, Seungwon↗

Geometrical modelling of textile reinforcements

The mechanical properties of textile composites are dictated by the arrangement of yarns contained within the material. Thus, to develop a comprehensive understanding of the performance of these materials, it is necessary to develop a geometrical model of the fabric structure. This task is quite complex, as the fabric is made from highly flexible yarn systems which experience a certain degree of compressibility. Furthermore there are tremendous forces acting on the fabric during densification typically resulting in yarn displacement and misorientation. The objective of this work is to develop a methodology for characterizing the geometry of yarns within a fabric structure including experimental techniques for evaluating these models. Furthermore, some applications of these geometric results to mechanical property predictions models are demonstrated.

Pastore, Christopher M.↗

Structural stability of thin overhanging walls during material extrusion additive manufacturing of thermoset-based ink

Recent developments have enabled material extrusion additive manufacturing of thermoset-based composite inks on the large scale. In addition, printing out-of-plane components is of broad interest to the polymer material extrusion community. Here, we address some of the challenges associated with both large-scale and out-of-plane thermoset material extrusion additive manufacturing by studying the height at which thin overhanging walls collapse. Walls at a range of overhang angles were printed until they collapsed. An optical camera captured the profile of each wall throughout the print, allowing the collapse height to be identified and the geometric fidelity to the programmed angle to be evaluated. Using previously measured rheological properties, predictive models were generated to approximate the collapse height and profile of the deflected walls. First, an analytical model was created to predict the height at which the walls would yield. The analytical model assumes the walls exhibit a perfectly linear profile; however, experiments proved this assumption to be false. Therefore, a finite element simulation was developed to account for the elastic deflection that occurs during printing. The finite element simulation predicts both the yield height and the deflected profile after the deposition of each layer. For the properties of the thermoset ink used here, the yield height predicted by the analytical model and finite element simulation are virtually identical. These predictions match experimental data reasonably well, but minor errors are observed. Accounting for the fully plastic moment appears to explain the small mismatch between experimental data and predictions. Additionally, the finite element simulation provides an excellent prediction of the deflected profile before the wall begins to collapse. Finally, by demonstrating that the collapse height and deflected profile of thin overhanging walls can be predicted, this work illustrates how the soft viscoelastic properties of thermoset-based composite inks limit the scale of a key feature required to print some nonplanar components. It also provides a basis to tailor in-process curing systems to suppress deflection and collapse of thin overhanging walls.

36 MATERIALS SCIENCE↗

Feedstock to Function (F2F) v1

The Feedstock to Function (F2F) tool was designed to help scientists and companies explore viable biofuels and bioproducts early in the R&D cycle to support more productive experimentation, while reducing early-stage exploration from months/years to days/weeks (feedstock-to-function.lbl.gov). The tool focuses on using machine learning to predict biomass-derived molecule properties, while evaluating the cost, benefits, and risks of promising molecules for sustainable aviation fuels. The tool successfully predicts (within 15% of experimental values) high-throughput aviation properties for over 10,000 molecules while enabling users to explore new possibilities and opportunities rapidly and effortlessly. It also links to lightweight life-cycle analysis and techno-economic tools for cost and emissions analyses. Predicted molecule properties include melting point, boiling point, flash point, yield sooting index, and heat of combustion. To date, F2F is more expansive and outperforms several other molecule property prediction models while enabling users (scientists, companies, and policy makers) to explore new possibilities and opportunities rapidly and effortlessly. F2F provides the foundation for developing an adaptive computational tool that predicts properties, cost, benefits, and risk of promising new and uncertified alternative jet fuel pathways and their blending effects.

Rapp, Vi↗

Multi-Scale Modeling of Liquid Phase Sintering Affected by Gravity: Preliminary Analysis

A multi-scale simulation concept taking into account impact of gravity on liquid phase sintering is described. The gravity influence can be included at both the micro- and macro-scales. At the micro-scale, the diffusion mass-transport is directionally modified in the framework of kinetic Monte-Carlo simulations to include the impact of gravity. The micro-scale simulations can provide the values of the constitutive parameters for macroscopic sintering simulations. At the macro-scale, we are attempting to embed a continuum model of sintering into a finite-element framework that includes the gravity forces and substrate friction. If successful, the finite elements analysis will enable predictions relevant to space-based processing, including size and shape and property predictions. Model experiments are underway to support the models via extraction of viscosity moduli versus composition, particle size, heating rate, temperature and time.

Olevsky, Eugene↗

TransPolymer: a Transformer-based language model for polymer property predictions

Accurate and efficient prediction of polymer properties is of great significance in polymer design. Conventionally, expensive and time-consuming experiments or simulations are required to evaluate polymer functions. Recently, Transformer models, equipped with self-attention mechanisms, have exhibited superior performance in natural language processing. However, such methods have not been investigated in polymer sciences. Herein, we report TransPolymer, a Transformer-based language model for polymer property prediction. Our proposed polymer tokenizer with chemical awareness enables learning representations from polymer sequences. Rigorous experiments on ten polymer property prediction benchmarks demonstrate the superior performance of TransPolymer. Moreover, we show that TransPolymer benefits from pretraining on large unlabeled dataset via Masked Language Modeling. Experimental results further manifest the important role of self-attention in modeling polymer sequences. We highlight this model as a promising computational tool for promoting rational polymer design and understanding structure-property relationships from a data science view.

36 MATERIALS SCIENCE↗