Search NASA⌕ Search

SEARCH · Search NASA

Results for “structured machine learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,765 records · Page 98

Molecular simulation and artificial intelligence for the circular economy of bioenergy and bioproducts

The concept of the circular bioeconomy is a carbon neutral, sustainable system with zero waste. One vision for such an economy is based upon lignocellulosic biomass. This lignocellulosic circular bioeconomy requires CO 2 absorption from biomass growth and the efficient deconstruction of recalcitrant biomass into solubilized and fractionated biopolymers, which are then used as precursors for the sustainable production of high-quality liquid fuels, chemical bioproducts, and bio-based materials. Here, in this study, we summarize the roles that molecular dynamics (MD) simulations and machine learning (ML) are playing in overcoming several fundamental challenges hindering the adoption of a circular bioeconomy. Specifically, we discuss the role of MD and ML/AI in overcoming lignocellulose recalcitrance by designing biomass pretreatment methods to efficiently produce solubilized cellulose/lignin/hemicellulose and of that in improving energy-intensive manufacturing of biomass-based materials and their structural and mechanical properties. Quantum mechanical methods and MD simulations, in addition to offering a mechanistic understanding of biomass deconstruction and biomaterials design, can provide meaningful structural, energetics, and physiochemical properties as inputs to train AI/ML models. The ML models can guide the experimental prioritization of materials/solvents and process parameters that significantly accelerate the development of biofuel and biomaterial components of the circular bioeconomy.

Smith, Jeremy C. [Oak Ridge National Laboratory (O↗

Tracking the phase changes in micelle-based NiGa nanocatalysts for methanol synthesis under activation and working conditions

The hydrogenation of CO 2 into high energy density fuels such as methanol, where the required H 2 is obtained from renewable sources, is of utmost importance for a sustainable society. In recent years, NiGa alloys have attracted attention as promising catalyst material systems for the hydrogenation of CO 2 into methanol at ambient pressures. They thus represent an energy-saving alternative to the Cu-based catalysts employed in today's catalytic industry that require high pressures for the CO 2 hydrogenation. However, the underlying reaction mechanisms for the NiGa system are still under debate. One of the challenges here is to unravel the evolution and coexistence of the different species in the heterogeneous NiGa catalyst system under activation and reaction conditions. To shed light on their evolution under activation in H 2 and their catalytic roles under CO 2 hydrogenation working conditions on well-defined Ni 3 Ga 1 and Ni 5 Ga 3 nanoparticle (NP) catalysts, we employed a multi-probe approach in this study. It included advanced machine learning-based analysis of operando X-ray absorption spectroscopy data combined with operando powder X-ray diffraction and near ambient pressure X-ray photoelectron spectroscopy measurements, as well as reactivity studies using bed-packed mass flow reactors. In addition, we employed atomic force microscopy and scanning transmission electron microscopy for structural characterization. Under H 2 activation at 1 bar total pressure, we concluded the formation of metallic Ni, starting for Ni 3 Ga 1 at 300 °C, and for Ni 5 Ga 3 at 400 °C. At higher temperatures, the formation of NiGa alloys follows. The α'-Ni 3 Ga 1 alloy phase is predominantly formed for the Ni 3 Ga 1 NPs, while the coexistence of α'-Ni 3 Ga 1 , δ-Ni 5 Ga 3 and Ga 2 O 3 phases is observed for the Ni 5 Ga 3 NPs after the H 2 activation. The formation of the Ga 2 O 3 phase also results in the presence of excess metallic Ni. Under CO 2 hydrogenation reaction conditions, Ga partially oxidizes again to form a Ga 2 O 3 -rich particle shell for both NP compositions, yet, to a larger extent for the Ni 3 Ga 1 NPs, which, in turn, feature a higher amount of excess Ni. We reveal that metallic Ni is responsible for the high selectivity of the Ni 3 Ga 1 NPs towards the production of methane in our catalytic tests. In contrast, the Ni 5 Ga 3 NPs display a strong selectivity toward methanol production (>92%), more than one order of magnitude higher than that for the Ni 3 Ga 1 NPs, which we ascribe to the presence of the δ-Ni 5 Ga 3 phase.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Development of a Filtered CFD-DEM Drag Model with Multiscale Markers Using an Artificial Neural Network and Nonlinear Regression

Here, the accuracy of coarse-grained Euler-Lagrangian simulations of fluidized beds heavily depends on the mesoscale drag models to account for the influences of the unresolved sub-grid structures. Traditional filtered drag models are regressed with mesoscale markers such as voidage and slip velocities. In this research, a filtered drag was regressed with both mesoscale and macro-scale markers using fine grid Computational Fluid Dynamics - Discrete Element Method (CFD-DEM) simulations. The traditional non-linear regression method was compared with machine learning regression using an Artificial Neural Network (ANN) implemented in PyTorch and coupled with MFiX. The new drag showed higher accuracy than the Wen-Yu drag and another filtered drag derived from the two-fluid model. The nonlinear regression shows slightly better results than ANN regression in cases with similar R 2 values. The utilization of the gas inlet velocity as an additional macro-scale marker reduced the errors by up to 55.3% in the tested cases.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Forecasting Marine Sediment Properties with Geospatial Machine Learning

Using a combination of geospatial machine learning prediction and sediment thermodynamic/physical modeling, we have developed a novel software workflow to create probabilistic maps of geoacoustic and geomechanical sediment properties of the global seabed. This new technique for producing reliable estimates of seafloor properties can better support Naval operations relying on sonar performance and seabed strength, can constrain models of shallow tomographic structure important for nuclear treaty compliance monitoring/detection, and can provide constraints on the distribution and inventory of shallow methane gas and gas hydrate accumulations on the continental shelves.

58 GEOSCIENCES↗

Prediction of Specificity of α-Conotoxins to Subtypes of Human Nicotinic Acetylcholine Receptors with Semi-supervised Machine Learning

Conotoxins are a family of highly toxic neurotoxins composed of cysteine-rich peptides produced by marine cone snails. The most lethal cone snail species to humans is Conus geographus, with fatality rates of up to ∼65% from a single sting, which is caused mostly by the activity of α-conotoxins against human nicotinic acetylcholine receptors (nAChRs). While sequence-based machine learning (ML) classifiers have been trained to identify targets of conotoxins binding voltage-gated ion channels, no ML model has been built to predict the subtype-specific nAChR targets of α-conotoxins. Here, we trained an ML model in a semi-supervised manner to predict the specificity of α-conotoxin binding toward different human nAChR subtypes to overcome the challenge of limited data in subtype-specific nAChR targets of α-conotoxins and the issue that one α-conotoxin can bind multiple nAChR subtypes with high selectivity. We considered additional features of sequences of α-conotoxins in training our ML model, including the secondary structure propensities and electrostatic properties, which resulted in better prediction capability for the ML model. Notably, we identify that most α-conotoxins bind to α3β2, α1γδ, and α7 subtypes of human nAChRs. Our findings from this study provide a framework for predicting targets of various kinds of toxins.

59 BASIC BIOLOGICAL SCIENCES↗

Interface learning of multiphysics and multiscale systems

Complex natural or engineered systems comprise multiple characteristic scales, multiple spatiotemporal domains, and even multiple physical closure laws. To address such challenges, we introduce an interface learning paradigm and put forth a data-driven closure approach based on memory embedding to provide physically correct boundary conditions at the interface. To enable the interface learning for hyperbolic systems by considering the domain of influence and wave structures into account, we put forth the concept of upwind learning toward a physics-informed domain decomposition. The promise of the proposed approach is shown for a set of canonical illustrative problems. Here, we highlight that high-performance computing environments can benefit from this methodology to reduce communication costs among processing units in emerging machine-learning-ready heterogeneous platforms toward exascale era.

42 ENGINEERING↗

Confidentiality-preserving machine learning algorithms for soft-failure detection in optical communication networks

Automated fault management is at the forefront of next-generation optical communication networks. The increase in complexity of modern networks has triggered the need for programmable and software-driven architectures to support the operation of agile and self-managed systems. In these scenarios, the European Telecommunications Standards Institute zero-touch network and service management approach is imperative. The need for machine learning algorithms to process the large volume of telemetry data brings safety concerns as distributed cloud-computing solutions become the preferred approach for deploying reliable communication network automation. This paper’s contribution is twofold. First, we propose a simple yet effective method to guarantee the confidentiality of the telemetry data based on feature scrambling. The method allows the operation of third-party computational services without direct access to the full content of the collected data. Additionally, the effectiveness of four unsupervised machine learning algorithms for soft-failure detection is evaluated when applied to the scrambled telemetry data. The methods are based on factor analysis, principal component analysis, nonlinear principal component analysis, and singular value decomposition. Most dimensionality reduction algorithms have the common property that they can maintain similar levels of fault classification performance while hiding the data structure from unauthorized access. Evaluations of the proposed algorithms demonstrate this capability.

97 MATHEMATICS AND COMPUTING↗

Optimal Adsorbents for Low-Cost Storage of Natural Gas and Hyd: Computational Identification, Experimental Demonstration, and System-Level Projection

This research program will develop best-in-class natural gas (NG) and hydrogen adsorbents based on metal-organic frameworks (MOFs). More specifically, high-throughput computational screening coupled to machine learning will be used to identify MOFs that simultaneously achieve high usable gravimetric and volumetric capacities for methane and hydrogen. The most promising materials pinpointed by computation will be synthesized and characterized experimentally. In addition, the final stage of the project will critically evaluate the use of methane as a model for NG and consider which structural features are most important in making a viable NG storage system.

03 NATURAL GAS↗

Machine Learning for Multipactor Susceptibility Prediction in Planar RF Gaps

Multipactor discharge is a nonlinear electron avalanche that limits the performance of high-power radio-frequency (RF) and vacuum electronic devices. Predicting multipactor susceptibility traditionally relies on Monte Carlo or particle-in-cell (PIC) simulations, which become computationally expensive for large parametric studies. In this work, we present a supervised machine-learning (ML) framework for prediction of multipactor susceptibility in a two-surface planar geometry. The models are trained using high-fidelity PIC simulation generated susceptibility data and learn the relationship between operational parameters, geometry, and material-dependent secondary electron emission properties. The proposed approach enables rapid reconstruction of susceptibility charts while preserving the physical structure of multipactor growth regions.

43 PARTICLE ACCELERATORS↗

Co-optimized machine-learned manifold models for large eddy simulation of turbulent combustion

Many modeling approaches in large eddy simulation (LES) of turbulent combustion employ a projection of the thermochemical state onto a low-dimensional manifold within state space to reduce the number of transported variables and hence computational cost. Flamelet-generated manifolds (FGM) is an example of a well-established, physics-based approach, but increasingly, principal component analysis (PCA) is being used as a data-driven method for generating manifold models. For both approaches, the nonlinear relationship between the location on the predefined manifold and the outputs of interest, such as reaction rates, can be tabulated or encoded in a neural network. This work proposes a new approach for manifold modeling that extends these existing approaches. A modified neural network structure simultaneously encodes the definition of the manifold variables, the nonlinear mapping, and the subfilter closure for LES. This allows all three of these aspects of the model to be co-optimized, generating a model from any source of combustion thermochemical state data. The manifold parameterizing variables are constrained to be linear combinations of species, as in FGM and PCA-based models, to aid in interpretability and implementation. For LES, subfilter variances of the manifold variables are also included as inputs. Two types of a priori analysis are performed to evaluate the new approach. In the first, the model is trained on data from one-dimensional premixed flames. In this case, the approach recovers the behavior of flamelet-based manifold approaches, and in fact slightly improves performance by identifying an optimized progress variable. The approach is also applied to data from direct numerical simulations of spherical ignition kernels in isotropic turbulence. For any specified manifold dimensionality, the new approach provides substantially lower prediction errors than a PCA-based model developed from the same data set. Additionally, the LES formulation of the new approach can provide accurate predictions for filtered reaction rates across a variety of filter widths.

97 MATHEMATICS AND COMPUTING↗

Autonomous Aerosol and Plasma Co‐Jet Printing of Metallic Devices at Ambient Temperature

Abstract Additive manufacturing of metallic materials holds the potential to revolutionize the fabrication of functional devices unattainable via traditional methods. Despite recent advancements, printing metallic materials typically requires thermal processing at elevated temperatures to form dense structures with desired properties, which presents a major challenge for direct printing and integration with temperature‐sensitive materials. Herein, a unique co‐jet printing (CJP) method is reported integrating an aerosol jet and a non‐thermal, atmospheric pressure plasma jet to enable concurrent aerosol deposition of metal nanoparticle inks and in situ sintering at ambient temperature. A machine learning algorithm is integrated with the CJP to perform real‐time defect detection and autonomous correction, enhancing the yield of printed films with high electrical conductivity from 44% to 94%. Concurrent printing and sintering eliminate the need for post‐printing processing, reducing the overall manufacturing time by multiple folds depending on product size. CJP enables direct printing of functional devices on a variety of temperature‐sensitive materials including biological materials. Direct printing of hydration sensors on living plant leaves is demonstrated for long‐duration monitoring of hydration level in the plant. The versatile CJP method opens tremendous opportunities to harmoniously integrate abiotic and biotic materials for emerging applications in wearable/implantable devices and biohybrid systems.

Du, Yipu [Department of Aerospace and Mechanical E↗

Machine learned features from density of states for accurate adsorption energy prediction

Materials databases generated by high-throughput computational screening, typically using density functional theory (DFT), have become valuable resources for discovering new heterogeneous catalysts, though the computational cost associated with generating them presents a crucial roadblock. Hence there is a significant demand for developing descriptors or features, in lieu of DFT, to accurately predict catalytic properties, such as adsorption energies. Here, we demonstrate an approach to predict energies using a convolutional neural network-based machine learning model to automatically obtain key features from the electronic density of states (DOS). The model, DOSnet, is evaluated for a diverse set of adsorbates and surfaces, yielding a mean absolute error on the order of 0.1 eV. In addition, DOSnet can provide physically meaningful predictions and insights by predicting responses to external perturbations to the electronic structure without additional DFT calculations, paving the way for the accelerated discovery of materials and catalysts by exploration of the electronic space.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Validation of new and existing methods for time-domain simulations of turbulence and loads

We seek to obtain a second-by-second match between the simulated and measured structural loads of a utility-scale wind turbine. To obtain the one-to-one load simulations, we start with the furthest upstream component of the modeling chain: the turbulent inflow. We consider new and existing methods to generate constrained-turbulence flow fields. The new method is based on large-eddy simulations (LES) and machine learning (ML). The existing methods include Kaimal-based TurbSim and the superstatistical wind field model. The inflow measurements used to constrain these simulations are obtained with a nacelle-mounted scanning lidar. We compare the flow fields for the different inflow simulation approaches and validate their associated load predictions against measurements collected in the Rotor Aero-dynamics, Aeroelastics, and Wake (RAAW) field campaign. We find that the rotor-position control developed for this study is key in enabling the time match between measurements and simulations. When this control approach is used, the load simulation performance tracks with the inflow simulation fidelity, with LES+ML yielding errors ≤ 4% for the damage-equivalent loads of flapwise bending moment, and tower fore-aft bending moments.

17 WIND ENERGY↗

AdenPredictor: accurate prediction of the adenylation domain specificity of nonribosomal peptide biosynthetic gene clusters in microbial genomes

Microbial natural products represent a major source of bioactive compounds for drug discovery. Among these molecules, nonribosomal peptides (NRPs) represent a diverse class that include antibiotics, immunosuppressants, anticancer agents, toxins, siderophores, pigments, and cytostatics. The discovery of novel NRPs remains a laborious process because many NRPs consist of nonstandard amino acids that are assembled by nonribosomal peptide synthetases (NRPSs). Adenylation domains (A-domains) in NRPSs are responsible for selection and activation of monomers appearing in NRPs. During the past decade, several support vector machine-based algorithms have been developed for predicting the specificity of the monomers present in NRPs. These algorithms utilize physiochemical features of the amino acids present in the A-domains of NRPSs. In this article, we benchmarked the performance of various machine learning algorithms and features for predicting specificities of NRPSs and we showed that the extra trees model paired with one-hot encoding features outperforms the existing approaches. Moreover, we show that unsupervised clustering of 453560 A-domains reveals many clusters that correspond to potentially novel amino acids. While it is challenging to predict the chemical structure of these amino acids, we developed novel techniques to predict their various properties, including polarity, hydrophobicity, charge, and presence of aromatic rings, carboxyl, and hydroxyl groups.

59 BASIC BIOLOGICAL SCIENCES↗

ODI notebook additive_manufacturing_video_2022

Additive Manufacturing, video dataset Two-photon lithography (TPL) is a widely used 3D nanoprinting technique that uses laser light to create objects. Challenges to large-scale adoption of this additive manufacturing method include identifying light dosage parameters and monitoring during fabrication. A research team from LLNL, Iowa State University, and Georgia Tech is applying machine learning models to tackle these challenges-i.e., accelerate the process of identifying optimal light dosage parameters and automate the detection of part quality. Funded by LLNL's Laboratory Directed Research and Development Program, the project team has curated a video dataset of TPL processes for parameters such as light dosages, photo-curable resins, and structures. Both raw and labeled versions of the datasets are available on the links in the Open Data Initiative page. The code uses the labeled dataset. Notebook compiled by Nisha Mulakken (mulakken1@llnl.gov) for LLNL Open Data Initiative, Summer 2022. Original code provided by research team. Publications: X.Y. Lee, S.K. Saha, S. Sarkar, B. Giera. "Automated detection of part quality during two-photon lithography via deep learning." Additive Manufacturing 36, December 2020: doi.org/10.1016/j.addma.2020.101444 X.Y. Lee, S.K. Saha, S. Sarkar, B. Giera. "wo Photon lithography additive manufacturing: Video dataset of parameter sweep of light dosages, photo-curable resins, and structures." Data in Brief 32, October 2020. doi.org/10.1016/j.dib.2020.106119.

Mulakken, NishaJ↗

OmicsMLMentor: A Web Application for Guided Machine Learning Analysis of Omics Data

Expression-based omics technologies (e.g. proteomics, metabolomics, transcriptomics, etc.) increasingly rely on supervised and unsupervised machine learning (ML) models to find key biomolecules distinguishing conditions, identify natural groupings in biological data, or generate predictions for outcomes of interest. Fitting ML models to omics data presents several challenges, including handling missing data, selecting a normalization method, choosing a valid model, and optimizing hyperparameters, all requiring statistical programming skills to address these challenges. Thus, the open-source web application SLOPE was designed to lower the barrier to ML modeling for omics data. SLOPE supports the fitting of 15 ML models (10 supervised and 5 unsupervised) tailored to omics datasets, such as proteomics, metabolomics, lipidomics, and transcriptomics. SLOPE offers several omics-specific features, including methods for handling missingness (imputation, conversion, removal), normalization tests, ranking of models based on the structure of a user’s data and user input, and optimal hyperparameter selections using cross-validation splits. By streamlining ML workflows for omics analysis, SLOPE address critical gaps in existing online web tools, facilitating a broader adoption of these models for omics research. Here, SLOPE is applied to data from a lignin exposure study to highlight the workflow for fitting both supervised and unsupervised models to data.

lipidomics↗

Graph Learning in Knowledge Bases

The amount of text data has been growing exponentially in recent years, giving rise to automatic information extraction methods that store text annotations in a database. The current state-of-theart structured prediction methods, however, are likely to contain errors and it’s important to be able to manage the overall uncertainty of the database. On the other hand, the advent of crowdsourcing has enabled humans to aid machine algorithms at scale. As part of this project we introduced pi-CASTLE , a system that optimizes and integrates human and machine computing as applied to a complex structured prediction problem involving conditional random fields (CRFs). We proposed strategies grounded in information theory to select a token subset, formulate questions for the crowd to label, and integrate these labelings back into the database using a method of constrained inference. On both a text segmentation task over academic citations and a named entity recognition task over tweets we showed an order of magnitude improvement in accuracy gain over baseline methods.

97 MATHEMATICS AND COMPUTING↗

Machine-Learned Manifold-Based Models for Large Eddy Simulation of Turbulent Combustion

Reduced-order manifold combustion models are commonly used to lower the cost of reacting Large Eddy Simulations (LES) and may be derived either from physical principles as in flamelet models or from data-driven methods like Principal Component Analysis (PCA). In either case, neural networks are increasingly used as part of these models to provide a nonlinear mapping between a small set of pre-defined variables that parameterize the manifold and outputs of interest, such as reaction rates. In this work, we propose a new manifold-based modeling approach that combines the definition of the manifold-parameterizing variables (linear combinations of species), the nonlinear mapping to the outputs, and closure of filtered quantities for LES into the structure of a single neural network. This allows the process used to train the neural network to simultaneously optimize both the functional form of the model and the identities of the inputs to the model. The new approach can flexibly incorporate thermochemical data from any combustion system; if trained on data from 1D flames it can be interpreted as an optimized flamelet model, but it can also be used to learn models from data from more complex configurations. This work presents a priori evaluations of the new approach in both contexts. Evaluation using data from 1D premixed flames demonstrates the physical interpretability of the manifold variables generated by the new approach. Evaluation using data from direct numerical simulations of turbulent flames shows improved predictions relative to either flamelet or PCA-based models in a more complex configuration.

47 OTHER INSTRUMENTATION↗