Search NASA⌕ Search

SEARCH · Search NASA

Results for “structured machine learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,657 records · Page 92
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

A Look at the Truths and Misconceptions of the Variational Quantum Eigensolver and the Implications of Overparameterization

In this work, we investigate loss landscapes of the variational quantum eigensolver (VQE) by quantifying the number of local minima through empirical analyses. We focus on minimal models in chemistry and physics so that we can do a complete analysis using more computationally expensive tools. We employ Hessian eigenvalue calculations and the nudged elastic band algorithm to characterize these landscapes. Our results expand upon the existing literature by highlighting the optimization challenges faced by VQE. We find that, as the number of parameters in our ansatz increases, the number of basins increases while the corresponding loss function values converge toward the global minimum value. This observation implies that overparameterization may lead to an ``effective convexity'' in VQE loss landscapes, a phenomenon supported by theoretical and numerical work in classical machine learning.

quantum computing↗
DOE OSTI2018

Development of formalisms based on locally coupled open subsystems for calculations in molecular electronic structure and dynamics

Quantum embedding theories model a collection of interacting molecules as a set of subsystems, where each can be treated with a particular electronic structure method (wave function or density functional theory, for example); these theories can lead to computationally efficient and accurate algorithms. Motivated by challenges in the field, we previously described a formalism (that models two subsystems), which we call “locally coupled open subsystems” (LCOS), for the computation of ground-state energies, fractional electron-occupation numbers of the subsystems, and the size-consistent limit of subsystem dissociation. In this work we present the full (nonrelativistic) LCOS theory and the following extensions of our previous work: (i) the framework to study systems composed of multiple subsystems and a procedure to spin-adapt the auxiliary wave function that describes the partitioned system, so that its spin state matches that of the real system of interest; (ii) potential functionals and ideas to employ machine learning for the computation of ground-state densities and energies; (iii) formulation of two LCOS ground-state approaches where the fragments are assigned Kohn-Sham wave functions; and (iv) a time-dependent (TD) extension of these two ground-state formalisms in which the state of the subsystems evolves according to a unitary propagation; from this evolution we can extract TD electron populations of the fragments, for instance. We also discuss potential applications of the TD LCOS theory to linear photoabsorption and Raman spectroscopy. As a result, the developments presented in this work can lead to ground-state and TD electronic structure calculations where the computational scaling can be controlled, depending on the level of theory and the accuracy desired to model each one of the subsystems and their coupling.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2023

Dimensionally reduced machine learning model for predicting single component octanol–water partition coefficients

Abstract MF-LOGP, a new method for determining a single component octanol–water partition coefficients ( $$LogP$$ LogP ) is presented which uses molecular formula as the only input. Octanol–water partition coefficients are useful in many applications, ranging from environmental fate and drug delivery. Currently, partition coefficients are either experimentally measured or predicted as a function of structural fragments, topological descriptors, or thermodynamic properties known or calculated from precise molecular structures. The MF-LOGP method presented here differs from classical methods as it does not require any structural information and uses molecular formula as the sole model input. MF-LOGP is therefore useful for situations in which the structure is unknown or where the use of a low dimensional, easily automatable, and computationally inexpensive calculations is required. MF-LOGP is a random forest algorithm that is trained and tested on 15,377 data points, using 10 features derived from the molecular formula to make $$LogP$$ LogP predictions. Using an independent validation set of 2713 data points, MF-LOGP was found to have an average $$RMSE$$ RMSE = 0.77 ± 0.007, $$MAE$$ MAE = 0.52 ± 0.003, and $${R}^{2}$$ R 2 = 0.83 ± 0.003. This performance fell within the spectrum of performances reported in the published literature for conventional higher dimensional models ( $$RMSE$$ RMSE = 0.42–1.54, $$MAE$$ MAE = 0.09–1.07, and $${R}^{2}$$ R 2 = 0.32–0.95). Compared with existing models, MF-LOGP requires a maximum of ten features and no structural information, thereby providing a practical and yet predictive tool. The development of MF-LOGP provides the groundwork for development of more physical prediction models leveraging big data analytical methods or complex multicomponent mixtures. Graphical Abstract

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

First principles study of the electronic structure of the Ni 2 MnIn / InAs and Ti 2 MnIn / InSb interfaces

We present a first principles study of the electronic and magnetic properties of epitaxial interfaces between the Heusler compounds, Ti 2 MnIn and Ni 2 MnIn, and the III-V semiconductors, InSb and InAs, respectively. We use density functional theory (DFT) with a machine-learned Hubbard U correction determined by Bayesian optimization. Here, we evaluate these interfaces for prospective applications in Majorana-based quantum computing and spintronics. In both interfaces, states from the Heusler penetrate into the gap of the semiconductor, decaying within a few atomic layers. The magnetic interactions at the interface are weak and local in space and energy. Magnetic moments of less than 0.1 µB are induced in the two atomic layers closest to the interface. The induced spin polarization around the Fermi level of the semiconductor decays within a few atomic layers. The decisive factor for the induced spin polarization around the Fermi level of the semiconductor is the spin polarization around the Fermi level in the Heusler, rather than the overall magnetic moment. As a result, the ferrimagnetic narrow-gap semiconductor Ti 2 MnIn induces a more significant spin polarization in the InSb than the ferromagnetic metal Ni 2 MnIn induces in the InAs. This is explained by the position of the transition metal d states in the Heusler with respect to the Fermi level. Based on our results, these interfaces are unlikely to be useful for Majorana devices but could be of interest for spintronics.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Differentiable physics-enabled closure modeling for Burgers’ turbulence

Abstract Data-driven turbulence modeling is experiencing a surge in interest following algorithmic and hardware developments in the data sciences. We discuss an approach using the differentiable physics paradigm that combines known physics with machine learning to develop closure models for Burgers’ turbulence. We consider the one-dimensional Burgers system as a prototypical test problem for modeling the unresolved terms in advection-dominated turbulence problems. We train a series of models that incorporate varying degrees of physical assumptions on an a posteriori loss function to test the efficacy of models across a range of system parameters, including viscosity, time, and grid resolution. We find that constraining models with inductive biases in the form of partial differential equations that contain known physics or existing closure approaches produces highly data-efficient, accurate, and generalizable models, outperforming state-of-the-art baselines. Addition of structure in the form of physics information also brings a level of interpretability to the models, potentially offering a stepping stone to the future of closure modeling.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Atomic cluster expansion potential for large scale simulations of hydrocarbons under shock compression

We present an Atomic Cluster Expansion (ACE) machine learned potential developed for high-fidelity atomistic simulations of hydrocarbons, targeting pressures and temperatures near and above supercritical fluid regimes for molecular fluids. A diverse set of stoichiometries were covered in training, including 1:0 (pure carbon), 1:4 (methane), and 1:1 (benzene), and rich bonding environments sampled at supercritical temperatures, hydrogen rich, reactive mixtures where metastable stoichiometries arise, including 1:2 (ethylene) and 1:3 (ethane). A high-fidelity training database was constructed by performing large-scale quantum molecular dynamic simulations [density functional theory (DFT) MD] of diamond, graphite, methane, and benzene. A novel approach to selecting structures from DFT MD is also presented, which allows for the rapid selection of unique DFT MD frames from complex trajectories. Comparisons to DFT and experimental data demonstrate that the presented ACE potential accurately reproduces isotherms, carbon melting curves, radial distribution functions, and shock Hugoniots for carbon and hydrocarbon systems for pressures up to 100 GPa and temperatures up to 6000 K for hydrocarbon systems and up to 9000 K for pure carbon systems. This work delivers a potential that can be used for accurate, large-scale simulations of shocked hydrocarbons and demonstrates a methodology for fitting and validating machine learning interatomic potentials to complex molecular environments, which can be applied to energetic materials in future works.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Classification Analytics of Pu-239 and U-235 Source Signatures Using Gamma Spectral Regions

Machine learning detection methods using gamma signatures from spectral measurements of low-intensity Pu-239 and U-235 sources are studied. NaI detectors located at different distances fromthe source have been used to collect the training and independent testing data sets. The source is introduced via a shielded conduit into the facility where it is surrounded by 21 NaI detectors deployed over 6 x 6 meters area in the formation of two concentric circles and a spiral. The counts in gamma spectral regions associated with these two sources are estimated at 1 second intervals for each NaI detector, and are used as classifier features for detecting the source presence. Eight different classifiers with five basic properties — namely, smooth, non-smooth, statistical, structural, and hyper-parameter tuning — are trained and tested using the background and source measurements collected over multiple experimental runs. While the overall classifier performance improved as detectors closer to the source are used, some identically produced detectors under-performed but differently between two sources. Some classifiers achieved lower training error but their testing error based on independent measurements is higher for both sources. Overall, these results indicate significant over-fitting by these methods, and illustrate the complexity of training and selecting the machine learning methods to solve these detection problems.

Rao, Nageswara↗
DOE OSTI2023

Deep learning symmetries and their Lie groups, algebras, and subalgebras from first principles

Abstract We design a deep-learning algorithm for the discovery and identification of the continuous group of symmetries present in a labeled dataset. We use fully connected neural networks to model the symmetry transformations and the corresponding generators. The constructed loss functions ensure that the applied transformations are symmetries and the corresponding set of generators forms a closed (sub)algebra. Our procedure is validated with several examples illustrating different types of conserved quantities preserved by symmetry. In the process of deriving the full set of symmetries, we analyze the complete subgroup structure of the rotation groups SO (2), SO (3), and SO (4), and of the Lorentz group S O ( 1 , 3 ) . Other examples include squeeze mapping, piecewise discontinuous labels, and SO (10), demonstrating that our method is completely general, with many possible applications in physics and data science. Our study also opens the door for using a machine learning approach in the mathematical study of Lie groups and their properties.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

Self-Taught Anomaly Detection With Hybrid Unsupervised/Supervised Machine Learning in Optical Networks

Here this paper proposes a self-taught anomaly detection framework for optical networks. The proposed framework makes use of a hybrid unsupervised and supervised machine learning scheme. First, it employs an unsupervised data clustering module (DCM) to analyze the patterns of monitoring data. The DCM enables a self-learning capability that eliminates the requirement of prior knowledge of abnormal network behaviors and therefore can potentially detect unforeseen anomalies. Second, we introduce a self-taught mechanism that transfers the patterns learned by the DCM to a supervised data regression and classification module (DRCM). The DRCM, whose complexity is mainly related to the scale of the applied supervised learning model, can potentially facilitate more scalable and time-efficient online anomaly detection by avoiding excessively traversing the original dataset. We designed the DCM and DRCM based on the density-based clustering algorithm and the deep neural network structure, respectively. Evaluations with experimental data from two use cases (i.e., single-point detection and end-to-end detection) demonstrate that up to 99% anomaly detection accuracy can be achieved with a false positive rate below 1%.

42 ENGINEERING↗
DOE OSTI2025

Machine learning-assisted design of metal–organic frameworks for hydrogen storage: A high-throughput screening and experimental approach

Various theoretical approaches, including big data and high-throughput screening techniques, have been explored in developing new materials due to their significant potential time-saving advantages. However, it remains a significant challenge to experimentally realize new materials that are predicted. In this study, we propose a novel materials design strategy that utilizes machine-learning (ML) techniques to predict new porous materials that show promise for hydrogen storage and are likely to be feasible to synthesize. By leveraging ML techniques and metal–organic framework (MOF) databases, we are able to predict the synthesizability of MOF structures. This is evidenced by the successful synthesis of a new vanadium-based MOF that exhibits excellent performance for cryogenic H 2 storage. Notably, the total gravimetric and volumetric H 2 uptakes are as high as 9.0 wt% and 50.0 g/L at 77 K and 150 bar. This ML-assisted materials design offers an efficient and promising approach for developing hydrogen storage materials.

08 HYDROGEN↗
DOE OSTI2023

Data-driven analysis and prediction of stable phases for high-entropy alloy design

High-entropy alloys (HEAs) represent a promising class of materials with exceptional structural and functional properties. However, their design and optimization pose challenges due to the large composition-phase space coupled with the complex and diverse nature of the phase formation dynamics. In this study, a data-driven approach that utilizes machine learning (ML) techniques to predict HEA phases and their composition-dependent phases is proposed. By employing a comprehensive dataset comprising 5692 experimental records encompassing 50 elements and 11 phase categories, we compare the performance of various ML models. Our analysis identifies the most influential features for accurate phase prediction. Furthermore, the class imbalance is addressed by employing data augmentation methods, raising the number of records to 1500 in each category, and ensuring a balanced representation of phase categories. The results show that XGBoost and Random Forest consistently outperform the other models, achieving 86% accuracy in predicting all phases. Additionally, this work provides an extensive analysis of HEA phase formers, showing the contributions of elements and features to the presence of specific phases. We also examine the impact of including different phases on ML model accuracy and feature significance. Notably, the findings underscore the need for ML model selection based on specific applications and desired predictions, as feature importance varies across models and phases. This study significantly advances the understanding of HEA phase formation, enabling targeted alloy design and fostering progress in the field of materials science.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Membrane lipids drive formation of KRAS4b-RAF1 RBDCRD nanoclusters on the membrane

The oncogene RAS, extensively studied for decades, presents persistent gaps in understanding, hindering the development of effective therapeutic strategies due to a lack of precise details on how RAS initiates MAPK signaling with RAF effector proteins at the plasma membrane. Recent advances in X-ray crystallography, cryo-EM, and super-resolution fluorescence microscopy offer structural and spatial insights, yet the molecular mechanisms involving protein-protein and protein-lipid interactions in RAS-mediated signaling require further characterization. This study utilizes single-molecule experimental techniques, nuclear magnetic resonance spectroscopy, and the computational Machine-Learned Modeling Infrastructure (MuMMI) to examine KRAS4b and RAF1 on a biologically relevant lipid bilayer. MuMMI captures long-timescale events while preserving detailed atomic descriptions, providing testable models for experimental validation. Both in vitro and computational studies reveal that RBDCRD binding alters KRAS lateral diffusion on the lipid bilayer, increasing cluster size and decreasing diffusion. RAS and membrane binding cause hydrophobic residues in the CRD region to penetrate the bilayer, stabilizing complexes through β-strand elongation. These cooperative interactions among lipids, KRAS4b, and RAF1 are proposed as essential for forming nanoclusters, potentially a critical step in MAP kinase signal activation.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Learning of networked spreading models from noisy and incomplete data

Recent years have seen a lot of progress in algorithms for learning parameters of spreading dynamics from both full and partial data. Some of the remaining challenges include model selection under the scenarios of unknown network structure, noisy data, missing observations in time, as well as an efficient incorporation of prior information to minimize the number of samples required for an accurate learning. Here, in this work, we introduce a universal learning method based on a scalable dynamic message-passing technique that addresses these challenges often encountered in real data. The algorithm leverages available prior knowledge on the model and on the data, and reconstructs both network structure and parameters of a spreading model. We show that a linear computational complexity of the method with the key model parameters makes the algorithm scalable to large network instances.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

A machine learning approach to thermal conductivity modeling: A case study on irradiated uranium-molybdenum nuclear fuels

A deep neural network was developed for the purpose of predicting thermal conductivity with a case study performed on irradiated nuclear fuel. Traditional thermal conductivity modeling approaches rely on existing theoretical frameworks that describe known, relevant phenomena that govern the microstructural evolution processes during neutron irradiation (such as recrystallization, and pore size, distribution and morphology). Current empirical modeling approaches, however, do not represent all irradiation test data well. We develop a machine learning approach to thermal conductivity modeling that does not require a priori knowledge of a specific material microstructure and system of interest. Our approach allows re-searchers to probe dependency of thermal conductivity on a variety of reactor operating and material conditions. The purpose of building such a model is to allow for improved predictive capabilities linking structure-property-processing-performance relationships in the system of interest (here, irradiated nuclear fuel), which could lead to improved experimental test planning and characterization. The uranium-molybdenum system is the fuel system studied in this work, and historic irradiation test data is leveraged for model development. Our model achieved a mean absolute percent error of approximately 10%. Results indicate our model generalizes well to never before seen data, and thus use of deep learning methods for material property predictions from limited, historic irradiation data is a viable approach. This work challenges the current paradigm in materials science, where material property models are based on limited experimental data fitted to low-dimensionality phenomenological models, or by simulations in which fundamental equations are explicitly solved. The work presented here aims to demonstrate the potential and limitations of machine learning in the field of materials science and material property modeling.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

The Open DAC 2023 Dataset and Challenges for Sorbent Discovery in Direct Air Capture

Direct air capture (DAC) of CO 2 with porous adsorbents such as metal-organic frameworks (MOFs) has the potential to aid large-scale decarbonization. Previous screening of MOFs for DAC relied on empirical force fields and ignored adsorbed H 2 O and MOF deformation. We performed quantum chemistry calculations overcoming these restrictions for thousands of MOFs. The resulting data enable efficient descriptions using machine learning.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Formation and surface melting of nanoparticle superlattices in a solution

The wisdom in the saying of “There are no two snowflakes alike” lies in the importance of history or kinetic pathways in the phase transitions of solids. Likewise, “artificial solids,” namely superlattices consisting of functional nanoparticles, have lattice size, surface morphology, crystallinity, symmetry, and structural reconfiguration (for example, transition into a disordered state) highly dependent on the kinetic pathways as the nanoparticles interact with each other in solution [1]. Great progresses have been made in understanding the formation pathways of superlattices using liquid-phase transmission electron microscopy (TEM) [2-4]. For example, by tracking single nanoparticle’s trajectories, especially aided by U-net neural network-based machine learning, previous studies mapped the fundamental nanoparticle interactions at nanometer resolution [5]. Nonclassical, two-step nucleation pathway has also been elucidated in the system of nanoprisms, by optimizing protocols such as loading nanoparticle suspensions over the supersaturation threshold and minimizing particle‒substrate interaction [2]. Surface morphologies or exposed facets of superlattices have been shown to follow the principles of Wulff construction rule, where the facet-dependent surface energy can be measured based on the capillary wave theory [4]. However, the reverse process of crystallization of superlattices, the conversion from crystalline to disordered state, has been much less explored. On one hand, the melting of nanoparticle superlattices can provide a preferred pathway to induce structural reorganization or shuffling of building blocks for them to transform into different types of crystal structures. On the other hand, understanding nanoscale superlattice melting and comparing such behaviors with the prevailing surface melting theories developed for atomic/molecular solids can provide a potent way to engineer phase transitions of supra- and hierarchical structures constructed from nanoscale entities (e.g., DNA-coated nanoparticles, proteins), for their applications in reprogrammable and switchable materials with multifunctional properties [6, 7]. The experimental challenges to observe melting of superlattices are twofold. Practically it is difficult to load the initial superlattice form, in an intact manner, into the highly confined liquid-phase TEM chamber for in-situ observation. Here, the triggering of melting also needs meticulous manipulation of nanoparticle concentration, interparticle interaction, and solution environment.

Kim, Ahyoung↗
DOE OSTI2026

LeWRON: Learning ElectroWeak phase tRansitiON with agentic architecture

An agent to analyze electroweak phase transition. LeWRON turns a BSM model description or a reproduction target into a structured run: symbolic setup, effective-potential artifacts, finite-temperature machinery, generated model code, a scientific report, and an interactive exploration session. It keeps both machine-readable artifacts and human-readable notes, so a run can be resumed, audited, revised, and shared.

Wang, Isaac [Fermi National Accelerator Laboratory↗
DOE OSTI2018

Deep Data Analytics in Structural and Functional Imaging of Nanoscale Materials

Recent advances in scanning probe microscopy and scanning transmission electron microscopy have opened unprecedented opportunities in probing the materials structural parameters and electronic properties in real space on a picometre-scale. At the same time, the ability of modern day microscopes to quickly produce large, high-resolution datasets has created a challenge for rapid physics-guided analysis of data that typically contain several hundreds to several thousand atomic or molecular units per image. Here it is demonstrated how the advanced statistical analysis and machine learning techniques can be used for extracting relevant physical and chemical information from microscope data on multiple functional materials. Specifically, the following three case studies are discussed (i) application of a combination of convolutional neural network and Markov model for analyzing positional and orientational order in molecular self-assembly; (ii) a combination of sliding window fast Fourier transform, Pearson correlation matrix and canonical correlation analysis methods to study the relationships between lattice distortions and electron scattering patterns in graphene; (iii) application of a non-negative matrix factorization with physics-based constraints and Moran’s analysis of spatial associations to extracting electronic responses linked to different types of structural domains from multi-modal imaging datasets on iron-based superconductors. The approaches demonstrated here are universal in nature and can be applied to a variety of microscopic measurements on different materials.

Ziatdinov, Maxim↗