Self-organizing and learning control systems.
Self organizing and learning control systems, adaptive systems theory and defining self organizing control systems
Barron, R. L.↗
SEARCH · Search NASA
Results for “Learning Theory”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Modeling the behavioral substrates of associate learning and memory - Adaptive neural models
Three adaptive single-neuron models based on neural analogies of behavior modification episodes are proposed, which attempt to bridge the gap between psychology and neurophysiology. The proposed models capture the predictive nature of Pavlovian conditioning, which is essential to the theory of adaptive/learning systems. The models learn to anticipate the occurrence of a conditioned response before the presence of a reinforcing stimulus when training is complete. Furthermore, each model can find the most nonredundant and earliest predictor of reinforcement. The behavior of the models accounts for several aspects of basic animal learning phenomena in Pavlovian conditioning beyond previous related models. Computer simulations show how well the models fit empirical data from various animal learning paradigms.
Lee, Chuen-Chien↗
Development and transferability of neural-network models for plasma-surface interactions
Plasma-surface interactions are increasingly critical to modern technologies; yet, accurate molecular dynamics simulations remain limited by the capabilities of interatomic potentials. Deep Potentials (DPs) promise to revolutionize the field by providing a systematic method for producing accurate interatomic potentials. The primary challenge of DP development is selecting a dataset, which efficiently spans the set of atomic environments one expects to encounter in the subsequent molecular dynamics simulations. The computational cost of density functional theory calculations, which are the typical basis for DP development, makes it impossible to directly verify the quality of a given DP. To address this challenge, we explore the development of a deep-learned interatomic potential, “DeepREBO,” trained to reproduce the behavior of the REBO2 empirical potential, enabling direct validation of training methodology and transferability. Using an active learning framework, we begin with a minimal dataset and iteratively expand it to train a Deep Potential-Smooth Edition model that faithfully reproduces REBO2 results for 25 eV hydrogen bombardment of diamond (001), a particularly challenging case. We show that small, carefully curated datasets can outperform large, unguided ones, with effective models requiring fewer than 15 000 snapshots. Subsequent transferability tests demonstrate that while DeepREBO generalizes well to diamond (111) surfaces, performance degrades for amorphous carbon or higher-energy impacts, highlighting the need for use-case-specific training data. We also evaluate methods to improve short-range repulsion. This study outlines best practices for training robust deep potentials and underscores the importance of dataset design for predictive plasma simulations.
Ab-initio molecular dynamics↗
Quantifying uncertainty in machine learning for nuclear binding energy
Techniques from artificial intelligence and machine learning are increasingly employed in nuclear theory; however, the uncertainties that arise from the complex parameter manifold encoded by the neural networks are often overlooked. Epistemic uncertainties arising from training the same network multiple times for an ensemble of initial weight sets offer a first insight into the confidence of machine learning predictions, but they often come with a high computational cost. Instead, we apply a single-model uncertainty quantification method called Δ-UQ that gives epistemic uncertainties with one-time training. Here, we demonstrate our approach on a two-feature model of nuclear binding energies per nucleon with proton and neutron number pairs as inputs. We show that Δ-UQ can produce reliable and self-consistent epistemic uncertainty estimates and can be used to assess the degree of confidence in predictions made with deep neural networks.
Huang, Mengyao [Lawrence Livermore National Labora↗
Learning Nonlinear Reduced Models from Data with Operator Inference
This review discusses Operator Inference, a nonintrusive reduced modeling approach that incorporates physical governing equations by defining a structured polynomial form for the reduced model, and then learns the corresponding reduced operators from simulated training data. The polynomial model form of Operator Inference is sufficiently expressive to cover a wide range of nonlinear dynamics found in fluid mechanics and other fields of science and engineering, while still providing efficient reduced model computations. The learning steps of Operator Inference are rooted in classical projection-based model reduction; thus, some of the rich theory of model reduction can be applied to models learned with Operator Inference. This connection to projection-based model reduction theory offers a pathway toward deriving error estimates and gaining insights to improve predictions. Furthermore, through formulations of Operator Inference that preserve Hamiltonian and other structures, important physical properties such as energy conservation can be guaranteed in the predictions of the reduced model beyond the training horizon. This review illustrates key computational steps of Operator Inference through a large-scale combustion example.
Mechanics↗
Accelerating the Structure Exploration of Diverse Bi–Pt Nanoclusters via Physics‐Informed Machine Learning Potential and Particle Swarm Optimization
Bimetallic Bi–Pt nanoclusters exhibit diverse structural motifs, including core-shell, Janus, and mixed alloy configurations, due to the unique bonding characteristics between Bi and Pt atoms. Using density functional theory refinements from ChIMES physically machine-learned potential and CALYPSO particle swarm optimization global searches, 34 Bi20-Pt20 nanoclusters are systematically classified. The results reveal that Bi atoms predominantly occupy surface sites, driven by charge transfer effects. Cohesive energy trends alone prove insufficient for structure differentiation, necessitating a data-driven approach employing principal component analysis and K-means clustering. Furthermore, vibrational, electronic, and infrared spectral analyses provide additional insights into structure-property relationships. The findings offer an original framework for the automated classification and analysis of bimetallic nanoclusters, enhancing the understanding of their stability and functional properties.
bimetallic nanoparticles↗
Machine Learning Vacancy Formation Energy in Nickel-Based Superalloys
Creep performance plays a key role in nickel-based superalloys for high temeprature applications. Creep behavior depends on many parameters such as strength, dislocations, diffusivity, and microstructural stability in addition to temeprature, applied stress, and oxidation. This work focuses on predicting vacancy formation energy in nickel-based superalloys using machine learning approach. High-throughput density functional theory (DFT) calculations are performed on Ni-based alloys with the addition of various alloying elements to predict the vacancy formation energy and vacancy concentration. Machine learning is performed using various models including graph neural networks.
creep performance↗
Weighted active space protocol for multireference machine-learned potentials
Multireference methods such as multiconfiguration pair-density functional theory accurately capture electronic correlation in systems with strong multiconfigurational character, but their cost precludes direct use in molecular dynamics. Combining these methods with machine-learned interatomic potentials (MLPs) can extend their reach. However, the sensitivity of multireference calculations to the choice of the active space complicates the consistent evaluation of energies and gradients across structurally diverse nuclear configurations. To overcome this limitation, we introduce the weighted active space protocol (WASP), a systematic approach to assign a consistent active space for a given system across uncorrelated configurations. By integrating WASP with MLPs and enhanced sampling techniques, we propose a data-efficient active learning cycle that enables the training of an MLP on multireference data. We demonstrated the approach on the TiC + -catalyzed C–H activation of methane, a reaction that poses challenges for Kohn–Sham density functional theory due to its significant multireference character. This framework enables accurate and efficient modeling of catalytic dynamics, establishing a paradigm for simulating complex reactive processes beyond the limits of conventional electronic-structure methods.
enhanced sampling↗
Machine Learning Guided Screen and Design of Perovskite Oxides for High-Temperature Oxygen Sensing
Machine learning (ML) is a powerful tool for functional material design. In this work, we combine first-principles density function theory with ML to develop perovskite database and design O<sub>2</sub> sensors for harsh environmental applications.
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
Effect of Solvent on the Local Structure, Dynamics, and Vibrational Density of States in Sn-BEA Zeolite
Lewis acid zeolites are attractive catalysts for epoxidation and biomass valorization, as they are highly active and selective in the liquid phase and can operate at or near ambient conditions. While a rich experimental literature exists on liquid-phase Lewis acid zeolite catalysis, our understanding of the molecular organization and solvent dynamics in the vicinity of Lewis acid sites with differing metal site speciation remains limited. In this work, we investigate the molecular coordination and diffusion of two common solvents (methanol and water) around the closed and open Sn-BEA zeolite active sites using molecular dynamics simulations with a machine-learned interatomic potential trained on ab initio molecular dynamics trajectories. Molecular dynamics simulations reveal that introducing active sites significantly enhances local order in the first and second solvation shells compared to the pure silica case. For methanol, both closed and open active sites are singly coordinated, while more than two water molecules coordinate the open site. In contrast to methanol, we observed that water molecules dissociate, leading to the formation of additional Sn-OH and silanol groups away from the active site. The diffusion coefficients of water and methanol are functions of the solvent population in the pore. Here, our work provides insights into how active site speciation in Lewis acid zeolites affects solvent coordination, diffusion, and vibrational signature. This information is foundational for catalyst design and optimization of liquid-phase catalytic processes in zeolites. It also demonstrates the suitability of machine-learned interatomic potentials for modeling reactive systems, enabling sufficiently long trajectories for appropriate statistical averaging.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Electronic structure prediction of multi-million atom systems through uncertainty quantification enabled transfer learning
The ground state electron density — obtainable using Kohn-Sham Density Functional Theory (KS-DFT) simulations — contains a wealth of material information, making its prediction via machine learning (ML) models attractive. However, the computational expense of KS-DFT scales cubically with system size which tends to stymie training data generation, making it difficult to develop quantifiably accurate ML models that are applicable across many scales and system configurations. Here, we address this fundamental challenge by employing transfer learning to leverage the multi-scale nature of the training data, while comprehensively sampling system configurations using thermalization. Our ML models are less reliant on heuristics, and being based on Bayesian neural networks, enable uncertainty quantification. We show that our models incur significantly lower data generation costs while allowing confident — and when verifiable, accurate — predictions for a wide variety of bulk systems well beyond training, including systems with defects, different alloy compositions, and at multi-million-atom scales. Moreover, such predictions can be carried out using only modest computational resources.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
A data-driven framework for predicting machining stability: employing simulated data, operational modal analysis, and enhanced transfer learning
Chatter, a self-excited vibration phenomenon, presents a significant challenge in machining operations, particularly in high-speed milling, where it can degrade tool life, reduce material removal efficiency, and compromise workpiece quality. Addressing this challenge requires a reliable predictive model that can accommodate the complex dynamics of various machining scenarios. This study introduces a novel, data-driven approach to predicting machining stability, leveraging over 140,000 simulated datasets and employing advanced techniques such as operational modal analysis (OMA), enhanced transfer learning (TL), and receptance coupling substructure analysis (RCSA). By integrating these methodologies, the framework effectively classifies and predicts chatter across diverse operational modes, achieving robust and accurate outcomes. Our model utilizes a Random Forest (RF) classifier trained with the comprehensive dataset, which demonstrates substantial improvements in both predictive accuracy and robustness. Specifically, the RF model achieved an accuracy rate of 85%, an area under the curve (AUC) of 0.90, and an F1 score of 0.88, underscoring its capability to adapt to varying machining configurations. These results highlight the framework’s potential to enhance operational efficiency and machining quality by providing reliable chatter predictions across a broad range of machining parameters. In conclusion, this research thus offers a significant advancement in predictive maintenance for machining processes, enabling more stable and efficient manufacturing operations.
42 ENGINEERING↗
Assessing the Impact of Measurement Precision on Metabolite Identification Probability in Multidimensional Mass Spectrometry-Based, Reference-Free Metabolomics
Identification of compounds with minimal ambiguity remains a central challenge in mass spectrometry-based metabolomics. Conventional compound identification relies on comparing analytical signatures (e.g., mass-to-charge ratio, collision cross section, tandem mass spectra) against reference data obtained from measurements of authentic chemical standards. The breadth of annotatable compounds using this approach is necessarily limited by availability of authentic standards, analytical throughput, and resolving power of the separations that underly the measurements. The maturation of computational methods, both theory-driven and artificial intelligence/machine learning-based, for prediction of various molecular properties relevant to multidimensional mass spectrometry measurements has opened the door to a new “reference-free” paradigm of compound annotation. Through augmenting existing reference data for molecular properties with computational predictions, the universe of identifiable chemical species can be expanded significantly beyond its current limits. An unexplored aspect of this novel approach is understanding how to gauge confidence in resulting annotations, especially as the compound search space is expanded. Intuitively, the confidence of a compound annotation is related to the inherent discriminatory power of the molecular properties used for identification, as well as the precision with which the properties are measured or predicted. In this work, we characterize this relationship between measurement precision and identification probability in a systematic and quantitative fashion for a defined region of chemical space that includes organic small molecule metabolites. Importantly, this work establishes a framework for conducting metabolite identification probability analysis that enables others to quantify this relationship for their own compounds and properties of interest.
Metabolite Identification↗
Parametric matrix models
We present a general class of machine learning algorithms called parametric matrix models. In contrast with most existing machine learning models that imitate the biology of neurons, parametric matrix models use matrix equations that emulate physical systems. Similar to how physics problems are usually solved, parametric matrix models learn the governing equations that lead to the desired outputs. Parametric matrix models can be efficiently trained from empirical data, and the equations may use algebraic, differential, or integral relations. While originally designed for scientific computing, we prove that parametric matrix models are universal function approximators that can be applied to general machine learning problems. After introducing the underlying theory, we apply parametric matrix models to a series of different challenges that show their performance for a wide range of problems. For all the challenges tested here, parametric matrix models produce accurate results within an efficient and interpretable computational framework that allows for input feature extrapolation.
Computational science↗
Toward first principles-based simulations of dense hydrogen
Accurate knowledge of the properties of hydrogen at high compression is crucial for astrophysics (e.g., planetary and stellar interiors, brown dwarfs, atmosphere of compact stars) and laboratory experiments, including inertial confinement fusion. There exists experimental data for the equation of state, conductivity, and Thomson scattering spectra. However, the analysis of the measurements at extreme pressures and temperatures typically involves additional model assumptions, which makes it difficult to assess the accuracy of the experimental data rigorously. On the other hand, theory and modeling have produced extensive collections of data. They originate from a very large variety of models and simulations including path integral Monte Carlo (PIMC) simulations, density functional theory (DFT), chemical models, machine-learned models, and combinations thereof. At the same time, each of these methods has fundamental limitations (fermion sign problem in PIMC, approximate exchange–correlation functionals of DFT, inconsistent interaction energy contributions in chemical models, etc.), so for some parameter ranges accurate predictions are difficult. Recently, a number of breakthroughs in first principles PIMC as well as in DFT simulations were achieved which are discussed in this review. Here we use these results to benchmark different simulation methods. We present an update of the hydrogen phase diagram at high pressures, the expected phase transitions, and thermodynamic properties including the equation of state and momentum distribution. Furthermore, we discuss available dynamic results for warm dense hydrogen, including the conductivity, dynamic structure factor, plasmon dispersion, imaginary-time structure, and density response functions. We conclude by outlining strategies to combine different simulations to achieve accurate theoretical predictions that are based on first principles.
70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
Infrared spectral signatures of interfacial water at TiO 2 –electrolyte interfaces from deep potential molecular dynamics
Vibrational spectroscopy is a powerful tool for probing water at oxide–electrolyte interfaces, but its molecular interpretation can be challenging. Here, we employ deep potential long-range molecular dynamics simulations with layer-resolved spectral analysis to investigate the microscopic origins of the infrared (IR) response of water at the interface with anatase TiO 2 (101), a prototypical oxide surface. The calculated interfacial spectra exhibit characteristic modifications compared to bulk water IR spectra, including enhanced intensities, a red shifted and broadened stretching band, and a higher-frequency shoulder, in qualitative agreement with experiments. Spectral decomposition shows that these signatures originate mainly from the first interfacial water layer, dominated by surface-bound H 2 O at Ti 5C sites, with secondary contributions from the second layer. A moderate salt concentration (0.4 M NaCl) leaves both the interfacial structure and the spectra essentially unchanged, while tuning the pH strongly modulates the spectral intensity. We establish a scaling relation linking the spectral intensity to the surface water dissociation fraction and the dipole moment, both governed by interfacial electric fields. These findings provide a microscopic framework for interpreting IR spectra of oxide–electrolyte interfaces.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Material Discovery and Design Principles of Perovskite Oxides for Reversible Solid Oxide Cells (R-SOC)
Reversible solid oxide cells (R-SOCs) are highly efficient devices for energy conversion and storage, capable of operating for both hydrogen utilization and production. In fuel cell mode, an R-SOC consumes hydrogen or natural gas to generate electricity, while in electrolysis mode, it produces hydrogen from steam. The discover of new materials with rapid oxygen surface exchange kinetics and enduring stability is crucial for the economically viable commercialization of R-SOCs. To facilitate this pursuit, we conducted extensive Density Functional Theory (DFT) calculations and developed Machine Learning (ML) models to predict critical catalytic properties essential for R-SOCs, such as oxygen surface exchange/diffusivity, and area-specific resistance (ASR). BaCoxFeyZrzO3-d(BFCZ)(x+y+z=1) emerged as a promising family of electrode materials with high activity and stability, validated through systematic experimental study. Moreover, a robust numerical multiphysics model was developed to optimize materials and microstructure parameters, providing the ability to predict the performance of functional R-SOCs.
Liu, Jian↗
International Workshop on Electronic Structure 2024 (ES 24)
The 36th annual Workshop on Recent Developments in Electronic Structure Theory commenced on June 2-5, 2024 at Boston University with 136 in-person and 75 virtual attendees. The organizing committee was composed of five faculty at Boston University with seven local area faculty comprising the greater Boston area advisory committee. On the first day, two hands-on workshops, NEXMD and ComDMFT were held on June 2, two full days of presentations were held on June 3-4 and one half day on June 5. There were 19 invited speakers who spoke about the state-of-the-art in electronic structure methods, including density functional theory, many-body perturbation theory, and the incorporation of machine learning into electronic structure calculations. In addition, 45 young scientists presented posters on June 4. Housing at a reduced rate was provided at the Boston University dormitories. This conference provided a valuable opportunity for scientists, students, postdocs, and senior researchers alike, to disseminate their latest research results, discuss their ideas and best practices, learn from each other, and form new collaborations.
42 ENGINEERING↗