Search NASA⌕ Search

SEARCH · Search NASA

Results for “Reinforcement learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

231 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Neuromorphic overparameterisation and few-shot learning in multilayer physical neural networks

Abstract Physical neuromorphic computing, exploiting the complex dynamics of physical systems, has seen rapid advancements in sophistication and performance. Physical reservoir computing, a subset of neuromorphic computing, faces limitations due to its reliance on single systems. This constrains output dimensionality and dynamic range, limiting performance to a narrow range of tasks. Here, we engineer a suite of nanomagnetic array physical reservoirs and interconnect them in parallel and series to create a multilayer neural network architecture. The output of one reservoir is recorded, scaled and virtually fed as input to the next reservoir. This networked approach increases output dimensionality, internal dynamics and computational performance. We demonstrate that a physical neuromorphic system can achieve an overparameterised state, facilitating meta-learning on small training sets and yielding strong performance across a wide range of tasks. Our approach’s efficacy is further demonstrated through few-shot learning, where the system rapidly adapts to new tasks.

Science & Technology - Other Topics↗
DOE OSTI2026

Knowledge-guided learning with curated prior genetic biomarkers for robust model interpretation

Abstract Motivation Knowledge-guided learning offers effective and robust model training strategies in data-scarce settings by incorporating established domain knowledge, thereby enhancing generalization, robustness, and interpretability. By contrast, conventional deep learning approaches rely purely on data-driven learning, which can limit robust model interpretability, particularly in high-dimensional settings with limited size samples. In computational biology, knowledge-guided learning has primarily leveraged network- and structural-based knowledge, leading to biologically interpretable representations and enhanced predictive performance compared to conventional approaches. However, curated biomarkers, one of the most accessible forms of biological knowledge, remain largely unexplored within knowledge-guided paradigms. Results In this study, we propose a model-agnostic training paradigm, Biomarker-driven Explainable Prior-guided Learning (BioExPL), that can be applied to any neural networks that incorporates curated prior knowledge. BioExPL enforces neural networks to reflect curated biomarker priors in their latent representations through a novel knowledge-alignment loss. BioExPL consistently demonstrated significantly improved predictive performance and enhanced model interpretability with minimized computational overhead in simulation studies and intensive experiments on multiple cancer datasets. BioExPL not only integrates prior curated knowledge into the model but also accurately identifies unknown associated signals additionally. BioExPL is model-agnostic and domain-independent, enabling its integration into diverse neural network architectures. Availability and implementation The open-source is publicly available at: https://github.com/datax-lab/BioExPL.

Baek, Beomsu [Department of Computer Science, Univ↗
NASA NTRS2026

NASA Talks: Space Shuttle Columbia - Lessons Learned

On February 25, 2026, two NASA Talks were held regarding the Space Shuttle Columbia (Columbia Launch & Recovery, Columbia Reconstruction, Investigation, Causes & Key Takeaways). Crew & Thermal System Division (EC) partnered with Kennedy Space Center (KSC) and Engineering Directorate (EA) to bring these talks to Johnson Space Center (JSC) centering on what led up to and transpired after the Space Shuttle Columbia accident. Some recovered debris was on exhibit during the talks. NASA Mishap Program Specialist David Erickson and retired NASA Columbia Vehicle Manager Scott Thurston presented these talks. Mr. Erickson supports NASA mishap investigations and assists with the development of NASA's new Columbia Learning Center at KSC. Mr. Thurston brought a wealth of knowledge from his mission experience. These talks were timely and a solemn reminder of the critical importance of diligence, safety, and excellence in our work. EA Director Julie Kramer White welcomed the 400+ center-wide in-person audience, and EC Division Chief Rubik Sheth introduced the speakers. This event was held in the JSC Teague Auditorium, recorded, and executed by the EC in-house STAR Productions team.

Space Shuttle Columbia↗
DOE OSTI2026

Boron Coordination in Multicomponent Glasses: Analytical Models and Machine Learning With Uncertainty

Borosilicate glasses are extensively used in a variety of applications from kitchenware to nuclear waste immobilization due to the strong network formed by the Si-O-B bond that makes it resistant to chemical corrosion and gives it a low thermal expansion. Boron, however, exists in both trigonal BO3 and tetrahedral BO4 bonds in glass systems, which impacts the chemical durability and thermal resistance of the glass, amongst other properties. Boron coordination (N4), or the ratio of the amount of BO4 to BO3 within a glass, may aid in predicting these properties but is difficult to derive without experimental data due to the complexity of impacts from varied glass compositions and processing factors. For this reason, compositional models have been developed to predict boron coordination, but the models typically include a limited number of glass components. To help fill this gap in the models, in this work, a diverse multicomponent glass dataset of 809 glasses is compiled from a literature search, and then a number of analytical and machine learning (ML) models are trained on the dataset. Previously developed modified Bernstein and modified Du Stebbins analytical models were fitted to update parameters with the new dataset. Then, partially Bayesian neural networks, Gaussian process regressor, and heteroskedastic deterministic neural networks were evaluated. The ML models examined all have different strategies to overcome the potential for overfitting as a result of a limited training dataset, and return results that account for model uncertainty, which can be valuable for understanding model reliability. For the first time, cooling rate is introduced as an input parameter for ML models, showing consistent improvements in performance and solidifying the importance of including parameters outside of composition alone for N4 prediction. The machine learning models examined here show promise in accurate predictions of boron coordination in borosilicate glasses, all achieving R2 values of 0.91.

boron coordination↗
NASA NTRS2026

NASA Talks: Space Shuttle Columbia - Lessons Learned: Columbia Reconstruction, Investigation, Causes and Key Takeaways

On February 25, 2026, this NASA Talk was held regarding the Space Shuttle Columbia (Columbia Launch & Recovery, Columbia Reconstruction, Investigation, Causes & Key Takeaways). Crew & Thermal System Division (EC) partnered with Kennedy Space Center (KSC) and Engineering Directorate (EA) to bring these talks to Johnson Space Center (JSC) centering on what led up to and transpired after the Space Shuttle Columbia accident. Some recovered debris was on exhibit during the talks. NASA Mishap Program Specialist David Erickson presented this talk. Mr. Erickson supports NASA mishap investigations and assists with the development of NASA's new Columbia Learning Center at KSC. This talk was timely and a solemn reminder of the critical importance of diligence, safety, and excellence in our work. EA Director Julie Kramer White welcomed the 400+ center-wide in-person audience, and EC Division Chief Rubik Sheth introduced the speakers. This event was held in the JSC Teague Auditorium, recorded, and executed by the EC in-house STAR Productions team. This record includes an mp4 video with a run time of 32 min. 31 sec.; in color; with sound.

NASA Talks↗
DOE OSTI2024

In Silico Chemical Experiments in the Age of AI: From Quantum Chemistry to Machine Learning and Back

Computational chemistry is an indispensable tool for understanding molecules and predicting chemical properties. However, traditional computational methods face significant challenges due to the difficulty of solving the Schrödinger equations and the increasing computational cost with the size of the molecular system. In response, there has been a surge of interest in leveraging artificial intelligence (AI) and machine learning (ML) techniques to in silico experiments. Integrating AI and ML into computational chemistry increases the scalability and speed of the exploration of chemical space. However, challenges remain, particularly regarding the reproducibility and transferability of ML models. This review highlights the evolution of ML in learning from, complementing, or replacing traditional computational chemistry for energy and property predictions. Starting from models trained entirely on numerical data, a journey set forth toward the ideal model incorporating or learning the physical laws of quantum mechanics. This paper also reviews existing computational methods and ML models and their intertwining, outlines a roadmap for future research, and identifies areas for improvement and innovation. Ultimately, the goal is to develop AI architectures capable of predicting accurate and transferable solutions to the Schrödinger equation, thereby revolutionizing in silico experiments within chemistry and materials science.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Active Learning for Rapid Targeted Synthesis of Compositionally Complex Alloys

The next generation of advanced materials is tending toward increasingly complex compositions. Synthesizing precise composition is time-consuming and becomes exponentially demanding with increasing compositional complexity. An experienced human operator does significantly better than a novice but still struggles to consistently achieve precision when synthesis parameters are coupled. The time to optimize synthesis becomes a barrier to exploring scientifically and technologically exciting compositionally complex materials. This investigation demonstrates an active learning (AL) approach for optimizing physical vapor deposition synthesis of thin-film alloys with up to five principal elements. We compared AL-based on Gaussian process (GP) and random forest (RF) models. The best performing models were able to discover synthesis parameters for a target quinary alloy in 14 iterations. We also demonstrate the capability of these models to be used in transfer learning tasks. RF and GP models trained on lower dimensional systems (i.e., ternary, quarternary) show an immediate improvement in prediction accuracy compared to models trained only on quinary samples. Furthermore, samples that only share a few elements in common with the target composition can be used for model pre-training. We believe that such AL approaches can be widely adapted to significantly accelerate the exploration of compositionally complex materials.

Chemistry↗
NASA NTRSDate not supplied

Lessons Learned From A Cryogenic Motor Configuration Study for Aircraft Propulsion

Cryogenic electric machines are a promising technology for multi megawatt electric aircraft drivetrains. Superconducting stators that make use of low AC loss superconducting wires are considered to be a key component for these cryogenic machines. NASA has undertaken 6-year technical challenge to address this need by designing a 5 MW superconducting motor and cryogenic drive and developing multi-MW prototypes. This poster shares the lessons learned from a completed design study that evaluated several configurations of a 5 MW cryogenic motor for this application. The lessons are drawn from a qualitative study of 16 configurations and a quantitative study of 8 down selected configurations. The quantitative study involved using a motor design code based on analytical calculations (electromagnetic, thermofluid, mechanical, and motor sizing) to determine each configuration’s Pareto front of total efficiency and total specific power. This poster builds upon preliminary results that were previously presented by (1) reporting final results based on a revised design code for each configuration, including a considerable increase in fidelity for a novel radial flux motor and (2) making a down selection of the configuration for future detailed design and demonstration and documenting the rationale for the selection.

Superconductors↗
DOE OSTI2024

Uncovering obscured phonon dynamics from powder inelastic neutron scattering using machine learning

The study of phonon dynamics is pivotal for understanding material properties, yet it faces challenges due to the irreversible information loss inherent in powder inelastic neutron scattering spectra and the limitations of traditional analysis methods. In this study, we present a machine learning framework designed to reveal obscured phonon dynamics from powder spectra. Using a variational autoencoder, we obtain a disentangled latent representation of spectra and successfully extract force constants for reconstructing phonon dispersions. Notably, our model demonstrates effective applicability to experimental data even when trained exclusively on physics-based simulations. The fine-tuning with experimental spectra further mitigates issues arising from domain shift. Analysis of latent space underscores the model’s versatility and generalizability, affirming its suitability for complex system applications. Furthermore, our framework’s two-stage design is promising for developing a universal pre-trained feature extractor. This approach has the potential to revolutionize neutron measurements of phonon dynamics, offering researchers a potent tool to decipher intricate spectra and gain valuable insights into the intrinsic physics of materials.

domain adaptation↗
NASA NTRS2026

NASA Talks: Space Shuttle Columbia - Lessons Learned: Columbia Launch and Recovery

On February 25, 2026, this NASA Talk was held regarding the Space Shuttle Columbia (Columbia Launch & Recovery). Crew & Thermal System Division (EC) partnered with Kennedy Space Center (KSC) and Engineering Directorate (EA) to bring this talk to Johnson Space Center (JSC) centering on what led up to and transpired after the Space Shuttle Columbia accident. Some recovered debris was on exhibit during the talk. Retired NASA Columbia Vehicle Manager Scott Thurston presented this talk. Mr. Thurston brings a wealth of knowledge from his mission experience. This talk was timely and a solemn reminder of the critical importance of diligence, safety, and excellence in our work. EA Director Julie Kramer White welcomed the 400+ center-wide in-person audience, and EC Division Chief Rubik Sheth introduced the speakers. This event was held in the JSC Teague Auditorium, recorded, and executed by the EC in-house STAR Productions team. This record includes an mp4 video presentation with a run time of 36 min. 20 sec.; in color; with sound.

NASA Talks↗
DOE OSTI2026

Lessons learned from the development and implementation of a workforce training curriculum for advanced controls for high performance HVAC systems

Over the past decade, academic research on advanced controls has slowly transitioned into new software platforms, giving rise to various companies developing and deploying these innovative products, including solutions for light commercial HVAC systems. However, the current workforce remains widely unprepared to install, maintain and operate these systems, particularly complex software-based control platforms, as most workforce training programs still focus on traditional building automation for large commercial buildings. This paper presents the development and piloting of curriculum for three key types of professionals: ● Technicians (trade-level): installing and maintaining modern high-performance HVAC systems and controls ● Programmers (undergrad-level): developing and implementing advanced controls ● Engineers and energy professionals (undergrad/grad-level): managing and evaluating system performance We share details of the material developed including training videos, open-source software, instruction manuals. We also present the results of a pilot implementation of the training materials with real students.

Casillas, Armando↗
DOE OSTI2026

Explainable machine learning reveals that local structural motifs encode the thermodynamic state across the CuZr metallic glass-forming range

Metallic glasses derive their properties from the statistics of local atomic motifs rather than from long-range order, yet a quantitative, chemistry-specific link between motif populations and the underlying glassy state has remained elusive. In this work we combine large-scale molecular dynamics, Voronoi tessellation, deep neural networks, and SHapley Additive exPlanations (SHAP) to identify which local structural motifs define the glassy state of Cu—Zr metallic glasses. A dataset of 17,180 atomistic configurations spanning ten compositions (Cu 20 Zr 80 –Cu 80 Zr 20 ) and four quench rates (10 9 –10 12 K/s) is used to train a feed-forward neural network that regresses temperature across the 50–2000 K liquid–supercooled–glass range, achieving a mean absolute error of 19.89 K and R 2 = 0.9974, confirming that the local structural state is faithfully encoded in motif-level structure. SHAP analysis then reveals that a tightly coupled near-icosahedral family of motifs (coordination numbers (CN) 11–13, including the full icosahedron 001200 and its single-atom-perturbation sibling 10930) collectively encodes the thermodynamic state of the system across the full glass-forming range. The CN = 11–13 ordered members carry negative SHAP values at high populations, tracking the most deeply-quenched configurations, while 10930 shows the reversed signature consistent with its role as a soft-spot host whose population shrinks as the icosahedral network deepens. The analysis demonstrates that explainable machine learning can isolate the minimal motif vocabulary defining the glassy state and recovers the near-icosahedral building blocks previously identified by data-driven analyses of Cu—Zr. The approach provides a general, chemistry-specific route for characterizing the structural state of disordered materials.

36 MATERIALS SCIENCE↗
DOE OSTI2026

PowerModelsGAT-AI: Physics-Informed Graph Attention for Multi-System Power Flow With Continual Learning

Solving the alternating current power flow equations in real time is essential for secure grid operation, yet classical Newton–Raphson solvers can be slow under stressed conditions. Existing graph neural networks for power flow are typically trained on a single system and often degrade on different systems. We present PowerModelsGAT-AI, a physics-informed graph attention network that predicts bus voltages and generator injections. The model uses bus-type-aware masking to handle different bus types and balances multiple loss terms, including a power-mismatch penalty, using learned weights. We evaluate the model on 14 benchmark systems (4 to 6,470 buses) and train a unified model on 13 of these under contingency conditions with up to two branch outages, achieving an average normalized mean absolute error of 0.89% for voltage magnitudes and R 2 >0.99 for voltage angles. We also show continual learning: when adapting a base model to a new 1,354-bus system, standard fine-tuning causes severe forgetting with error increases exceeding 1000% on base systems, while our experience replay and elastic weight consolidation strategy keeps error increases below 2% and in some cases improves base-system performance. Interpretability analysis shows that learned attention weights correlate with physical branch parameters (susceptance: r=0.38 ; thermal limits: r=0.22 ), and feature importance analysis supports that the model captures established power flow relationships.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Unveiling the lithium-ion transport mechanism in Li{sub 2}ZrCl{sub 6} Solid-State Electrolyte {ital via} deep learning-accelerated molecular dynamics simulations.

Lithium zirconium chlorides (LZCs) present a promising class of cost-effective solid electrolytes for next-generation all-solid-state batteries. The unique crystal structure of LZCs plays a crucial role in facilitating lithium-ion mobility, which further affects the electrochemical performance. To understand the underlying mechanism governing ion transport, we employed deep learning-accelerated molecular dynamics simulation on Li2ZrCl6 (trigonal alpha- and monoclinic beta-LZC), focusing specifically on the zirconium coordination environment. Our results reveal that disordered alpha-LZC exhibits the highest ionic conductivity, while beta-LZC demonstrates significantly lower conductivity, closely aligning with experimental findings. The study confirms that across all phases, lithium migration proceeds via the site-to-site hopping mechanism, where variations in site residence times critically impact the overall ionic conductivity. In alpha-LZCs, lithium ions prefer to anisotropically diffuse across interlayers as the result of a lower energy barrier, driven primarily by collective diffusion. In contrast, lithium ions in beta-LZC primarily isotropically diffuse within the intralayer, hindered by higher energy barriers and determined by individual diffusion. The variation in ZrCl6 2- octahedral unit softening, induced by the specific layered arrangement of zirconium atoms, emerges as a critical determinant of the energy barriers across the LZC phases. These atomic-scale insights into the transport processes provide valuable guidance for the rational design and optimization of LZCs-based electrolytes, accelerating their practical application in advanced energy storage technologies.

Guo, Hanzeng↗
DOE OSTI2025

From PINNs to PIKANs: recent advances in physics-informed machine learning

Physics-Informed Neural Networks (PINNs) have emerged as a key tool in Scientific Machine Learning since their introduction in 2017, enabling the efficient solution of ordinary and partial differential equations using sparse measurements. Over the past few years, significant advancements have been made in the training and optimization of PINNs, covering aspects such as network architectures, adaptive refinement, domain decomposition, and the use of adaptive weights and activation functions. A notable recent development is the Physics-Informed Kolmogorov-Arnold Networks (PIKANS), which leverage a representation model originally proposed by Kolmogorov in 1957, offering a promising alternative to traditional PINNs. In this review, we provide a comprehensive overview of the latest advancements in PINNs, focusing on improvements in network design, feature expansion, optimization techniques, uncertainty quantification, and theoretical insights. We also survey key applications across a range of fields, including biomedicine, fluid and solid mechanics, geophysics, dynamical systems, heat transfer, chemical engineering, and beyond. Lastly, we review computational frameworks and software tools developed by both academia and industry to support PINN research and applications.

Kolmogorov-Arnold networks↗
DOE OSTI2026

Ionic Interdiffusion at Cathode|Solid-Electrolyte Interface: A Machine Learning–Assisted Multiscale Investigation and Mitigation Strategies

Future lithium batteries are expected to use solid electrolytes to achieve higher energy density and fast charge capabilities. However, most solid electrolytes are thermodynamically unstable against layered oxide cathodes. In this study, the stability of LiCoO2 (LCO) cathode with Li10GeP2S12 (LGPS) solid electrolyte is investigated using ab initio molecular dynamics (AIMD) and machine learning molecular dynamics (MLMD). The propensity of ionic interdiffusion, formation of a passivating interphase layer, and corresponding decay in cell performance is addressed using a continuum model. Large-scale MLMD simulations confirm that the LCO|LGPS interface permits interdiffusion of cobalt (Co) and other ionic species, leading to the formation and growth of a resistive interphase and to dramatic capacity fade even in the first cycle. We examine the literature evidence that incorporating a thin layer of LiNb0.5Ta0.5O3 (LNTO) between LCO and LGPS prevents the interdiffusion of ions. Atomistic simulations suggest that substituting lithium (Li) in LNTO with Co is thermodynamically unfavorable, thereby inhibiting ionic interdiffusion. The stable Nb5+/Ta5+ states form a rigid metal-oxide framework, which consequently also prevents the substitution of niobium (Nb) or tantalum (Ta). However, continuum-level analysis suggests that the higher mechanical stiffness of LNTO can lead to interfacial delamination between the LCO and LNTO. This phenomenon reduces the effectiveness of the protective layer. This paper, therefore, highlights the need to develop novel interlayers that balance low ionic interdiffusion with low mechanical stiffness.

Ncube, Musawenkosi K.↗
NASA NTRSDate not supplied

The NASA Turbulent Heat Flux (THX) Experiments: Summary and Lessons Learned

The Turbulent Heat Flux (THX) experiments were conducted at NASA Glenn Research Center (GRC) in order to collect measurements of velocities and temperatures for computational fluid dynamics (CFD) validation of heated flows, with a focus on propulsion system components. The experiments spanned 5 phases; four of which were conducted in the GRC AeroAcoustic Propulsion Laboratory (AAPL) using the Small Hot Jet Flow Rig (SHJAR). In addition to making velocity measurements with Particle Image Velocimetry (PIV), the THX experiments introduced a new Raman-scattering based capability to measure temperatures. Computational studies were also conducted for each of the experimental configurations, in order to provide a baseline of expected CFD results and conduct an assessment of the capability of various CFD approaches for calculating flows where the turbulent transport of heat was important. Two of the collected sets of data were used for American Institute of Aeronautics and Astronautics (AIAA) Propulsion Aerodynamic Workshops (PAWs). The data set from the 5th phase, collected for heated supersonic jets, was also used to construct new validation cases for the NASA Turbulence Model Resource (TMR). This paper provides an overview of the experiments and associated computations for each of the 5 test phases. Key experimental findings are presented. Lessons learned are provided concerning the effect of computational modeling choice on accuracy of predicting turbulent flows where thermal transport is important. Emphasis is placed on comparing Reynolds-averaged Navier-Stokes approaches with large-eddy simulation approaches. The benefits of utilizing a conjugate heat transfer method in conjunction with CFD solver for film cooling is demonstrated.

RANS↗
NASA NTRSDate not supplied

Physics-Guided Deep Learning for Complex System Health Management and Decision Making

The landscape of complex engineered systems is rapidly evolving, from smart manufacturing facilities to next-generation transportation vehicles. As these systems become increasingly sophisticated and interconnected, the need for advanced health management systems grows ever more critical. These systems must go beyond simple monitoring, actively predicting potential failures before they occur. This paradigm shift from fixed maintenance schedules to condition-based predictions is key to optimizing system performance, enhancing safety, and paving the way for autonomous decision-making across various industries. Whether in industrial processes, energy systems, or advanced transportation, the ability to anticipate and prevent failures is becoming a cornerstone of operational excellence. To accurately predict the future health of any complex system, knowledge of its current health state and future operational conditions is essential. Recent advancements in data-driven algorithms have generated growing interest in artificial intelligence for industrial applications. However, the limitations of pure data-driven methods, particularly in industries where data acquisition is costly and limited, have become apparent. This has led to a focus on blending physics with data-driven algorithms, mitigating the drawbacks of both approaches while emphasizing their respective advantages. This research proposes a novel framework for integrating physics-based performance models with deep learning algorithms for the prognostics of complex safety-critical systems. In this approach, physics-based models serve as a blueprint, capturing fundamental system behaviors, while deep learning algorithms, leveraging real-world sensor data, fill in gaps and identify subtle patterns indicative of potential problems. This hybrid methodology, utilizing techniques such as Physics-Informed Neural Networks (PINNs), offers a powerful solution for predicting system health. By fusing domain knowledge with data-driven insights, this approach promises more accurate, adaptable, and reliable models for health prediction. The resulting framework is versatile, applicable across various sectors including aerospace, manufacturing, and energy systems, ultimately contributing to safer, more efficient operations in our increasingly complex technological landscape.

Diagnostics↗