Search NASA⌕ Search

SEARCH · Search NASA

Results for “deep reinforcement learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

170 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Echo state network for coarsening dynamics of charge density waves

An echo state network (ESN) is a type of reservoir computer that uses a recurrent neural network with a sparsely connected hidden layer. Compared with other recurrent neural networks, one great advantage of ESN is the simplicity of its training process. Yet, despite the seemingly restricted learnable parameters, ESN has been shown to successfully capture the spatial-temporal dynamics of complex patterns. Here we build an ESN to model the coarsening dynamics of charge-density waves (CDWs) in a semiclassical Holstein model, which exhibits a checkerboard electron density modulation at half-filling stabilized by a commensurate lattice distortion. The inputs to the ESN are local CDW order parameters in a finite neighborhood centered around a given site, while the output is the predicted CDW order of the center site at the next time step. Special care is taken in the design of couplings between hidden layer and input nodes to ensure lattice symmetries are properly incorporated into the ESN model. Since the model predictions depend only on CDW configurations of a finite domain, the ESN is scalable and transferrable in the sense that a model trained on dataset from a small system can be directly applied to dynamical simulations on larger lattices. Furthermore, our work opens avenues for efficient dynamical modeling of pattern formations in functional electron materials.

2-dimensional systems↗
DOE OSTI2026

Hierarchical Multi-agent Large Language Model Reasoning for Autonomous Heterogeneous Catalyst Discovery

Artificial intelligence is reshaping scientific exploration, but most methods automate procedural tasks without engaging in scientific reasoning, limiting autonomy in discovery. We demonstrate that hierarchical agentic large language model reasoning can efficiently drive simulation and scientific exploration. Across two chemical applications, CO adsorption on Cu surface transition metal adatoms and on M–N–C catalysts, reasoning-guided exploration reduces required atomistic simulations by up to 90% relative to heuristic or random selection. Comparisons across single-agent, multi-agent, and stochastic baselines show that hierarchical strategies yield more coherent and information-efficient search trajectories. Reasoning traces reveal chemically grounded decisions that cannot be explained by semantic bias or stochastic sampling. We realize these agentic reasoning strategies in Materials Agents for Simulation and Theory in Electronic-structure Reasoning (MASTER), a multimodal system that translates natural language into density functional theory workflows. Altogether, multi-agent collaboration accelerates heterogeneous catalyst discovery and marks a step toward more autonomous, reasoning-guided scientific exploration.

30 DIRECT ENERGY CONVERSION↗
DOE OSTI2026

Multitask graph neural networks for elastoplastic response prediction in dual-phase polycrystals

Microstructure-sensitive prediction of elastoplastic response remains a recurring bottleneck in multiscale damage and fatigue modeling, where large ensembles of statistically distinct polycrystals are required to quantify variability and extreme-value behavior. In this work, we develop a multitask graph neural network (GNN) surrogate that maps dual-phase ferrite–martensite polycrystal microstructures to Statistical Volume Element (SVE)-level elastoplastic Quantities of Interest (QoIs). Each SVE is represented as a grain-adjacency graph, with node features encoding phase, geometry, and crystallographic orientation, and edge features encoding relative misorientation. A message-passing graph convolution generates node embeddings, which are pooled into a graph representation and passed to a multitask regression head that jointly predicts 10 scalar QoIs and vector-valued stress–strain responses in orthogonal loading directions across multiple martensite volume fractions and SVE sizes. Results show high accuracy for scalar QoIs and strong agreement for full stress–strain trajectories, with population envelopes reproducing both median behavior and finite-SVE variability across compositions and partition scales. A unified model trained on pooled volume-fraction data preserves most within-regime accuracy relative to regime-specific models while also capturing the broader cross-regime variation reflected in the pooled test set. Distributional comparisons further demonstrate that the surrogate preserves heterogeneity under SVE partitioning, enabling statistically consistent block-wise random-field construction for mesoscale analyses. Overall, the proposed grain-graph surrogate provides a practical pathway to accelerate ensemble-based studies of SVE-level constitutive variability in dual-phase polycrystals.

Crystal plasticity↗
DOE OSTI2025

Unique Conductivity Behavior in Water-In-Salt Electrolytes Driven by Ion Clusters

Understanding and predicting ion transport in aqueous electrolytes are crucial for advanced energy storage and biophysics, and many emergent technologies yet remain elusive. Herein, we introduce a unified framework to quantitatively describe and predict electrolyte conductivity that shifts from conventional molar concentration-based metrics to a volume fraction-based approach. Through analyzing a variety of electrolyte solutions via this perspective, we observe a universal conductivity peak at a 37% volume fraction. Small-angle X-ray scattering (SAXS) and molecular dynamics (MD) simulations reveal that nanometer-scale ion clusters drive this general behavior. Moreover, key geometric features of the ion transport pathwayssuch as pore size, tortuosity, and connectivityfollow a consistent dependence with respect to the volume fraction, reinforcing the argument for the universal conductivity trend. This paradigm shift opens new avenues for designing high-performance electrolytes and provides transformative insights for advancing studies in many fields, wherein molecular aggregates dictate transport properties.

Nguyen, Huong T. D.↗
DOE OSTI2026

Virtual Growth of SRF Materials

Niobium's native surface oxide affects SRF cavity and superconducting qubit performance, motivating interest in controlling its crystalline structure. We combine a literature-derived machine-learning analysis with temperature-dependent XRD to study crystalline ordering in Nb2O5. Random Forest models, trained on 74 processing conditions from 17 papers and validated by leave-one-group-out cross-validation, predicted broad crystallinity outcomes well (balanced accuracy 0.809), but struggled with specific polymorph identity (0.577). Annealing temperature was the dominant predictor across all targets; oxygen partial pressure showed negligible importance, reflecting narrow literature coverage rather than physical irrelevance. Temperature-dependent XRD on anodized and H2O2-treated Niobium showed structural evolution consistent with the machine learning predictions. Our model and overall approach provide a data-driven framework for identifying and optimizing conditions that promote crystallization in initially amorphous oxides. This framework can guide the selection of growth and post-annealing conditions for Nb surfaces by narrowing the experimental parameter space, thereby reducing trial-and-error efforts in developing oxide structures relevant to SRF applications.

Tilkin, Anthony [Fermilab]↗
DOE OSTI2026

Multi-modal dynamic radiography using short-pulse laser-generated probe beams

Radiography is an important tool for the interrogation of dynamic experiments in the fields of dynamic properties of materials, and in condensed matter, high explosive, and high-energy-density physics. Multi-modal radiography advances the hypothesis that combining the information delivered by multiple radiographic modalities can lead to more constrained (improved) “reconstruction” of the scene than can be obtained from a single probe. We identify four modalities: multi-probe, time sequence, multi-view, and multi-messenger. Multi-probe radiography is a promising candidate for a next-generation dynamic radiographic facility. High-energy X-rays are the most frequently used probe for dynamic radiography, although recent developments show the utility of proton (pRad), electron (eRad), and neutron probe beams. Because each probing species interacts with material in the radiographic scene through quantitatively different mechanisms, each returns independent information about the scene, which can add extra constraints to the reconstruction process. How to conduct detailed, quantitative “co-analysis” of multiple data streams remains an area of active research. Multi-beam, short-pulse, laser-generated probes offer sufficient dose, an appropriate spectrum, and appropriate spatio-temporal resolution to produce high-quality dynamic radiographs. This paper reports on technology development to advance the state of the art of multi-modal/multi-probe radiography and the pursuit of both deterministic and inferential (AI/ML assisted) co-analysis methodologies to produce more constrained reconstructions from multi-modal data.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2026

Roadmap and Benchmarking: Privacy in Federated Load Forecasting

Data-driven techniques for energy demand forecasting continue to emerge with promising impacts on distribution grid planning. However, the development of robust and generalizable machine learning models requires that representative high quality training data are available. Distributed energy resources have begun to embed intelligence, gathering large amounts of data on customer demand, behavior, and household devices that are connected to the grid. Though utilities aggregate meter-level demand data for load shaping, demand response, outage management, reliability planning, and billing applications, there lies an inherent privacy concern in sharing consumption data that may identify individual consumer behavioral patterns. Hence, while sharing the data is crucial, the private sensitive customer data must be safeguarded from being exposed or manipulated. In this study, we propose a roadmap for implementing a based privacy preserving framework to support the advancement of data-driven analytics in data-sensitive distributed energy resources environments. The roadmap incorporates federated learning–a distributed training framework, differential privacy–a statistical framework that provides guarantees to safeguard the leakage of sensitive data, secure multiparty computation and homomorphic encryption– techniques for encrypting model gradients and applying secure aggregation on the server. Moreover, we perform baseline experiments on the federated short-term load forecasting (STLF) task using open-source residential load profile datasets, offering insights into the challenges of integrating differential privacy into federated learning.

Abebe, Waqwoya [Oak Ridge National Laboratory (ORN↗
DOE OSTI2025

Interface Evolutionand Long-Term Performance of NegativeCarbon Fiber Structural Electrodes

Abstract Laminated structural batteries present a transformative solution to reducing weight constraints in electric vehicles. These structural batteries are based on a multifunctional material that incorporates an energy storage function within a carbon fiber-reinforced polymer. Despite the potential of this technology, the intricate morphology of fiber–matrix or electrode–electrolyte interfaces and the impact of long-term cycling at low current rates (C-rates) on these interfaces remain insufficiently understood. This study addresses these critical knowledge gaps by examining the influence of matrix composition on the long-term electrochemical performance of structural battery electrodes and exploring advanced techniques to investigate carbon fiber–matrix interfaces. Localized imaging and X-ray scattering techniques were used to characterize morphological changes at the electrode–electrolyte interfaces by analyzing negative structural electrodes. The findings revealed that the matrix composition influences long-term electrochemical behavior and fiber–matrix interface formation. While the intrinsic properties of carbon fibers largely remain unaffected by long-term cycling, cycling promotes debonding at fiber–matrix interfaces. Nonetheless, residual regions of adhesion persist, underscoring the potential for preserving multifunctionality even under prolonged cycling conditions. These insights advance the understanding of interface dynamics, which is critical for optimizing structural battery technologies.

Chemistry↗
DOE OSTI2024

Mechanochemically responsive polymer enables shockwave visualization

Abstract Understanding the physical and chemical response of materials to impulsive deformation is crucial for applications ranging from soft robotic locomotion to space exploration to seismology. However, investigating material properties at extreme strain rates remains challenging due to temporal and spatial resolution limitations. Combining high-strain-rate testing with mechanochemistry encodes the molecular-level deformation within the material itself, thus enabling the direct quantification of the material response. Here, we demonstrate a mechanophore-functionalized block copolymer that self-reports energy dissipation mechanisms, such as bond rupture and acoustic wave dissipation, in response to high-strain-rate impacts. A microprojectile accelerated towards the polymer permanently deforms the material at a shallow depth. At intersonic velocities, the polymer reports significant subsurface energy absorption due to shockwave attenuation, a mechanism traditionally considered negligible compared to plasticity and not well explored in polymers. The acoustic wave velocity of the material is directly recovered from the mechanochemically-activated subsurface volume recorded in the material, which is validated by simulations, theory, and acoustic measurements. This integration of mechanochemistry with microballistic testing enables characterization of high-strain-rate mechanical properties and elucidates important insights applicable to nanomaterials, particle-reinforced composites, and biocompatible polymers.

Science & Technology - Other Topics↗
DOE OSTI2025

Quantum mechanical dataset of 836k neutral closed-shell molecules with up to 5 heavy atoms from C, N, O, F, Si, P, S, Cl, Br

Abstract We introduce the Vector-QM24 (VQM24) dataset comprehensively covering all possible neutral closed-shell small organic and inorganic molecules with up to five heavy (p-block) atoms: C, N, O, F, Si, P, S, Cl, Br. All valid stoichiometries, Lewis-rule-consistent graphs, and stable conformers (identified via GFN2-xTB) were enumerated combinatorially, yielding 577k conformational isomers spanning 258k constitutional isomers and 5,599 unique stoichiometries. DFT (ωB97X-D3/cc-pVDZ) optimizations were performed for all, and diffusion quantum Monte Carlo (DMC@PBE0(ccECP/cc-pVQZ)) energies are provided for 10,793 lowest-energy conformers with up to 4 heavy atoms. VQM24 includes structures, vibrational modes, rotational constants, thermodynamic properties (Gibbs free energies, enthalpies, ZPVEs, entropies, heat capacities), and electronic properties such as atomization, electron interaction, exchange-correlation, dispersion energies, multipole moments (dipole to hexadecapole), alchemical potentials, Mulliken charges, and wavefunctions. Machine learning models of atomization energies on this dataset reveal significantly higher complexity than QM9, with none achieving chemical accuracy. VQM24 offers a rigorous, high-fidelity benchmark for evaluating quantum machine learning models.

Science & Technology - Other Topics↗
DOE OSTI2026

Evaluating Fracture Behavior of Bioinspired Alumina-YSZ Composites through Static and Dynamic Mechanical Testing

Ceramic materials are known for their high hardness and strength but are limited by low toughness and sudden failure. Inspired by the microstructure of dental enamel, which features undulating rods that promote crack deflection and energy absorption, architected specimens were designed and manufactured. A bespoke ball-on-ring (BoR) testing apparatus measured the static biaxial rupture strength of these bioinspired materials. Additionally, impact testing with spherical steel projectiles assessed their behavior under dynamic conditions. Monolithic alumina specimens were compared to architected alumina reinforced with yttria-stabilized zirconia (YSZ) rods produced via direct ink write 3D printing. BoR tests revealed that monolithic alumina had a Weibull modulus of 10.53 and a characteristic strength of 372.3 MPa, while the composite specimens showed a Weibull modulus of 5.46 and a characteristic strength of 213.3 MPa. Although the composite failed at lower stresses and projectile velocities, it exhibited notable crack deflection and fracture resistance, with cracks being effectively interrupted by the rod inclusions. The composite specimens also resulted in fewer and larger fragments upon impact. Finite element simulations confirmed the effectiveness of the rod structures in enhancing fracture resistance.

Bioinspired materials↗
DOE OSTI2025

Boron Nitride-Driven Strengthening of Aluminum Composites via Friction Stir Processing

Friction stir welding and processing (FSW/P) has emerged as an effective solid-state joining technique for fabricating metal matrix composites (MMCs), offering improved mechanical properties through refined microstructural evolution. In this study, an aluminum-boron nitride nanoparticle (Al-BNNP) composite was synthesized via FSW, and its indentation-based mechanical properties were systematically evaluated. Microhardness mapping across the weld cross-section revealed a progressive increase in hardness toward the stir zone (SZ), attributed to severe plastic deformation, dynamic recrystallization (DRX), and the reinforcing effect of BNNPs. Profilometry-based indentation plastometry (PIP) inferred yield strength (YS) demonstrates a 47.8% increase compared to the base metal (BM) and a 75% improvement compared to FSP pure aluminum reported in literature. This enhancement is attributed to strengthening mechanisms, including grain boundary pinning, load transfer, and increased dislocation density. The strain rate sensitivity (SRS) measurements at the nanoscale demonstrated a substantial decrease in the SZ, correlated with ultrafine grain structures and strong BNNP-matrix interactions. Activation volume analysis revealed a significant reduction in the SZ, suggesting that dislocation motion is increasingly restricted by dislocation-dislocation and dislocation-particle interactions. These findings suggest that incorporating BNNPs in FSW/P enables tailoring the microstructure without thermal degradation of the secondary particles, thereby significantly enhancing the mechanical performance of aluminum composites, particularly for structural applications in aerospace and automotive industries.

Aluminum↗
DOE OSTI2026

Predicting Atomistic Transitions with Transformers

Accurate knowledge of the atomistic transition pathways in materials and material surfaces is crucial for many material science problems. However, conventional simulation techniques used to find these transitions are extremely computationally intensive. Even with large-scale, accelerated material simulations, the computational cost constrains the applicable domain in practice. Machine learning models, with the potential to learn the complex emergent behaviors governing atomistic transitions as a fast surrogate model, have great promise to predict transitions with a vastly reduced computational cost. Here, we demonstrate how transformers can be trained to predict atomistic transitions in nano-clusters. We show how we evaluate physical validity of the predictions and how a multitude of additional, different microstates can be generated by slightly varying the data provided to the model.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Fracture Analysis of Cohesive Zone Models for Modeling Residual Stress Induced Delamination in Composite Structures

A fracture study of coupon-scale composite cylinders with embedded defects was conducted with an objective to assess and validate a modeling approach using two available cohesive material models. The study included experimental and simulation evaluations of initiation of crack growth and progression. Interrupted thermal experiments used acoustic emissions monitoring to identify the onset of crack progression during each cooling interval and ultrasonic scanning provided images of defect growth. Verification, validation, and uncertainty quantification (VVUQ) processes were performed in the assessment of the simulation predicted temperature at which crack propagation begins (quantity of interest). The Sobol sensitivity analysis identified the hoop direction elastic modulus in the carbon fiber reinforced polymer (CFRP) plies as the most influential parameter for simulations using both cohesive models, accounting for at least 70% of the variation in the temperature at crack propagation. The UQ temperature range for the Tvergaard-Hutchinson model was higher (more conservative) than the experimental acoustic measurement indicators of crack progression, while the temperature range for the Thouless-Parmigiani model enveloped the experimental data points for the primary defect size of 0.75 x 1 in. The simulations could not capture the stable crack growth indicated in the experiments. This is likely due to the models’ inability to represent anisotropic fracture toughness attributed to the structure of the orthotropic fiber weave in a woven composite laminate.

42 ENGINEERING↗
DOE OSTI2025

De Novo Design of High‐Affinity Miniprotein Binders Targeting Francisella Tularensis Virulence Factor

Abstract Francisella tularensis poses considerable public health risk due to its high infectivity and potential for bioterrorism. Francisella‐like lipoprotein (Flpp3), a key virulence factor unique to Francisella, plays critical roles in infection and immune evasion, making it a promising target for therapeutic development. However, the lack of well‐defined binding pockets and structural information on native interactions has hindered structure‐guided ligand discovery against Flpp3. Here, we used a combination of physics‐based and deep‐learning methods to design high‐affinity miniprotein binders targeting two distinct sites on Flpp3. We identified four binders for site I with binding affinities ranging between 24–110 nM. For the second site, an initial binder showed a dissociation constant ( K D ) of 81 nM, and subsequent site saturation mutagenesis yielded variants with sub‐nanomolar affinities. Circular dichroism confirmed the topology of designed miniproteins. The X‐ray crystal structure of Flpp3 in complex with a site I binder is nearly identical to the design model (Cα root‐mean‐square deviation (RMSD): 0.9 Å). These designed miniproteins provide research tools to explore the roles of Flpp3 in tularemia and should enable the development of new therapeutic candidates.

Gokce‐Alpkilic, Gizem [Molecular Engineering and S↗
DOE OSTI2024

Synthesis and investigation into explosive sensitivity for a series of new picramide explosives

Tailoring the molecular properties that govern energetic material sensitivity is essential to improve safety and help develop new energetic materials. Despite this need, understanding the complex chemistry and physics of explosive initiation and propagation is still a challenge. Recent work by our group has reinforced the view that explosive sensitivity under sub-shock conditions is connected to the strength of the weakest covalent bond in the molecule, that is, its “trigger linkage.” These correlations have been observed with different classes of energetic molecules and indicate that “trigger linkage” bond breaking, and heat of explosion are good indicators for the sensitivity trends. Herein we report the synthesis of aliphatic energetic materials with ethane, propane and neopentane backbones. Experimental and computational studies show that the trigger linkage model, based on results from quantum molecular dynamics simulations, correctly predicts trends observed in the impact sensitivity of the molecules. However, while the model predicts the impact sensitivities of the ethane series, the neopentane series has higher impact sensitivities than predicted, which is presumably influenced by crystal packing effects.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗