Search NASA⌕ Search

SEARCH · Search NASA

Results for “deep reinforcement learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

170 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Distributed quantum approximate optimization algorithm on a quantum-centric supercomputing architecture

Quantum approximate optimization algorithm (QAOA) has shown promise in solving combinatorial optimization problems by providing quantum speedup on near-term gate-based quantum computing systems. However, QAOA faces challenges for high-dimensional problems due to the large number of qubits required and the complexity of deep circuits, limiting its scalability for real-world applications. In this study, we present a distributed QAOA (DQAOA), which leverages distributed computing strategies to decompose a large computational workload into smaller tasks that require fewer qubits and shallower circuits than are necessary to solve the original problem. These sub-problems are processed using a combination of high-performance and quantum computing resources. The global solution is iteratively updated by aggregating sub-solutions, allowing convergence toward the optimal solution. We demonstrate that DQAOA can handle considerably large-scale optimization problems (e.g., 1000-bit problem), achieving a high solution quality and short time-to-solution, outperforming existing strategies. Furthermore, we realize DQAOA on a quantum-centric supercomputing architecture, paving the way for practical applications of gate-based quantum computers in real-world optimization tasks. To extend DQAOA’s applicability to materials science, we further develop an active learning algorithm integrated with our DQAOA (AL-DQAOA), which involves machine learning, DQAOA, and active data production in an iterative loop. We successfully optimize photonic structures using AL-DQAOA, indicating that solving real-world optimization problems using gate-based quantum computing is feasible. We expect the proposed DQAOA to be applicable to a wide range of optimization problems and AL-DQAOA to find broader applications in material design.

Kim, Seongmin [ORNL] (ORCID:0000000159063004)↗
DOE OSTI2025

A Reductively Stable Electrolyte Realizes Deep Cycling Behavior in Anode‐free Sodium Batteries

For anode‐free sodium batteries to achieve practical consideration, highly reversible chemistries require exceptional ≥99.95% coulombic efficiencies that maintain over prolonged cycling periods. To do so, consumption of this severely limited sodium inventory must be restricted while metal nucleation processes that comprise the in situ formed metal anode are improved. Herein, we describe a fluorine‐free carborane electrolyte that satisfies these criteria by emphasizing reductive stability and weakly coordinating anion behavior as design principles. We find this approach promotes the development of a thin, robust SEI chemistry rich in both organic speciation and boron. The electrolyte described herein exhibits ideal metal nucleation behavior on one‐micron thin carbonaceous current collector surfaces and achieves a metal deposition/stripping efficiency near parity for 400 cycles. This novel anode chemistry is introduced to anode‐free full cell configurations where 87% of the initial discharge capacity is retained after 1000 cycles at 2.0 C. In conclusion, post‐test characterization of deep‐cycled anode‐free cells reveals suppressed capacity fade in these systems is attributed to the chemical stability of the carborane anion.

anode-free↗
DOE OSTI2026

Nuclear–Electronic Orbital General Rate Theory: Predicting Hydrogen Kinetic Isotope Effects in the Deep Tunneling Regime

Hydrogen transfer is a critical component of many chemical and biological processes. The ratio of rate constants for hydrogen and deuterium transfer defines the H/D kinetic isotope effect (KIE), which is a powerful tool for elucidating hydrogen transfer mechanisms. Interpretation of experimental H/D KIEs relies on accurate and affordable computational methods. However, due to their light mass, hydrogen and deuterium can undergo tunneling, which is challenging to describe in multidimensional molecular systems. Herein, we introduce the nuclear–electronic orbital general rate theory (NEO-GRT), which enables the efficient prediction of H/D KIEs based on full-dimensional molecular quantum chemistry calculations. The NEO-GRT approach describes the hydrogen transfer rate constant with a general expression that spans the vibrationally adiabatic and nonadiabatic hydrogen tunneling regimes. The input quantities are computed using NEO density functional theory, which treats the transferring hydrogen or deuterium nucleus quantum mechanically on the same level as the electrons. We investigate two intramolecular proton transfer reactions in organic molecules at temperatures down to 50 K to evaluate the performance of NEO-GRT by comparison to transition state theory and ring-polymer instanton theory. The KIEs computed with NEO-GRT agree with those calculated using ring-polymer instanton theory for the full-dimensional molecular systems at the same level of electronic structure theory. This agreement indicates that NEO-GRT captures the deep hydrogen tunneling effects, in contrast to transition state theory, which neglects such effects. Given its relatively low computational cost, NEO-GRT is a promising approach for predicting H/D KIEs in large organic and organometallic systems.

Hydrogen↗
DOE OSTI2025

Adsorptive behavior of poly (vinylidene fluoride) membranes for the recovery of lignin-derived hydrophobic deep eutectic solvents

Abstract Recently, membrane technology has gained significant traction as an energy-efficient alternative to traditional thermal processes for solvent recovery. Deep eutectic solvents (DESs) have emerged as sustainable alternatives to conventional organic solvents, yet a systematic methodology for selecting compatible membrane materials for their recovery remains underdeveloped. This study established a predictive framework for membrane material selection in hydrophobic DES applications using Hansen Solubility Parameters (HSP) with inverted criteria targeting materials with relative energy difference (RED) values greater than 1.0. Flat sheet membranes were fabricated via the non-solvent induced phase separation (NIPS) technique. Four NIPS fabricated polymer membranes were evaluated: polysulfone, cellulose acetate, polyvinylidene fluoride (PVDF) fabricated with polyethylene glycol (PEG) as a pore-forming agent, and polybenzimidazole (PBI). The HSP approach successfully predicted membrane-solvent compatibility, with polysulfone (RED = 0.6) and cellulose acetate (RED = 0.9) dissolving completely within 24 h, while PVDF (RED = 1.9) and PBI (RED = 1.1) maintained structural integrity throughout a 7-day exposure period. Furthermore, PVDF demonstrated superior performance with minimal weight gain (3.0%), hydrophobic surface characteristics (122° water contact angle), and enhanced mechanical properties following DES exposure. Comprehensive chemical and morphological characterization confirmed PVDF’s chemical stability and revealed a surface-selective interaction mechanism involving simultaneous PEG (pore-forming agent) extraction and DES component adsorption. Adsorption kinetics followed pseudo-first-order behavior with reversible characteristics, best described by the Temkin isotherm model (R² = 0.9987). PVDF membranes-maintained separation functionality with average lignin rejection (75.2 ± 7.69%) and demonstrated filtration permeability of 2.0 ± 0.34 LMH/bar. This methodology provides a rational approach for membrane selection in emerging solvent systems, contributing to the advancement of sustainable separation technologies for DES-based biomass processing applications.

Science & Technology - Other Topics↗
DOE OSTI2026

Aerosol-deep convection interaction based on joint cell-thermal tracking in Large Eddy Simulations during the TRACER campaign

In cumulus clouds, aerosol concentrations control cloud droplet concentrations, modifying cloud radiative properties, precipitation processes, and cloud electrification. However, mechanisms of aerosol-deep convection interactions are not well understood due to complex cloud dynamics and microphysics. We investigate the interaction of aerosols with isolated deep convection using Large Eddy Simulations of two cases during the TRacking Aerosol Convection interactions ExpeRiment (TRACER) near Houston, Texas, using a joint cell-thermal tracking algorithm. Cumulus thermals are droplet generators, since supersaturation and droplet nucleation coincide with thermal centers, where the strongest updrafts occur. Primary ice crystal formation does not take place inside thermals, but at layers where previous thermals detrained moisture. As subsequent thermals containing supercooled droplets penetrate these layers, hail and graupel form at or near these thermals. Higher aerosol concentrations result in higher droplet concentrations that suppress drizzle, delay warm rain processes, and transport more moisture aloft. This increases snow and ice amount, as well as graupel and hail, leading to more lightning. Polluted thermals initiate at slightly higher altitudes, and are slightly larger and faster, suggesting a weak invigoration. We also find more thermals per cell, but fewer isolated cells, since convection is more aggregated and intense, especially near the end of the 24 h simulation. Non-linear mesoscale feedback likely triggered by temperature and moisture responses to aerosol-thermal interactions causes the aggregation. Time-lagged aerosol-reinitialization experiments show that the mesoscale response is the predominant forcing for the invigoration. These changes happen within one day, on a smaller scale than previously suggested.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Stoichiometry dependent properties of cerium hydride: An active learning developed interatomic potential study

Cerium hydride has a variety of interesting properties, including a known lattice contraction and densification with increasing hydrogen content. However, precise stoichiometric control is not experimentally straightforward and ab initio approaches are not computationally feasible for many properties such as melting and low temperature diffusion. Therefore, we develop a machine-learned interatomic potential for cerium hydride that is valid for H to Ce ratios from 2.0 to 3.0. A query-by-committee active learning approach is used to develop the training set. Leveraging classical molecular dynamics simulations, we assess a range of properties and provide fundamental mechanisms for the trends with stoichiometry. Finally, a majority of the properties follow the trend of lattice contraction, being governed by the stronger lattice binding induced by adding octahedral atoms.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Detecting thermodynamic phase transition via explainable machine learning of photoemission spectroscopy

Identifying thermodynamic signatures of electronic phases, such as superconductivity, is challenging in low-dimensional materials due to strong fluctuations and low probing volume. Spectroscopic methods are often used to identify new bulk phases, but their main measurable quantity—electronic energy gaps—is no longer an effective order parameter in low-dimensional and fluctuating systems. Combining angle-resolved photoemission with a domain-adversarial neural network, we report a data-driven method to identify thermodynamic phase transitions solely based on single-particle spectra. We demonstrate 97.6% accuracy in cuprate superconductor Bi 2 Sr 2 CaCu 2 O 8+δ with strong superconducting fluctuations. This model notably compensates for the scarcity of experimental data by leveraging virtually inexhaustible simulated data. Further, its explainability reveals the crucial role of in-gap spectral weight in detecting phase fluctuations and thermodynamic transitions. Our work pinpoints the spectroscopic signatures of fluctuating orders and enables using spectroscopy for machine-learning-assisted material discovery for low-dimensional and strong coupling systems.

2D materials↗
DOE OSTI2026

A generative machine learning model for designing metal hydrides applied to hydrogen storage

Developing new metal hydrides is a critical step toward efficient hydrogen storage in carbon-neutral energy systems. However, existing materials databases, such as the Materials Project, contain a limited number of well-characterized hydrides, which constrains the discovery of optimal candidates. This work presents a framework that integrates causal discovery with a lightweight generative machine learning model to generate novel metal hydride candidates that may not exist in current databases. Using a dataset of 450 samples (270 training, 90 validation, and 90 testing), the model generates 1000 candidates. After ranking and filtering, six previously unreported chemical formulas and crystal structures are identified, four of which are validated by density functional theory simulations and show strong potential for future experimental investigation. Overall, the proposed framework provides a scalable and time-efficient approach for expanding hydrogen storage datasets and accelerating materials discovery.

generative model↗
DOE OSTI2026

Machine Learning for Multipactor Susceptibility Prediction in Planar RF Gaps

Multipactor discharge is a nonlinear electron avalanche that limits the performance of high-power radio-frequency (RF) and vacuum electronic devices. Predicting multipactor susceptibility traditionally relies on Monte Carlo or particle-in-cell (PIC) simulations, which become computationally expensive for large parametric studies. In this work, we present a supervised machine-learning (ML) framework for prediction of multipactor susceptibility in a two-surface planar geometry. The models are trained using high-fidelity PIC simulation generated susceptibility data and learn the relationship between operational parameters, geometry, and material-dependent secondary electron emission properties. The proposed approach enables rapid reconstruction of susceptibility charts while preserving the physical structure of multipactor growth regions.

43 PARTICLE ACCELERATORS↗
DOE OSTI2025

Generative learning of densities on manifolds

A generative modeling framework is proposed that combines diffusion models and manifold learning to efficiently sample data densities on manifolds. The approach utilizes Diffusion Maps to uncover possible low-dimensional underlying (latent) spaces in the high-dimensional data (ambient) space. Two approaches for sampling from the latent data density are described. The first is a score-based diffusion model, which is trained to map a standard normal distribution to the latent data distribution using a neural network. The second one involves solving an Itô stochastic differential equation in the latent space. Additional realizations of the data are generated by lifting the samples back to the ambient space using Double Diffusion Maps , a recently introduced technique typically employed in studying dynamical system reduction; here the focus lies in sampling densities rather than system dynamics. The proposed approaches enable sampling high dimensional data densities restricted to low-dimensional, a priori unknown manifolds. The efficacy of the proposed framework is demonstrated through a benchmark problem and a material with multiscale structure.

Double diffusion maps↗
DOE OSTI2024

Learning Nonlinear Reduced Models from Data with Operator Inference

This review discusses Operator Inference, a nonintrusive reduced modeling approach that incorporates physical governing equations by defining a structured polynomial form for the reduced model, and then learns the corresponding reduced operators from simulated training data. The polynomial model form of Operator Inference is sufficiently expressive to cover a wide range of nonlinear dynamics found in fluid mechanics and other fields of science and engineering, while still providing efficient reduced model computations. The learning steps of Operator Inference are rooted in classical projection-based model reduction; thus, some of the rich theory of model reduction can be applied to models learned with Operator Inference. This connection to projection-based model reduction theory offers a pathway toward deriving error estimates and gaining insights to improve predictions. Furthermore, through formulations of Operator Inference that preserve Hamiltonian and other structures, important physical properties such as energy conservation can be guaranteed in the predictions of the reduced model beyond the training horizon. This review illustrates key computational steps of Operator Inference through a large-scale combustion example.

Mechanics↗
DOE OSTI2026

Active learning using hybrid surrogate tool life modeling for machining process optimization

Here, this paper describes an active learning approach for part-to-part iterative machining process optimization using a hybrid surrogate tool life model. A probabilistic interpolating tool life model is developed by combining the empirical Taylor-type tool life equation and the model fit error. The probabilistic tool life model is then used to calculate the machining cost per part distribution. The optimal machining parameters are selected using an expected improvement in machining cost per part criterion. The method is validated numerically using experimental results; the results show a median convergence error of 2.2% after three tests over 400 simulations. The method is validated experimentally on two industrial applications for Ti-6Al-4V roughing resulting in a cost per part reduction greater than 23% after two tests. The described method is a robust solution for rapid convergence to optimal machining parameters in an industrial production environment.

Active learning↗