SEARCH · Search NASA
Results for “Reinforcement learning”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Reinforcement learning framework for the mechanical design of microelectronic components under multiphysics constraints
Explore the source record for details and available documents.
Optimization of the FRIB beam dump: a hybrid genetic algorithm and reinforcement learning approach
The operational envelope of high-power-density systems, such as particle accelerators and advanced nuclear energy systems, is critically constrained by the need to manage extreme thermal loads. To address this, we present a novel hybrid optimization framework combining a genetic algorithm (GA) with a soft actor-critic (SAC) deep reinforcement learning agent. This framework was applied to a practical high-heat-flux problem: redesigning the beam dump at the Facility for Rare Isotope Beams (FRIB) for a power upgrade from 20 kW to 50 kW. The resulting design, validated by three-dimensional conjugate heat transfer simulations, suppresses hazardous hot spots and yields a markedly more uniform temperature distribution. This provides a robust operating margin, increasing the average power-handling capability by 72% relative to the current design, demonstrating the framework’s potential to solve complex thermal management challenges in both accelerator technology and advanced nuclear systems.
User-Centric Communication With Aerial Network for 6G: A Reinforcement Learning Approach
Meeting the diverse needs of user verticals requires innovative cellular architectures that can offer additional degrees of freedom to provide on-demand services. The terrestrial user-centric radio access network (UC-RAN) stands out as an excellent choice for this purpose. However, a drawback of UC-RAN is its tendency to prioritize high-priority verticals, often resulting in a subpar quality of experience for low-priority verticals. This issue is particularly exacerbated in hotspot areas. Here, to address this problem, we introduce an aerial network integrated with terrestrial UC-RAN to provide coverage to users which are not served by the terrestrial network. Furthermore, we analyze the impact of key configuration and optimization parameters (COPs), such as location, transmit power, altitude, and beamwidth of aerial base stations (ABSs) on system key performance indicators (KPIs), such as coverage, latency satisfaction, average spectral efficiency, and energy efficiency. We formulate a robust multiobjective function to maximize these KPIs without biasing toward any specific KPI(s). Finally, we propose a deep reinforcement learning optimization framework based on the state-of-the-art soft actor-critic algorithm to control ABS COPs and optimize system KPIs. Experimental evaluations demonstrate that the proposed optimization framework can converge to near-optimal solutions derived from the pseudo brute force in a few thousand epochs.
Feedback, physics, and forecasts: The emerging paradigm of machine learning-driven battery research
Machine learning (ML) is reshaping how we understand, predict, and optimize electrochemical systems. In batteries, ML accelerates discovery across chemistry, design, and operation by transforming massive experimental and simulated datasets into predictive, interpretable models. This review consolidates a decade of progress in ML-driven battery innovation, from early-cycle feature extraction to operando image analysis and physics-informed modeling. We categorize approaches by data domain and physical fidelity, emphasizing interpretable ML for diagnostics, reinforcement learning for control, and multi-objective optimization for lifetime extension strategies. Additionally, we demonstrate how integrated models accelerate discovery, reduce testing time, and guide sustainable design. Economic analyses furthermore illustrate how these advances can lower cost per cycle and improve circularity. Together, these developments chart a path toward self-optimizing, sustainable battery technologies.
Micrometer: Micromechanics transformer for predicting full field mechanical responses of heterogeneous materials
Predicting mechanical responses of heterogeneous materials across scales remains a significant challenge. Traditional computational methods often struggle with complex and multiscale nature of these materials, limiting their effectiveness in real-world applications. Here, in this paper, we introduce Micrometer, a vision transformer based deep learning model designed to predict full field mechanical responses of heterogeneous materials, bridging the gap between computer vision and solid mechanics problems. We show that Micrometer, trained on a large-scale high-resolution dataset of 2D fiber-reinforced composites, can achieve state-of-the-art performance in predicting microscale strain fields across a wide range of material properties and loading conditions. Our model demonstrates accuracy and computational efficiency in applications such as computational homogenization and multiscale modeling, reducing computational time by up to two orders of magnitude compared to conventional numerical solvers while maintaining less than 1 % errors in predicting macroscale stress fields. Furthermore, we showcase Micrometer’s adaptability through transfer learning experiments on new materials with limited data, highlighting its potential to tackle diverse scenarios in computational solid mechanics. These results represent a significant step towards AI-driven innovation in materials science, addressing the limitations of traditional numerical methods and paving the way for more efficient simulations of heterogeneous materials across various industrial applications.
Large Language Model for Validation, Optical Calibration, and Learning (VOCAL) Distributed Temperature Sensing Interface
Distributed temperature sensing (DTS) using fiber optic sensors (FOS) offers a promising method for temperature measurements in advanced reactors, such as sodium fast reactors and molten salt cooled reactors. To support the calibration and validation of DTS measurements, Argonne National Laboratory developed the Validation, Optical Calibration, and Learning (VOCAL) software package. This report describes the integration of a local large language model (LLM) with a retrieval-augmented generation (RAG) system into the VOCAL interface to serve as an interactive user assistant. The LLM framework enhances the VOCAL platform’s accessibility to users by explaining interface components, clarifying inputs and outputs, and answering user queries dynamically in real-time. The accuracy of the LLM assistant performance was evaluated with 20 queries regarding the interface and its parameters using experimental data from the Thermal Hydraulic Experimental Test Article (THETA) facility. Results demonstrate that the LLM achieved a 95% accuracy rate, with a BERTScore of 0.8816 and SBERT value of 0.7417. Furthermore, validation of the RAG system within the LLM framework showed optimal accuracy with k-values between 1 and 2 using the k-refinement convergence test. The prompt perturbation analysis demonstrated good initial consistency for the RAG system, exhibiting the highest accuracy under punctuation variations and the greatest sensitivity under query reordering. Notably, the model’s errors were limited to data retrieval failures rather than factual hallucinations, reinforcing its baseline reliability. The integration of LLM provides a highly accurate, userfriendly enhancement to the VOCAL platform without disrupting its core computational capabilities for FOS calibration and validation.
Validation of Ultrasonic Techniques for Reinforcing Bar Stress Measurement in Concrete Structures Considering Temperature Effect
Explore the source record for details and available documents.
Coordinated Architectural and Chemical Reinforcement in the Crushing Mandible of a Soldier Termite
Explore the source record for details and available documents.
Design Trade-Offs in Composite Fuel Cell Membranes: Effects of Reinforcement and Chemical Additives
Perfluorosulfonic acid (PFSA) membranes are critical components in proton exchange membrane fuel cells, where performance depends on balancing ionic conductivity, mechanical durability, and chemical stability. This study characterizes a composite membrane (NC700) featuring PFSA-impregnated expanded polytetrafluoroethylene (ePTFE) reinforcement and cerium-based radical scavengers, benchmarked against unreinforced NR211. Complementary techniques, including electron microscopy, X-ray scattering, infrared spectroscopy, thermogravimetric analysis, and dynamic mechanical analysis, identify the structural and compositional strategies employed in NC700. Water sorption isotherms reveal lower water uptake for NC700 across all conditions, attributed to reinforcement and cerium incorporation. Reinforcement reduces in-plane swelling from 11% to 2.1% at 90% RH, confirming strong swelling anisotropy, while maintaining mechanical properties at elevated temperatures. While the ionic conductivity of NC700 is approximately 10% lower than that of NR211, the reduced thickness yields a 40% decrease in calculated area-specific resistance, suggesting the composite architecture can favorably shift the conductivity-stability trade-off. The composite structure also reduces gas permeability, indicating potential for improved separator function alongside favorable transport properties. Systematic deconvolution of reinforcement and additive contributions shows that conductivity losses from cerium incorporation are largely offset by gains from the lower equivalent-weight polymer, providing quantitative relationships that may guide composite membrane design for fuel cells and other electrochemical applications.
Polymer grafted aramid nanofiber reinforces immiscible waste polypropylene/poly(ethylene terephthalate)
Polypropylene (PP) and poly(ethylene terephthalate) (PET) are plastics commonly used for packaging because of their excellent barrier and mechanical properties. The properties of these plastics are often diminished after mechanical recycling, inevitably causing down-cycling. Furthermore, this problem is exacerbated when different kinds of polymers mix. Aramid nanofibers have the potential to improve the mechanical properties of polymers due to their excellent mechanical properties but their poor dispersion in polymers is a challenge. Grafting polymers onto nanofibers can help address this challenge. In this work, different loading levels (1%, 2%, and 5%) of polymer grafted aramid nanofibers (ANFs) are blended with waste PP/PET (90/10), simulating a PP waste stream containing traces of PET contaminants. Scanning electronic microscopy, rheology, and differential scanning calorimetry results show the affinity of PP functionalized aramid nanofibers (PP_ANF) towards the PP matrix. At 1 wt% of the nanofiber, the size of the PET droplets in the PP matrix of the PP_ANF blend range from 0.2 to 2.0 μm while that of unmodified ANF and PET_ANF blends are in the range of 0.1–6.2 and 0.5–7.4 μm, respectively. In summary, polymer grafted ANFs have the tendency of improving properties of its like polymers due to similarity in the grafting polymer and the polymer matrix.
Enhancement of the Physical and Mechanical Properties of Cellulose Nanofibril-Reinforced Lignocellulosic Foams for Packaging and Building Applications
Biobased foams have the potential to serve as eco-friendly alternatives to petroleum-based foams, provided they achieve comparable thermomechanical and physical properties. We propose a facile approach to fabricate eco-friendly cellulose nanofibril (CNF)-reinforced thermomechanical pulp (TMP) fiber-based foams via an oven-drying process with thermal conductivity as low as 0.036 W/(m·K) at a 34.4 kg/m3 density. Acrodur®, iron chloride (FeCl3), and cationic polyacrylamide (CPAM) were used to improve the foam properties. Acrodur® did not have any significant effect on the foamability and density of the foams. Mechanical, thermal, cushioning, and water absorption properties of the foams were dependent on the density and interactions of the additives with the fibers. Due to their high density, foams with CPAM and FeCl3 at a 1% additive dosage had significantly higher compressive properties at the expense of slightly higher thermal conductivity. There was slight increase in compressive properties with the addition of Acrodur®. All additives improved the water stability of the foams, rendering them stable even after 24 h of water absorption.
Effects of high-dose neutron irradiation at light-water reactor relevant temperature on the mechanical properties of SiC/SiC composites
For this study, the neutron dose-dependent evolutions and the underlying mechanisms of properties of SiC fiber-reinforced SiC matrix (SiC/SiC) composites at a temperature relevant to light-water reactors (∼600 K) were investigated and analyzed. Chemical vapor infiltrated (CVI) SiC/SiC composites reinforced with Hi-Nicalon Type S or Tyranno SA3 fiber were neutron-irradiated to doses up to 30 dpa. The irradiated composites retained their flexural strengths. The thermal diffusivity and dimensional changes were mostly retained from 2.0 to 30.2 dpa. Discrepancies in irradiation responses among CVI SiC/SiC composites from different sources were found. Additional microstructural analysis using Raman spectroscopy and numerical analysis on irradiation effect on residual stress were used to explain how the microstructural variables, especially of carbon interphases, affect the mechanical properties in the 30–40 dpa dose range.
PET waste- and bio-derived imine vitrimers for shape-memory, intrinsic flame-retardant, and recyclable carbon fiber composites
Developing circular multifunctional vitrimers and carbon fiber–reinforced polymers (CFRPs) that are simultaneously recyclable, mechanically robust, and intrinsically flame retardant remains a major challenge. Here, in this study, we report multifunctional vitrimers and their carbon fiber–reinforced vitrimer (CFRV) composites, where the vitrimer design integrates closed-loop recyclability, enhanced interfacial adhesion, and intrinsic flame retardancy within a single materials platform. The vitrimer matrix is synthesized from post-consumer polyethylene terephthalate (PET) waste and a vanillin-derived phosphorus-containing crosslinker, forming an imine-based network. The resulting vitrimer resin exhibits high tensile strength, thermal healability, repeated reprocessability, programmable shape memory, and rapid chemical depolymerization under mild conditions. Amine-functionalized carbon fibers significantly improve fiber–matrix interfacial bonding, yielding CFRVs with tensile strengths up to 789 MPa and complete recovery of structurally intact fibers after chemical recycling. The phosphorus-rich aromatic network further imparts intrinsic flame retardancy, enabling self-extinguishing behavior without external additives. This work advances a materials design paradigm for next-generation multifunctional, sustainable vitrimers and CFRVs, while simultaneously addressing the recycling challenges associated with both plastic and CFRP waste.
Hamiltonian switching control of noisy bipartite qubit systems
Abstract We develop a Hamiltonian switching ansatz for bipartite control that is inspired by the quantum approximate optimization algorithm, to mitigate environmental noise on qubits. We demonstrate the control for a central spin coupled to bath spins via isotropic Heisenberg interactions, and then make physical applications to the protection of quantum gates performed on superconducting transmon qubits coupling to environmental two-level-systems (TLSs) through dipole-dipole interactions, as well as on such qubits coupled to both TLSs and a Lindblad bath. The control field is classical and acts only on the system qubits. We use reinforcement learning with policy gradient to optimize the Hamiltonian switching control protocols, using a fidelity objective for specific target quantum gates. We use this approach to demonstrate effective suppression of both coherent and dissipative noise, with numerical studies achieving target gate implementations with fidelities over 0.9999 (four nines) in the majority of our test cases and showing improvement beyond this to values of 0.999 999 999 (nine nines) upon a subsequent optimization by GRadient Ascent Pulse Engineering (GRAPE). We analyze how the control depth, total evolution time, number of environmental TLS, and choice of optimization method affect the fidelity achieved by the optimal protocols and reveal some critical behaviors of bipartite control of quantum gates.
An Overview of Electric Vehicle Load Modeling Strategies for Grid Integration Studies
The adoption of electric vehicles (EVs) has emerged as a solution to reduce greenhouse gas emissions in the transportation sector, which has motivated the implementation of public policies to promote their use in several countries. However, the high adoption of EVs poses challenges for the electricity sector, as it would imply an increase in energy demand and possible impacts on the power quality (PQ) of the power grid. Therefore, it is important to conduct EV integration studies in the power grid to determine the amount that can be incorporated without causing problems and identify the areas of the power sector that will require reinforcements. Accurate EV load patterns are required for this type of study that, through mathematical modeling, reflect both the dynamic behavior and the factors that influence the decision to recharge EVs. This article aims to present an overview of EVs, examine the different factors considered in the literature for modeling EV load patterns, and review modeling methods. EV load modeling methods are classified into deterministic, statistical, and machine learning. The article shows that each modeling method has its advantages, disadvantages, and data requirements, ranging from simple load modeling to more accurate models requiring large datasets.
Balancing Opportunity and Risk of Onboard Machine Learning for The NGSS Successor
Explore the source record for details and available documents.
Atomistic Modeling of Fusion Energy Materials using machine learned interatomic potentials
Explore the source record for details and available documents.