Reinforcement learning framework for the mechanical design of microelectronic components under multiphysics constraints
Explore the source record for details and available documents.
Nair, Siddharth [Purdue University]↗
SEARCH · Search NASA
Results for “Reinforcement learning”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Optimization of the FRIB beam dump: a hybrid genetic algorithm and reinforcement learning approach
The operational envelope of high-power-density systems, such as particle accelerators and advanced nuclear energy systems, is critically constrained by the need to manage extreme thermal loads. To address this, we present a novel hybrid optimization framework combining a genetic algorithm (GA) with a soft actor-critic (SAC) deep reinforcement learning agent. This framework was applied to a practical high-heat-flux problem: redesigning the beam dump at the Facility for Rare Isotope Beams (FRIB) for a power upgrade from 20 kW to 50 kW. The resulting design, validated by three-dimensional conjugate heat transfer simulations, suppresses hazardous hot spots and yields a markedly more uniform temperature distribution. This provides a robust operating margin, increasing the average power-handling capability by 72% relative to the current design, demonstrating the framework’s potential to solve complex thermal management challenges in both accelerator technology and advanced nuclear systems.
Accelerator↗
User-Centric Communication With Aerial Network for 6G: A Reinforcement Learning Approach
Meeting the diverse needs of user verticals requires innovative cellular architectures that can offer additional degrees of freedom to provide on-demand services. The terrestrial user-centric radio access network (UC-RAN) stands out as an excellent choice for this purpose. However, a drawback of UC-RAN is its tendency to prioritize high-priority verticals, often resulting in a subpar quality of experience for low-priority verticals. This issue is particularly exacerbated in hotspot areas. Here, to address this problem, we introduce an aerial network integrated with terrestrial UC-RAN to provide coverage to users which are not served by the terrestrial network. Furthermore, we analyze the impact of key configuration and optimization parameters (COPs), such as location, transmit power, altitude, and beamwidth of aerial base stations (ABSs) on system key performance indicators (KPIs), such as coverage, latency satisfaction, average spectral efficiency, and energy efficiency. We formulate a robust multiobjective function to maximize these KPIs without biasing toward any specific KPI(s). Finally, we propose a deep reinforcement learning optimization framework based on the state-of-the-art soft actor-critic algorithm to control ABS COPs and optimize system KPIs. Experimental evaluations demonstrate that the proposed optimization framework can converge to near-optimal solutions derived from the pseudo brute force in a few thousand epochs.
6G↗
Deep RL for Fast Long-Horizon Operations Scheduling on NASA's Carruthers Geocorona Observatory Mission
Spacecraft operations scheduling is a highly constrained, long-horizon combinatorial optimization problem that traditionally relies on heuristics, constraint programming, or manual planning. We present a scalable deep reinforcement learning framework developed and deployed for NASA’s Carruthers Geocorona Observatory mission. Our framework introduces a macro-action abstraction known as activity blocks coupled with dynamic action-masking to navigate the intractably large search space and strictly enforce complex power, thermal, and instrument constraints. The resulting architecture generates globally feasible schedules with overwhelming probability, establishes operational trust, and executes a full training cycle in under six hours, circumventing the need for policy robustness by enabling rapid, on-demand retraining. Further, resulting schedules outperform baseline heuristics in scheduled science quality. The deep reinforcement learning framework was deployed as the default operational scheduler for the Carruthers Geocorona Observatory mission from the outset of the mission, demonstrating that deep reinforcement learning can be trusted for real spacecraft operations under complex, evolving constraints.
Geocorona↗
Manufacturing Process Development of a Carbon Fiber Reinforced Polymer Composite Shaft for Electric Motors
Electric aircraft applications require electric motors with increased specific power and efficiency. Composite structural components in motors are a potential solution for reducing motor mass, reducing magnetic losses, and limiting undesired conduction paths for fault, electromagnetic interference, or common-mode currents. In this report, manufacturing trials for a high-speed carbon fiber reinforced polymer composite motor shaft are presented. Four prototype shafts were produced using a hybrid biaxial/triaxial fabric that was circumferentially wrapped onto an additively manufactured high-temperature washout mandrel. An additional traditional overbraid approach was also evaluated and shows promise for high-rate, high-performance parts using automated manufacturing. This paper discusses the shaft design, manufacturing methods explored, material selection, the manufacturing trials, and the lessons learned. The results of this manufacturing investigation show feasibility for manufacturing composite shafts for electric motors.
Electric moto shaft↗
Feedback, physics, and forecasts: The emerging paradigm of machine learning-driven battery research
Machine learning (ML) is reshaping how we understand, predict, and optimize electrochemical systems. In batteries, ML accelerates discovery across chemistry, design, and operation by transforming massive experimental and simulated datasets into predictive, interpretable models. This review consolidates a decade of progress in ML-driven battery innovation, from early-cycle feature extraction to operando image analysis and physics-informed modeling. We categorize approaches by data domain and physical fidelity, emphasizing interpretable ML for diagnostics, reinforcement learning for control, and multi-objective optimization for lifetime extension strategies. Additionally, we demonstrate how integrated models accelerate discovery, reduce testing time, and guide sustainable design. Economic analyses furthermore illustrate how these advances can lower cost per cycle and improve circularity. Together, these developments chart a path toward self-optimizing, sustainable battery technologies.
artificial intelligence↗
Micrometer: Micromechanics transformer for predicting full field mechanical responses of heterogeneous materials
Predicting mechanical responses of heterogeneous materials across scales remains a significant challenge. Traditional computational methods often struggle with complex and multiscale nature of these materials, limiting their effectiveness in real-world applications. Here, in this paper, we introduce Micrometer, a vision transformer based deep learning model designed to predict full field mechanical responses of heterogeneous materials, bridging the gap between computer vision and solid mechanics problems. We show that Micrometer, trained on a large-scale high-resolution dataset of 2D fiber-reinforced composites, can achieve state-of-the-art performance in predicting microscale strain fields across a wide range of material properties and loading conditions. Our model demonstrates accuracy and computational efficiency in applications such as computational homogenization and multiscale modeling, reducing computational time by up to two orders of magnitude compared to conventional numerical solvers while maintaining less than 1 % errors in predicting macroscale stress fields. Furthermore, we showcase Micrometer’s adaptability through transfer learning experiments on new materials with limited data, highlighting its potential to tackle diverse scenarios in computational solid mechanics. These results represent a significant step towards AI-driven innovation in materials science, addressing the limitations of traditional numerical methods and paving the way for more efficient simulations of heterogeneous materials across various industrial applications.
Composite materials↗
Large Language Model for Validation, Optical Calibration, and Learning (VOCAL) Distributed Temperature Sensing Interface
Distributed temperature sensing (DTS) using fiber optic sensors (FOS) offers a promising method for temperature measurements in advanced reactors, such as sodium fast reactors and molten salt cooled reactors. To support the calibration and validation of DTS measurements, Argonne National Laboratory developed the Validation, Optical Calibration, and Learning (VOCAL) software package. This report describes the integration of a local large language model (LLM) with a retrieval-augmented generation (RAG) system into the VOCAL interface to serve as an interactive user assistant. The LLM framework enhances the VOCAL platform’s accessibility to users by explaining interface components, clarifying inputs and outputs, and answering user queries dynamically in real-time. The accuracy of the LLM assistant performance was evaluated with 20 queries regarding the interface and its parameters using experimental data from the Thermal Hydraulic Experimental Test Article (THETA) facility. Results demonstrate that the LLM achieved a 95% accuracy rate, with a BERTScore of 0.8816 and SBERT value of 0.7417. Furthermore, validation of the RAG system within the LLM framework showed optimal accuracy with k-values between 1 and 2 using the k-refinement convergence test. The prompt perturbation analysis demonstrated good initial consistency for the RAG system, exhibiting the highest accuracy under punctuation variations and the greatest sensitivity under query reordering. Notably, the model’s errors were limited to data retrieval failures rather than factual hallucinations, reinforcing its baseline reliability. The integration of LLM provides a highly accurate, userfriendly enhancement to the VOCAL platform without disrupting its core computational capabilities for FOS calibration and validation.
Hong, Evan↗
In-Situ Scanning Electron Microscope Experiments for Microscale Mechanical Testing and Validated Modeling of Fiber Reinforced Thermoplastics
A novel, in-situ, scanning electron microscope (SEM) mechanical testing capability for materials at the microscale which provides experimental validation to a machine learning (ML) toolset for full-field validation of physics-based micromechanics models is being developed by researchers at NASA Glenn Research Center. These are enabling technologies for the integration of multiscale digital twins for materials into system level models which will result in the improved performance, material discovery, reduced production cost and time, rapid characterization, and prognostic structural health monitoring (SHM) for materials and structures for extreme environments in support of NASA space exploration missions. In order to bridge the material structure-to-system gap for digital twins, physics-based models must be experimentally validated at multiple length scales. Seminal microscale experiments, conducted at the Air Force Research Laboratory (AFRL), were limited to transverse compression of single-layer, unidirectional thermoset polymer matrix composite (PMC) micropillar specimens [1]. The early phases of the current project followed those initial results and setup to reproduce the compression testing of PMC material on the custom-built piezoelectric actuated micromechanical testing rig built by MicroTesting Solutions LLC. In this work, samples of thermoplastic PMC material were first machined into 3 mm cubes, and then further machining and final milling was done using a Focused Ion Beam (FIB). The initial experiment was done on a pillar roughly 20 µm x 20 µm x 40 µm tall. Additional pillars were milled with final sizes ranging from 20 µm x 20 µm x 40 µm tall to 40 µm x 40 µm x 65 µm tall. A speckle pattern for in-situ full-field measurements using Digital Image Correlation (DIC) was applied with platinum, which was coated on the surface, and then the FIB was used to mill away some of the coating to produce an irregular pattern of Pt on the pillar surface. The samples were loaded into the custom testing rig and placed into the SEM and loaded under compression until failure. Images were collected in the SEM during testing. Post-processing of the images was conducted using DIC to obtain full-field displacement and strain measurements elucidating the role of the matrix as well as fiber-fiber interaction at the microscale within the composite subjected to compression loading well into the non-linear regime of the material. Moreover, the evolution of fiber-matrix debonding and matrix cracking is observed in-situ at the microscale. This data, along with images segmented with a newly developed ML toolset [2], was used to create and validate physics-based micromechanics models. An image of the failed micropillar is shown in Figure 1. The techniques developed in the initial compression experiment was tailored to the validation needs of the models and expanded to include different sized samples as well as possibly tension and fatigue.
Laura Wilson↗
3D Reinforced Composites for Improved Impact Resistance in Spacesuits
Explore the source record for details and available documents.
Will Higginson↗
Detection of Trace Silicone Contamination on Carbon Fiber Reinforced Composite (CFRP) Surfaces by Picosecond Laser Induced Breakdown Spectroscopy (LIBS)
Explore the source record for details and available documents.
Rodolfo Ledesma↗
Design Trade-Offs in Composite Fuel Cell Membranes: Effects of Reinforcement and Chemical Additives
Perfluorosulfonic acid (PFSA) membranes are critical components in proton exchange membrane fuel cells, where performance depends on balancing ionic conductivity, mechanical durability, and chemical stability. This study characterizes a composite membrane (NC700) featuring PFSA-impregnated expanded polytetrafluoroethylene (ePTFE) reinforcement and cerium-based radical scavengers, benchmarked against unreinforced NR211. Complementary techniques, including electron microscopy, X-ray scattering, infrared spectroscopy, thermogravimetric analysis, and dynamic mechanical analysis, identify the structural and compositional strategies employed in NC700. Water sorption isotherms reveal lower water uptake for NC700 across all conditions, attributed to reinforcement and cerium incorporation. Reinforcement reduces in-plane swelling from 11% to 2.1% at 90% RH, confirming strong swelling anisotropy, while maintaining mechanical properties at elevated temperatures. While the ionic conductivity of NC700 is approximately 10% lower than that of NR211, the reduced thickness yields a 40% decrease in calculated area-specific resistance, suggesting the composite architecture can favorably shift the conductivity-stability trade-off. The composite structure also reduces gas permeability, indicating potential for improved separator function alongside favorable transport properties. Systematic deconvolution of reinforcement and additive contributions shows that conductivity losses from cerium incorporation are largely offset by gains from the lower equivalent-weight polymer, providing quantitative relationships that may guide composite membrane design for fuel cells and other electrochemical applications.
25 ENERGY STORAGE↗
Enhancement of the Physical and Mechanical Properties of Cellulose Nanofibril-Reinforced Lignocellulosic Foams for Packaging and Building Applications
Biobased foams have the potential to serve as eco-friendly alternatives to petroleum-based foams, provided they achieve comparable thermomechanical and physical properties. We propose a facile approach to fabricate eco-friendly cellulose nanofibril (CNF)-reinforced thermomechanical pulp (TMP) fiber-based foams via an oven-drying process with thermal conductivity as low as 0.036 W/(m·K) at a 34.4 kg/m3 density. Acrodur®, iron chloride (FeCl3), and cationic polyacrylamide (CPAM) were used to improve the foam properties. Acrodur® did not have any significant effect on the foamability and density of the foams. Mechanical, thermal, cushioning, and water absorption properties of the foams were dependent on the density and interactions of the additives with the fibers. Due to their high density, foams with CPAM and FeCl3 at a 1% additive dosage had significantly higher compressive properties at the expense of slightly higher thermal conductivity. There was slight increase in compressive properties with the addition of Acrodur®. All additives improved the water stability of the foams, rendering them stable even after 24 h of water absorption.
Chemistry↗
Micromechanical Design of Carbon Nanotube Ribbon Reinforced Polymer Composite Materials
Lightweight materials are an important component of the design of aerospace structures. Carbon nanotube materials have been considered for this purpose due to the strength and stiffness of individual nanotubes, and the commercial availability of bulk formats such as fibers. These fibers can have a ribbon cross section which results in a different design space for their composites relative to traditional reinforcements which have a round cross section. This work applies brick-and-mortar micromechanical models and classical lamination theory with an inverse approach to investigate the design space of these composites. Using this approach, the influences of fiber geometry and axial and transverse mechanical properties are mapped. Finally, a sensitivity study is performed and the relative impacts of ±10% variations in the constituent material and geometric properties are ranked. Lamina axial moduli were found to range from a maximum of 3x to 1x minimum relative to a target quasi-isotropic laminate modulus depending on the anisotropy and shear modulus of the lamina. The fiber targets depended strongly on the fiber volume fraction in the lamina and the fiber axial modulus target was found to range from 4.8x to 3.2x the quasi-isotropic laminate target. The sensitivity analysis found that the largest driver of performance was the volume fraction, followed by the fiber axial modulus. While bio-based brick-and-mortar composites, such as nacre, can benefit from reinforcement aspect ratios above 10, for carbon nanotube ribbon (or carbon fiber)/polymer composites the sensitivity study indicated that the optimal cross-sectional aspect ratio was relatively smaller, potentially less than three.
Micromechanics↗
Influence of Processing Parameters on the Mechanical Properties of 3D Printed Borosilicate Particulate Reinforced Polymer Composites
Emerging composite materials are expanding the potential of additive manufacturing and enabling applications previously restricted by traditional manufacturing methods. The multi-phase nature of these composite materials combined with the complex in-ternal geometry of additively manufactured parts have enabled unique behavior, and potentially new applications. Additionally, these materials can be pyrolyzed to create dense metal, ceramic, and glass parts with geometries typically not achievable by tra-ditional processes. Additive manufacturing of borosilicate glass-based systems can open new applications in nuclear engineering, astronomy, and bone regrowth therapy. To elucidate the process-parameter relationship of borosilicate-polylactic acid (PLA) composites, mechanical testing was conducted and compared with a pure polylactic acid polymer baseline. Test specimens were fabricated by fused-filament fabrication with minimal post-processing. Yield strength, ultimate strength, and elastic modulus were calculated from stress-strain curves. Optical and scanning electron microscopy were conducted to observe the specimen microstructure before and after testing. The highest compressive yield strength for the composite was 28.22 MPa, and the highest compressive yield strength for PLA was 49.30 MPa. Print orientation was found to benefit the composite material but have a detrimental effect on the pure matrix material. An elastic modulus of 2.66 GPa was recorded for the borosilicate-PLA composite at 100% infill, 1 shell wall, and layer lines parallel to compression axis. Microscopy revealed that lower modulus composite specimens had the particulates re-distributed within the matrix. Tensile testing was done according to a polymer testing standard, which caused difficulties obtaining consistent fracture within the gauge length.
mechanical testing↗
Effects of high-dose neutron irradiation at light-water reactor relevant temperature on the mechanical properties of SiC/SiC composites
For this study, the neutron dose-dependent evolutions and the underlying mechanisms of properties of SiC fiber-reinforced SiC matrix (SiC/SiC) composites at a temperature relevant to light-water reactors (∼600 K) were investigated and analyzed. Chemical vapor infiltrated (CVI) SiC/SiC composites reinforced with Hi-Nicalon Type S or Tyranno SA3 fiber were neutron-irradiated to doses up to 30 dpa. The irradiated composites retained their flexural strengths. The thermal diffusivity and dimensional changes were mostly retained from 2.0 to 30.2 dpa. Discrepancies in irradiation responses among CVI SiC/SiC composites from different sources were found. Additional microstructural analysis using Raman spectroscopy and numerical analysis on irradiation effect on residual stress were used to explain how the microstructural variables, especially of carbon interphases, affect the mechanical properties in the 30–40 dpa dose range.
Continuous fiber-reinforced ceramic matrix composi↗
Mechanical Properties of Carbon Fiber Reinforced Composites Exposed to Cryogenic Conditions and Space Radiation via Simulation and Testing
As NASA missions extend beyond low Earth orbit, increasing reliance is placed on carbon fiber reinforced polymer (CFRP) composites for spacecraft structures where mass efficiency, durability, and long-term reliability are critical. In service, these materials are subjected to a combination of ultraviolet radiation, vacuum, ionizing radiation, atomic oxygen, and extreme thermal excursions under sustained mechanical loading. Flight systems such as the Boeing Starliner and SpaceX Dragon employ external composite structures that will experience these environments for extended durations. Although prior spaceflight and ground studies have reported limited changes in bulk mechanical properties, the synergistic effects of these environments on composite microstructure, particularly at the fiber matrix interphase, remain insufficiently characterized and represent a potential qualification and reliability risk. This study investigates the effects of short-term cryogenic exposure on a radiation shielding carbon epoxy composite, SC2020, as a ground-based analog for space relevant thermal extremes. The SC2020 material system has previously flown on the International Space Station under the Materials International Space Station Experiment (MISSE) program. Composite specimens were exposed to liquid nitrogen for 6 and 24 hours and evaluated using a multiscale characterization framework that combined ASTM D3039 tensile testing, Atomic Force Microscopy (AFM) based interphase analysis, and helium gas permeability measurements. Tensile testing showed no statistically significant or permanent degradation in global strength or modulus following cryogenic exposure. In contrast, AFM measurements revealed reductions in interphase modulus, weakened adhesion, and increased nanoscale heterogeneity, indicating localized degradation mechanisms not captured by conventional bulk testing. Gas permeability measurements showed a progressive increase in helium diffusion with exposure duration, consistent with micro-void formation or partial interfacial debonding. The results indicate that cryogenic exposure initiates degradation at the fiber matrix interphase while leaving global mechanical properties largely unchanged over short durations. These findings underscore the importance of multiscale diagnostics for identifying early-stage damage mechanisms that may influence long term performance and qualification margins for spaceflight composite structures. The data presented establish a cryogenic baseline for comparison with forthcoming MISSE flight exposure results and support ongoing NASA Established Program to Stimulate Competitive Research (EPSCoR) efforts aimed at improving composite qualification methodologies, risk assessment, and reliability prediction for space environments.
composite reliability↗
PET waste- and bio-derived imine vitrimers for shape-memory, intrinsic flame-retardant, and recyclable carbon fiber composites
Developing circular multifunctional vitrimers and carbon fiber–reinforced polymers (CFRPs) that are simultaneously recyclable, mechanically robust, and intrinsically flame retardant remains a major challenge. Here, in this study, we report multifunctional vitrimers and their carbon fiber–reinforced vitrimer (CFRV) composites, where the vitrimer design integrates closed-loop recyclability, enhanced interfacial adhesion, and intrinsic flame retardancy within a single materials platform. The vitrimer matrix is synthesized from post-consumer polyethylene terephthalate (PET) waste and a vanillin-derived phosphorus-containing crosslinker, forming an imine-based network. The resulting vitrimer resin exhibits high tensile strength, thermal healability, repeated reprocessability, programmable shape memory, and rapid chemical depolymerization under mild conditions. Amine-functionalized carbon fibers significantly improve fiber–matrix interfacial bonding, yielding CFRVs with tensile strengths up to 789 MPa and complete recovery of structurally intact fibers after chemical recycling. The phosphorus-rich aromatic network further imparts intrinsic flame retardancy, enabling self-extinguishing behavior without external additives. This work advances a materials design paradigm for next-generation multifunctional, sustainable vitrimers and CFRVs, while simultaneously addressing the recycling challenges associated with both plastic and CFRP waste.
Bio-derived crosslinker↗