Search NASASearch

SEARCH · Search NASA

Results for “Reinforcement learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

Deep RL for Fast Long-Horizon Operations Scheduling on NASA's Carruthers Geocorona Observatory Mission

Spacecraft operations scheduling is a highly constrained, long-horizon combinatorial optimization problem that traditionally relies on heuristics, constraint programming, or manual planning. We present a scalable deep reinforcement learning framework developed and deployed for NASA’s Carruthers Geocorona Observatory mission. Our framework introduces a macro-action abstraction known as activity blocks coupled with dynamic action-masking to navigate the intractably large search space and strictly enforce complex power, thermal, and instrument constraints. The resulting architecture generates globally feasible schedules with overwhelming probability, establishes operational trust, and executes a full training cycle in under six hours, circumventing the need for policy robustness by enabling rapid, on-demand retraining. Further, resulting schedules outperform baseline heuristics in scheduled science quality. The deep reinforcement learning framework was deployed as the default operational scheduler for the Carruthers Geocorona Observatory mission from the outset of the mission, demonstrating that deep reinforcement learning can be trusted for real spacecraft operations under complex, evolving constraints.

Geocorona

Manufacturing Process Development of a Carbon Fiber Reinforced Polymer Composite Shaft for Electric Motors

Electric aircraft applications require electric motors with increased specific power and efficiency. Composite structural components in motors are a potential solution for reducing motor mass, reducing magnetic losses, and limiting undesired conduction paths for fault, electromagnetic interference, or common-mode currents. In this report, manufacturing trials for a high-speed carbon fiber reinforced polymer composite motor shaft are presented. Four prototype shafts were produced using a hybrid biaxial/triaxial fabric that was circumferentially wrapped onto an additively manufactured high-temperature washout mandrel. An additional traditional overbraid approach was also evaluated and shows promise for high-rate, high-performance parts using automated manufacturing. This paper discusses the shaft design, manufacturing methods explored, material selection, the manufacturing trials, and the lessons learned. The results of this manufacturing investigation show feasibility for manufacturing composite shafts for electric motors.

Electric moto shaft

In-Situ Scanning Electron Microscope Experiments for Microscale Mechanical Testing and Validated Modeling of Fiber Reinforced Thermoplastics

A novel, in-situ, scanning electron microscope (SEM) mechanical testing capability for materials at the microscale which provides experimental validation to a machine learning (ML) toolset for full-field validation of physics-based micromechanics models is being developed by researchers at NASA Glenn Research Center. These are enabling technologies for the integration of multiscale digital twins for materials into system level models which will result in the improved performance, material discovery, reduced production cost and time, rapid characterization, and prognostic structural health monitoring (SHM) for materials and structures for extreme environments in support of NASA space exploration missions. In order to bridge the material structure-to-system gap for digital twins, physics-based models must be experimentally validated at multiple length scales. Seminal microscale experiments, conducted at the Air Force Research Laboratory (AFRL), were limited to transverse compression of single-layer, unidirectional thermoset polymer matrix composite (PMC) micropillar specimens [1]. The early phases of the current project followed those initial results and setup to reproduce the compression testing of PMC material on the custom-built piezoelectric actuated micromechanical testing rig built by MicroTesting Solutions LLC. In this work, samples of thermoplastic PMC material were first machined into 3 mm cubes, and then further machining and final milling was done using a Focused Ion Beam (FIB). The initial experiment was done on a pillar roughly 20 µm x 20 µm x 40 µm tall. Additional pillars were milled with final sizes ranging from 20 µm x 20 µm x 40 µm tall to 40 µm x 40 µm x 65 µm tall. A speckle pattern for in-situ full-field measurements using Digital Image Correlation (DIC) was applied with platinum, which was coated on the surface, and then the FIB was used to mill away some of the coating to produce an irregular pattern of Pt on the pillar surface. The samples were loaded into the custom testing rig and placed into the SEM and loaded under compression until failure. Images were collected in the SEM during testing. Post-processing of the images was conducted using DIC to obtain full-field displacement and strain measurements elucidating the role of the matrix as well as fiber-fiber interaction at the microscale within the composite subjected to compression loading well into the non-linear regime of the material. Moreover, the evolution of fiber-matrix debonding and matrix cracking is observed in-situ at the microscale. This data, along with images segmented with a newly developed ML toolset [2], was used to create and validate physics-based micromechanics models. An image of the failed micropillar is shown in Figure 1. The techniques developed in the initial compression experiment was tailored to the validation needs of the models and expanded to include different sized samples as well as possibly tension and fatigue.

Laura Wilson

Micromechanical Design of Carbon Nanotube Ribbon Reinforced Polymer Composite Materials

Lightweight materials are an important component of the design of aerospace structures. Carbon nanotube materials have been considered for this purpose due to the strength and stiffness of individual nanotubes, and the commercial availability of bulk formats such as fibers. These fibers can have a ribbon cross section which results in a different design space for their composites relative to traditional reinforcements which have a round cross section. This work applies brick-and-mortar micromechanical models and classical lamination theory with an inverse approach to investigate the design space of these composites. Using this approach, the influences of fiber geometry and axial and transverse mechanical properties are mapped. Finally, a sensitivity study is performed and the relative impacts of ±10% variations in the constituent material and geometric properties are ranked. Lamina axial moduli were found to range from a maximum of 3x to 1x minimum relative to a target quasi-isotropic laminate modulus depending on the anisotropy and shear modulus of the lamina. The fiber targets depended strongly on the fiber volume fraction in the lamina and the fiber axial modulus target was found to range from 4.8x to 3.2x the quasi-isotropic laminate target. The sensitivity analysis found that the largest driver of performance was the volume fraction, followed by the fiber axial modulus. While bio-based brick-and-mortar composites, such as nacre, can benefit from reinforcement aspect ratios above 10, for carbon nanotube ribbon (or carbon fiber)/polymer composites the sensitivity study indicated that the optimal cross-sectional aspect ratio was relatively smaller, potentially less than three.

Micromechanics

Influence of Processing Parameters on the Mechanical Properties of 3D Printed Borosilicate Particulate Reinforced Polymer Composites

Emerging composite materials are expanding the potential of additive manufacturing and enabling applications previously restricted by traditional manufacturing methods. The multi-phase nature of these composite materials combined with the complex in-ternal geometry of additively manufactured parts have enabled unique behavior, and potentially new applications. Additionally, these materials can be pyrolyzed to create dense metal, ceramic, and glass parts with geometries typically not achievable by tra-ditional processes. Additive manufacturing of borosilicate glass-based systems can open new applications in nuclear engineering, astronomy, and bone regrowth therapy. To elucidate the process-parameter relationship of borosilicate-polylactic acid (PLA) composites, mechanical testing was conducted and compared with a pure polylactic acid polymer baseline. Test specimens were fabricated by fused-filament fabrication with minimal post-processing. Yield strength, ultimate strength, and elastic modulus were calculated from stress-strain curves. Optical and scanning electron microscopy were conducted to observe the specimen microstructure before and after testing. The highest compressive yield strength for the composite was 28.22 MPa, and the highest compressive yield strength for PLA was 49.30 MPa. Print orientation was found to benefit the composite material but have a detrimental effect on the pure matrix material. An elastic modulus of 2.66 GPa was recorded for the borosilicate-PLA composite at 100% infill, 1 shell wall, and layer lines parallel to compression axis. Microscopy revealed that lower modulus composite specimens had the particulates re-distributed within the matrix. Tensile testing was done according to a polymer testing standard, which caused difficulties obtaining consistent fracture within the gauge length.

mechanical testing

Mechanical Properties of Carbon Fiber Reinforced Composites Exposed to Cryogenic Conditions and Space Radiation via Simulation and Testing

As NASA missions extend beyond low Earth orbit, increasing reliance is placed on carbon fiber reinforced polymer (CFRP) composites for spacecraft structures where mass efficiency, durability, and long-term reliability are critical. In service, these materials are subjected to a combination of ultraviolet radiation, vacuum, ionizing radiation, atomic oxygen, and extreme thermal excursions under sustained mechanical loading. Flight systems such as the Boeing Starliner and SpaceX Dragon employ external composite structures that will experience these environments for extended durations. Although prior spaceflight and ground studies have reported limited changes in bulk mechanical properties, the synergistic effects of these environments on composite microstructure, particularly at the fiber matrix interphase, remain insufficiently characterized and represent a potential qualification and reliability risk. This study investigates the effects of short-term cryogenic exposure on a radiation shielding carbon epoxy composite, SC2020, as a ground-based analog for space relevant thermal extremes. The SC2020 material system has previously flown on the International Space Station under the Materials International Space Station Experiment (MISSE) program. Composite specimens were exposed to liquid nitrogen for 6 and 24 hours and evaluated using a multiscale characterization framework that combined ASTM D3039 tensile testing, Atomic Force Microscopy (AFM) based interphase analysis, and helium gas permeability measurements. Tensile testing showed no statistically significant or permanent degradation in global strength or modulus following cryogenic exposure. In contrast, AFM measurements revealed reductions in interphase modulus, weakened adhesion, and increased nanoscale heterogeneity, indicating localized degradation mechanisms not captured by conventional bulk testing. Gas permeability measurements showed a progressive increase in helium diffusion with exposure duration, consistent with micro-void formation or partial interfacial debonding. The results indicate that cryogenic exposure initiates degradation at the fiber matrix interphase while leaving global mechanical properties largely unchanged over short durations. These findings underscore the importance of multiscale diagnostics for identifying early-stage damage mechanisms that may influence long term performance and qualification margins for spaceflight composite structures. The data presented establish a cryogenic baseline for comparison with forthcoming MISSE flight exposure results and support ongoing NASA Established Program to Stimulate Competitive Research (EPSCoR) efforts aimed at improving composite qualification methodologies, risk assessment, and reliability prediction for space environments.

composite reliability

MSFC Thermal Testing Lessons Learned Course. Section 3: Lessons Learned from Protoflight StarBurst Instrument Thermal Vacuum Test

MSFC thermal engineers will be presenting lessons learned while preparing and conducting thermal tests. This course will cover practical real world examples of thermal chamber and vacuum chamber testing from engineering development units to system level testing on flight hardware. Special topics include large scale testing preparation, requirement tailoring from parent documents, and cryogenic development testing.

thermal discipline

A Frank Discussion on Lessons Learned From Adopting and Applying NASA-STD-6030 for Spaceflight Systems

With the advancement and adoption of Additive Manufacturing (AM) for spaceflight systems, numerous lessons have been learned during the qualification and certification of AM components. The lessons learned covered in this presentation will provide an overview of the challenges faced by NASA centers and commercial partners working to design AM hardware that complies with NASA-STD-6030 Additive Manufacturing Requirements (AMR). Topics of interest include tailoring of requirements for specific projects, documentation requirements, and addressing conservative approaches towards mechanical property development and analysis. In addition to that, this presentation aims to impress that these lessons learned will influence the future revisions of the NASA technical standard to facilitate and advance AM technology adoption on NASA projects.

Additive Manufacturing

Developmental and Cryogenic Thermal Vacuum (TVAC) Testing Lessons Learned

Developmental thermal vacuum (TVAC) testing is a critical step in maturing hardware designs and validating performance prior to flight qualification. Unlike qualification or acceptance testing, developmental testing provides flexibility to explore design margins, uncover integration challenges, and refine test approaches before formal verification activities begin. This presentation highlights the value of developmental testing while sharing common pitfalls encountered during developmental TVAC campaigns. Lessons learned from hands-on testing experience, including extensive developmental testing at cryogenic temperatures, will be shared in this presentation. Topics include test planning and preparation, instrumentation strategies, contamination control considerations, troubleshooting unexpected anomalies, and approaches for staying on schedule while meeting test objectives. The audience will gain practical insights and best practices that can improve test efficiency, reduce risk, and enhance the overall success of future developmental TVAC efforts.

Mackenzie Byrnes

Lessons Learned From A Cryogenic Motor Configuration Study for Aircraft Propulsion

Cryogenic electric machines are a promising technology for multi megawatt electric aircraft drivetrains. Superconducting stators that make use of low AC loss superconducting wires are considered to be a key component for these cryogenic machines. NASA has undertaken 6-year technical challenge to address this need by designing a 5 MW superconducting motor and cryogenic drive and developing multi-MW prototypes. This poster shares the lessons learned from a completed design study that evaluated several configurations of a 5 MW cryogenic motor for this application. The lessons are drawn from a qualitative study of 16 configurations and a quantitative study of 8 down selected configurations. The quantitative study involved using a motor design code based on analytical calculations (electromagnetic, thermofluid, mechanical, and motor sizing) to determine each configuration’s Pareto front of total efficiency and total specific power. This poster builds upon preliminary results that were previously presented by (1) reporting final results based on a revised design code for each configuration, including a considerable increase in fidelity for a novel radial flux motor and (2) making a down selection of the configuration for future detailed design and demonstration and documenting the rationale for the selection.

Superconductors

The NASA Turbulent Heat Flux (THX) Experiments: Summary and Lessons Learned

The Turbulent Heat Flux (THX) experiments were conducted at NASA Glenn Research Center (GRC) in order to collect measurements of velocities and temperatures for computational fluid dynamics (CFD) validation of heated flows, with a focus on propulsion system components. The experiments spanned 5 phases; four of which were conducted in the GRC AeroAcoustic Propulsion Laboratory (AAPL) using the Small Hot Jet Flow Rig (SHJAR). In addition to making velocity measurements with Particle Image Velocimetry (PIV), the THX experiments introduced a new Raman-scattering based capability to measure temperatures. Computational studies were also conducted for each of the experimental configurations, in order to provide a baseline of expected CFD results and conduct an assessment of the capability of various CFD approaches for calculating flows where the turbulent transport of heat was important. Two of the collected sets of data were used for American Institute of Aeronautics and Astronautics (AIAA) Propulsion Aerodynamic Workshops (PAWs). The data set from the 5th phase, collected for heated supersonic jets, was also used to construct new validation cases for the NASA Turbulence Model Resource (TMR). This paper provides an overview of the experiments and associated computations for each of the 5 test phases. Key experimental findings are presented. Lessons learned are provided concerning the effect of computational modeling choice on accuracy of predicting turbulent flows where thermal transport is important. Emphasis is placed on comparing Reynolds-averaged Navier-Stokes approaches with large-eddy simulation approaches. The benefits of utilizing a conjugate heat transfer method in conjunction with CFD solver for film cooling is demonstrated.

RANS

Physics-Guided Deep Learning for Complex System Health Management and Decision Making

The landscape of complex engineered systems is rapidly evolving, from smart manufacturing facilities to next-generation transportation vehicles. As these systems become increasingly sophisticated and interconnected, the need for advanced health management systems grows ever more critical. These systems must go beyond simple monitoring, actively predicting potential failures before they occur. This paradigm shift from fixed maintenance schedules to condition-based predictions is key to optimizing system performance, enhancing safety, and paving the way for autonomous decision-making across various industries. Whether in industrial processes, energy systems, or advanced transportation, the ability to anticipate and prevent failures is becoming a cornerstone of operational excellence. To accurately predict the future health of any complex system, knowledge of its current health state and future operational conditions is essential. Recent advancements in data-driven algorithms have generated growing interest in artificial intelligence for industrial applications. However, the limitations of pure data-driven methods, particularly in industries where data acquisition is costly and limited, have become apparent. This has led to a focus on blending physics with data-driven algorithms, mitigating the drawbacks of both approaches while emphasizing their respective advantages. This research proposes a novel framework for integrating physics-based performance models with deep learning algorithms for the prognostics of complex safety-critical systems. In this approach, physics-based models serve as a blueprint, capturing fundamental system behaviors, while deep learning algorithms, leveraging real-world sensor data, fill in gaps and identify subtle patterns indicative of potential problems. This hybrid methodology, utilizing techniques such as Physics-Informed Neural Networks (PINNs), offers a powerful solution for predicting system health. By fusing domain knowledge with data-driven insights, this approach promises more accurate, adaptable, and reliable models for health prediction. The resulting framework is versatile, applicable across various sectors including aerospace, manufacturing, and energy systems, ultimately contributing to safer, more efficient operations in our increasingly complex technological landscape.

Diagnostics

The NASA Turbulent Heat Flux Experiments: Summary and Lessons Learned

The Turbulent Heat Flux (THX) experiments were conducted at NASA Glenn Research Center (GRC) in order to collect measurements of velocities and temperatures for computational fluid dynamics (CFD) validation of heated flows, with a focus on propulsion system components. The experiments spanned 5 phases; four of which were conducted in the GRC AeroAcoustic Propulsion Laboratory (AAPL) using the Small Hot Jet Flow Rig (SHJAR). In addition to making velocity measurements with Particle Image Velocimetry (PIV), the THX experiments introduced a new Raman-scattering based capability to measure temperatures. Computational studies were also conducted for each of the experimental configurations, in order to provide a baseline of expected CFD results and conduct an assessment of the capability of various CFD approaches for calculating flows where the turbulent transport of heat was important. Two of the collected sets of data were used for American Institute of Aeronautics and Astronautics (AIAA) Propulsion Aerodynamic Workshops (PAWs). The data set from the 5th phase, collected for heated supersonic jets, was also used to construct new validation cases for the NASA Turbulence Model Resource (TMR). This paper provides an overview of the experiments and associated computations for each of the 5 test phases. Key experimental findings are presented. Lessons learned are provided concerning the effect of computational modeling choice on accuracy of predicting turbulent flows where thermal transport is important. Emphasis is placed on comparing Reynolds- averaged Navier-Stokes approaches with large-eddy simulation approaches. The benefits of utilizing a conjugate heat transfer method in conjunction with CFD solver for film cooling is demonstrated.

RANS