Search NASASearch

SEARCH · Search NASA

Results for “Reinforcement learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

72 records · Page 2

Incremental Learning for Passive Microwave Precipitation Retrievals using Advanced Technology Microwave Sounder

Spaceborne passive microwave (PMW) radiometry is central to global precipitation monitoring, yet retrieval uncertainties remain substantial, particularly for cross-track sounders whose variable footprints and channel configurations are optimized for atmospheric temperature and moisture profiling rather than precipitation. Consequently, existing operational products often exhibit angular-dependent biases, limited effective swath utilization, unrealistic rainfall probability distributions, and systematic misclassification of precipitation phase. These limitations are further compounded by the scarcity of globally accurate and representative precipitation observations, as training data from the Dual-frequency Precipitation Radar (DPR) and the Cloud Profiling Radar (CPR) are spatially sparse, lack uniform global coverage, and exhibit heterogeneous error characteristics across precipitation regimes. To address these challenges, this study presents a supervised retrieval algorithm that incrementally trains an ensemble of extreme gradient-boosted decision trees by augmenting base learners with pre-training on reanalysis data and post-training on coincident DPR and CPR observations matched with the Advanced Technology Microwave Sounder (ATMS). By transferring prior information from reanalysis to posterior constraints from radar observations and adopting a sequential detection–estimation strategy for precipitation phase and rate retrieval, the proposed approach yields retrievals across the full ATMS swath that are largely free from persistent deficiencies in current Global Precipitation Measurement (GPM) passive microwave operational products. In particular, the method resolves bimodal artifacts in rainfall retrievals and mitigates systematic high-latitude snowfall biases, including overestimation across the Arctic and underestimation across the Antarctic. Validation against independent Multi-Radar Multi-Sensor (MRMS) data over the Contiguous United States (CONUS) further demonstrates improved performance in precipitation phase detection and rate estimation relative to both reanalysis and current GPM PMW products.

Mahyar Garshasbi

Up-and-Coming IMCs

While the good oxidation and environmental resistance, high melting points, and comparatively low densities of such ordered intermetallics as Ti 3 Al, NiAl, FeAl, and NbAl 3 render them good candidates for advanced aerospace structures, their poor toughness at low temperatures and low strength at elevated temperatures have prompted the development of fiber-reinforced intermetallic-matrix composites (IMCs) with more balanced characteristics. Fabrication methods for continuous-fiber IMCs under development include the P/M 'powder cloth' method, the foil/fiber method, and thermal spraying. The ultimate success of IMCs depends on fibers truly compatible with the matrix materials.

Randy Bowman

A Machine Learning Framework for Error Compensation in Radiative Transfer Calculations

Radiative heat transfer influences the amount of heat flux transferred to the surface of the hypersonic vehicle, which is essential to evaluate the performance of thermal protection systems. The radiative heat flux is found to be computationally prohibitive while accounting for the variation in spatial, angular, and spectral domains. A new methodology has been recently developed to alleviate the cost of computation in the spectral domain by constructing flow-agnostic reduced-order models (ROMs). The developed spectral ROM databases provide grouping strategies that account for non-equilibrium absorption and emission as well as interaction between disparate species due to spectral overlap in associated radiative processes. However, the developed ROMs need to be optimized for a specific combination of interacting gas species and would need to re-calibrated in case individual species are added/omitted. In this work, we use various machine learning (ML) techniques to approximate the radiative intensities determined by a ROM optimized for a specific gas mixture. The ML model relies on the ROM databases developed for a single species which ignores any spectral overlap. Thus, radiation evaluation starts with a simple summation of radiative intensities predicted using these non-calibrated ROMs for the contributing species. The ML framework then provides a correction to account for the interplay in the frequency, i.e., emission of photons by one species and absorption by another, and yields mixture-specific radiation fields. Once trained on the individual ROM databases, the ML framework offers instantaneous corrections that serves as a time/cost effective alternative to the optimization of ROMs for a specific gas mixture. The ML framework is trained on both the high fidelity and ROM evaluated line of sight (LOS) data from Orion, Stardust, and FIRE II cases to obtain a general purpose correction model for earth re-entry scenarios when radiation contributions from both atomic nitrogen and atomic oxygen are considered. A geometric length scale parameter is used in the training process to account for errors introduced in the ROM databases as a consequence of high optical thickness. The efficacy of the ML framework is underscored through extensive analysis of train and test errors with respect to all the re-entry scenarios. The applicability of such an ML framework was further corroborated by embedding it in a state-of-the-art US3D - NERO system for determining the radiative heat flux transferred to the hypersonic vehicle surface.

Radiation

Machine Learning for Predicting Team Functioning in HERA Missions

Team functioning is integral to success in future long term space exploration missions. Proactively detecting declines in team functioning can mitigate conflict and ensure mission success. This project developed a speech-based artificial intelligence (AI) system that unobtrusively predicts degradation in team functioning, including performance and cohesion, in the Human Exploration Research Analog (HERA) Campaigns 4 and 5. The AI system conducted automated analysis of the prosodic (tone of voice) and linguistic (language content) components of speech, modeling interpersonal dynamics at both the turn-taking and day-wide levels. We investigated team functioning via observing structured interactions (i.e., multi-mission space exploration vehicle-extra vehicular activity [MMSEV-EVA], team interaction battery [TIB]) and unstructured interactions before the MMSEV-EVA task. We developed machine learning models to predict team functioning (objective task accuracy, self reported team efficacy and self reported team cohesion) by analyzing OpenSmile acoustic features, linguistic descriptors extracted via the linguistic inquiry and word count (LIWC) dictionary, and semantic embeddings. In the TIB, static models using logistic regression and random forests were not able to predict task accuracy, but predicted team efficacy and cohesion during both the decision making and relational tasks to a moderate level (60-70%). Majority voting on the individual turns to predict day long team efficacy further increased accuracies (70-80%). Finally, long short-term memory (LSTM) models showed the best performance across all variables (80-91%), including task performance. In the MMSEV-EVA, static models achieved an accuracy of 60% with majority voting, which increased to 80% through the incorporation of mission day as a variable, accounting for the learning effect. A key finding across both tasks was the "team-dependent" nature of these interactions; models achieved much higher accuracy when trained on prior days of the same team's data rather than attempting to generalize across entirely different teams, with even 1-2 days of prior data per team achieving 5-15% improvement over team-independent models. In addition, the incorporation of pre-task data from the same team also improves model performance, e.g., incorporating data from the decision-making task of the TIB, which preceded the relational task, improved the prediction of team efficacy and cohesion during the latter. We compared model performance when trained on machine-generated data compared to data that had been further corrected by human annotators. Overall, models trained on human-corrected data exhibited a modest improvement in performance, particularly when acoustic features were used. We found no significant correlation between word error rate (WER) and model accuracy (r(55) = -0.08, p = 0.51), but model’s accuracy was significantly higher for medium/high quality transcription (0.74 (SD = 0.48)) compared to the low-quality group (0.64 (SD = 0.36)) (t(63)=2.82, p = 0.006). Based on these, several design recommendation emerge, that could inform Standards at NASA. Models predicting team functioning should incorporate at least one to two days of historical interaction data, include brief pre-task discussions, and explicitly model temporal learning effects, especially for longer operational tasks. Minimum quality standards for automated speech-processing pipelines are needed, given the performance gains observed with manually corrected acoustic data. Finally, systems should leverage both acoustic features and language embeddings in complementary ways, with modality choices and fusion strategies tailored to mission context, task demands, and data quality requirements.

Shrivatsa Mishra

Thermoplastic Matrix Composite Design for Cryotanks Using Multiscale Modeling and Bayesian Optimization

Designing lightweight, robust cryogenic storage tanks is critical for future launch vehicles, in-space propellant storage, and hydrogen powered aircraft. This work presents a multiscale modeling and Bayesian optimization framework for the design of thermoplastic matrix composite cryotanks. Molecular dynamics simulations are first used to determine temperature-dependent constituent properties for candidate thermoplastic matrices, which are homogenized to the lamina scale using NASA’s Multiscale Analysis Tool (NASMAT). These lamina properties, in combination with laminate family generation rules, are evaluated in HyperX structural optimization software to identify stacking sequences that meet all cryogenic load requirements. A Bayesian optimization framework is applied, with HyperX in the loop (via the HyperX API) to efficiently search across material and laminate design variables, yielding an optimized cryotank configuration with significant reductions in design cycle time compared to exhaustive search approaches.

thermoplastics

Autonomous Detection and Classification of Lunar Minerals Using a Convolutional Neural Network Based Framework for the SUCR DALI Project

NASA’s long-term goal is to deploy humans to the Moon and, from there, advance human exploration to Mars, with Artemis missions as pivotal milestones. Raman spectroscopy can uniquely identify minerals, compounds, water states, and other materials, providing distinctive fingerprints for classification. A Raman instrument has been successfully deployed and utilized on the Mars surface via the Perseverance rover, but has not yet been utilized at the lunar surface The SUCR DALI project is working towards developing a Raman spectroscopy instrument to be applied in various lunar mission concepts, including within the Artemis program. The objective of my research is to assist in the maturation of the proposed SUCR DALI lunar Raman instrument through the development of an autonomous detection and classification model capable of identifying minerals and water states on the Moon’s surface.

Convolutional Neural Networks

Turbo-Design: Open-Source Radial Equilibrium Turbomachinery Solver: Part I - Turbines

Advances in 3D Geometrical Designs and Cooling have played a significant role in improving the efficiency of turbomachinery. However, these advancements must be effectively translated back to the modeler. Machine learning can facilitate this transition. Specifically, machine learning–based loss models can bridge the gap between 3D and 1D designs, enabling modelers not only to predict velocity triangles but also to extract additional geometric features. Currently, the design tools used at NASA have not been updated to support such integration—until now. TurboDesign is an open-source, Python-based framework that replaces TD2 (LEW-11029-1) and AXOD2 (LEW-16323-1), both of which are radial equilibrium solvers for axial turbines. The goal of this update is to enable the integration of machine learning loss models into radial equilibrium equations. Additionally, TurboDesign is designed to support radial machines. This paper presents the governing equations, the assumptions underlying the code, the integration of legacy loss models, an example of machine learning model integration, and a validation comparison with CFD. All code, tutorials, and documentation are available at: https://www.github.com/nasa/turbo-design

Radial Equilibrium

Proactive Wildfire Management: A Remote Sensing and Multimodal CNN-MLP Architecture for Ignition Risk Forecasting

As the frequency and intensity of wildfires increase, with fire seasons now starting earlier and ending later than they have over the past decades, current monitoring systems, such as lookout towers and satellites, are hindered by cloud cover, low-resolution imagery, and static data gaps that fail to track vegetation moisture levels fast enough to catch rapid pre-ignition changes. This report proposes a Machine Learning-enabled Wildfire Ignition Prediction framework that combines satellite monitoring with dynamic and high-resolution remote sensing from Unmanned Aerial Vehicle (UAV) swarms. The method would use multispectral and thermal data from the Landsat program to create a baseline for vegetation health, calculating a two-band Enhanced Vegetation Index (EVI2) and the moisture content of the vegetation. These inputs will later be fused with microscale UAV weather data, including thermal hotspots found through thick canopies, hyperspectral chemical signatures of pre-visual combustion, and local weather streams. The multispectral satellite, multispectral Light Detection and Ranging (LiDAR), and thermal data would then be processed through a Convolutional Neural Network (CNN), alongside a Multilayer Perceptron (MLP) for the micro-weather telemetry. The outputs of these networks would be fused into a single feature representation and passed through a final prediction network to generate real-time ignition risk scores and hotspot alerts. Model performance would be assessed using standard classification metrics, including a Receiver Operating Characteristic - Area Under the Curve (ROC AUC) and F1 score. This system would allow first responders to identify high-risk zones and intervene before ignition occurs, improving emergency response time compared to current approaches.

machine learning

Evaluating Crystallinity in Thermoplastic composites

Polymer matrix composites (PMCs) offer many benefits for the aerospace industry due to their potential for weight reduction when compared to metal or ceramic based materials. Most PMCs currently in flight use thermoset matrices, however, thermoplastic resins are being explored as alternatives due to their ability to be remelted, which is of particular interest due to the potential for in-situ repair and manufacturing required in space. Most thermoplastic resins are semicrystalline polymers. The properties of semicrystalline thermoplastics are largely influenced by their crystallinity, which can vary due to many factors including thermal treatments, environmental conditions, and mechanical deformation. Monitoring the crystallinity of thermoplastic composites is key to ensuring these materials reliably meet the high demands required by space exploration. This talk discusses the use of multiple techniques such as Polarized Light Optical Microscopy and Fourier-Transform Infrared Spectroscopy to characterize the crystallinity in various thermoplastic composites, including carbon fiber reinforced PMCs and novel bio-based Martian and Lunar regolith composites designed for in-situ manufacturing. This work aims to provide the fundamental data necessary to understand the effects of crystallinity on thermoplastic PMCs, which is key to advancing their use in space applications.

Thermoplastics

Design, Build and Qualification of 28 Volt Lithium-Ion battery

Contents include the following: 1. GSFC performance specifications requirements. 2. AEA philosophy: battery configuration. 3. AEA battery design: SONY cell, cell screening, 20Ah and 60Ah. 4. Testing: 20Ah battery qualification (environmental); 60Ah battery LEO life cycle. 5. Conclusion.: summary and lessons learned.

Curzon, D.

Polymer Composite Material Screening for a Cryotank Application

Composite cryotanks will play a key role in enabling the next generation of efficient aircraft. Carbon fiber reinforced polymer (CFRP) composites have the benefits of reduced weight and potentially higher structural strength compared to traditional metallic fuel tanks. A material screening study was conducted to inform material selection for liquid hydrogen (LH2) fuel storage. Three composite materials were considered because of their aerospace grade toughness, strength, and existing data to compare against. These materials were a thermoplastic low-melt polyaryletherketone (LM-PAEK)/carbon fiber (CF), thermoset/CF, and hybrid thermoset/thermoplastic polyurethane (TPU) veil/CF composite. Mechanical screening tests included tension, compression, in-plane shear (IPS), and tensile-tensile fatigue (TTF). Each material was tested at both a baseline (no liquid nitrogen/LN2 cycling) and 100 LN2-cycled conditions to determine the knockdown factor, if any, of each material when exposed to environmental loading effects in a cryotank. Results show minimal effects of the LN2-cycling compared against baseline values. The three materials behaved similarly in tension; however, the thermoplastic/CF had the highest IPS toughness. The hybrid thermoset/TPU/CF composite had the lowest IPS strength, compressive strength, and toughness. LN2-cycling had minimal effects on tensile-tensile fatigue performance of the thermoplastic/CF material. Mechanical data was captured to guide material down selection for future commercially viable hydrogen aircraft design.

Composites

Biobased Polybenzoxazine Derived from Furfurylamine and Piceol with Low Cure Temperature and Advanced Properties for Composite Matrices

A novel benzoxazine made from furfurylamine, paraformaldehyde, and piceol, Bz-FA-HA, is assessed for applications in fiber reinforced (FR) composites. Piceol is a biobased phenolic compound derived from the roots of Norwegian spruce trees and contains a methyl ketone group at the para position. Bz-FA-HA is a liquid at room temperature, has a viscosity of < 1 Pa.s at temperatures above 90 °C, and a Tonset of cure at 132 °C. The carbonyl is found to react with the furan ring, yielding a crosslinking reaction, when cured above 180 °C as indicated by differential scanning calorimetry and thermogravimetric analysis coupled with Fourier transform infrared spectroscopy. Poly(Bz-FA-HA) has a Tg > 350 °C, attributed to the crosslinking reaction. Furthermore, the storage modulus is > 3 GPa, regardless of cure temperature. Poly(Bz-FA-HA) has a char yield at 800 °C of 65.0 % (62.3 % at 1000 °C), and a Tonset of decomposition of 357 °C in nitrogen. The resulting carbon formed during pyrolysis shrinks during the carbonization reaction and scanning electron microscopy imaging shows a cross-section with micro cracks. The high processability, advanced mechanical properties, and exceptional char yield make it a promising candidate as the matrix for FR composites.

Benzoxazine

Cost reductions in nickel-hydrogen battery

Significant progress was made toward the development of a commercially marketable hydrogen nickel oxide battery. The costs projected for this battery are remarkably low when one considers where the learning curve is for commercialization of this system. Further developmental efforts on this project are warranted as the H2/NiO battery is already cost competitive with other battery systems.

Beauchamp, Richard L.

Developing a Pyrolysis Gas Thermal Blocking Model for Reentry Demise

In NASA’s Object Reentry Survival Analysis Tool (ORSAT), aerodynamic drag and aerothermal heating coefficients are computed for each of the free-molecular, continuum, and transitional flow regimes using analytical and semi-analytical methods. These heating coefficients were derived for typical metallic materials that melt and do not have a strong gas-phase contribution to the flow in the boundary layer. Modern satellites typically feature fiber-reinforced polymer (FRP) components, such as solar array booms, facesheets of sandwich panels, or overwraps for composite-overwrapped pressure vessels (COPV). These FRP materials do not behave the same as metals in the reentry environment, but instead will pyrolyze and develop significant volumes of gas into the boundary layer. Accurately predicting the reentry demise of FRP components is critical to assessing the reentry casualty risk for modern spacecraft. Research in recent years has shown that this demisability can depend heavily on how the expulsion of gaseous pyrolysis products through the outer surface of the material affects the heat flux at the surface. The ODPO has been developing a reduced-order model of the effect of pyrolysis gas blowing on the heat flux based on correlations between a blowing factor and a non-dimensional heat flux to be incorporated in the upcoming version 7.3 of the Object Reentry Survivability Analysis Tool (ORSAT). This presentation discusses the progress of this development project and the challenges remaining for generalizing the model across families of FRP materials.

Benton Greene

LBFD X-59 Propulsion Overview

The LBFD X-59 Propulsion Overview is prepared in support of a panel session at the 2026 AIAA Aviation Conference. The overview covers highlights of the X-59 propulsion system, a short history of propulsion testing at NASA GRC, A summary of X-59 ground testing, a summary of X-59 flight testing, and finally some lessons learned.

Aerodynamic

Natural Fiber Simulations and Analysis for Composites

As the U.S. government and the aviation industry strive to achieve net-zero carbon emissions by 2050, the Sustainable Manufacturing of Aircraft (SUMAC) project, supported by the Convergent Aeronautics Solutions (CAS) program of the National Aeronautics and Space Administration (NASA), aims to develop sustainably derived thermoplastic composites and manufacturing technologies for future aviation. A multidisciplinary team of experts drives this initiative through a collective effort. The team’s key focus areas are sustainably derived thermoplastic resins, natural fiber reinforcement, composite manufacturing, structural health monitoring, computational materials modeling, and systems analysis. This presentation will give an overview of the SUMAC project. Fiber-scale microscopy analysis characterized fiber cross sections finding that hemp and flax fibers are very deformable and non-circular (circularities of 0.2 were observed), and diameters range from submicron to 20 μm. Fiber shapes range from flattened, with aspect ratios Rlong/Rshort up to 5, to round, Rlong/Rshort =1. And Fiber core perimeters, which likely drives deformability, were calculated Pcore=7 μm. Explicit-fiber yarn simulations, parameterized from single-fiber measurements, resolved and identified slack as a cause for yarn strain-hardening tensile behavior. The bonded network model of PLA, PHA and PA11 resins captures tensile behavior, and can model an infused weave. Computational models of the weave unit cells matched the pattern (including plain, twill and triaxial braid), yarn ply (1to 2), and yarn twist from optical microscopy.

thermoplastic

Natural Fiber Simulations and Analysis for Composites

As the U.S. government and the aviation industry strive to achieve net-zero carbon emissions by 2050, the Sustainable Manufacturing of Aircraft (SUMAC) project, supported by the Convergent Aeronautics Solutions (CAS) program of the National Aeronautics and Space Administration (NASA), aims to develop sustainably derived thermoplastic composites and manufacturing technologies for future aviation. A multidisciplinary team of experts drives this initiative through a collective effort. The team’s key focus areas are sustainably derived thermoplastic resins, natural fiber reinforcement, composite manufacturing, structural health monitoring, computational materials modeling, and systems analysis. This presentation will give an overview of the SUMAC project. Fiber-scale microscopy analysis characterized fiber cross sections finding that hemp and flax fibers are very deformable and non-circular (circularities of 0.2 were observed), and diameters range from submicron to 20 μm. Fiber shapes range from flattened, with aspect ratios Rlong/Rshort up to 5, to round, Rlong/Rshort =1. And Fiber core perimeters, which likely drives deformability, were calculated Pcore=7 μm. Explicit-fiber yarn simulations, parameterized from single-fiber measurements, resolved and identified slack as a cause for yarn strain-hardening tensile behavior. The bonded network model of PLA, PHA and PA11 resins captures tensile behavior, and can model an infused weave. Computational models of the weave unit cells matched the pattern (including plain, twill and triaxial braid), yarn ply (1to 2), and yarn twist from optical microscopy.

thermoplastic

Beyond Melting: Amorphous Bonding for Joining and Consolidation

Crystallization may be the hidden constraint in thermoplastic composite manufacturing. It requires tightly controlled cooling, induces residual stresses through shrinkage, and introduces path-dependent behavior that complicates predictive modeling yet remains essential for structural performance. This work asks: can bonding be achieved without relying on melt-driven crystallization? To address this, thin (5–20 μm) polyetherimide (PEI) interlayers are pre-healed to slow-cooled polyaryletherketone (PAEK) in two contexts. The first, Thermabond®, is sub-melt joining of low melt-PAEK laminates. Results show that bond quality is governed primarily by processing (i.e., adequate healing and film handling) rather than modest changes in interlayer thickness. This concept is then extended to laminate-scale manufacturing through an architecture known as OATMEAL (Out-of-autoclave Amorphous/semicrystalline Thermoplastic Material for Energy-efficient Aerospace-grade Laminates). PEI is healed to carbon fiber reinforced polyetheretherketone (PEEK) at the prepreg and excess PEI is then ablated from the surface. Crystallinity is developed off-line during prepreg fabrication, while subsequent consolidation occurs below the melt temperature to preserve it. Cross-ply warpage experiments show that, contrary to intuition, repeated amorphous interfaces reduce global curvature by lowering the effective stress lock-in temperature and eliminating crystallization shrinkage from the lamina response. Correspondingly, laminate behavior is accurately predicted using classical laminate theory (CLT) with a single effective stress-free temperature, whereas conventional CF/PEEK requires accounting for crystallization-driven effects. By decoupling interfacial healing from crystallization, OATMEAL enables sub-melt consolidation, reduces energy consumption by up to 75%, and increases manufacturing throughput by fivefold. These results demonstrate that amorphous bonding is not only a joining strategy, but a pathway to more predictable and scalable thermoplastic composite manufacturing.

solidification