Results for “REINFORCEMENT” — Page 11

NASA NTRSDate not supplied

Adaptive Stress Testing of Collision Avoidance Systems for Small UASs with Deep Reinforcement Learning

The next-generation Airborne Collision Avoidance System for smaller UASs (ACAS sXu) is currently being developed and tested by the Federal Aviation Administration (FAA) to provide detect-and-avoid capability for small unmanned aircraft operating beyond line-of-sight. Due to the complexity and safety-critical nature of the system, safety validation is important not only for the certification of the final system, but also for informing changes during the iterative development process. In this paper, we analyze a prototype of ACAS sXu in simulated aircraft encounters to discover scenarios of small near mid-air collisions (sNMACs), an important safety event in which two aircraft come closer than 50 feet horizontally and 15 feet vertically. Due to the size and complexity of the system as well as rarity of sNMAC events, traditional methods such as Monte Carlo testing often require informed setup and targeting to elicit failures. However, such a dependence on domain knowledge can be incompatible with the independent verification and validation (IV&V) process, the aim of which is to discover unforeseen issues. To address these challenges, we apply an accelerated validation method called adaptive stress testing (AST) to find the most likely sNMAC scenarios without reliance on system introspection. AST uses reinforcement learning to adapt the search towards the most promising areas of the search space as it progresses. We use a state-of-the-art deep reinforcement learning algorithm, proximate policy optimization, to more efficiently search the large and continuous state space. We find that this approach significantly improves the performance of AST compared to a prior approach based on Monte Carlo tree search. We perform experiments using AST to find sNMAC events under various encounter configurations, varying parameters pertaining to dynamics and coordination. Our experiments show AST to be very effective at finding sNMAC scenarios. We summarize our findings, presenting high-level categories of discovered sNMACs and specific examples of encounters in each category.

aircraft collision avoidance↗

NASA NTRSDate not supplied

Collision Avoidance Approach Using Deep Reinforcement Learning

A method to enable autonomous robots moving in a 2D space collision free motivates the purposed approach for collision avoidance for autonomous UAM vehicles. Challenges of autonomous collision free navigation for both problems are similar. Agents in each environment do not know the intent, or goal, of the other. Finding the time efficient paths require some level of anticipation with neighboring agents which is computationally expensive. In the original work, these obstacles were overcome with a novel application of deep reinforcement learning which offloads the online computation to an offline learning algorithm. A value network that encodes the estimated time to the goal given the agent’s state and the observable portion of the other agent’s state is trained on a baseline policy and further refined with reinforcement learning to promote time efficient collision free navigation. Online, the value network efficiently informs the agent’s decision making in the face of uncertainty of the other agent’s next move. In this paper, challenges extending this methodology to the 3D environment of autonomous UAM vehicles with kinematic constraints are discussed and initial results shown.

Collision Avoidance↗

NASA NTRSDate not supplied

Collision Avoidance Approach Using Deep Reinforcement Learning

A method to enable autonomous robots moving in a 2D space collision free motivates the purposed approach for collision avoidance for autonomous UAM vehicles. Challenges of autonomous collision free navigation for both problems are similar. Agents in each environment do not know the intent, or goal, of the other. Finding the time efficient paths require some level of anticipation with neighboring agents which is computationally expensive. In the original work, these obstacles were overcome with a novel application of deep reinforcement learning which offloads the online computation to an offline learning algorithm. A value network that encodes the estimated time to the goal given the agent’s state and the observable portion of the other agent’s state is trained on a baseline policy and further refined with reinforcement learning to promote time efficient collision free navigation. Online, the value network efficiently informs the agent’s decision making in the face of uncertainty of the other agent’s next move. In this paper, challenges extending this methodology to the 3D environment of autonomous UAM vehicles with kinematic constraints are discussed and initial results shown.

Collision Avoidance↗

NASA NTRSDate not supplied

On the Representation of Through-The-Thickness Reinforcements in Finite Element Analysis of Stitched, Blade Stiffened Panels

Modern aircraft employ laminated composites for their tailorable in-plane properties, high specific strengths, and high specific stiffnesses. However, laminated composites exhibit relatively poor interlaminar properties without through-the-thickness reinforcements. Quantifying the necessary amount of through-the-thickness reinforcements is necessary to reduce cost and meet damage tolerance certification requirements. In this study, a discrete superposed cohesive element (DSCE) approach is applied to represent the mixed-mode delamination behavior of stitched stiffened panels subjected to seven-point bending. This approach is compared to a one-dimensional embedded spring element (ESE) method. The DSCE approach uses two superposed bilinear traction-separation laws to obtain a representative load-displacement response determined from interlaminar tensile and shear tests. Additionally, several stitch configurations (unstitched, stitched, and overstitched) are evaluated in terms of their load-displacement response and crack-arrestment capability. Results indicate that the DSCE and ESE approaches show good agreement with respect to the predicted load-displacement response, but the ESE method tends to overpredict the crack growth behavior by approximately 13%. Stitches were not observed to fail during skin-stringer separation. Using an overstitched laminate with stitches near the flange edge provides the greatest crack-arrestment capability. Furthermore, the skin retains 92% of its stiffness after skin-stringer separation occurs.

composites↗

NASA NTRSDate not supplied

On the Representation of Through-The-Thickness Reinforcements in Finite Element Analysis of Stitched, Blade Stiffened Panels

Modern aircraft employ laminated composites for their tailorable in-plane properties, high specific strengths, and high specific stiffnesses. However, laminated composites exhibit relatively poor interlaminar properties without through-the-thickness reinforcements. Quantifying the necessary amount of through-the-thickness reinforcements is necessary to reduce cost and meet damage tolerance certification requirements. In this study, a discrete superposed cohesive element (DSCE) approach is applied to represent the mixed-mode delamination behavior of stitched stiffened panels subjected to seven-point bending. This approach is compared to a one-dimensional embedded spring element (ESE) method. The DSCE approach uses two superposed bilinear traction-separation laws to obtain a representative load-displacement response determined from interlaminar tensile and shear tests. Additionally, several stitch configurations (unstitched, stitched, and overstitched) are evaluated in terms of their load-displacement response and crack-arrestment capability. Results indicate that the DSCE and ESE approaches show good agreement with respect to the predicted load-displacement response, but the ESE method tends to overpredict the crack growth behavior by approximately 13%. Stitches were not observed to fail during skin-stringer separation. Using an overstitched laminate with stitches near the flange edge provides the greatest crack-arrestment capability. Furthermore, the skin retains 92% of its stiffness after skin-stringer separation occurs.

composites↗

NASA NTRS2024

Investigation of Carbon-Reinforced Acrylonitrile Butadiene Styrene 3D-Printed Honeycomb Composites

The expansive utility of polymeric 3D printing technologies and demand for high-performance lightweight structures has prompted the emergence of various carbon-reinforced polymer composite filaments. However, detailed characterization of the processing-microstructure-property relationships of these materials is still required to realize their full potential. In this study, acrylonitrile butadiene styrene (ABS) and carbon reinforced ABS variants, both carbon nanotubes (CNT) and 5 wt.% chopped carbon fiber (CF), are fabricated in a honeycomb geometry and investigated across a range of layer thicknesses and hex sizes. Microscopy of material cross-sections is conducted to evaluate the relationship between print parameters and porosity. Additionally, mechanical properties are evaluated through compression testing, demonstrating the potential of honeycomb ABS, ABS-CNT, and ABS-5wt.% CF polymer composites for novel 3D printed structures.

ABS (Acrylonitrile Butadiene Styrene)↗

NASA NTRS2023

Reinforcement Learning Approach to Flight Control Allocation with Distributed Electric Propulsion

The flight control system of the SUSAN Electrofan concept aircraft achieves attitude control using both conventional flight control surfaces and differential thrust through distributed electric propulsion (DEP) from sixteen wing-mounted electric engines. The introduction of eight pairs of wing fans for attitude control creates a highly actuated system. Such a system requires more sophisticated control to operate, especially in the presence of wingfan failures where the loss of a single wingfan can result in a thrust imbalance. This paper investigates the use of deep reinforcement learning (RL) using proximal policy optimization (PPO) to achieve attitude control through a combination of DEP and control surface deflections. First, the paper examines the aircraft undergoing a coordinated turn. Then, it examines the aircraft experiencing a wingfan failure during cruise conditions. It is shown that deep reinforcement learning can be a potential avenue for nonlinear flight control design.

Distributed Electric Propulsion↗

NASA NTRSDate not supplied

Investigation of Carbon-Reinforced Acrylonitrile Butadiene Styrene 3D-Printed Honeycomb Composites

The expansive utility of polymeric 3D printing technologies and demand for high-performance lightweight structures has prompted the emergence of various carbon-reinforced polymer composite filaments. However, detailed characterization of the processing-microstructure-property relationships of these materials is still required to realize their full potential. In this study, acrylonitrile butadiene styrene (ABS) and carbon reinforced ABS variants, both carbon nanotubes (CNT) and 5 wt.% chopped carbon fiber (CF), are fabricated in a honeycomb geometry and investigated across a range of layer thicknesses and hex sizes. Microscopy of material cross-sections is conducted to evaluate the relationship between print parameters and porosity. Additionally, mechanical properties are evaluated through compression testing, demonstrating the potential of honeycomb ABS, ABS-CNT, and ABS-5wt.% CF polymer composites for novel 3D printed structures.

ABS (Acrylonitrile Butadiene Styrene)↗

NASA NTRSDate not supplied

Energy-Optimized Path Planning for Uas in Varying Winds Via Reinforcement Learning

In this paper we propose a reinforcement learning (RL) algorithm for path planning of Unmanned Aviation Vehicles (UAVs) under varying wind conditions. Solutions to UAV path planning problems are becoming increasingly necessary as autonomous UAVs continue to enter commercial and government spaces. Path-planning is inherently challenging, as UAVs need to account for dynamically changing flying conditions such as weather, obstacle or no-fly zones, degraded vehicle health, and off-nominal battery power consumption. Machine learning methods such as reinforcement learning (RL) have the potential to revolutionize how vehicles navigate in such uncertain environments. In this study, we compute UAV trajectories from a pre-determined starting position to a target cell within a 7X7 grid environment by optimizing parameters for mission assurance and safety limits in addition to the energy consumption and operation time. The UAV navigates the grid by taking actions to move in any of the eight cardinal and inter-cardinal directions, under constant thrust profile. The resultant UAV state is sampled from a probability distribution which accounts for the UAV’s action, local wind velocity, and the presence of obstacles or boundaries. As the unmanned airspace gets more complex due to multiple vehicles and environmental uncertainties, trade-offs between energy consumption, operation time, risk tolerance, and mission assurance need to be made. Our Markov Decision Process (MDP) environment model can capture any combination of these in the optimization objective, making it novel compared to other work in the field.

trajectory planning↗

DOE OSTI2025

Lightweight, Flexible Electromagnetic Shielding Composite Films Reinforced with Recycled Carbon Fibers and Carbon Nanofillers

Lightweight, flexible polymer composites are widely adopted in modern electronic devices and systems for high-efficiency electromagnetic interference (EMI) shielding. Reinforcing polymer composites with conductive fillers offers a promising alternative to conventional metal-based shielding material thanks to their low density, tunable properties, and flexibility. Herein, lightweight, flexible ultra-high molecular weight polyethylene composite films reinforced with recycled carbon fibers (rCFs) and carbon-based nanofillers, including graphene nanoplatelets (GNPs) and carbon nanotubes, are reported for EMI shielding applications. The incorporation of these nanofillers significantly reduces the required content of rCFs and improves processability while maintaining comparable shielding effectiveness. The addition of these nanofillers with rCFs enhances the EMI shielding effectiveness by up to 15 dB. Incorporating 1 wt% GNPs can replace 5 wt% rCFs and achieve comparable EMI shielding performance, while 5 wt% of either nanofillers can substitute for 10 wt% rCFs. Numerical modeling of electromagnetic wave transmission reveals that increasing nanofiller concentrations enhances both reflection and absorption losses, with absorption consistently dominating across all levels. Furthermore, this study not only provides insight into the synergistic contributions of rCFs and carbon nanofillers to shielding effectiveness but also paves the way for the design of sustainable, lightweight EMI shielding composite films for applications in electric vehicles, medical equipment, and portable electronics.

carbon nanofiller↗

DOE OSTI2025

Polypropylene Composites Reinforced With Recycled Waste Cellulosic Fiber/Fine Mixture: The Impact of Cellulose Sieving on Performance

This study explores how a sieving step of waste cellulosic fiber and fine (WCFF) mixture affects the performance of WCFF‐loaded polypropylene (PP) composites and whether the separation of fines from fibers offers an added benefit. The WCFF samples were downsized, and four different filler size ranges were sieved using a series of mesh sizes from 4 to 0.85 mm. The WCFF/PP composites were then compounded at 20 wt.% loading of WCFF using a twin‐screw extruder. Incorporating WCFF increased the tensile strength to 41.28 MPa and the modulus to 3207 MPa, accounting for 28% and 38% enhancements, respectively. Interestingly, the greatest improvements were associated with the nonsieved WCFF case, and the sieved WCFF fibers provided only marginal enhancements over virgin PP. The outperformance of nonsieved WCFF was attributed to the synergistic reinforcement of hybrid fibers and fines as well as the maintenance of longer fibers in the system. However, the strain at break and impact strength of PP decreased after introducing WCFF. Moreover, the complex viscosity and storage modulus increased with an increase in the filler size, due to the formation of a more effective percolative network. The PP's crystallinity exhibited a relatively strong dependency on the sieving, where WCFF samples with short‐aspect‐ratio fillers promoted the crystallinity significantly. It was also found that the WCFF degradation onset temperature increased once it was incorporated into PP. This study suggests that waste cellulosic feedstocks can be utilized as a reinforcement without additional sieving to manufacture high‐performance and cost‐effective composites.

36 MATERIALS SCIENCE↗

DOE OSTI2025

New class of tritium breeders for fusion applications: Metal-reinforced composite breeders

Commercial fusion reactors operating on a D-T fuel cycle will require a steady supply of tritium to maintain the burning plasma required for continuous power generation. Since tritium has a short half-life, there is negligible natural abundance which necessitates fusion reactors to produce their own source of tritium. Tritium is most easily produced by surrounding a fusion reactor core with lithium (Li), which reacts under the intense neutron flux leaving the reactor core to form tritium and helium. Due to the hazards and technical challenges associated with surrounding a fusion reactor core with many tons of molten Li, other Li-bearing tritium breeder materials have been pursued. Unfortunately, most of the liquid breeders historically examined are exceedingly corrosive to reactor structural materials while many solid breeders in the form of ceramics are forced to make tradeoffs between Li content and mechanical integrity. In this work, to break the historic limit between Li-density and mechanical integrity of traditional solid breeders, a new class of solid tritium breeders is developed: metal-reinforced composite (MERC) breeders. Specifically, the high Li-density of lithium oxide (Li 2 O) is exploited through the addition of a metal reinforcing phase, producing a composite breeder material exhibiting high splitting tensile strength and quasi-ductility with a Li-density greater than other leading solid breeder candidates, including lithium orthosilicate (Li 4 SiO 4 ) and lithium metatitanate (Li 2 TiO 3 ). Mechanical testing, microstructural characterization, and neutronic simulation results are presented and discussed in light of fusion reactor design considerations.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2025

RLMolLM: Reinforcement Learning-Enhanced Language Model Framework for Inverse Molecular Design

Inverse molecular design faces significant challenges due to vast chemical space and complex property requirements. While language models show promise for molecular generation, they struggle with validity, multi-property optimization, and structural constraints. This work presents RLMolLM, a reinforcement learning framework combining Proximal Policy Optimization (PPO) with genetic algorithms to address these limitations. Our approach optimizes multiple user-specified properties including quantitative estimates of drug-likeness (QED), synthetic accessibility (SA), and ADMET (absorption, distribution, metabolism, excretion, and toxicity) endpoints without requiring complete model retraining, while maintaining capability for scaffold-constrained generation where specific substructures must be preserved. We outperform state-of-the-art methods for molecular optimization, achieving best QED scores across GDB13, Moses, and Zinc datasets with up to 31% improvement over previous methods while maintaining excellent validity, uniqueness, and novelty metrics. For simultaneous multi-property optimization, our framework achieves substantial improvements in ADMET properties including 4.5-fold reduction in hERG toxicity and enhanced Caco-2 permeability compared to Moses dataset. Under structural constraints, the framework significantly improves molecular validity while preserving scaffolds and effectively optimizing properties. In conclusion, this versatile solution advances pharmaceutical and materials molecular design through effective integration of reinforcement learning and genetic algorithms with multi-property optimization and scaffold preservation.

Genetic algorithms↗

DOE OSTI2025

Origin of Heating-Induced Softening and Enthalpic Reinforcement in Elastomeric Nanocomposites

Molecular simulations demonstrate that the enthalpic softening of elastomeric nanocomposites upon heating can arise naturally from a Poisson’s ratio mismatch between elastomer and nanoparticle networks, providing a more parsimonious explanation for this phenomenon than the widely accepted interpretation based on glassy interparticle bridging. Despite a century of use, the mechanism of nanoparticle-driven mechanical reinforcement of elastomers is unresolved. Here, a major hypothesis attributes it to glassy interparticle bridges, supported by an observed inversion of the variation of the modulus E(T) on heating – from entropic stiffening in elastomers to enthalpic softening in nanocomposites. Here, molecular simulations reveal that elastomer enthalpic softening can instead emerge from a competition over the preferred volumes between elastomer and nanoparticulate networks. A theory for this competition accounting for softening of the bulk modulus on heating predicts the simulated E(T) inversion, suggesting that reinforcement is driven by a volume-competition mechanism unique to cocontinuous systems of soft and rigid networks.

Biopolymers↗

DOE OSTI2026

Chemical Recycling of Carbon Fiber-Reinforced Nylon Composites

Nylon-based fiber-reinforced composites are widely used in various sectors due to their strength, durability, and lightweight properties. Despite their widespread use, recycling these composites is difficult due to the inability to separate fibers and thermal instability of nylon at high temperatures. Consequently, most nylon composites are landfilled, leading to significant economic loss. Current fiber recovery methods (i.e., pyrolysis) are energetically inefficient and preclude recovery of the matrix. Dissolution methods, such as using hexafluoroisopropanol (HFIP), allow recovery of polymer and fiber but are economically taxing and require extensive safety infrastructure. Herein we report tailored glycolysis of nylon-6 composites, resulting in separated constituent fibers and nylon-6 oligomers. Deconstruction kinetics reveal nylon’s molecular weight reductions from 32,600 to 2000 g/mol, while SEM and tensile testing confirm recovered fiber integrity. In conclusion, this approach offers a pathway to reclaim high-value materials from nylon composites, providing a strategy for the chemical recycling of fiber-reinforced composites.

Zheng, Jackie [Univ. of Tennessee, Knoxville, TN (↗

DOE OSTI2024

High-strength 3D printed poly(lactic acid) composites reinforced by shear-aligned polymer-grafted cellulose nanofibrils

This work demonstrates the application of pilot-scale surface functionalization of cellulose nanofibrils (CNFs) by aqueous grafting-through polymerization and subsequent spray drying in 3D printed poly(lactic acid) (PLA) composites. Grafted-CNF composites attain an ultimate tensile strength of 88 ± 3 MPa and a tensile modulus of elasticity of 7.8 ± 1.3 GPa in the printing direction at 20 wt% reinforcement loading. These increases, 42% and 139% over neat PLA, respectively, represent the strongest reported 3D printed CNF/PLA composite to date in the literature. The mechanisms behind these improvements are investigated by comparisons to neat PLA and unmodified spray-dried CNF/PLA controls using melt rheology, dynamic mechanical analysis, and assessment of the reinforcement dispersion. These experiments reveal that improved network formation and shear-induced alignment of the grafted CNFs facilitate the remarkable tensile properties of the printed composites.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2026

Cyclic olefin copolymer-based reinforced anion exchange membranes for water electrolyzers

Anion exchange membranes (AEMs) have emerged as a promising technology for water electrolysis in hydrogen production since they offer significant cost reduction in choices of electrocatalysts and bipolar plates. However, AEMs satisfying multiple requirements of high ionic conductivity, good chemical stability, robust mechanical properties, scalable synthesis, and low manufacturing costs are rare. Herein, we introduce quaternary ammonium functionalized cyclic olefin copolymers (COCs) as a new class of chemically stable and low-cost AEM materials. To further enhance the mechanical robustness, we prepared reinforced composite AEMs by impregnating the ionically functionalized COC into a mechanically robust matrix. The resulting reinforced composite membrane exhibits a high hydroxide conductivity of 127 mS cm −1 and excellent mechanical strength. In water electrolyzers, the MEA demonstrated outstanding performance, achieving a current density of 2.24 A cm −2 at 1.8 V, attributable to high conductivity, enhanced mechanical properties, and good alkaline stability of the composite membrane. These results indicate that the COC-based AEMs demonstrate good potential for application in AEM electrolyzers.

08 HYDROGEN↗

DOE OSTI2025

Thermophysical Properties of Ti3SiC2 MAX Phase Composites with SiC Reinforcement

In the present work, dense (∼100%) Ti 3 SiC 2 composites (TSC) are processed along with 20 vol% of SiC reinforcement (TSC20) via spark plasma sintering at 1400°C, 40 MPa, 15 min, and dynamic vacuum environment. Thermal expansion of both the composites increases from RT to 1273 K and linear fitting of data yields coefficient of thermal expansion (CTE) of 9.4 × 10 −6 K −1 for TSC which decreases to 8.3 × 10 −6 K −1 for TSC20. With increase in temperature from RT to 773 K, specific heat for both TSC and TSC20 composites is observed to increase from 598-850 J.kg −1 .K −1 , whereas thermal diffusivity and thermal conductivity values decrease with testing temperature. SiC reinforcement in Ti 3 SiC 2 resulted in improved thermal diffusivity from 12.7 to 18.7 mm 2 .s −1 and thermal conductivity from ∼57 to ∼79 W.m −1 .K −1 at RT. However, with increase in temperature (773 K), thermal diffusivity and conductivity decrease, and values get closer for both TSC and TSC20 composites. Further extrapolation of thermal conductivity data showed cross-over at ∼973 K due to domination of phonon-phonon scattering and thus lower values of thermal conductivity for TSC20 than TSC. Therefore, reduced CTE and higher thermal conductivity of TSC20 make it a viable choice for applications in high temperatures.

36 MATERIALS SCIENCE↗