Search NASA⌕ Search

SEARCH · Search NASA

Results for “Reinforcement Learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Additive manufacturing of metal matrix composites

Although Metal matrix composites (MMCs) are superior to most sought-after metallic alloys, their challenging fabricability has limited their widespread use in bulk-form applications. Among the many advanced fabrication techniques, Additive Manufacturing (AM), owing to its unique capabilities to produce near-net shapes, has drawn significant traction in the past two decades, especially for materials that are difficult to process using traditional methods. However, unlike pure metal/alloy systems, MMCs are highly sensitive to the processing conditions prevailing in AM techniques due to factors such as the high melting point of reinforcement particles and the potential for in-situ reactions. Therefore, it may be a while before metal matrix composites are commercially produced via AM. This review will discuss the current state-of-the-art design, fabricability, and performance of various additively manufactured MMCs. A particular focus will be on microstructural evolution and microstructure-property relationships. The most employed AM techniques, such as directed energy deposition, powder bed fusion, binder jetting, sheet lamination, and solid-state friction stir processing, are fundamentally different in terms of thermo-kinetics, forming the perspective for this review. A detailed comparison of microstructural evolution and process parameter optimization, including feedstock preparation methods and the role of machine learning and modeling among the different AM processes, is also presented. Finally, a critical evaluation of emerging AM technologies for MMCs is also provided, highlighting their potential advantages and challenges.

36 - MATERIALS SCIENCE↗
DOE OSTI2024

7 Innovations in high-rate composite manufacturing: integrating additive manufacturing with compression molding process

Advanced composites play a pivotal role in modern engineering, offering exceptional strength-to-weight ratios and tailored properties, essential for various industries. High-rate composite manufacturing techniques have rapid production capabilities, which are essential for meeting the demands of industries requiring cost-saving, efficiency, and quick turnaround times. This chapter explores the Additive Manufacturing- Compression Molding (AM-CM) system developed by Oak Ridge National Laboratory (ORNL) for advanced composites manufacturing. The AM-CM system integrates additive manufacturing with compression molding, facilitating the production of polymer composite parts with superior mechanical properties and meticulously controlled microstructures. This innovative system not only ensures precise material deposition but also operates as a fast composite manufacturing process, enhancing productivity and performance, which are needed attributes across industrial applications. Through comprehensive mechanical testing and microstructural analysis, AM-CM promotes remarkable fiber alignment and reduced porosity in composite parts compared to alternative thermoplastic high-rate composite manufacturing methods. Furthermore, AM-CM enables overmolding reinforcement using continuous carbon fiber and supports selective reinforcement through customizable toolpaths. It also facilitates the production of hybrid materials to achieve tailored mechanical properties. Future advancements in AM-CM technology aim to enhance process efficiency, broaden material versatility, and improve part performance. This involves exploring novel materials, advancing process monitoring, implementing automation technologies, and integrating artificial intelligence (AI) and machine learning (ML) for predictive modeling and real-time optimization in composite manufacturing. These developments will establish the AM-CM system as a transformative technology in composite manufacturing, driving innovation across industries.

Hassen, Ahmed [ORNL] (ORCID:0000000328521222)↗
NASA NTRS2012

Mission at Mubasi - A Simulation for Leadership Development

The United States Army is investing in simulations as a way of providing practice for leader decision making. Such simulations, grounded in lessons learned from deployment experienced leaders, place less experienced and more junior leaders in challenging situations they might soon be confronted with. And given increased demands on the Army to become more efficient, while maintaining acceptable levels of mission readiness, simulations offer a cost effective complement to live field training. So too, the design parameters of such a simulation can be made to reinforce specific behavior responses which teach leaders known theory and application of effective (and ineffective) decision making. With this in mind, the Center for Army Leadership (CAL) determined that decision-making was of critical importance. Specifically, the following aspects of decision-making were viewed as particularly important for today's Army leaders: 1) Decision dilemmas, in the form of equally appealing or equally unappealing choices, such that there is no clear "right" or "wrong" choice 2) Making decisions with incomplete or ambiguous information, and 3) Predicting and experiencing second- and third-order consequences of decisions. It is decision making in such a setting or environment that Army leaders are increasingly confronted with given the full spectrum of military operations they must be prepared for. This paper details the approach and development of this decision making simulation.

Cummings, Pau;↗
NASA NTRS1994

A hypertext system that learns from user feedback

Retrieving specific information from large amounts of documentation is not an easy task. It could be facilitated if information relevant in the current problem solving context could be automatically supplied to the user. As a first step towards this goal, we have developed an intelligent hypertext system called CID (Computer Integrated Documentation). Besides providing an hypertext interface for browsing large documents, the CID system automatically acquires and reuses the context in which previous searches were appropriate. This mechanism utilizes on-line user information requirements and relevance feedback either to reinforce current indexing in case of success or to generate new knowledge in case of failure. Thus, the user continually augments and refines the intelligence of the retrieval system. This allows the CID system to provide helpful responses, based on previous usage of the documentation, and to improve its performance over time. We successfully tested the CID system with users of the Space Station Freedom requirements documents. We are currently extending CID to other application domains (Space Shuttle operations documents, airplane maintenance manuals, and on-line training). We are also exploring the potential commercialization of this technique.

Mathe, Nathalie↗
NASA NTRS2007

A Return to Innovative Engineering Design, Critical Thinking and Systems Engineering

I believe we are facing a critical time where innovative engineering design is of paramount importance to the success of our aerospace industry. However, the very qualities and attributes necessary for enhancing, educating, and mentoring a creative spirit are in decline in important areas. The importance of creativity and innovation in this country was emphasized by a special edition of the Harvard Business Review OnPoint entitled: "The Creative Company" which compiled a series of past and present articles on the subject of creativity and innovation and stressed its importance to our national economy. There is also a recognition of a lack of engineering, critical thinking and problem-solving skills in our education systems and a trend toward trying to enhance those skills by developing K-12 educational programs such as Project Lead the Way, "Science for All Americans", Benchmarks 2061 , etc. In addition, with respect to spacecraft development, we have a growing need for young to mid-level engineers with appropriate experience and skills in spacecraft design, development, analysis, testing, and systems engineering. As the Director of Engineering at NASA's Johnson Space Center, I realized that sustaining engineering support of an operational human spacecraft such as the Space Shuttle is decidedly different than engineering design and development skills necessary for designing a new spacecraft such as the Crew Exploration Vehicle of the Constellation Program. We learned a very important lesson post Columbia in that the Space Shuttle is truly an experimental and not an operational vehicle and the strict adherence to developed rules and processes and chains of command of an inherently bureaucratic organizational structure will not protect us from a host of known unknowns let alone unknown unknowns. There are no strict rules, processes, or procedures for understanding anomalous results of an experiment, anomalies with an experimental spacecraft like Shuttle, or in the conceptual design of a spacecraft. Engineering design is as much an art as it is a science. The critical thinking skills necessary to uncover lurking problems in an experimental design and creatively develop solutions are some of the same skills necessary to design a new spacecraft. Thus, I believe engineers unfamiliar with or removed from design and development need time to transition and develop the required skill set to be effective spacecraft designers. I believe the creative process necessary in design can be enhanced and even taught as early as grades K-12 and should continue to be nurtured and developed at the university level and beyond. I am going to present a strategy for developing learning teams to address complex multidisciplinary problems and to creatively develop solutions to those problems rapidly at minimal cost. I will frame a real problem, the development of on-orbit thermal protection system repair of the Space Shuttle, and step through the series of skills necessary to enhance the creative process. The case study I will illustrate is based on a real project, the R&D Reinforced Carbon-Carbon (RCC) Repair Team's development of on-orbit repair concepts for damaged Space Shuttle RCC nose cap and/or leading edges.

Camarda, Charles J.↗
DOE OSTI2024

An Overview of Electric Vehicle Load Modeling Strategies for Grid Integration Studies

The adoption of electric vehicles (EVs) has emerged as a solution to reduce greenhouse gas emissions in the transportation sector, which has motivated the implementation of public policies to promote their use in several countries. However, the high adoption of EVs poses challenges for the electricity sector, as it would imply an increase in energy demand and possible impacts on the power quality (PQ) of the power grid. Therefore, it is important to conduct EV integration studies in the power grid to determine the amount that can be incorporated without causing problems and identify the areas of the power sector that will require reinforcements. Accurate EV load patterns are required for this type of study that, through mathematical modeling, reflect both the dynamic behavior and the factors that influence the decision to recharge EVs. This article aims to present an overview of EVs, examine the different factors considered in the literature for modeling EV load patterns, and review modeling methods. EV load modeling methods are classified into deterministic, statistical, and machine learning. The article shows that each modeling method has its advantages, disadvantages, and data requirements, ranging from simple load modeling to more accurate models requiring large datasets.

Computer Science↗
NASA NTRS2026

Manufacturing Process Development of a Carbon Fiber Reinforced Polymer Composite Shaft for Electric Motors

Electric aircraft applications require electric motors with increased specific power and efficiency. Composite structural components in motors are a potential solution for reducing motor mass, reducing magnetic losses, and limiting undesired conduction paths for fault, electromagnetic interference, or common-mode currents. In this report, manufacturing trials for a high-speed carbon fiber reinforced polymer composite motor shaft are presented. Four prototype shafts were produced using a hybrid biaxial/triaxial fabric that was circumferentially wrapped onto an additively manufactured high-temperature washout mandrel. An additional traditional overbraid approach was also evaluated and shows promise for high-rate, high-performance parts using automated manufacturing. This paper discusses the shaft design, manufacturing methods explored, material selection, the manufacturing trials, and the lessons learned. The results of this manufacturing investigation show feasibility for manufacturing composite shafts for electric motors.

Electric moto shaft↗
NASA NTRS2011

Crew Health Care System (CHeCS) Design Research, Documentations, and Evaluations

The Crew Health Care System (CHeCS) is a group within the Space Life Science Directorate (SLSD) that focuses on the overall health of astronauts by reinforcing the three divisions - the Environmental Maintenance System (EMS), the Countermeasures System (CMS), and the Health Maintenance System (HMS). This internship provided opportunity to gain knowledge, experience, and skills in CHeCS engineering and operations tasks. Various and differing tasks allowed for occasions to work independently, network to get things done, and show leadership abilities. Specific exercises included reviewing hardware certification, operations, and documentation within the ongoing Med Kit Redesign (MKR) project, and learning, writing, and working various common pieces of paperwork used in the engineering and design process. Another project focused on the distribution of various pieces of hardware to off-site research facilities with an interest in space flight health care. The main focus of this internship, though, was on a broad and encompassing understanding of the engineering process as time was spent looking at each individual step in a variety of settings and tasks.

CLement, Bethany M.↗
NASA NTRS2003

Long-term changes in amphetamine-induced reinforcement and aversion in rats following exposure to 56Fe particle

Exposing rats to heavy particles produces alterations in the functioning of dopaminergic neurons and in the behaviors that depend upon the integrity of the dopaminergic system. Two of these dopamine-dependent behaviors include amphetamine-induced reinforcement, measure using the conditioned place preference procedure, and amphetamine-induced reinforcement, measured using the conditioned place preference procedure, and amphetamine-induced aversion, measured using the conditioned taste aversion. Previous research has shown that exposing rats to 1.0 Gy of 1GeV/n 56Fe particles produced a disruption of an amphetamine-induced taste aversion 3 days following exposure, but produced an apparent enhancement of the aversion 112 days following exposure. The present experiments were designed to provide a further evaluation of these results by examining taste aversion learning 154 days following exposure to 1.0 Gy 56Fe particles and to establish the convergent validity of the taste aversion results by looking at the effects of exposure on the establishment of an amphetamine-induced conditioned place preference 3, 7, and 16 weeks following irradiation. The taste aversion results failed to confirm the apparent enhancement of the amphetamine-induced CTA observed in the prior experiment. However, exposure to 56Fe particles prevented the acquisition of amphetamine-induced place preference at all three-time intervals. The results are interpreted as indicating that exposure to heavy particles can produce long-term changes in behavioral functioning. c2002 COSPAR. Published by Elsevier Science Ltd. All rights reserved.

Non-NASA Center↗
NASA NTRS2009

NASA Tech Briefs, August 2009

Topics covered include: Aligning a Receiving Antenna Array to Reduce Interference; Collecting Ground Samples for Balloon-Borne Instruments; Tethered Pyrotechnic Apparatus for Acquiring a Ground Sample; Enhanced Video-Oculography System; Joint Carrier-Phase Synchronization and LDPC Decoding; Dual-Polarization, Sideband-Separating, Balanced Receiver for 1.5 THz Modular Battery Charge Controller; Efficient Multiplexer FPGA Block Structures Based on G4FETs; VLSI Microsystem for Rapid Bioinformatic Pattern Recognition; Low-Noise Amplifier for 100 to 180 GHz; Improved Fabrication of Ceramic Matrix Composite/Foam Core Integrated Structures; Inert Welding/Brazing Gas Filters and Dryers; Fabricating Copper Nanotubes by Electrodeposition; Reducing Aerodynamic Drag on Empty Open Cargo Vehicles; Rotary Percussive Auto-Gopher for Deep Drilling and Sampling; More About Reconfigurable Exploratory Robotic Vehicles; Thermostatic Valves Containing Silicone-Oil Actuators; Improving Heat Flux Performance of Flat Surface in Spray-Cooling Systems; Treating Fibrous Insulation to Reduce Thermal Conductivity; Silica-Aerogel Composites Opacified with La(sub0.7)Sr(sub0.3)MnO3; Cyclic Oxidation Behavior of CuCrAl Cold-Sprayed Coatings for Reusable Launch Vehicles; Ceramic Fiber Structures for Cryogenic Load-Bearing Applications; Elastomer Reinforced with Carbon Nanotubes; Biologically Inspired Purification and Dispersion of SWCNTs; A Technique for Adjusting Eigenfrequencies of WGM Resonators; Low-Pressure, Field-Ionizing Mass Spectrometer; Modifying Operating Cycles to Increase Stability in a LITS; Chamber for Simulating Martian and Terrestrial Environments; Algorithm for Detecting a Bright Spot in an Image; Extreme Programming: Maestro Style; Adaptive Behavior for Mobile Robots; Protocol for Communication Networking for Formation Flying; Planning Complex Sequences Using Compressed Representations; and Self-Supervised Learning of Terrain Traversability from Proprioceptive Sensors.

Source record↗
NASA NTRS1986

Lessons learned from the DC-10 carbon-epoxy rudder program

With the DC-10 carbon-epoxy rudder, the Douglas Aircraft Company achieved one of the greatest percentage weight savings associated with composite structures. Apart from minor damage from lightning strikes, the 15 rudders put into service have experienced virtually trouble-free operation for about a decade. This paper explains why a multirib, postbuckled skin design was used for the DC-10 composite rudder, how it was justified, and how it would have compared with more conventional sandwich design concepts. Special attention is devoted to the reasons why, for such postbuckled designs, it is better to allow the skin to wrinkle and unload itself than to reinforce it and make it resist buckling until some higher load level is attained. With minor changes in the manufacturing technique, this design concept is ideal for the control surfaces on many aircraft. The paper includes suggestions on how to make even better composite control surfaces in the future.

Hart-Smith, L. J.↗
DOE OSTI2026

From microbial diversity to functional potential using dimensionality reduction

The high dimensionality of microbial diversity data from ‘omics observations can be reduced using Machine Learning, with many recent studies showcasing ML utility for exploratory ecological feature finding and process prediction. Here, we compare the Self Organizing Map (SOM) dimensionality reduction method to the well-documented sample-based Principal Coordinate Analysis (PCoA) and taxa-based Weighted Gene Correlation Network Analysis (WGCNA) using near daily 16S rRNA gene amplicon sequencing data from the 2019 to 2020 MOSAiC International Arctic Drift Expedition. We then map k-means clustering outputs from each method to available metagenomes, extracting functionally distinct seasonal microbial ecotypes in the surface Arctic Ocean. Our results indicate the SOM method better represented expected seasonal transitions and identified a greater number of metabolically distinct functional groups than the more traditional PCoA ordination. Ultimately, we identified four community ecotypes with distinct taxonomic and functional cut-offs driven by seasonality, water mass, and substrate turnover, highlighting the importance of succession in functional diversity for the central Arctic Ocean. These results reinforce ML dimensionality reduction as a meaningful translator in the mining of historical amplicon datasets to address modern mechanistic questions and potentially provide ’omics informed ecotype diversity to leverage in mechanistic biogeochemical models.

Arctic Ocean↗
NASA NTRS1972

Degradation of learned skills: Effectiveness of practice methods on visual approach and landing skill retention

Flight control and procedural task skill degradation, and the effectiveness of retraining methods were evaluated for a simulated space vehicle approach and landing under instrument and visual flight conditions. Fifteen experienced pilots were trained and then tested after 4 months either without the benefits of practice or with static rehearsal, dynamic rehearsal or with dynamic warmup practice. Performance on both the flight control and procedure tasks degraded significantly after 4 months. The rehearsal methods effectively countered procedure task skill degradation, while dynamic rehearsal or a combination of static rehearsal and dynamic warmup practice was required for the flight control tasks. The quality of the retraining methods appeared to be primarily dependent on the efficiency of visual cue reinforcement.

Sitterley, T. E.↗
DOE OSTI2024

Machine Learning Applications in Analyzing the Role of Shale Barriers and Baffles for CO2 Storage

This study uses machine learning to analyze microseismic data from the Illinois Basin Decatur Project (IBDP) and quantify CO₂ plume extents. By leveraging well logs, microseismic records, and CO₂ injection metrics, the research predicts subsurface CO₂ plume dynamics. Findings show vertical clustering of microseismic events near the injection well, with CO₂ periodically breaching barriers due to buoyancy. K-Means clustering performed best, achieving the highest Silhouette Score and lowest Davies-Bouldin Index. This capability is crucial for real-time monitoring and management of CO₂ sequestration sites, validated against physical models and IBDP data, reinforcing CO₂ geological sequestration's viability and enhancing management tools.

Carr, Timothy↗
NASA NTRS1990

Reinforcements: The key to high performance composite materials

Better high temperature fibers are the key to high performance, light weight composite materials. However, current U.S. and Japanese fibers still have inadequate high temperature strength, creep resistance, oxidation resistance, modulus, stability, and thermal expansion match with some of the high temperature matrices being considered for future aerospace applications. In response to this clear deficiency, both countries have research and development activities underway. Once successful fibers are identified, their production will need to be taken from laboratory scale to pilot plant scale. In such efforts it can be anticipated that the Japanese decisions will be based on longer term criteria than those applied in the U.S. Since the initial markets will be small, short term financial criteria may adversely minimize the number and strength of U.S. aerospace materials suppliers to well into the 21st century. This situation can only be compounded by the Japanese interests in learning to make commercial products with existing materials so that when the required advanced fibers eventually do arrive, their manufacturing skills will be developed.

Grisaffe, Salvatore J.↗
DOE OSTI2025

Physically constrained 3D diffusion for inverse design of fiber-reinforced polymer composite materials

Designing fiber-reinforced polymer composites (FRPCs) with a tailored nonlinear stress-strain response is crucial for applications such as energy absorption in crash structures, flexible robotics, and impact-resistant protective gear. However, the inherent complexities of composite materials and the multitude of parameters involved, render traditional design and optimization methods inadequate for achieving effective inverse design of composites. In this paper, we present an AI-based inverse design framework that effectively and efficiently generates FRPCs with targeted nonlinear stress-strain responses. We introduce a physically constrained diffusion model (PC3D_Diffusion) capable of managing the complexities of composite materials and producing detailed, high-quality designs. We propose a loss-guided, learning-free approach to generate physically feasible microstructure designs by explicitly enforcing physical constraints during the generation process. For training purposes, 1.35 million FRPC samples were created, and their corresponding stress-strain curves were computed using established physics-based computational models. The results show that PC3D_Diffusion consistently generates high-quality designs with tailored mechanical behaviors, while guaranteeing compliance with the physical constraints. PC3D_Diffusion advances FRPC inverse design and may facilitate the inverse design of other 3D materials, offering potential applications in industries reliant on materials with custom mechanical properties.

Xu, Pei [Clemson Univ., SC (United States)]↗
DOE OSTI2025

Modeling inter‐reader variability in clinical target volume delineation for soft tissue sarcomas using diffusion model

Abstract Background Accurate delineation of the clinical target volume (CTV) is essential in the radiotherapy treatment of soft tissue sarcomas. However, this process is subject to inter‐reader variability due to the need for clinical assessment of risk and extent of potential microscopic spread. This can lead to inconsistencies in treatment planning, potentially impacting treatment outcomes. Most existing automatic CTV delineation methods do not account for this variability and can only generate a single CTV for each case. Purpose This study aims to develop a deep learning‐based technique to generate multiple CTV contours for each case, simulating the inter‐reader variability in the clinical practice. Methods We employed a publicly available dataset consisting of fluorodeoxyglucose positron emission tomography (FDG‐PET), x‐ray computed tomography (CT), and pre‐contrast T1‐weighted magnetic resonance imaging (MRI) scans from 51 patients with soft tissue sarcoma, along with an independent validation set containing five additional patients. An experienced reader drew a contour of the gross tumor volume (GTV) for each patient based on multi‐modality images. Subsequently, two additional readers, together with the first one, were responsible for contouring three CTVs in total based on the GTV. We developed a diffusion model‐based deep learning method that is capable of generating arbitrary number of different and plausible CTVs to mimic the inter‐reader variability in CTV delineation. The proposed model incorporates a separate encoder to extract features from the GTV masks, leveraging the critical role of GTV information in accurate CTV delineation. Results The proposed diffusion model demonstrated superior performance with the highest Dice Index (0.902 compared to values below 0.881 for state‐of‐the‐art models) and the best generalized energy distance (GED) (0.209 compared to values exceeding 0.221 for state‐of‐the‐art models). It also achieved the second‐highest recall and precision metrics among the compared ambiguous image segmentation models. Results from both datasets exhibited consistent trends, reinforcing the reliability of our findings. Additionally, ablation studies exploring different model structures and input configurations highlighted the significance of incorporating prior GTV information for accurate CTV delineation. Conclusions The proposed diffusion model successfully generates multiple plausible CTV contours for soft tissue sarcomas, effectively capturing inter‐reader variability in CTV delineation.

Dong, Yafei [Yale Biomedical Imaging Institute Yal↗
NASA NTRS1994

The growth of the UniTree mass storage system at the NASA Center for Computational Sciences: Some lessons learned

In October 1992, the NASA Center for Computational Sciences made its Convex-based UniTree system generally available to users. The ensuing months saw growth in every area. Within 26 months, data under UniTree control grew from nil to over 12 terabytes, nearly all of it stored on robotically mounted tape. HiPPI/UltraNet was added to enhance connectivity, and later HiPPI/TCP was added as well. Disks and robotic tape silos were added to those already under UniTree's control, and 18-track tapes were upgraded to 36-track. The primary data source for UniTree, the facility's Cray Y-MP/4-128, first doubled its processing power and then was replaced altogether by a C98/6-256 with nearly two-and-a-half times the Y-MP's combined peak gigaflops. The Convex/UniTree software was upgraded from version 1.5 to 1.7.5, and then to 1.7.6. Finally, the server itself, a Convex C3240, was upgraded to a C3830 with a second I/O bay, doubling the C3240's memory and capacity for I/O. This paper describes insights gained and reinforced with the burgeoning demands on the UniTree storage system and the significant increases in performance gained from the many upgrades.

Tarshish, Adina↗