Search NASA⌕ Search

SEARCH · Search NASA

Results for “Reinforcement Learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24
All sourcesNASA NTRSDOE OSTI
NASA NTRS2003

MC-1 Engine Valves, Lessons Learned

Many lessons were learned during the development of the valves for the MC-1 engine. The purpose of this report is to focus on a variety of issues related to the engine valves and convey the lessons learned. This paper will not delve into detailed technical analysis of the components. None of the lessons learned are new or surprising, but simply reinforce the importance of addressing the details of the design early, at the component level. The Marshall Space Flight Center (MSFC), Huntsville, Alabama developed the MC-1 engine, a LOX / FW-1, 60,000 pound thrust engine. This engine was developed under the Low Cost Boost Technology office at MSFC and proved to be a very successful project for the MSFC Propulsion team and the various subcontractors working the development of the engine and its components.

Laszar, John↗
DOE OSTI2024

Predicting Mechanical Properties from Microstructure Images in Fiber-Reinforced Polymers Using Convolutional Neural Networks

Evaluating the mechanical response of fiber-reinforced composites can be extremely time-consuming and expensive. Machine learning (ML) techniques offer a means for faster predictions via models trained on existing input–output pairs and have exhibited success in composite research. This paper explores a fully convolutional neural network modified from StressNet, which was originally used for linear elastic materials, and extended here for a non-linear finite element (FE) simulation to predict the stress field in 2D slices of segmented tomography images of a fiber-reinforced polymer specimen. The network was trained and evaluated on data generated from the FE simulations of the exact microstructure. The testing results show that the trained network accurately captures the characteristics of the stress distribution, especially on fibers, solely from the segmented microstructure images. The trained model can make predictions within seconds in a single forward pass on an ordinary laptop, given the input microstructure, compared to 92.5 h to run the full FE simulation on a high-performance computing cluster. These results show promise in using ML techniques to conduct fast structural analysis for fiber-reinforced composites and suggest a corollary that the trained model can be used to identify the location of potential damage sites in fiber-reinforced polymers.

Sun, Yixuan (ORCID:0000000311093380)↗
DOE OSTI2025

CRCNS US-France Research Proposal: Collaborative Research: Encoding reward expectation in Drosophilia

The fruit fly Drosophila melanogaster has been a valuable model for investigating the genetic and neural bases that underlie learning and memory. Early and most current studies use basic behavior conditioning protocols to study learning in controlled laboratory settings. More recently, the ability to transgenically manipulate many of the brain neurons in the fruit fly with exquisite specificity, and the recent knowledge of the synaptic ‘connectome’ of the fruit fly brain, makes these animals almost unique as a comprehensive model for studies of learning, memory and motivated behavior. In fact, the connectome has revealed many types of new connections that had until now been overlooked. Within this context, the thesis of this proposal is that studies of learning and memory will be greatly enhanced by using more sophisticated means for evaluating memory representations, such as have been developed in vertebrates, and combining those studies with information from the connectome guided by computational modelling. We propose to push beyond the boundaries of existing conditioning protocols for fruit flies to investigate more complex memory representations. In particular, we will investigate the function of reinforcement pathways in relation to the absence of expected reinforcement. More specifically, we propose a series of experiments designed to investigate the memory representations in fruit flies when an expected consequence of a Conditioned Stimulus (CS) fails to occur. Although studies have evaluated how this failure can establish extinction memory for the CS, our studies will go beyond studying extinction. Specifically, we predict that in Drosophila when a CS is associated with a failed expectation of an appetitive food reinforcement it will acquire aversive value, and vice versa for a failed expectation of an aversive reinforcer. We combine these studies with manipulations of reinforcement pathways in the CNS inspired from the connectome, iteratively knitted in with established computational models. Intellectual Merit: The concept of reinforcement expectation and incentive contrast have been influential in the development of studies of associative learning in mammals. These questions are particularly challenging to answer in vertebrates because they require exquisite cellular, temporal, and genetic specificity of experimental manipulations. The recent development of work with identified neurons and their connectomes makes the larval and adult fly brains ripe as models for pushing our understanding of neural bases for these higher- order conditioning phenomena. Broader Impacts: Public health: These analyses and the conceptual framework of prediction error processing underlying them have a profound impact on our understanding of reinforcement-related behavior in humans, including monetary rewards and the mnemonic consequences of traumatic experiences, and for pathologies of the dopamine reinforcement system. Educational: This project will provide interdisciplinary training for postdoctoral researchers, Ph.D. and undergraduate students. The PIs will act as co-supervisors or mentors of students working in the different labs via face-to-face and internet-based technologies. We will also work with ASU’s award-winning Ask- A-Biologist program. This is an online science program designed to enrich the learning experiences of students of all ages and to provide classroom material for use by K-12 teachers. We will develop an extension of a game developed under a prior NSF award, and the new game will include modules to teach K-12 students about how insects learn. We will also integrate into the AAB site a program developed by a collaborator (B Gerber) at the Leibniz Institut für Neurobiologie, Magdeburg, and now in use in schools in Germany, to teach K-12 students how to train animals using the fruit fly larval learning paradigm. Underrepresented groups: All PIs will work with their university offices of Academic Diversity and Equal Opportunity for reaching underrepresented students.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Transfer learning for probabilistic localization of hidden cracks in concrete structures

Abstract The utility of discriminative supervised learning models built using multiple training-data sources is investigated for hidden crack localization in concrete. Feed-forward neural network (FFNN) is chosen as the model architecture, and transfer learning is used to assimilate the information obtained from different sources (computational physics simulations and laboratory experiments). The labeled training data consists of values of a damage index and the known locations of hidden cracks. The classification models need to learn how the presence of damage (hidden cracks) affects the damage index at different sensors for different test conditions. To this end, diagnostic FFNN models are built by sequentially adding and training new hidden layers to assimilate labeled information from computer models (different model geometries, test conditions, crack lengths, crack locations) and laboratory experiments on a plain cement slab. These transfer learning-based models are then used to localize damage in concrete specimens that reflect real-world conditions (i.e., specimens with steel reinforcement and randomly distributed aggregate). The actual damage state in these specimens is determined by extracting cores and performing petrographic studies on the extracted cores. The damage probability estimated by transfer learning-based models is compared with the petrographic damage rating index (DRI) to identify the most suitable approach to train the diagnostic models. The transfer learning-based diagnostic methodology shows promise and could be used in various structural health monitoring applications, where sufficient labeled data are typically not available from a single data source.

Miele, S.↗
NASA NTRS2001

Design and Control of Large Collections of Learning Agents

The intelligent control of multiple autonomous agents is an important yet difficult task. Previous methods used to address this problem have proved to be either too brittle, too hard to use, or not scalable to large systems. The 'Collective Intelligence' project at NASA/Ames provides an elegant, machine-learning approach to address these problems. This approach mathematically defines some essential properties that a reward system should have to promote coordinated behavior among reinforcement learners. This work has focused on creating additional key properties and algorithms within the mathematics of the Collective Intelligence framework. One of the additions will allow agents to learn more quickly, in a more coordinated manner. The other will let agents learn with less knowledge of their environment. These additions will allow the framework to be applied more easily, to a much larger domain of multi-agent problems.

Agogino, Adrian↗
NASA NTRS1973

Research rocket test RR-1 (Black Brant VC) and RR-2 (Aerobee 170A): Investigations of the stability of bubbles in plain and fiber-reinforced metal and solidified in a near-zero-g environment

The results of the first two of a series of research rocket flights are presented. The objectives of these flights were (1) to learn about the capabilities of these rockets, (2) to learn how to interface the payloads and rockets, and (3) to process some of the composite casting demonstration capsules intended originally for Apollo 15. The capsules contained experiments for investigating the stability of gas bubbles in plain and fiber-reinforced metal melted and solidified in a near-zero-g (0.0119g) environment. The characteristics of the two research rockets, an Aerobee 170A and a Black Brant VC, used to obtain the periods of near-zero-g and the temperature control unit used for processing the contents of the two experiment capsules are discussed.

Yates, I. C.↗
DOE OSTI2025

Machine learning-enabled multiscale modeling of mechanical deformation of aluminum and Al-SiC nanocomposites

A machine learning-enabled multiscale framework is developed for modeling the mechanical response of both pure metal and nanoparticle-reinforced metal matrix nanocomposites (MMNCs). Using aluminum–silicon carbide (Al-SiC) as an example MMNC, atomistic simulations reveal three distinct deformation mechanisms (i.e., defect-free, dislocation-based, and interface separation) governed by the interfaces between the Al matrix and SiC nanoparticles. As compared with single crystal Al, the lattice undergoes a more abrupt failure once the dislocation network becomes extensive and void nucleation initiates, whereas in Al-SiC, nanoparticle interfaces enable a more gradual progression of damage. These mechanisms are captured through a combined classification-regression neural network surrogate model that bridges atomic-scale insights with continuum-scale finite element analysis. Machine learning-enabled multiscale modeling of pure Al accurately predicted strain localization and confirmed by in-situ scanning electron microscopic tensile testing on perforated Al specimens. This study underscores the promise of integrating physics-informed machine learning with hierarchical modeling to capture the interface dominated phenomena and guide the design of advanced MMNCs.

Al-SiC↗
DOE OSTI2024

Using Gamification to Enhance Mastery of Network Security Concepts

Gamification has proven to be effective in engaging and encouraging people to work towards and achieve goals. Many students struggle to focus on schoolwork, due to a lack of interest, lack of understanding, or other factors unique to the student. Applying gamification elements to education can help engage these students in learning their course material and help them excel academically. This study examines the effectiveness of using gamification techniques to enhance the learning experience in college Computer Science courses. A video game application is utilized to review and reinforce cybersecurity concepts that students have already been taught in class. Previous work has been made on a prototype game build that teaches about ARP (Address Resolution Protocol) components. The focus of this study is to refine and develop the structure of the prototype into a more interactive and enjoyable format with non-competitive and captivating activities that allow students to study at their own pace. An updated version of the game was created that focused on reaching a balance between education and entertainment. The game was used by students enrolled in a cybersecurity class, where pre-survey, post-survey and a focus group interview were conducted to determine how effective the updated version is compared to the current build, in addition to how effective the gamification method is regarding student retention of taught material. The pre-survey and post-survey results revealed an increase in interest and mastery of cybersecurity concepts as a result of playing the game. Students found value in the game as both a method of reviewing material taught in class and an entertaining and engaging game. These results show potential in using gamification in cybersecurity and education.

Hilliard, Kevin↗
NASA NTRS2007

Educational Experiences of Embry-Riddle Students through NASA Research Collaboration

NASA's educational programs benefit students while increasing the overall productivity of the organization. The NASA Graduate Student Research Program (GSRP) awards fellowships for graduate study leading to both masters and doctoral degrees in several technical fields, while the Cooperative Education program allows undergraduate and graduate students the chance to gain work experience in the field. The Mission Analysis Branch of the Expendable Launch Vehicles Division at NASA Kennedy Space Center has utilized these two programs with students from Embry-Riddle Aeronautical University to conduct research in modeling and developing a parameter estimation method for spacecraft fuel slosh using simple pendulum analogs. Simple pendulum models are used to understand complicated spacecraft fuel slosh behavior. A robust parameter estimation process will help to identiFy the parameters that will predict the response fairly accurately during the initial stages of design. NASA's Cooperative Education Program trains the next wave of new hires while allowing graduate and undergraduate college students to gain valuable "real-world" work experience. It gives NASA a no risk capability to evaluate the true performance of a prospective new hire without relying solely on a paper resume, while providing the students with a greater hiring potential upon graduation, at NASA or elsewhere. In addition, graduate students serve as mentors for undergrad students and provide a unique learning environment. Providing students with a unique opportunity to work on "real-world" aerospace problems ultimately reinforces their problem solving abilities and their communication skills (in terms of interviewing, resume writing, technical writing, presentation, and peer review) that are vital for the workforce to succeed.

Schlee, Keith↗
DOE OSTI2025

Machine learning-driven design and self-sensing capabilities of automotive bumper lattices for adaptive impact response

We present a novel approach to design an automotive bumper energy absorber using carbon fiber reinforced polymer composites, optimized to meet conflicting performance requirements for two distinct impact scenarios. The design must satisfy both a low-speed (2.5 mph) pendulum intrusion test, simulating vehicle-to-vehicle collisions, and a high-speed (25 mph) leg flexion test, replicating pedestrian impacts. These tests demand opposing deformation characteristics: high flexibility (deformation < 85 mm) for the former and high stiffness (deformation < 22 mm) for the latter. To address these contradictory requirements, we developed a machine learning (ML) framework for inverse optimization of lattice designs and material selection. Unlike traditional iterative design processes, our ML model directly outputs optimal design parameters and material choices based on target performance inputs. The energy absorber was fabricated using advanced additive manufacturing techniques, including extrusion deposition and digital light processing. The integration of carbon fibers provides multifunctionality to the bumper structure, enabling self-sensing capabilities through changes in electrical resistivity under compression. This electrical response demonstrates high repeatability under multiple cycles at 2% compression and exhibits distinct signatures during crack formation under high deformation. This research offers adaptive performance through innovative design methodologies and smart material integration. The approach has potential applications in various fields requiring adaptive energy absorption and real-time structural health monitoring.

Chawla, Komal [ORNL] (ORCID:0000000190327565)↗
NASA NTRSDate not supplied

In-Situ Scanning Electron Microscope Experiments for Microscale Mechanical Testing and Validated Modeling of Fiber Reinforced Thermoplastics

A novel, in-situ, scanning electron microscope (SEM) mechanical testing capability for materials at the microscale which provides experimental validation to a machine learning (ML) toolset for full-field validation of physics-based micromechanics models is being developed by researchers at NASA Glenn Research Center. These are enabling technologies for the integration of multiscale digital twins for materials into system level models which will result in the improved performance, material discovery, reduced production cost and time, rapid characterization, and prognostic structural health monitoring (SHM) for materials and structures for extreme environments in support of NASA space exploration missions. In order to bridge the material structure-to-system gap for digital twins, physics-based models must be experimentally validated at multiple length scales. Seminal microscale experiments, conducted at the Air Force Research Laboratory (AFRL), were limited to transverse compression of single-layer, unidirectional thermoset polymer matrix composite (PMC) micropillar specimens [1]. The early phases of the current project followed those initial results and setup to reproduce the compression testing of PMC material on the custom-built piezoelectric actuated micromechanical testing rig built by MicroTesting Solutions LLC. In this work, samples of thermoplastic PMC material were first machined into 3 mm cubes, and then further machining and final milling was done using a Focused Ion Beam (FIB). The initial experiment was done on a pillar roughly 20 µm x 20 µm x 40 µm tall. Additional pillars were milled with final sizes ranging from 20 µm x 20 µm x 40 µm tall to 40 µm x 40 µm x 65 µm tall. A speckle pattern for in-situ full-field measurements using Digital Image Correlation (DIC) was applied with platinum, which was coated on the surface, and then the FIB was used to mill away some of the coating to produce an irregular pattern of Pt on the pillar surface. The samples were loaded into the custom testing rig and placed into the SEM and loaded under compression until failure. Images were collected in the SEM during testing. Post-processing of the images was conducted using DIC to obtain full-field displacement and strain measurements elucidating the role of the matrix as well as fiber-fiber interaction at the microscale within the composite subjected to compression loading well into the non-linear regime of the material. Moreover, the evolution of fiber-matrix debonding and matrix cracking is observed in-situ at the microscale. This data, along with images segmented with a newly developed ML toolset [2], was used to create and validate physics-based micromechanics models. An image of the failed micropillar is shown in Figure 1. The techniques developed in the initial compression experiment was tailored to the validation needs of the models and expanded to include different sized samples as well as possibly tension and fatigue.

Laura Wilson↗
DOE OSTI2024

Efficient distributed continual learning for steering experiments in real-time

Deep learning has emerged as a powerful method for extracting valuable information from large volumes of data. However, when new training data arrives continuously (i.e., is not fully available from the beginning), incremental training suffers from catastrophic forgetting (i.e., new patterns are reinforced at the expense of previously acquired knowledge). Training from scratch each time new training data becomes available would result in extremely long training times and massive data accumulation. Rehearsal-based continual learning has shown promise for addressing the catastrophic forgetting challenge, but research to date has not addressed performance and scalability. To fill this gap, we propose an approach based on a distributed rehearsal buffer that efficiently complements data-parallel training on multiple GPUs to achieve high accuracy, short runtime, and scalability. It leverages a set of buffers (local to each GPU) and uses several asynchronous techniques for updating these local buffers in an embarrassingly parallel fashion, all while handling the communication overheads necessary to augment input minibatches using unbiased, global sampling. We further propose a generalization of rehearsal buffers to support both classification and generative learning tasks, as well as more advanced rehearsal strategies (notably Dark Experience Replay, leveraging knowledge distillation). We illustrate this approach with a real-life HPC streaming application from the domain of ptychographic image reconstruction. Furthermore, we run extensive experiments on up to 128 GPUs of the ThetaGPU supercomputer to compare our approach with baselines representative of training-from-scratch (the upper bound in terms of accuracy) and incremental training (the lower bound). Results show that rehearsal-based continual learning achieves a top-5 validation accuracy close to the upper bound, while simultaneously exhibiting a runtime close to the lower bound.

Asynchronous data management↗
NASA NTRSDate not supplied

Structural Carbon Nanotube Development

Mechanical properties of carbon nanotubes (CNTs) at the nanoscale suggest their potential to enable significantly lighter structures of interest in aerospace applications. As different formats of the material became available over the last 20 years, understanding of how CNTs contribute to improvements in mechanical properties of structural composites has evolved.Although the material is now available in large quantities that permit the development of composite fabrication processes, the retention of properties that make these materials attractive on the nano scale remains a challenge in large assemblies of CNTs. The work to be presented will summarize lessons learned in our efforts to produce carbon nanotube composites with tensile properties that begin to rival those of carbon fiber reinforced polymer composites. Challenges that need to be overcome for practical adoption of this emerging material system will be considered.

Carbon nanotube↗
NASA NTRS1974

Development of techniques to enhance man/machine communication

A four-state random stimulus generator, considered to function as an ESP teaching machine was used to investigate an approach to facilitating interactions between man and machines. A subject tries to guess in which of four states the machine is. The machine offers the user feedback and reinforcement as to the correctness of his choice. Using this machine, 148 volunteer subjects were screened under various protocols. Several whose learning slope and/or mean score departed significantly from chance expectation were identified. Direct physiological evidence of perception of remote stimuli not presented to any known sense of the percipient using electroencephalographic (EEG) output when a light was flashed in a distant room was also studied.

Targ, R.↗
NASA NTRS2013

How to Demonstrate Microgravity in your Classroom

Learn why zero gravity is a misnomer and learn how to demonstrate microgravity to students and the general public. In this session, a short theory segment will explain and reinforce these concepts so that you may explain to others. Session participants will also see simple equipment that demonstrates microgravity during the session and can just as well be done in the classroom or museum exhibit hall. The hands-on demonstration devices range from a leaky water bottle to an electronic drop tower with an on-board camera. The session will also include demonstration techniques for Physics, Forces & Motion, and orbits. This material is useful for middle school forces and motions instruction, high school physics instruction, public demonstrations at conferences & school open houses, travelling museum exhibits, fixed museum exhibits, and independent student projects or experiments. These activities also connect the terrestrial demonstration with planetary & moon motion, comet trajectory, and more.

DeLombard, Richard↗
DOE OSTI2024

Polymer Additive Manufacturing for Marine Renewable Energy Applications: Best Practices, Research Trends, and Current Challenges

Additive manufacturing (AM) is a rapidly growing technology space, not only for prototyping, but is also becoming more feasible at larger scales and increasing component quantities. There are a large variety of AM processes and materials available to users and effectively applying those processes and materials to a specific use case can be challenging. One specific area where AM could be particularly beneficial is marine renewable energy (MRE). Not only is MRE a relatively nascent industry with a near-term need for rapid deployments and prototype testing, but developers could also see long-term benefits from the broad variety of environmentally resistant materials available and the ability to manufacture complex geometries that AM technologies offer. Over the past 4 years, AM materials have played an increasing role in the Advanced Materials project; a multi-year, multi-laboratory research project funded by the U.S. Department of Energy's Water Power Technologies Office, with the main goal of reducing barriers to the adoption of complex materials in the MRE industry. The primary focus of this project is to develop test methods and generate datasets to understand the long-term performance of advanced materials in marine environmental and address specific material challenges as they arise. This report provides an extensive overview of the research that has been performed specific to AM polymers as part of the Advanced Materials project. The intention of this document is to provide recommendations of best practices with regards to material selection, mechanical test method development, and design practices, lessons learned along the way, current research trends, and ongoing challenges with regards to AM polymers in marine environments. In particular, this report focuses on several key aspects: Material and process selection, Environmental conditioning and subsequent degradation quantification through mechanical characterization, Composite reinforcements on AM polymer substrates, Adhesion of instrumentation for mechanical characterization and loads measurements, Protective coatings for preventing biofouling and water ingress, Other MRE case studies where AM has proved particularly useful. Ultimately, we hope that the test methods that have been developed, data generated, and lessons learned from this research will be valuable to the MRE community (researchers and developers alike), as well as other industries, and can be used as a reference point as the respective MRE and AM industries continue to grow and mature.

16 TIDAL AND WAVE POWER↗
NASA NTRS2006

Educational Experiences of Embry-Riddle Students through NASA Research Collaboration

NASA's educational. programs benefit students and faculty while increasing the overall productivity of the organization. The NASA Graduate Student Research Program (GSRP) awards fellowships for graduate study leading to both masters and doctoral degrees in several technical fields. GSRP participants have the option to utilize NASA Centers andlor university research facilities. In addition, GSRP students can serve as mentors for undergrad students to provide a truly unique learning experience. NASA's Cooperative Education Program allows undergraduate students the chance to gain "real-world" work experience in the field. It also gives NASA a no risk capability to evaluate the true performance of a prospective new hire without relying solely on a "paper resume" while providing the students with a greater hiring potential upon graduation, at NASA or elsewhere. University faculty can also benefit by participating in the NASA Faculty Fellowship Program (NFFP). This program gives the faculty an opportunity to work with NASA peers. The Mission Analysis Branch of the Expendable Launch Vehicles Division at NASA Kennedy Space Center has utilized these two programs with students from Embry-Riddle Aeronautical University (ERAU) to conduct research in modeling and developing a parameter estimation method for spacecraft fuel slosh using simple pendulum analogs. Simple pendulum models are used to understand complicated spacecraft fuel slosh behavior. A robust parameter estimation process will help to identif' the parameters that will predict the response fairly accurately during the initial stages of design. These programs provide students with a unique opportunity to work on "real-world" aerospace problems, like spacecraft fuel slosh,. This in turn reinforces their problem solving abilities and their communication skills such as interviewing, resume writing, technical writing, and presentation. Faculty benefits by applying what they have learned to the classroom. Through university collaborations with NASA and industry help students to acquire skills that are vital for their success upon entering the workforce.

Schlee, Keith↗
NASA NTRS2012

Bridging the Gap Between Scientists and Classrooms: Scientist Engagement in the Expedition Earth and Beyond Program

Teachers in today s classrooms need to find creative ways to connect students with science, technology, engineering, mathematics (STEM) experts. These STEM experts can serve as role models and help students think about potential future STEM careers. They can also help reinforce academic knowledge and skills. The cost of transportation restricts teachers ability to take students on field trips exposing them to outside experts and unique learning environments. Additionally, arranging to bring in guest speakers to the classroom seems to happen infrequently, especially in schools in rural areas. The Expedition Earth and Beyond (EEAB) Program [1], facilitated by the Astromaterials Research and Exploration Science (ARES) Directorate Education Program at the NASA Johnson Space Center has created a way to enable teachers to connect their students with STEM experts virtually. These virtual connections not only help engage students with role models, but are also designed to help teachers address concepts and content standards they are required to teach. Through EEAB, scientists are able to actively engage with students across the nation in multiple ways. They can work with student teams as mentors, participate in virtual student team science presentations, or connect with students through Classroom Connection Distance Learning (DL) Events.

Graff, P. V.↗