Search NASA⌕ Search

SEARCH · Search NASA

Results for “Reinforcement Learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
NASA NTRS1991

Modeling the behavioral substrates of associate learning and memory - Adaptive neural models

Three adaptive single-neuron models based on neural analogies of behavior modification episodes are proposed, which attempt to bridge the gap between psychology and neurophysiology. The proposed models capture the predictive nature of Pavlovian conditioning, which is essential to the theory of adaptive/learning systems. The models learn to anticipate the occurrence of a conditioned response before the presence of a reinforcing stimulus when training is complete. Furthermore, each model can find the most nonredundant and earliest predictor of reinforcement. The behavior of the models accounts for several aspects of basic animal learning phenomena in Pavlovian conditioning beyond previous related models. Computer simulations show how well the models fit empirical data from various animal learning paradigms.

Lee, Chuen-Chien↗
NASA NTRS2003

MC-1 Engine Valves, Lessons Learned

Many lessons were learned during the development of the valves for the MC-1 engine. The purpose of this report is to focus on a variety of issues related to the engine valves and convey the lessons learned. This paper will not delve into detailed technical analysis of the components. None of the lessons learned are new or surprising, but simply reinforce the importance of addressing the details of the design early, at the component level. The Marshall Space Flight Center (MSFC), Huntsville, Alabama developed the MC-1 engine, a LOX / FW-1, 60,000 pound thrust engine. This engine was developed under the Low Cost Boost Technology office at MSFC and proved to be a very successful project for the MSFC Propulsion team and the various subcontractors working the development of the engine and its components.

Laszar, John↗
NASA NTRS2001

Design and Control of Large Collections of Learning Agents

The intelligent control of multiple autonomous agents is an important yet difficult task. Previous methods used to address this problem have proved to be either too brittle, too hard to use, or not scalable to large systems. The 'Collective Intelligence' project at NASA/Ames provides an elegant, machine-learning approach to address these problems. This approach mathematically defines some essential properties that a reward system should have to promote coordinated behavior among reinforcement learners. This work has focused on creating additional key properties and algorithms within the mathematics of the Collective Intelligence framework. One of the additions will allow agents to learn more quickly, in a more coordinated manner. The other will let agents learn with less knowledge of their environment. These additions will allow the framework to be applied more easily, to a much larger domain of multi-agent problems.

Agogino, Adrian↗
NASA NTRS1973

Research rocket test RR-1 (Black Brant VC) and RR-2 (Aerobee 170A): Investigations of the stability of bubbles in plain and fiber-reinforced metal and solidified in a near-zero-g environment

The results of the first two of a series of research rocket flights are presented. The objectives of these flights were (1) to learn about the capabilities of these rockets, (2) to learn how to interface the payloads and rockets, and (3) to process some of the composite casting demonstration capsules intended originally for Apollo 15. The capsules contained experiments for investigating the stability of gas bubbles in plain and fiber-reinforced metal melted and solidified in a near-zero-g (0.0119g) environment. The characteristics of the two research rockets, an Aerobee 170A and a Black Brant VC, used to obtain the periods of near-zero-g and the temperature control unit used for processing the contents of the two experiment capsules are discussed.

Yates, I. C.↗
NASA NTRS2007

Educational Experiences of Embry-Riddle Students through NASA Research Collaboration

NASA's educational programs benefit students while increasing the overall productivity of the organization. The NASA Graduate Student Research Program (GSRP) awards fellowships for graduate study leading to both masters and doctoral degrees in several technical fields, while the Cooperative Education program allows undergraduate and graduate students the chance to gain work experience in the field. The Mission Analysis Branch of the Expendable Launch Vehicles Division at NASA Kennedy Space Center has utilized these two programs with students from Embry-Riddle Aeronautical University to conduct research in modeling and developing a parameter estimation method for spacecraft fuel slosh using simple pendulum analogs. Simple pendulum models are used to understand complicated spacecraft fuel slosh behavior. A robust parameter estimation process will help to identiFy the parameters that will predict the response fairly accurately during the initial stages of design. NASA's Cooperative Education Program trains the next wave of new hires while allowing graduate and undergraduate college students to gain valuable "real-world" work experience. It gives NASA a no risk capability to evaluate the true performance of a prospective new hire without relying solely on a paper resume, while providing the students with a greater hiring potential upon graduation, at NASA or elsewhere. In addition, graduate students serve as mentors for undergrad students and provide a unique learning environment. Providing students with a unique opportunity to work on "real-world" aerospace problems ultimately reinforces their problem solving abilities and their communication skills (in terms of interviewing, resume writing, technical writing, presentation, and peer review) that are vital for the workforce to succeed.

Schlee, Keith↗
NASA NTRSDate not supplied

In-Situ Scanning Electron Microscope Experiments for Microscale Mechanical Testing and Validated Modeling of Fiber Reinforced Thermoplastics

A novel, in-situ, scanning electron microscope (SEM) mechanical testing capability for materials at the microscale which provides experimental validation to a machine learning (ML) toolset for full-field validation of physics-based micromechanics models is being developed by researchers at NASA Glenn Research Center. These are enabling technologies for the integration of multiscale digital twins for materials into system level models which will result in the improved performance, material discovery, reduced production cost and time, rapid characterization, and prognostic structural health monitoring (SHM) for materials and structures for extreme environments in support of NASA space exploration missions. In order to bridge the material structure-to-system gap for digital twins, physics-based models must be experimentally validated at multiple length scales. Seminal microscale experiments, conducted at the Air Force Research Laboratory (AFRL), were limited to transverse compression of single-layer, unidirectional thermoset polymer matrix composite (PMC) micropillar specimens [1]. The early phases of the current project followed those initial results and setup to reproduce the compression testing of PMC material on the custom-built piezoelectric actuated micromechanical testing rig built by MicroTesting Solutions LLC. In this work, samples of thermoplastic PMC material were first machined into 3 mm cubes, and then further machining and final milling was done using a Focused Ion Beam (FIB). The initial experiment was done on a pillar roughly 20 µm x 20 µm x 40 µm tall. Additional pillars were milled with final sizes ranging from 20 µm x 20 µm x 40 µm tall to 40 µm x 40 µm x 65 µm tall. A speckle pattern for in-situ full-field measurements using Digital Image Correlation (DIC) was applied with platinum, which was coated on the surface, and then the FIB was used to mill away some of the coating to produce an irregular pattern of Pt on the pillar surface. The samples were loaded into the custom testing rig and placed into the SEM and loaded under compression until failure. Images were collected in the SEM during testing. Post-processing of the images was conducted using DIC to obtain full-field displacement and strain measurements elucidating the role of the matrix as well as fiber-fiber interaction at the microscale within the composite subjected to compression loading well into the non-linear regime of the material. Moreover, the evolution of fiber-matrix debonding and matrix cracking is observed in-situ at the microscale. This data, along with images segmented with a newly developed ML toolset [2], was used to create and validate physics-based micromechanics models. An image of the failed micropillar is shown in Figure 1. The techniques developed in the initial compression experiment was tailored to the validation needs of the models and expanded to include different sized samples as well as possibly tension and fatigue.

Laura Wilson↗
NASA NTRSDate not supplied

Structural Carbon Nanotube Development

Mechanical properties of carbon nanotubes (CNTs) at the nanoscale suggest their potential to enable significantly lighter structures of interest in aerospace applications. As different formats of the material became available over the last 20 years, understanding of how CNTs contribute to improvements in mechanical properties of structural composites has evolved.Although the material is now available in large quantities that permit the development of composite fabrication processes, the retention of properties that make these materials attractive on the nano scale remains a challenge in large assemblies of CNTs. The work to be presented will summarize lessons learned in our efforts to produce carbon nanotube composites with tensile properties that begin to rival those of carbon fiber reinforced polymer composites. Challenges that need to be overcome for practical adoption of this emerging material system will be considered.

Carbon nanotube↗
NASA NTRS1974

Development of techniques to enhance man/machine communication

A four-state random stimulus generator, considered to function as an ESP teaching machine was used to investigate an approach to facilitating interactions between man and machines. A subject tries to guess in which of four states the machine is. The machine offers the user feedback and reinforcement as to the correctness of his choice. Using this machine, 148 volunteer subjects were screened under various protocols. Several whose learning slope and/or mean score departed significantly from chance expectation were identified. Direct physiological evidence of perception of remote stimuli not presented to any known sense of the percipient using electroencephalographic (EEG) output when a light was flashed in a distant room was also studied.

Targ, R.↗
NASA NTRS2013

How to Demonstrate Microgravity in your Classroom

Learn why zero gravity is a misnomer and learn how to demonstrate microgravity to students and the general public. In this session, a short theory segment will explain and reinforce these concepts so that you may explain to others. Session participants will also see simple equipment that demonstrates microgravity during the session and can just as well be done in the classroom or museum exhibit hall. The hands-on demonstration devices range from a leaky water bottle to an electronic drop tower with an on-board camera. The session will also include demonstration techniques for Physics, Forces & Motion, and orbits. This material is useful for middle school forces and motions instruction, high school physics instruction, public demonstrations at conferences & school open houses, travelling museum exhibits, fixed museum exhibits, and independent student projects or experiments. These activities also connect the terrestrial demonstration with planetary & moon motion, comet trajectory, and more.

DeLombard, Richard↗
NASA NTRS2006

Educational Experiences of Embry-Riddle Students through NASA Research Collaboration

NASA's educational. programs benefit students and faculty while increasing the overall productivity of the organization. The NASA Graduate Student Research Program (GSRP) awards fellowships for graduate study leading to both masters and doctoral degrees in several technical fields. GSRP participants have the option to utilize NASA Centers andlor university research facilities. In addition, GSRP students can serve as mentors for undergrad students to provide a truly unique learning experience. NASA's Cooperative Education Program allows undergraduate students the chance to gain "real-world" work experience in the field. It also gives NASA a no risk capability to evaluate the true performance of a prospective new hire without relying solely on a "paper resume" while providing the students with a greater hiring potential upon graduation, at NASA or elsewhere. University faculty can also benefit by participating in the NASA Faculty Fellowship Program (NFFP). This program gives the faculty an opportunity to work with NASA peers. The Mission Analysis Branch of the Expendable Launch Vehicles Division at NASA Kennedy Space Center has utilized these two programs with students from Embry-Riddle Aeronautical University (ERAU) to conduct research in modeling and developing a parameter estimation method for spacecraft fuel slosh using simple pendulum analogs. Simple pendulum models are used to understand complicated spacecraft fuel slosh behavior. A robust parameter estimation process will help to identif' the parameters that will predict the response fairly accurately during the initial stages of design. These programs provide students with a unique opportunity to work on "real-world" aerospace problems, like spacecraft fuel slosh,. This in turn reinforces their problem solving abilities and their communication skills such as interviewing, resume writing, technical writing, and presentation. Faculty benefits by applying what they have learned to the classroom. Through university collaborations with NASA and industry help students to acquire skills that are vital for their success upon entering the workforce.

Schlee, Keith↗
NASA NTRS2012

Bridging the Gap Between Scientists and Classrooms: Scientist Engagement in the Expedition Earth and Beyond Program

Teachers in today s classrooms need to find creative ways to connect students with science, technology, engineering, mathematics (STEM) experts. These STEM experts can serve as role models and help students think about potential future STEM careers. They can also help reinforce academic knowledge and skills. The cost of transportation restricts teachers ability to take students on field trips exposing them to outside experts and unique learning environments. Additionally, arranging to bring in guest speakers to the classroom seems to happen infrequently, especially in schools in rural areas. The Expedition Earth and Beyond (EEAB) Program [1], facilitated by the Astromaterials Research and Exploration Science (ARES) Directorate Education Program at the NASA Johnson Space Center has created a way to enable teachers to connect their students with STEM experts virtually. These virtual connections not only help engage students with role models, but are also designed to help teachers address concepts and content standards they are required to teach. Through EEAB, scientists are able to actively engage with students across the nation in multiple ways. They can work with student teams as mentors, participate in virtual student team science presentations, or connect with students through Classroom Connection Distance Learning (DL) Events.

Graff, P. V.↗
NASA NTRS1995

Emergence of Relations and the Essence of Learning: A Review of Sidman's Equivalence Relations and Behavior: A Research Story

Sidman addresses two very important questions in Equivalence Relations and Behavior: A Research Story: What are the bases of behavioral competence? And how do units of learning become related? The book recounts the story of how an understanding of emergent relations and competencies was achieved through studies in his teaching-research program with mentally retarded subjects. Although children normally accrue vast networks of relations between stimuli and events, those with mental retardation typically do not. Consequently, by learning how to establish those networks, Sidman and his students contribute richly both to the cultivation of competencies by their subjects and, more generally, to an understanding of real-world human behavior. The basic equivalence paradigm affords the subject feedback and reinforcement for very specific choices during training, but the test is not for those choices! Rather, tests for equivalence look for new choices, ones seemingly quite foreign to the training regimen. The tests for equivalence relations entail presentations of stimuli that were the options for conditional choice during reinforced training. In tests of equivalence, correct choices are novel; hence, they have never been reinforced during training. The study of equivalence relations can encourage the emergence of new perspectives that are more symbiotic than competitive. In full acknowledgment of the important role and contributions made by those who identify themselves as experimental analysts of behavior, it is timely that rapprochements be worked toward, as indeed they are, to meld that perspective with others of our time. Both our research methods and our expectations about the nature of the learning process and the abilities of our subjects can delimit what they might learn and what we, in turn, learn about their learning. The text will be of great value for instruction at the upper-division and graduate levels. Its impact will be substantial, for it defines an important advance in our efforts to understand the richness of behavior in both humans and nonhuman animals. Although not presented to that end, the book might also serve to bridge communications with other groups of animal researchers whose interests lie more in a comparative or ethological framework.

Rumbaugh, Duane M.↗
NASA NTRS1992

Thermal conductance of two interface materials and their applications in space systems

The temperature control of spacecraft and instrument systems and subsystems requires heat transfer interface materials that possess good thermal and structural characteristics, among other properties, to respond to the vacuum environment of space. These materials must be easy to apply to, and remove from, the surfaces where they are applied, and must be able to withstand power dissipation extremes, and be used for different clamping configurations and pressures. Silicone based greases, used in the past, tend to migrate and to contaminate nearby surfaces. Bare metal to metal contact offers low thermal conductance and difficulties in estimating the actual heat transfer. Several polymeric materials containing different thermal conductive compounds and structural reinforcements were prepared to overcome grease and metal problems. Two polymeric materials were evaluated: Cho-Therm 1671 elastomer; and the CV-2946, a conductive RTV silicone. Tests were done to learn more about these products. Results indicate that the tightly bolted, torqued fixtures did not buckle or distort, and provided optimum thermal conductance. Fixtures simulating actual spacecraft configuration suffered bowing and separating.

Scialdone, J. J.↗
NASA NTRS1999

Wilberforce Power Technology in Education Program

The Wilberforce Power Technology in Education Program is a multipart program. Three key parts of this program will be described. They are: (1) WISE-The Wilberforce Summer Intensive Experience. This annual offering is an educational program which is designed to provide both background reinforcement and a focus on study skills to give the participants a boost in their academic performance throughout their academic careers. It is offered to entering Wilberforce students. Those students who take advantage of WISE learn to improve important skills which enable them to work at higher levels in mathematics, science and engineering courses throughout their college careers, but most notably in the first year of college study. (2) Apply technology to reaming. This is being done in several ways including creating an electronic chemistry text with hypertext links to a glossary to help the students deal with the large new vocabulary required to describe and understand chemistry. It is also being done by converting lecture materials for the Biochemistry class to PowerPoint format. Technology is also being applied to learning by exploring simulation software of scientific instrumentation. (3) Wilberforce participation in collaborative research with NASA's John H. Glenn Research Center at Lewis Field. This research has focused on two areas in the past year. The first of these is the deposition of solar cell materials. A second area involves the development of polymeric materials for incorporation into thin film batteries.

Gordon, Edward M.↗
NASA NTRS2002

Structural Acoustic Response of a Shape Memory Alloy Hybrid Composite Panel (Lessons Learned)

This study presents results from an effort to fabricate a shape memory alloy hybrid composite (SMAHC) panel specimen and test the structure for dynamic response and noise transmission characteristics under the action of thermal and random acoustic loads. A method for fabricating a SMAHC laminate with bi-directional SMA reinforcement is described. Glass-epoxy unidirectional prepreg tape and Nitinol ribbon comprise the material system. Thermal activation of the Nitinol actuators was achieved through resistive heating. The experimental hardware required for mechanical support of the panel/actuators and for establishing convenient electrical connectivity to the actuators is presented. Other experimental apparatus necessary for controlling the panel temperature and acquiring structural acoustic data are also described. Deficiency in the thermal control system was discovered in the process of performing the elevated temperature tests. Discussion of the experimental results focuses on determining the causes for the deficiency and establishing means for rectifying the problem.

Turner, Travis L.↗
NASA NTRS2019

Demisability of GFRP and CFRP Components of Reentering Orbital Debris: Phase I Test Results

Observations of surviving reentry debris on the ground and research performed by Hyperschall Technologie Göttingen (HTG) [1] indicated that significantly more glass fiber-reinforced polymer (GFRP) and carbon fiber-reinforced polymer (CFRP) components survive reentry than current models predict. NASA’s Orbital Debris Program Office conducted a series of tests to evaluate the accuracy of material demise models for reentering orbital debris used in NASA’s Object Reentry Survival Analysis Tool (ORSAT) and Debris Assessment Software (DAS). Testing is planned in a multi-phase series to allow for quick quantification of results as well as refinement of methods resulting from lessons learned during early phases. The Phase 1 tests discussed here validated ORSAT models for homogeneous metals, provided an efficient quantification of composite material demisability properties like mass loss rate and overall time to demise, and identified potential failure modes, which are currently not well understood. Phase 2 tests will be used to further understand mass loss rates and modes of both thermal and mechanical failure in composite materials. The authors exposed 95 samples of aluminum, CFRP, Kevlar fiber-reinforced polymer, GFRP, and sheets of G10 fiberglass to conditions approximating the reentry environment using an inductively coupled plasma (ICP) torch facility. The cylindrical CFRP samples were exposed to the atmospheric pressure plasma, at both the end and the midpoint, to investigate the difference in demisability between parts with exposed edges, like panels, and parts with no edges, such as carbonoverwrapped pressure vessels (COPVs). In a non-oxidative environment, no composite materials demised within the 5-minute test time. In the oxidative, elevated heat flux environment, CFRP samples demised between 210 s and 270 s. For the first 100 s of insertion time, most of the mass loss was due to pyrolysis of resin, creating an approximately bi-linear mass-loss rate curve with time. In a non-oxidative environment, carbon filaments were observed to unravel from some of the CFRP end-burned samples; however, this effect did not seem to affect the overall time to demise for the samples significantly. These results indicate that both GFRP and CFRP components survive reentry with significantly more remaining mass than current models predict.

Greene, Benton R.↗
NASA NTRS2007

Digital Learning Network Education Events for the Desert Research and Technology Studies

NASA s Digital Learning Network (DLN) reaches out to thousands of students each year through video conferencing and webcasting. As part of NASA s Strategic Plan to reach the next generation of space explorers, the DLN develops and delivers educational programs that reinforce principles in the areas of science, technology, engineering and mathematics. The DLN has created a series of live education videoconferences connecting the Desert Research and Technology Studies (RATS) field test to students across the United States. The programs are also extended to students around the world via live webcasting. The primary focus of the events is the Vision for Space Exploration. During the programs, Desert RATS engineers and scientists inform and inspire students about the importance of exploration and share the importance of the field test as it correlates with plans to return to the Moon and explore Mars. This paper describes the events that took place in September 2006.

Paul, Heather L.↗
NASA NTRS1988

Biomedical support of man in space

In its broadest sense, biomedical support of man in space must not be limited to assisting spacecraft crew during the mission; such support should also ensure that flight personnel be able to perform properly during landing and after leaving the craft. Man has developed mechanisms that allow him to cope with specific stresses in his normal habitat; there is indisputable evidence that, in some cases, the space environment, by relieving these stresses, has also allowed the adaptive mechanisms to lapse, causing serious problems after re-entry. Inflight biomedical support must therefore include means to simulate some of the normal stresses of the Earth environment. In the area of cardiovascular performance, we have come to rely heavily on complex feedback mechanisms to cope with two stresses, often combined: postural changes, which alter the body axis along which gravitational acceleration acts, and physical exercise, which increases the total load on the system. Unless the appropriate responses are reinforced continuously during flight, crew members may be incapacitated upon return. The first step in the support process must be a study of the way in which changes in g, even of short duration, affect these responses. In particular we should learn more about effects of g on the "on" and "off" dynamics, using a variety of approaches: increased acceleration on one hand at recumbency, immersion, lower body positive pressure, and other means of simulating some of the effects of low g, on the other. Once we understand this, we will have to determine the minimal exposure dose required to maintain the response mechanisms. Finally, we shall have to design stresses that simulate Earth environment and can be imposed in the space vehicle. Some of the information is already at hand; we know that several aspects of the response to exercise are affected by posture. Results from a current series of studies on the kinetics of tilt and on the dynamics of readjustment to exercise in different postures will be presented and discussed.

NASA Discipline Cardiopulmonary↗