Search NASA⌕ Search

SEARCH · Search NASA

Results for “learning dynamics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Differential Equation Approximation Using Gradient-Boosted Quantile Regression

The operation of cyber-physical-human (CPH) systems is subject to various epistemic and aleatory uncertainties. Overall trustworthiness of CPH systems relies on the trustworthiness of its components and their interactions. It is important that computational models comprising the cyber component of CPH provide predictions accompanied by a measure of confidence in model outcomes. Uncertainty quantification (UQ) and propagation are especially important in safety critical CPH systems. Gradient-boosted trees is a modeling approach capable both of learning the dynamics of a system and performing UQ. In this paper, we devise a method for using gradient boosting to learn the dynamics of a second order differential equation and estimate uncertainty at the same time. We do this by creating a custom loss function that trains the model to approximate the second derivative of a noisy time series, and to penalize based on a parameter that corresponds to the desired quantile. The resulting gradient boosting model can simulate stochastic trajectories of the system given a single starting point, that is, it can estimate both the expected trajectory and its uncertainty. We show that the uncertainty estimation is well calibrated and that the model can learn the dynamics even in the presence of noise. We demonstrate the approach on a simple cartpole system.

Autonomous systems↗
NASA NTRS2011

Flight Dynamics Operations: Methods and Lessons Learned from Space Shuttle Orbit Operations

The Flight Dynamics Officer is responsible for trajectory maintenance of the Space Shuttle. This paper will cover high level operational considerations, methodology, procedures, and lessons learned involved in performing the functions of orbit and rendezvous Flight Dynamics Officer and leading the team of flight dynamics specialists during different phases of flight. The primary functions that will be address are: onboard state vector maintenance, ground ephemeris maintenance, calculation of ground and spacecraft acquisitions, collision avoidance, burn targeting for the primary mission, rendezvous, deorbit and contingencies, separation sequences, emergency deorbit preparation, mass properties coordination, payload deployment planning, coordination with the International Space Station, and coordination with worldwide trajectory customers. Each of these tasks require the Flight Dynamics Officer to have cognizance of the current trajectory state as well as the impact of future events on the trajectory plan in order to properly analyze and react to real-time changes. Additionally, considerations are made to prepare flexible alternative trajectory plans in the case timeline changes or a systems failure impact the primary plan. The evolution of the methodology, procedures, and techniques used by the Flight Dynamics Officer to perform these tasks will be discussed. Particular attention will be given to how specific Space Shuttle mission and training simulation experiences, particularly off-nominal or unexpected events such as shortened mission durations, tank failures, contingency deorbit, navigation errors, conjunctions, and unexpected payload deployments, have influenced the operational procedures and training for performing Space Shuttle flight dynamics operations over the history of the program. These lessons learned can then be extended to future vehicle trajectory operations.

Cutri-Kohart, Rebecca M.↗
NASA NTRS2005

Real-Time Principal-Component Analysis

A recently written computer program implements dominant-element-based gradient descent and dynamic initial learning rate (DOGEDYN), which was described in Method of Real-Time Principal-Component Analysis (NPO-40034) NASA Tech Briefs, Vol. 29, No. 1 (January 2005), page 59. To recapitulate: DOGEDYN is a method of sequential principal-component analysis (PCA) suitable for such applications as data compression and extraction of features from sets of data. In DOGEDYN, input data are represented as a sequence of vectors acquired at sampling times. The learning algorithm in DOGEDYN involves sequential extraction of principal vectors by means of a gradient descent in which only the dominant element is used at each iteration. Each iteration includes updating of elements of a weight matrix by amounts proportional to a dynamic initial learning rate chosen to increase the rate of convergence by compensating for the energy lost through the previous extraction of principal components. In comparison with a prior method of gradient-descent-based sequential PCA, DOGEDYN involves less computation and offers a greater rate of learning convergence. The sequential DOGEDYN computations require less memory than would parallel computations for the same purpose. The DOGEDYN software can be executed on a personal computer.

Duong, Vu↗
NASA NTRS1992

A self-learning rule base for command following in dynamical systems

In this paper, a self-learning Rule Base for command following in dynamical systems is presented. The learning is accomplished though reinforcement learning using an associative memory called SAM. The main advantage of SAM is that it is a function approximator with explicit storage of training samples. A learning algorithm patterned after the dynamic programming is proposed. Two artificially created, unstable dynamical systems are used for testing, and the Rule Base was used to generate a feedback control to improve the command following ability of the otherwise uncontrolled systems. The numerical results are very encouraging. The controlled systems exhibit a more stable behavior and a better capability to follow reference commands. The rules resulting from the reinforcement learning are explicitly stored and they can be modified or augmented by human experts. Due to overlapping storage scheme of SAM, the stored rules are similar to fuzzy rules.

Tsai, Wei K.↗
NASA NTRSDate not supplied

A Dynamic PCA and Machine Learning Tool for Automated Identification of Solar Wind Disturbances Impacting Earth’s Magnetosphere

Earth’s magnetosphere is continuously impacted by solar wind and interplanetary magnetic field (IMF) disturbances, such as shocks, discontinuities, magnetic clouds and more. Understanding how such disturbances propagate from the Sun and what is their impact on the different magnetospheric domains is key to understanding and forecasting energy transfer from the solar wind to Earth. The large number of overlapping solar wind and magnetospheric missions carrying magnetometers and the recent advances in communications and data storage technologies have enabled an unprecedented quantity of high-fidelity magnetic field data captured by in-situ spacecraft to be available at the click of a button. However, this massive quantity of available data can prove unwieldy for researchers, limiting the identification of interesting phenomena and disturbances to a relatively small percentage of the total dataset. Several techniques have been previously developed for automated identification of specific types of magnetic anomalies, but these methods are typically mission-specific and can be difficult to generalize. We present initial results for a generic method of automated anomaly detection in magnetic field measurements based on dimensionality reduction and unsupervised clustering via machine learning. The benefit of our technique is its high degree of generalizability and flexibility which make it a most useful data survey tool for a wide range of magnetic field datasets. This method can also be applied simultaneously to other observed time-series properties like plasma density, pressure, and velocity for more accurate event identification. Additionally, the application of this method to data captured by multiple spacecraft enables the simultaneous identification of disturbances and the determination of their propagation characteristics. Initial evaluation of this technique has been performed using data from Magnetospheric MultiScale (MMS) and THEMIS-ARTEMIS missions, providing a testbed scenario for the future Heliophysics Environmental and Radiation Measurement Experiment Suite (HERMES) platform instruments that will measure solar wind and IMF properties from lunar orbit onboard the Gateway station.

Miguel Martinez-Ledesma↗
NASA NTRSDate not supplied

A Dynamic PCA and Machine Learning Tool for Automated Identification of Solar Wind Disturbances Impacting Earth’s Magnetosphere

Earth’s magnetosphere is continuously impacted by solar wind and interplanetary magnetic field (IMF) disturbances, such as shocks, discontinuities, magnetic clouds and more. Understanding how such disturbances propagate from the Sun and what is their impact on the different magnetospheric domains is key to understanding and forecasting energy transfer from the solar wind to Earth. The large number of overlapping solar wind and magnetospheric missions carrying magnetometers and the recent advances in communications and data storage technologies have enabled an unprecedented quantity of high-fidelity magnetic field data captured by in-situ spacecraft to be available at the click of a button. However, this massive quantity of available data can prove unwieldy for researchers, limiting the identification of interesting phenomena and disturbances to a relatively small percentage of the total dataset. Several techniques have been previously developed for automated identification of specific types of magnetic anomalies, but these methods are typically mission-specific and can be difficult to generalize. We present initial results for a generic method of automated anomaly detection in magnetic field measurements based on dimensionality reduction and unsupervised clustering via machine learning. The benefit of our technique is its high degree of generalizability and flexibility which make it a most useful data survey tool for a wide range of magnetic field datasets. This method can also be applied simultaneously to other observed time-series properties like plasma density, pressure, and velocity for more accurate event identification. Additionally, the application of this method to data captured by multiple spacecraft enables the simultaneous identification of disturbances and the determination of their propagation characteristics. Initial evaluation of this technique has been performed using data from Magnetospheric MultiScale (MMS) and THEMIS-ARTEMIS missions, providing a testbed scenario for the future Heliophysics Environmental and Radiation Measurement Experiment Suite (HERMES) platform instruments that will measure solar wind and IMF properties from lunar orbit onboard the Gateway station.

Miguel Martinez-Ledesma↗
NASA NTRS2018

Laser Tracker Utilization Methodology in Measuring Truth Trajectories for INS Testing on 6 Degree of Freedom Table at the Marshall Space Flight Center's Contact Dynamics Simulation Laboratory with Lessons Learned

When performing Inertial Navigation System (INS) testing at the Marshall Space Flight Center's (MSFC) Contact Dynamics Simulation Laboratory (CDSL) early in 2017, a Leica Geosystems AT901 Laser Tracker system (LLT) measured the twist & sway trajectories as generated by the 6 Degree Of Freedom (6DOF) Table in the CDSL. These LLT measured trajectories were used in the INS software model validation effort. Several challenges were identified and overcome during the preparation for the INS testing, as well as numerous lessons learned. These challenges included determining the position and attitude of the LLT with respect to an INS-shared coordinate frame using surveyed monument locations in the CDSL and the accompanying mathematical transformation, accurately measuring the spatial relationship between the INS and a 6DOF tracking probe due to lack of INS visibility from the LLT location, obtaining the data from the LLT during a test, determining how to process the results for comparison with INS data in time and frequency domains, and using a sensitivity analysis of the results to verify the quality of the results. While many of these challenges were identified and overcome before or during testing, a significant lesson on test set-up was not learned until later in the data analysis process. It was found that a combination of trajectory-dependent gimbal locking and environmental noise introduced non-negligible noise in the angular measurements of the LLT that spanned the evaluated frequency spectrum. The lessons learned in this experiment may be useful for others performing INS testing in similar testing facilities.

Leggett, Jared O.↗
NASA NTRS2022

L1 Adaptive Control with Switched Reference Models: Application to Learn-to-Fly

Learn-to-Fly (L2F) is a new framework that aims to replace the traditional iterative development paradigm for aerial vehicles with a combination of real-time aerodynamic modeling, guidance, and learning control. To ensure safe learning of the vehicle dynamics on the fly, this paper presents an L1 adaptive control (L1AC) based scheme, which actively estimates and compensates for the discrepancy between the intermediately learned dynamics and the actual dynamics. First, to incorporate the periodic update of the learned model within the L2F framework, this paper extends the L1AC architecture to handle a switched reference system subject to unknown time-varying parameters and disturbances. The paper also includes analysis of both transient and steady-state performance of the L1AC architecture in the presence of non-zero initialization error for the state predictor. Second, the paper presents how the proposed L1AC scheme is integrated into the L2F framework, including its interaction with the baseline controller and the real-time modeling module. Finally, flight tests on an unmanned aerial vehicle (UAV) validate the efficacy of the proposed control and learning scheme.

Steven Snyder↗
NASA NTRS1988

A dynamic case-based planning system for space station application

We are currently investigating the use of a case-based reasoning approach to develop a dynamic planning system. The dynamic planning system (DPS) is designed to perform resource management, i.e., to efficiently schedule tasks both with and without failed components. This approach deviates from related work on scheduling and on planning in AI in several aspects. In particular, an attempt is made to equip the planner with an ability to cope with a changing environment by dynamic replanning, to handle resource constraints and feedback, and to achieve some robustness and autonomy through plan learning by dynamic memory techniques. We briefly describe the proposed architecture of DPS and its four major components: the PLANNER, the plan EXECUTOR, the dynamic REPLANNER, and the plan EVALUATOR. The planner, which is implemented in Smalltalk, is being evaluated for use in connection with the Space Station Mobile Service System (MSS).

Oppacher, F.↗
NASA NTRS1996

Behavioral analysis of signals that guide learned changes in the amplitude and dynamics of the vestibulo-ocular reflex

We characterized the dependence of motor learning in the monkey vestibulo-ocular reflex (VOR) on the duration, frequency, and relative timing of the visual and vestibular stimuli used to induce learning. The amplitude of the VOR was decreased or increased through training with paired head and visual stimulus motion in the same or opposite directions, respectively. For training stimuli that consisted of simultaneous pulses of head and target velocity 80-1000 msec in duration, brief stimuli caused small changes in the amplitude of the VOR, whereas long stimuli caused larger changes in amplitude as well as changes in the dynamics of the reflex. When the relative timing of the visual and vestibular stimuli was varied, brief image motion paired with the beginning of a longer vestibular stimulus caused changes in the amplitude of the reflex alone, but the same image motion paired with a later time in the vestibular stimulus caused changes in the dynamics as well as the amplitude of the VOR. For training stimuli that consisted of sinusoidal head and visual stimulus motion, low-frequency training stimuli induced frequency-selective changes in the VOR, as reported previously, whereas high-frequency training stimuli induced changes in the amplitude of the VOR that were more similar across test frequency. The results suggest that there are at least two distinguishable components of motor learning in the VOR. One component is induced by short-duration or high-frequency stimuli and involves changes in only the amplitude of the reflex. A second component is induced by long-duration or low-frequency stimuli and involves changes in the amplitude and dynamics of the VOR.

NASA Discipline Neuroscience↗
NASA NTRS2008

Effects of Learning on Performance When Computerized Dynamic Posturography Assessments Are Repeated

Background: Computerized dynamic posturography is widely used to measure balance control performance. Clinically, performance is assessed by comparing individual data against standards obtained from a normative population. When performing repeated assessments to track performance changes, one must be concerned with the influence of learning effects. Subjects do not have the opportunity to practice before the first session, and often a second session is not performed prior to an experiment. Thus, the objective of this activity was to examine learning effects on balance control performance. We hypothesize that subjects will perform better on the second session when compared to the first, and that the difference will be greater for more difficult conditions. Methods: Data were collected from 204 subjects using the NeuroCom Equitest system during quiet stance with arms crossed at the chest on up to two sessions. All subjects performed standard sensory organization tests (SOTs) including 1) normal vision, fixed support; 2) absent vision, fixed support; 3) sway-referenced vision, fixed support; 4) normal vision, swayreferenced support; 5) absent vision, sway-referenced support; and 6) sway-referenced vision, sway-referenced support. 120 of these subjects performed modified sensory organization tests (mSOTs 2 and 5) which included static (20 back) and dynamic (20, 0.33Hz) head tilts. Median equilibrium scores (mEQ) were calculated from peak-to-peak anterior-posterior sway across trials. Data collected on the first session were then compared with the second to examine learning effect. Results: There were no differences in mEQ scores between the first and second sessions for SOTs 1, 2, and 4, while mEQ scores were higher for the second session when compared to the first for SOTs 3, 5, and 6 and for all mSOTs. Discussion: An additional familiarization session or practice trials prior to the first session may be necessary for more challenging SOT and mSOT conditions to minimize learning effect.

Taylor, Laura C.↗
NASA NTRS1990

Neural controller for adaptive movements with unforeseen payloads

A theory and computer simulation of a neural controller that learns to move and position a link carrying an unforeseen payload accurately are presented. The neural controller learns adaptive dynamic control from its own experience. It does not use information about link mass, link length, or direction of gravity, and it uses only indirect uncalibrated information about payload and actuator limits. Its average positioning accuracy across a large range of payloads after learning is 3 percent of the positioning range. This neural controller can be used as a basis for coordinating any number of sensory inputs with limbs of any number of joints. The feedforward nature of control allows parallel implementation in real time across multiple joints.

Kuperstein, Michael↗
NASA NTRS1993

Architecture for Adaptive Intelligent Systems

We identify a class of niches to be occupied by 'adaptive intelligent systems (AISs)'. In contrast with niches occupied by typical AI agents, AIS niches present situations that vary dynamically along several key dimensions: different combinations of required tasks, different configurations of available resources, contextual conditions ranging from benign to stressful, and different performance criteria. We present a small class hierarchy of AIS niches that exhibit these dimensions of variability and describe a particular AIS niche, ICU (intensive care unit) patient monitoring, which we use for illustration throughout the paper. We have designed and implemented an agent architecture that supports all of different kinds of adaptation by exploiting a single underlying theoretical concept: An agent dynamically constructs explicit control plans to guide its choices among situation-triggered behaviors. We illustrate the architecture and its support for adaptation with examples from Guardian, an experimental agent for ICU monitoring.

ACTIVE CONTROL↗
NASA NTRS2004

Algorithm for Training a Recurrent Multilayer Perceptron

An improved algorithm has been devised for training a recurrent multilayer perceptron (RMLP) for optimal performance in predicting the behavior of a complex, dynamic, and noisy system multiple time steps into the future. [An RMLP is a computational neural network with self-feedback and cross-talk (both delayed by one time step) among neurons in hidden layers]. Like other neural-network-training algorithms, this algorithm adjusts network biases and synaptic-connection weights according to a gradient-descent rule. The distinguishing feature of this algorithm is a combination of global feedback (the use of predictions as well as the current output value in computing the gradient at each time step) and recursiveness. The recursive aspect of the algorithm lies in the inclusion of the gradient of predictions at each time step with respect to the predictions at the preceding time step; this recursion enables the RMLP to learn the dynamics. It has been conjectured that carrying the recursion to even earlier time steps would enable the RMLP to represent a noisier, more complex system.

Parlos, Alexander G.↗
NASA NTRSDate not supplied

Mission Status, On-Orbit Performance, and Lessons Learned of the Global Ecosystem Dynamics Investigation (GEDI) Lidar Laser Transmitters

The Global Ecosystems Dynamics Investigation (GEDI) Lidar, is a global 3-dimensional biomass lidar instrument aboard the International Space Station (ISS) and the Japanese Experiment Module (JEM). Its core mission is to measure the global carbon balance of Earth’s forests with 3 laser transmitters using multi-beam waveform-capture methods. GEDI’s laser transmitter concept was originally funded by NASA Goddard’s Earth Science Technology Office (ESTO) for future Earth Altimetry and Lidar missions ~ 20 years ago, and after a long road of development, the first flight-ready unit was a 10 mJ-class system for GEDI’s ISS-based specifications. Furthermore, no adjustment in drive parameters has been required nor significant decay detected after 4 years of near continuous operation of 3 on-board lasers, which were designed for a 2-year mission. We report on the GEDI laser design process, their on-orbit performance, the major lessons learned, and some critical insight into our in-house flight quality development process that enabled their delivery within budget, schedule, and low risk extended mission life capability.

D. Barry Coyle↗
NASA NTRS2004

Flywheel Technology

Throughout the summer of 2004, I am working on a number of different projects. While located in the Space Power and Propulsion Test Engineering branch, my main area of study is flywheel technology. I have been exposed to flywheels, their components, and their uses in today's society. I have been able to experience numerous flywheels here in the flywheel lab at NASA Glenn. My first main project was to explore the attributes and physical characteristics of a flywheel. Our branch was constructing a flywheel demonstration to be presented at the public open house taking place in June. Our Flywheel Interactive Demo, or FIDO, represents a real life multi-flywheel system here at NASA. I was given the opportunity to learn about how these flywheels store energy and are able to position a satellite. With all of this new knowledge, I was able to create the posters that explained how our demonstration worked. I also composed a step-by-step process made up of four experiments that any visitor could follow and perform on FIDO. By stepping through these experiments, the individual learns how a flywheel works. They not only read the explanation of what is happening, but they are also able to see it happen. Creating these two posters not only taught me, but also helped teach the general public during the open house, how flywheel technology is a very important part of our future. Through my research, I have learned that flywheels are able to store massive amounts of energy. They can be described as an electro-mechanical battery that stores kinetic energy while rotating. The faster it rotates, the more energy it stores. Their lifetime is about triple that of an ordinary battery. Flywheels also have the ability to combine energy storage with attitude control all in a single system. Attitude control is the ability to position a satellite as required. FIDO helps us to understand the rotational force (torque) that is applied upon a turn-table or satellite during wheel acceleration/deceleration. My other main project that I have just begun is to create a flywheel presentation, brochure, and video all explaining the history, applications, early attempts, and working processes of modem flywheels. These items are all usefull tools for educating school children and even adults about flywheels. This task will require a large amount of research and skills in the use of multiple applications. My goal this summer is to learn the dynamics and uses of a flywheel in today s society, and then inform and encourage the public about flywheels. I am able to express my knowledge by creating some effective as well as attractive posters, presentations, brochures, videos, etc. that are able to explain how a flywheel works along with how our FIDO demonstration simulates a real flywheel. My goal is underway, and should be successfully reached with the help of my mentor, other coworkers, and fellow interns.

Ritchie, Lisa M.↗
NASA NTRS2004

Perceptual learning through optimization of attentional weighting: human versus optimal Bayesian learner

Human performance in visual detection, discrimination, identification, and search tasks typically improves with practice. Psychophysical studies suggest that perceptual learning is mediated by an enhancement in the coding of the signal, and physiological studies suggest that it might be related to the plasticity in the weighting or selection of sensory units coding task relevant information (learning through attention optimization). We propose an experimental paradigm (optimal perceptual learning paradigm) to systematically study the dynamics of perceptual learning in humans by allowing comparisons to that of an optimal Bayesian algorithm and a number of suboptimal learning models. We measured improvement in human localization (eight-alternative forced-choice with feedback) performance of a target randomly sampled from four elongated Gaussian targets with different orientations and polarities and kept as a target for a block of four trials. The results suggest that the human perceptual learning can occur within a lapse of four trials (<1 min) but that human learning is slower and incomplete with respect to the optimal algorithm (23.3% reduction in human efficiency from the 1st-to-4th learning trials). The greatest improvement in human performance, occurring from the 1st-to-2nd learning trial, was also present in the optimal observer, and, thus reflects a property inherent to the visual task and not a property particular to the human perceptual learning mechanism. One notable source of human inefficiency is that, unlike the ideal observer, human learning relies more heavily on previous decisions than on the provided feedback, resulting in no human learning on trials following a previous incorrect localization decision. Finally, the proposed theory and paradigm provide a flexible framework for future studies to evaluate the optimality of human learning of other visual cues and/or sensory modalities.

Non-NASA Center↗