Search NASASearch

Engineering topics

Zaal, Peter M. T.

Publications and source records attributed to Zaal, Peter M. T..

Adaptive Hexapod Simulator Motion Based on Aircraft Stability

This paper determined the feasibility of an adaptive hexapod simulator motion algorithm based on aircraft roll stability. An experiment was conducted that used a transport aircraft model in the Vertical Motion Simulator at NASA Ames Research Center. Eighteen general aviation pilots flew a heading-capture task and a stall task consecutively under four motion configurations: baseline hexapod, adaptive hexapod, optimized hexapod, and full motion. The adaptive motion was more similar to the baseline hexapod motion in the heading-capture task when the aircraft was more stable, and more similar to the optimized hexapod motion in the stall task when the aircraft was more unstable. Pilot motion ratings and task performance in the heading-capture task under the adaptive hexapod motion were more similar to baseline hexapod motion compared to optimized hexapod motion. However, motion ratings and task performance in the stall task under the adaptive motion were not significantly more similar to the optimized hexapod motion compared to baseline hexapod motion. Motion ratings and overall task performance under optimized hexapod motion as opposed to baseline hexapod motion were always more similar to the full motion condition. This paper showed that adaptive motion based on aircraft stability is feasible and can be implemented in a straightforward way. More research is required to test the adaptive motion algorithm in different tasks.

Zaal, Peter M. T.

Comparing Virtual Reality to Conventional Simulator Visuals: Effects of Peripheral Visual Cues in Roll-Axis Tracking Tasks

This paper compares the effects of peripheral visual cues on manual control between a conventional fixed-base simulator and virtual reality. The results were also compared with those from a previous experiment conducted in a motion-base simulator. Fifteen participants controlled a system with second-order dynamics in a disturbance-rejection task. Tracking performance, control activity, simulator sickness questionnaire answers, and biometrics were collected. Manual control behavior was modeled for the first time in a virtual reality environment. Virtual reality did not degrade participants’ manual control performance or alter their control behavior. However, peripheral cues were significantly more effective in virtual reality. Control activity decreased for all conditions with peripheral cues. The trends introduced by the peripheral visual cues from the previous experiment were replicated. Finally, VR was not more nauseogenic than the conventional simulator. These results suggest that virtual reality might be a good alternative to conventional fixed-base simulators for training manual control skills.

Terenzi, Lorenzo

Rotational and Translational Velocity and Acceleration Thresholds for the Onset of Cybersickness in Virtual Reality

This paper determined rotational and translational velocity and acceleration thresholds for the onset of cybersickness. Cybersickness causes discomfort and discourages the widespread use of virtual reality systems for both recreational and professional use. Visual motion or optic flow is known to be one of the main causes of cybersickness due to the sensory conflict it creates with the vestibular system. The aim of this experiment is to detect rotational and translational velocity and acceleration thresholds that cause the onset of cybersickness. Participants were exposed to a moving particle field in virtual reality for a few seconds per run. The field moved in different directions (longitudinal, lateral, roll, and yaw), with different velocity profiles (steady and accelerating), and different densities. Using a staircase procedure, that controlled the speed or acceleration of the field, we detected the threshold at which participant started to feel temporary symptoms of cybersickness. The optic flow was quantified for each motion type and by modifying the number of features, the same amount of optic flow was present in each scene. Having the same optic flow in each scene allows a direct comparison of the thresholds. The results show that the velocity and acceleration thresholds for rotational optic flow were significantly lower than for translational optic flow. The thresholds suggestively decreased with the decreasing particle density of the scene. Finally, it was found that all the rotational and translational thresholds strongly correlate with each other. While the mean values of the thresholds could be used as guidelines to develop virtual reality applications, the high variability between individuals implies that the individual tuning of motion controls would be more effective to reduce cybersickness while minimizing the impact on the experience of immersion.

Terenzi, Lorenzo

Generalizability of Manual Control Skills Between Control Tasks of Varying Difficulty

This paper presents the results of an experiment that was performed at NASA Ames Research Center using 18 participants in two different groups who trained a task for ten days, with the goal of identifying how skill generalization would occur between two similar tasks of varying difficulty. A cybernetic approach was used. The first group was trained in a simple one-dimensional tracking task and transferred to a difficult two-dimensional tracking task. For the second group, this was reversed. Training with a simple task before transferring to the difficult task resulted in a slower convergence to final performance. However, it did allow participants to start with a better initial performance in the difficult task. Furthermore, after training with a simple task, participants controlled with a higher gain and generated lower lead time constants. However, possibly due to the number of participants, this experiment did not find any statistical evidence to support the conclusion that training with a simple task version helps in learning a more complex task.

skill generalizability

Training for Long-Duration Space Missions: A Literature Review into Skill Retention and Generalizatility

In long-duration space missions, skill retention and generalizability become ever more important as mission length increases, for it is through these capabilities that astronaut crews achieve autonomy. A framework is proposed for future research based on three types of training commonly found in operational scenarios: initial training, refresher training, and just-in-time training. One of the key points of interest identified from the body of literature is the need for a structured and quantifiable approach to characterize skill decay. Such an approach would allow gaining a deeper understanding of the mechanisms through which skill decay operates. Because simulators are used extensively in all types of training, the effects of simulator fidelity on skill retention and generalizability are paramount to understand. Some common fidelity types are defined and their effects on the human operator are discussed. From a review of the literature on all these topics, several research gaps were identified that led to three key opportunities for future research: (1) developing skill decay functions provides theoretical insights into skill decay and allows for several practical applications, such as planning refresher training, (2) the effects of simulator fidelity on skill decay functions should be investigated empirically, and (3) investigating the generalizability of skills learned in initial training to other tasks could provide space crews with greater autonomy. A cybernetic approach might give new insights.

Pieters, Marc A.

Validation of Proposed Go-Around Criteria Under Various Environmental Conditions

This paper evaluates the effects of environmental conditions on touchdown performance under varying approach states and validates proposed go-around criteria developed using data from a previously conducted study under these various environmental conditions. An experiment was conducted using Boeing 737-800 and Airbus A330-200 Level D full-flight simulators in which 24 pilots flew multiple approaches under different approach conditions and environmental variables. Pilots were instructed to always land the aircraft, even from conditions considered to be an unstable approach. Various touchdown performance metrics were analyzed. In addition, pilots’ perceptions of risk under the various unstable approach conditions and resulting landings were assessed. The results of the study revealed that wind speed/direction and visibility had a stronger effect on touchdown performance than the approach parameters. Specifically, wind had a highly significant effect on longitudinal and lateral touchdown point, as well as a significant effect on sink-rate at touchdown. Wind and visibility, along with localizer deviation, also had a strong effect on pilots’ perception of risk and workload ratings. Furthermore, the study confirmed that touchdown performance was similar among the runs with a 300-foot and 500-foot starting gate, as was found in the previously conducted experiment. These results support the previous finding that lowering the go-around decision gate to 300-foot might be acceptable, but suggest that certain environmental conditions might warrant altered thresholds of the proposed go-around criteria at this gate. Finally, the findings of this experiment highlight the importance of environmental factors in the assessment of risk of unwanted outcomes on approach and landing.

Transport Aircraft

Pilot Evaluation of Proposed Go-Around Criteria for Transport Category Aircraft

The primary objective of this study was to capture pilot feedback and decision-making with regard to proposed, hypothetical, go-around criteria that were developed based on previous research. A secondary objective of the study was to assess crew members' awareness of the aircraft state on approach. An experiment was conducted using Boeing 737-800 and Airbus A330-200 level D full-flight simulators, in which pilots flew multiple approaches which were on the borderline of the proposed go-around criteria at 300 ft. Pilots were instructed that they could either execute a go-around or land the airplane on each run, forcing a decision for the borderline cases at 300 ft. Pilots were instructed to go around if the aircraft was outside of the go-around criteria at 300 ft or if either pilot was uncomfortable with the approach. The results revealed that: 1) the most important factors which drove go-around decision-making during the experiment were airspeed and localizer deviation, 2) the objective data suggested that the 300-ft gate is viable, although many pilots were still uncomfortable with that gate height; perhaps more emphasis on checking stability at 1,000 ft and 500 ft would make more pilots comfortable with the 300-ft go-around gate, 3) allowing for momentary deviations should be considered, and 4) the acceptability of the criteria is highly dependent on given pilot's risk tolerance. Overall, the proposed criteria performed well, and most pilots would find the criteria acceptable with some minor adjustments.

go-arounds

Verification of a Motion Cueing Strategy for Stall Recovery Training in a Commercial Transport Simulator

This paper verifies a motion cueing strategy for improved pilot stall recovery training in commercial transport simulators. Eight airline transport pilots flew a high-altitude stall recovery task in the NASA B747 level-D-certified full flight simulator under three different motion configurations: no motion, baseline motion, and enhanced motion. For each motion condition, pilots performed the task with both baseline aircraft dynamics and aircraft dynamics enhanced with lateral-directional characteristics of the airplane at angle of attack approaching stall. Motion configuration significantly affected: 1) pilot opinions on the helpfulness of motion in performing the task, 2) the maximum roll angle in the stall maneuver, 3) the minimum load factor in the recovery, 4) the number of secondary stick shakers in the stall recovery, and 5) the maximum airspeed in the recovery. The two different aircraft dynamics significantly affected: 1) pilot opinions on the noticeability of the banking roll off near the stall and 2) the maximum roll angle in the stall maneuver. These results indicate that the relatively minor enhancements to the motion logic of heritage commercial transport simulators presented here can significantly improve pilot performance in simulated stall recoveries, and potentially improve stall recovery training.

Pilot Performance

Development of Possible Go-Around Criteria for Transport Aircraft

This paper adds data to help with the development of possible go-around criteria for transport category aircraft. Presently, airline procedures state that pilots make a go-around decision using multiple criteria at 1000 or 500 ft above the ground, or so-called gates. An experiment conducted on three level-D full-flight simulators investigated the conditions from which pilots cannot successfully recover from an unstable approach and make a normal landing. In addition, pilots' perceptions of risk under these various unstable approach conditions and resulting landings were assessed. Six crews, comprised of a captain and a first officer from the same airline, participated in each simulator. Both the captain and the first officer flew approaches and landings from 55 different initial conditions with varying gate heights, localizer deviations, glideslope deviations, reference-speed deviations, and rate of descents. The initial condition at the starting gate mainly affected longitudinal touchdown deviation and rate of descent at touchdown, with reference-speed deviation having the most significant effect. Results show little difference in touchdown performance for conditions from the 300-ft and 500-ft gates. Conditions at the 100-ft gate introduced significant differences in touchdown performance. Reference-speed and localizer deviation at the starting gate had the strongest influences on perceived risk and go-around decision. In line with other studies, these findings suggest that a 300-ft go-around gate might be acceptable. More research is required to investigate the effects of environmental and runway variables before possible go-around criteria for transport category aircraft can be defined.

GO-AROUNDS

Time-Varying Manual Control Identification in a Stall Recovery Task under Different Simulator Motion Conditions

This paper adds data to help develop simulator motion guidelines for stall recovery training by identifying time-varying manual control behavior in a stall recovery task under different simulator motion conditions. A study was conducted in the NASA Ames Vertical Motion Simulator, where seventeen general aviation pilots performed a stall recovery task. Pilots had to follow a flight director through four stages of the stall recovery task. A time-varying identification method was used to quantify how pilots weigh position and velocity information throughout different stages of the task, in both roll and pitch. Four motion configurations were used: no motion, generic hexapod motion, enhanced hexapod motion and full motion. Pilot performance was highest for the enhanced hexapod and full motion conditions in both roll and pitch, and the lowest for the condition with no motion. The time-varying identification method revealed that, in the roll axis, pilot position gain did not significantly change between time segments, but was the lowest for the condition with no motion. The pilot velocity gain was significantly different between motion conditions, the largest difference being found at the beginning of the stall. The enhanced hexapod motion condition had the highest pilot velocity gain. In the pitch axis, the pilot position gain was significantly different between time segments but not between motion conditions. The pitch pilot velocity gain was highest for the full motion condition and increased at the beginning of the stall, but did not change significantly for the other motion conditions. Overall, pilot control behavior under enhanced hexapod motion was more similar to that under full aircraft motion compared to standard hexapod motion. This indicates that motion cueing on hexapod simulators might be improved for stall recovery training by using the enhanced hexapod motion developed in previous experiments.

stall recovery

Effects of Retinal Eccentricity on Human Manual Control

This study investigated the effects of viewing a primary flight display at different retinal eccentricities on human manual control behavior and performance. Ten participants performed a pitch tracking task while looking at a simplified primary flight display at different horizontal and vertical retinal eccentricities, and with two different controlled dynamics. Tracking performance declined at higher eccentricity angles and participants behaved more nonlinearly. The visual error rate gain increased with eccentricity for single-integrator-like controlled dynamics, but decreased for double-integrator-like dynamics. Participants' visual time delay was up to 100 ms higher at the highest horizontal eccentricity compared to foveal viewing. Overall, vertical eccentricity had a larger impact than horizontal eccentricity on most of the human manual control parameters and performance. Results might be useful in the design of displays and procedures for critical flight conditions such as in an aerodynamic stall.

system identification

Dual Extended Kalman Filter for the Identification of Time-Varying Human Manual Control Behavior

A Dual Extended Kalman Filter was implemented for the identification of time-varying human manual control behavior. Two filters that run concurrently were used, a state filter that estimates the equalization dynamics, and a parameter filter that estimates the neuromuscular parameters and time delay. Time-varying parameters were modeled as a random walk. The filter successfully estimated time-varying human control behavior in both simulated and experimental data. Simple guidelines are proposed for the tuning of the process and measurement covariance matrices and the initial parameter estimates. The tuning was performed on simulation data, and when applied on experimental data, only an increase in measurement process noise power was required in order for the filter to converge and estimate all parameters. A sensitivity analysis to initial parameter estimates showed that the filter is more sensitive to poor initial choices of neuromuscular parameters than equalization parameters, and bad choices for initial parameters can result in divergence, slow convergence, or parameter estimates that do not have a real physical interpretation. The promising results when applied to experimental data, together with its simple tuning and low dimension of the state-space, make the use of the Dual Extended Kalman Filter a viable option for identifying time-varying human control parameters in manual tracking tasks, which could be used in real-time human state monitoring and adaptive human-vehicle haptic interfaces.

manual control

Effects of Motion Cues on the Training of Multi-Axis Manual Control Skills

The study described in this paper investigated the effects of two different hexapod motion configurations on the training and transfer of training of a simultaneous roll and pitch control task. Pilots were divided between two groups which trained either under a baseline hexapod motion condition, with motion typically provided by current training simulators, or an optimized hexapod motion condition, with increased fidelity of the motion cues most relevant for the task. All pilots transferred to the same full-motion condition, representing motion experienced in flight. A cybernetic approach was used that gave insights into the development of pilots use of visual and motion cues over the course of training and after transfer. Based on the current results, neither of the hexapod motion conditions can unambiguously be chosen as providing the best motion for training and transfer of training of the used multi-axis control task. However, the optimized hexapod motion condition did allow pilots to generate less visual lead, control with higher gains, and have better disturbance-rejection performance at the end of the training session compared to the baseline hexapod motion condition. Significant adaptations in control behavior still occurred in the transfer phase under the full-motion condition for both groups. Pilots behaved less linearly compared to previous single-axis control-task experiments; however, this did not result in smaller motion or learning effects. Motion and learning effects were more pronounced in pitch compared to roll. Finally, valuable lessons were learned that allow us to improve the adopted approach for future transfer-of-training studies.

flight simulators

Effects of False Tilt Cues on the Training of Manual Roll Control Skills

This paper describes a transfer-of-training study performed in the NASA Ames Vertica lMotion Simulator. The purpose of the study was to investigate the effect of false tilt cues on training and transfer of training of manual roll control skills. Of specific interest were the skills needed to control unstable roll dynamics of a mid-size transport aircraft close to the stall point. Nineteen general aviation pilots trained on a roll control task with one of three motion conditions: no motion, roll motion only, or reduced coordinated roll motion. All pilots transferred to full coordinated roll motion in the transfer session. A novel multimodal pilot model identification technique was successfully applied to characterize how pilots' use of visual and motion cues changed over the course of training and after transfer. Pilots who trained with uncoordinated roll motion had significantly higher performance during training and after transfer, even though they experienced the false tilt cues. Furthermore, pilot control behavior significantly changed during the two sessions, as indicated by increasing visual and motion gains, and decreasing lead time constants. Pilots training without motion showed higher learning rates after transfer to the full coordinated roll motion case.

simulators

Transfer of Training on the Vertical Motion Simulator

This paper describes a transfer-of-training study in the NASA Ames Vertical Motion Simulator (VMS). Sixty-one general aviation pilots, divided in four groups, trained on four challenging commercial transport tasks with four motion conditions: no motion, small hexapod, large hexapod, and VMS motion. Then, every pilot repeated the tasks with VMS motion to determine if training with different motion conditions had an effect. New objective motion criteria guided the selection of the motion parameters for the small and large hexapod conditions. Considering results that were statistically significant, or marginally, the motion condition used in training affected 1) longitudinal and lateral touchdown location; 2) the number of secondary stall warnings in a stall recovery; 3) pilot ratings of motion utility and maximum load factor obtained in an overbanked upset recovery; and 4) pilot ratings of motion utility and pedal input reaction time in the engine-out-on-takeoff task. Since the motion condition revealed statistical differences on objective measures in all the tasks, even with some in the direction not predicted, trainers should be cautious not to oversimplify the effects of platform motion. Evidence suggests that the new objective motion criteria may offer valid standardization benefits, as instances arose when the higher-fidelity hexapod motion, as predicted by the criteria, provided better cues in training than the lower-fidelity hexapod motion.

Zaal, Peter M. T.

Transfer-of-Training Research at NASA Ames Research Center

In this presentation, I will first give an overview of some of the research being performed at the Human Systems Integration Division of NASAs Ames Research Center. In the second part of the presentation, I will discuss two studies that investigate the effects of simulator motion on pilot transfer of training. In a study funded by the Federal Aviation Administration, task performance is used to investigate the effects of motion on the training of 4 challenging tasks in a transport category aircraft. In addition, the effectiveness of recently proposed objective motion cueing criteria for training simulators are evaluated. The second study, part of the NASA Aeronautics Research Program, focuses on optimizing simulator motion for maximum transfer of stall recovery training and utilizes a cybernetic approach to measure transfer of training.

Zaal, Peter M. T.

Identification of Time-Varying Pilot Control Behavior in Multi-Axis Control Tasks

Recent developments in fly-by-wire control architectures for rotorcraft have introduced new interest in the identification of time-varying pilot control behavior in multi-axis control tasks. In this paper a maximum likelihood estimation method is used to estimate the parameters of a pilot model with time-dependent sigmoid functions to characterize time-varying human control behavior. An experiment was performed by 9 general aviation pilots who had to perform a simultaneous roll and pitch control task with time-varying aircraft dynamics. In 8 different conditions, the axis containing the time-varying dynamics and the growth factor of the dynamics were varied, allowing for an analysis of the performance of the estimation method when estimating time-dependent parameter functions. In addition, a detailed analysis of pilots adaptation to the time-varying aircraft dynamics in both the roll and pitch axes could be performed. Pilot control behavior in both axes was significantly affected by the time-varying aircraft dynamics in roll and pitch, and by the growth factor. The main effect was found in the axis that contained the time-varying dynamics. However, pilot control behavior also changed over time in the axis not containing the time-varying aircraft dynamics. This indicates that some cross coupling exists in the perception and control processes between the roll and pitch axes.

Zaal, Peter M. T.

Estimation of Time-Varying Pilot Model Parameters

Human control behavior is rarely completely stationary over time due to fatigue or loss of attention. In addition, there are many control tasks for which human operators need to adapt their control strategy to vehicle dynamics that vary in time. In previous studies on the identification of time-varying pilot control behavior wavelets were used to estimate the time-varying frequency response functions. However, the estimation of time-varying pilot model parameters was not considered. Estimating these parameters can be a valuable tool for the quantification of different aspects of human time-varying manual control. This paper presents two methods for the estimation of time-varying pilot model parameters, a two-step method using wavelets and a windowed maximum likelihood estimation method. The methods are evaluated using simulations of a closed-loop control task with time-varying pilot equalization and vehicle dynamics. Simulations are performed with and without remnant. Both methods give accurate results when no pilot remnant is present. The wavelet transform is very sensitive to measurement noise, resulting in inaccurate parameter estimates when considerable pilot remnant is present. Maximum likelihood estimation is less sensitive to pilot remnant, but cannot detect fast changes in pilot control behavior.

Zaal, Peter M. T.