Linear Mixed-Effects Models for Human-in-the-Loop Tracking Experiment Data

Peter M. T. Zaal; Daan M. Pool; Max Mulder

NASA NTRS · 20205010928

Linear Mixed-Effects Models for Human-in-the-Loop Tracking Experiment Data

Peter M. T. Zaal·Daan M. Pool·Max Mulder

Abstract

Linear mixed-effects models provide several benefits over more traditional statistical inference tests that are particularly useful for most human-in-the-loop tracking experiment data. However, surprisingly, mixed models are virtually not used for the analysis of tracking experiment data. This paper uses of linear mixed-effects models to analyze combined tracking data from two previous human-in-the-loop roll tracking experiments that compared control behavior metrics collected in both a research aircraft and a motion-base simulator. In the experiments, pilots' behavior under 10 different motion configurations with varying motion filter gains and break frequencies was evaluated and compared to that in the real aircraft. The linear mixed-effects model analysis on the combined dataset confirmed the main statistical outcomes of the individual experiments. The main benefits of mixed models for this type of data were demonstrated by successfully combining data from two experiments that used different experimental conditions and of which one had an additional apparatus and the other a missing participant. Finally, the mixed-model analysis was able to explicitly test for scientifically relevant statistical differences in the dependent measures between the aircraft and simulator, as well as both experiments.

Explore related subjects

manual control linear mixed-effects models simulator motion

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Peter M. T. Zaal, Daan M. Pool, Max Mulder. Linear Mixed-Effects Models for Human-in-the-Loop Tracking Experiment Data. https://ntrs.nasa.gov/citations/20205010928

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related reports

NASA NTRS2021

Between-Simulator Comparison of Motion Filter Order and Break Frequency Interaction Effects on Pilot Control Behavior

This paper investigates the interaction effects of motion filter order and break frequency on pilots' manual control behavior and control performance using two simulators. Eighteen pilots performed the experiment in the Vertical Motion Simulator (VMS) at NASA Ames Research Center and twenty pilots in the SIMONA Research Simulator at Delft University of Technology. The experiment used a full-factorial design with three motion filter orders (first-, second-, and third-order) and two filter break frequencies (0.5 and 2.0 rad/s), in addition to reference no-motion and full-motion conditions. Key task variables, such as the quality of the motion and visual cues and the characteristics of the sidestick, were matched across both simulators. Overall, the expected effects of filter order and break frequency variations were found, with both increasing order and increasing break frequency causing pilots to use less motion feedback in their control strategy, resulting in lower tracking performance. Furthermore, across the wide range of filter orders tested in the experiment, the existing Sinacori-Schroeder motion fidelity criterion was found to be a good predictor of the interaction effects of both filter settings on pilot control behavior. For the same motion condition, there was a consistent offset in the results between simulators, due to the more high-gain control strategy adopted by a number of the VMS pilots. Still, the observed relative trends in pilot control behavior and performance between motion conditions were equivalent in both simulators and thus accurately replicated.

manual control↗

NASA NTRS2018

Time-Varying Manual Control Identification in a Stall Recovery Task Under Different Simulator Motion Conditions

This paper adds data to help the development of simulator motion cueing guidelines for stall recovery training by identifying time-varying manual control behavior in a stall recovery task under different simulator motion conditions. A study was conducted with seventeen general aviation pilots in the NASA Ames Vertical Motion Simulator. Pilots had to follow a flight director through four stages of a high-altitude stall task. A time-varying identification method was used to quantify how pilot manual control parameters change throughout different stages of the task in both roll and pitch. Four motion configurations were used: no motion, generic hexapod motion, enhanced hexapod motion and full motion. Pilot performance was highest for the enhanced hexapod and full motion configurations in both roll and pitch, and the lowest without motion. In the roll axis, the pilot position gain did not significantly change throughout the stall task, but was the lowest for the condition with no motion. The pilot roll velocity gain was significantly different between motion conditions, the largest difference being found close to the stall point. The enhanced hexapod motion condition had the highest pilot roll velocity gain. In the pitch axis, the pilot position gain was significantly different between time segments but not between motion conditions. The pilot pitch velocity gain was highest for the full motion condition and increased close to the stall point, but did not change significantly for the other motion conditions. Overall, pilot control behavior under enhanced hexapod motion was most similar to that under full aircraft motion. This indicates that motion cueing for stall recovery training on hexapod simulators might be improved by using the principles behind the enhanced hexapod motion configuration.

manual control↗

NASA NTRS2017

Dual Extended Kalman Filter for the Identification of Time-Varying Human Manual Control Behavior

A Dual Extended Kalman Filter was implemented for the identification of time-varying human manual control behavior. Two filters that run concurrently were used, a state filter that estimates the equalization dynamics, and a parameter filter that estimates the neuromuscular parameters and time delay. Time-varying parameters were modeled as a random walk. The filter successfully estimated time-varying human control behavior in both simulated and experimental data. Simple guidelines are proposed for the tuning of the process and measurement covariance matrices and the initial parameter estimates. The tuning was performed on simulation data, and when applied on experimental data, only an increase in measurement process noise power was required in order for the filter to converge and estimate all parameters. A sensitivity analysis to initial parameter estimates showed that the filter is more sensitive to poor initial choices of neuromuscular parameters than equalization parameters, and bad choices for initial parameters can result in divergence, slow convergence, or parameter estimates that do not have a real physical interpretation. The promising results when applied to experimental data, together with its simple tuning and low dimension of the state-space, make the use of the Dual Extended Kalman Filter a viable option for identifying time-varying human control parameters in manual tracking tasks, which could be used in real-time human state monitoring and adaptive human-vehicle haptic interfaces.

manual control↗