Search NASA⌕ Search

SEARCH · Search NASA

Results for “eye tracking experiment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Anticipatory Eye Movements in Interleaving Templates of Human Behavior

Performance modeling has been made easier by architectures which package psychological theory for reuse at useful levels of abstraction. CPM-GOMS uses templates of behavior to package at a task level (e.g., mouse move-click, typing) predictions of lower-level cognitive, perceptual, and motor resource use. CPM-GOMS also has a theory for interleaving resource use between templates. One example of interleaving is anticipatory eye movements. This paper describes the use of ACT-Stitch, a framework for translating CPM-GOMS templates and interleaving theory into ACT-R, to model anticipatory eye movements in skilled behavior. The anticipatory eye movements explain performance in a well-practiced perceptual/motor task, and the interleaving theory is supported with results from an eye-tracking experiment.

Matessa, Michael↗

Quantifying Pilot Visual Attention in Low Visibility Terminal Operations

Quantifying pilot visual behavior allows researchers to determine not only where a pilot is looking and when, but holds implications for specific behavioral tracking when these data are coupled with flight technical performance. Remote eye tracking systems have been integrated into simulators at NASA Langley with effectively no impact on the pilot environment. This paper discusses the installation and use of a remote eye tracking system. The data collection techniques from a complex human-in-the-loop (HITL) research experiment are discussed; especially, the data reduction algorithms and logic to transform raw eye tracking data into quantified visual behavior metrics, and analysis methods to interpret visual behavior. The findings suggest superior performance for Head-Up Display (HUD) and improved attentional behavior for Head-Down Display (HDD) implementations of Synthetic Vision System (SVS) technologies for low visibility terminal area operations. Keywords: eye tracking, flight deck, NextGen, human machine interface, aviation

Ellis, Kyle K.↗

Investigation of the use of an electronic multifunction display and an electromechanical horizontal situation indicator for guidance and control of powered-lift short-haul aircraft

The use which pilots make of a moving map display from en route through the terminal area and including the approach and go-around flight phases was investigated. The content and function of each of three primary STOLAND displays are reviewed from an operational point of view. The primary displays are the electronic attitude director indicator (EADI), the horizontal situation indicator (HSI), and the multifunction display (MFD). Manually controlled flight with both flight director guidance and raw situation data is examined in detail in a simulated flight experiment with emphasis on tracking reference flight plans and maintaining geographic orientation after missed approaches. Eye-point-of-regard and workload measurements, coupled with task performance measurements, pilot opinion ratings, and pilot comments are presented. The experimental program was designed to offer a systematic objective and subjective comparison of pilots' use of the moving map MFD in conjunction with the other displays.

Clement, W. F.↗

Use of Data Comm by Flight Crew in High-Density Terminal Areas

This paper describes a collaborative FAA and NASA experiment using 22 commercial airline pilots to determine the effect of using Datalink Communication (Data Comm) to issue messages in busy, terminal area operations. Four conditions were defined that span current day to future flight deck equipage levels (voice communication only, Data Comm only, Data Comm with Moving Map Display, Data Comm with Moving Map displaying taxi route), and each condition was used to create an arrival and a departure scenario at the Boston Logan Airport. These eight scenarios were repeated twice for a total of 16 scenarios for each of the eleven crews. Quantitative data was collected on subject reaction time and eye tracking information. Questionnaires collected subjective feedback on workload and acceptability to the flight crew for using Data Comm in a busy terminal area. 95% of the Data Comm messages were responded to by the flight crew within one minute; however, post experiment debrief comments revealed almost unanimous consensus that two minutes was a reasonable expectation for crew response. Eye tracking data indicated an insignificant decrease in head-up time for the Pilot Flying when Data Comm was introduced; however, the Pilot Monitoring had significantly less head-up time. Data Comm workload was rated as operationally acceptable by both crew members in all conditions in flight at any altitude above the Final Approach Fix in terms of response time and workload. Results also indicate the use of Data Comm during surface operations was acceptable, the exception being the simultaneous use of voice, Data Comm, and audio chime required for an aircraft to cross an active runway. Many crews reported they believed Data Comm messages would be acceptable after the Final Approach Fix or to cross a runway if the message was not accompanied by a chime and there was not a requirement to immediately respond to the uplink message.

Baxley, Brian T.↗

Vestibular and Non-vestibular Contributions to Eye Movements that Compensate for Head Rotations during Viewing of Near Targets

We studied horizontal eye movements induced by en-bloc yaw rotation, over a frequency range 0.2 - 2.8 Hz, in 10 normal human subjects as th ey monocularly viewed a target located at their near point of focus. We measured gain and phase relationships between eye-in-head velocity and head velocity when the near target was either earth-fixed or head-fixed. During viewing of the earth-fixed near target,median gain was 1.49 (range 1.24 - 1.87) at 0.2 Hz for the group of subjects, but decl ined at higher frequencies, so that at 2.8 Hz median gain was 1.08 (r ange 0.68 - 1.67). During viewing of the head-fixed near target, median gain was 0.03 (range 0.01 - 0.10) at 0.2 Hz for the group of subjec ts, but increased at higher frequencies, so that at 2.8 Hz median gai n was 0.71 (range 0.28 - 0.94). We estimated the vestibular contribution to these responses (vestibulo-ocular reflex gain, Gvor) by applyin g transient head perturbations (peak acceleration> 1,000 deg's(exp 2) ) during sinusoidal rotation under the two viewing conditions. Median Gvor, estimated < 70m after the onset of head perturbation, was 0.98 (range 0.39 - 1.42) while viewing the earth-fixed near target, and 0. 97 (range 0.37 - 1.33) while viewing the head-fixed near target. For the group of subjects, 9 out of 10 subjects showed no sigificant diff erence of Gvor between the two viewing conditions ( p > 0.053 ) at all test frequencies. Since Gvor accounted for only approximately 73% of the overall response gain during viewing of the earth-fixed target, we investigated the relative contributions of non-vestibular factors. When subjects viewed the earth-fixed target under strobe illumination , to eliminate retinal image slip information, the gain of compensato ry eye movements declined compared with viewing in ambient room light . During sum-of-sine head rotations, while viewing the earth-fixed target, to minimize contributions from predictive mechanisms, gain also declined Nonetheless, simple superposition of smooth-pursuit tracking of sinusoidal target motion could not fully account for the overall r esponse at higher frequencies, suggesting other non-vestibular contributions. During binocular viewing conditions when vergence angle was s ignificantly greater than monocular viewing (p < 0.001), this gain of compensatory eye movements did not show proportional change; indeed, gain could not be correlated with vergence angle during monocular or binocular viewing. We conclude that several separate factors contribute to generate eye rotations during sinusoidal yaw head rotations whi le viewing a near target; these include the VOR, visual-tracking eye movements that utilize retinal image motion, predictive eye movements and, possibly, other unidentified nonvestibular factors. For these experiments, vergence was not an important determinant of response gain .

Han, Yanning H.↗

Vestibular and Non-vestibular Contributions to Eye Movements that Compensate for Head Rotations during Viewing of Near Targets

We studied horizontal eye movements induced by en-bloc yaw rotation, over a frequency range 0.2 - 2.8 Hz, in 10 normal human subjects as they monocularly viewed a target located at their near point of focus. We measured gain and phase relationships between eye-in-head velocity and head velocity when the near target was either earth-fixed or head-fixed. During viewing of the earth-fixed near target, median gain was 1.49 (range 1.24 - 1.87) at 0.2 Hz for the group of subjects, but declined at higher frequencies, so that at 2.8 Hz median gain was 1.08 (range 0.68 - 1.67). During viewing of the head-fixed near target , median gain was 0.03 (range 0.01 - 0.10) at 0.2 Hz for the group of subjects, but increased at higher frequencies, so that at 2.8 Hz median gain was 0.71 (range 0.28 - 0.94). We estimated the vestibular contribution to these responses vestibulo-ocular reflex gain (Gvor) by applying transient head perturbations (peak acceleration> 1,000 deg/s(exp 2)) during sinusoidal rotation under the two viewing conditions. Median Gvor, estimated < 70ms after the onset of head perturbation, was 0.98 (range 0.39 - 1.42) while viewing the earth-fixed near target, and 0.97 (range 0.37 - 1.33) while viewing the head-fixed near target. For the group of subjects, 9 out of 10 subjects showed no significant difference of Gvor between the two viewing conditions ( p > 0.053 ) at all test frequencies. Since Gvor accounted for only -73% of the overall response gain during viewing of the earth-fixed target, we investigated the relative contributions of non-vestibular factors. When subjects viewed the earth-fixed target under strobe illumination, to eliminate retinal image slip information, the gain of compensatory eye movements declined compared with viewing in ambient room light. During sum-of-sine head rotations, while viewing the earth-fixed target, to Han et al./VOR during near-viewing minimize contributions from predictive mechanisms, gain also declined Nonetheless, simple superposition of smooth-pursuit tracking of sinusoidal target motion could not fully account for the overall response at higher frequencies, suggesting other nonvestibular contributions. During binocular viewing conditions when vergence angle was significantly greater than monocular viewing (p < 0.00l), the gain of compensatory eye movements did not show proportional change; indeed, gain could not be correlated with vergence angle during monocular or binocular viewing. We conclude that several separate factors contribute to generate eye rotations during sinusoidal yaw head rotations while viewing a near target; these include the VOR, visual-tracking eye movements that utilize retinal image motion, predictive eye movements and, possibly, other unidentified non-vestibular factors. For these experiments, vergence was not an important determinant of response gam.

Han, Yanning H.↗

Context-specific adaptation of pursuit initiation in humans

PURPOSE: To determine if multiple states for the initiation of pursuit, as assessed by acceleration in the "open-loop" period, can be learned and gated by context. METHODS: Four normal subjects were studied. A modified step-ramp paradigm for horizontal pursuit was used to induce adaptation. In an increasing paradigm, target velocity doubled 230 msec after onset; in a decreasing paradigm, it was halved. In the first experiment, vertical eye position (+/-5 degrees ) was used as the context cue, and the training paradigm (increasing or decreasing) changed with vertical eye position. In the second experiment, with vertical position constant, when the target was red, training was decreasing, and when green, increasing. The average eye acceleration in the first 100 msec of tracking was the index of open-loop pursuit performance. RESULTS: With vertical position as the cue, pursuit adaptation differed between up and down gaze. In some cases, the direction of adaptation was in exact accord with the training stimuli. In others, acceleration increased or decreased for both up and down gaze but always in correct relative proportion to the training stimuli. In contrast, multiple adaptive states were not induced with color as the cue. CONCLUSIONS: Multiple values for the relationship between the average eye acceleration during the initiation of pursuit and target velocity could be learned and gated by context. Vertical position was an effective contextual cue but not target color, implying that useful contextual cues must be similar to those occurring naturally, for example, orbital position with eye muscle weakness.

NASA Discipline Neuroscience↗

Event-related brain potentials reveal how multiple aspects of semantic processing unfold across parafoveal and foveal vision during sentence reading

Recent event–related brain potential (ERP) experiments have demonstrated parafoveal N400 expectancy and congruity effects, showing that semantic information can be accessed from words in parafoveal vision (a conclusion also supported by some eye–tracking work). At the same time, it is unclear how higher–order integrative aspects of language comprehension unfold across the visual field during reading. In the current study, we recorded ERPs in a parafoveal flanker paradigm, while readers were instructed to read passively for comprehension or to judge the plausibility of sentences in which target words varied in their semantic expectancy and congruity. We directly replicated prior work showing graded N400 effects for parafoveal viewing, which are then not duplicated when the target words are processed foveally. Critically, although N400 effects were not modulated by task goals, a posteriorly distributed late positive component thought to reflect semantic integration processes was observed to semantic incongruities only in the plausibility judgment task. Furthermore, this effect was observed at a considerable delay, appearing only after words had moved into foveal vision. Our findings thus suggest that semantic access can be initiated in parafoveal vision, whereas central foveal vision may be necessary to enact higher–order (and task–dependent) integrative processing.

60 APPLIED LIFE SCIENCES↗

Part-Task Simulation of Synthetic and Enhanced Vision Concepts for Lunar Landing

During Apollo, the constraints placed by the design of the Lunar Module (LM) window for crew visibility and landing trajectory were a major problem. Lunar landing trajectories were tailored to provide crew visibility using nearly 70 degrees look-down angle from the canted LM windows. Apollo landings were scheduled only at specific times and locations to provide optimal sunlight on the landing site. The complications of trajectory design and crew visibility are still a problem today. Practical vehicle designs for lunar lander missions using optimal or near-optimal fuel trajectories render the natural vision of the crew from windows inadequate for the approach and landing task. Further, the sun angles for the desirable landing areas in the lunar polar regions create visually powerful, season-long shadow effects. Fortunately, Synthetic and Enhanced Vision (S/EV) technologies, conceived and developed in the aviation domain, may provide solutions to this visibility problem and enable additional benefits for safer, more efficient lunar operations. Piloted simulation evaluations have been conducted to assess the handling qualities of the various lunar landing concepts, including the influence of cockpit displays and the informational data and formats. Evaluation pilots flew various landing scenarios with S/EV displays. For some of the evaluation trials, an eye glasses-mounted, monochrome monocular display, coupled with head tracking, was worn. The head-worn display scene consisted of S/EV fusion concepts. The results of this experiment showed that a head-worn system did not increase the pilot s workload when compared to using just the head-down displays. As expected, the head-worn system did not provide an increase in performance measures. Some pilots commented that the head-worn system provided greater situational awareness compared to just head-down displays.

Arthur, Jarvis J., III↗

Airborne Precision Spacing: A Trajectory-based Approach to Improve Terminal Area Operations

Airborne Precision Spacing has been developed by the National Aeronautics and Space Administration (NASA) over the past seven years as an attempt to benefit from the capabilities of the flight deck to precisely space their aircraft relative to another aircraft. This development has leveraged decades of work on improving terminal area operations, especially the arrival phase. With APS operations, the air traffic controller instructs the participating aircraft to achieve an assigned inter-arrival spacing interval at the runway threshold, relative to another aircraft. The flight crew then uses airborne automation to manage the aircraft s speed to achieve the goal. The spacing tool is designed to keep the speed within acceptable operational limits, promote system-wide stability, and meet the assigned goal. This reallocation of tasks with the controller issuing strategic goals and the flight crew managing the tactical achievement of those goals has been shown to be feasible through simulation and flight test. A precision of plus or minus 2-3 seconds is generally achievable. Simulations of long strings of arriving traffic show no signs of instabilities or compression waves. Subject pilots have rated the workload to be similar to current-day operations and eye-tracking data substantiate this result. This paper will present a high-level review of research results over the past seven years from a variety of tests and experiments. The results will focus on the precision and accuracy achievable, flow stability and some major sources of uncertainty. The paper also includes a summary of the flight crew s procedures and interface and a brief concept overview.

Barmore, Bryan↗

Experimental tests of a superposition hypothesis to explain the relationship between the vestibuloocular reflex and smooth pursuit during horizontal combined eye-head tracking in humans

1. We used a modeling approach to test the hypothesis that, in humans, the smooth pursuit (SP) system provides the primary signal for cancelling the vestibuloocular reflex (VOR) during combined eye-head tracking (CEHT) of a target moving smoothly in the horizontal plane. Separate models for SP and the VOR were developed. The optimal values of parameters of the two models were calculated using measured responses of four subjects to trials of SP and the visually enhanced VOR. After optimal parameter values were specified, each model generated waveforms that accurately reflected the subjects' responses to SP and vestibular stimuli. The models were then combined into a CEHT model wherein the final eye movement command signal was generated as the linear summation of the signals from the SP and VOR pathways. 2. The SP-VOR superposition hypothesis was tested using two types of CEHT stimuli, both of which involved passive rotation of subjects in a vestibular chair. The first stimulus consisted of a "chair brake" or sudden stop of the subject's head during CEHT; the visual target continued to move. The second stimulus consisted of a sudden change from the visually enhanced VOR to CEHT ("delayed target onset" paradigm); as the vestibular chair rotated past the angular position of the stationary visual stimulus, the latter started to move in synchrony with the chair. Data collected during experiments that employed these stimuli were compared quantitatively with predictions made by the CEHT model. 3. During CEHT, when the chair was suddenly and unexpectedly stopped, the eye promptly began to move in the orbit to track the moving target. Initially, gaze velocity did not completely match target velocity, however; this finally occurred approximately 100 ms after the brake onset. The model did predict the prompt onset of eye-in-orbit motion after the brake, but it did not predict that gaze velocity would initially be only approximately 70% of target velocity. One possible explanation for this discrepancy is that VOR gain can be dynamically modulated and, during sustained CEHT, it may assume a lower value. Consequently, during CEHT, a smaller-amplitude SP signal would be needed to cancel the lower-gain VOR. This reduction of the SP signal could account for the attenuated tracking response observed immediately after the brake. We found evidence for the dynamic modulation of VOR gain by noting differences in responses to the onset and offset of head rotation in trials of the visually enhanced VOR.(ABSTRACT TRUNCATED AT 400 WORDS).

Non-NASA Center↗

Industrial Energy Assessment Training Effectiveness Evaluation: An Eye-Tracking Study

It is essential to understand the effectiveness of any training program so it can be improved accordingly. Various studies have applied standard metrics for the evaluation of visual behavior to recognize the areas of interest that attract individuals’ attention as there is a high correlation between attentional behavior and where one is focusing on. However, through reviewing the literature, we believe that studies that applied eye-tracking technologies for training purposes are still limited, especially in the industrial energy assessment training field. In this paper, the effectiveness of industrial energy assessment training was quantitatively evaluated by measuring the attentional allocation of trainees using eye-tracking technology. Moreover, this study identifies the areas that require more focus based on evaluating the performance of subjects after receiving the training. Additionally, this research was conducted in a controlled environment to remove the distractions that may be caused by environmental factors to only concentrate on variables that influence the learning behavior of subjects. The experiment results showed that after receiving the training, the subjects’ performance in energy assessment was significantly improved in two areas: production, and recycling and waste management, and the designed training program enhanced the knowledge of participants in identifying energy-saving opportunities to the knowledge level of experienced participants.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Visual fatigue - The need for an integrated model

Two experiments were conducted to examine possible decrements in performance over time on two visual tracking tasks. In Experiment 1, six subjects tracked a horizontal, sinusoidally moving target in the picture plane for 6.5 min. In Experiment 2, six subjects tracked a target sinusoidally changing focus in the depth plane between 0 and 4 D over 6.5 min. Results indicated a linearly decreasing amplitude of both pursuit eye movements (.29 deg of visual angle per minute) and accommodation (.11 D/min). These visual fatigue effects are discussed in the context of several competing explanations.

Malmstrom, F. V.↗

Flight Crew Workload, Acceptability, and Performance When Using Data Comm in a High-Density Terminal Area Simulation

This document describes a collaborative FAA/NASA experiment using 22 commercial airline pilots to determine the effect of using Data Comm to issue messages during busy, terminal area operations. Four conditions were defined that span current day to future flight deck equipage: Voice communication only, Data Comm only, Data Comm with Moving Map Display, and Data Comm with Moving Map displaying taxi route. Each condition was used in an arrival and a departure scenario at Boston Logan Airport. Of particular interest was the flight crew response to D-TAXI, the use of Data Comm by Air Traffic Control (ATC) to send taxi instructions. Quantitative data was collected on subject reaction time, flight technical error, operational errors, and eye tracking information. Questionnaires collected subjective feedback on workload, situation awareness, and acceptability to the flight crew for using Data Comm in a busy terminal area. Results showed that 95% of the Data Comm messages were responded to by the flight crew within one minute and 97% of the messages within two minutes. However, post experiment debrief comments revealed almost unanimous consensus that two minutes was a reasonable expectation for crew response. Flight crews reported that Expected D-TAXI messages were useful, and employment of these messages acceptable at all altitude bands evaluated during arrival scenarios. Results also indicate that the use of Data Comm for all evaluated message types in the terminal area was acceptable during surface operations, and during arrivals at any altitude above the Final Approach Fix, in terms of response time, workload, situation awareness, and flight technical performance. The flight crew reported the use of Data Comm as implemented in this experiment as unacceptable in two instances: in clearances to cross an active runway, and D-TAXI messages between the Final Approach Fix and 80 knots during landing roll. Critical cockpit tasks and the urgency of out-the window scan made the additional head down time to respond to Data Comm messages undesirable during these events. However, most crews also stated that Data Comm messages without an accompanying audio chime and no expectation of an immediate response could be acceptable even during these events.

Norman, R. Michael↗

Opaque Contact Lens For Tracking Motion Of Eye

Opaque contact lens facilitates measurements of movements of eye; particularly, torsional movements. Lens, marked with pair of indices at diameter of 0.5 mm, provides stable, high-contrast reference for measurements of angular position and velocity of eye by use of video-image-analysis techniques. Intended for use in experiments on response of eye to vestibular balance mechanism.

Zografos, James L., II↗

Evaluation of Visualization Heuristics

Heuristics have been used since the early 1990's in the Human Computer Interaction (HCI) domain, for evaluating user interfaces. Most notably, heuristics developed by Nielsen and Molich (1990) have been used by the HCI community. Forsell and Johansson (2010) used the same methodology as Nielsen and Molich and developed a set of 10 heuristics for information visualization. Currently, neither the information visualization or the visual analytics community has adopted these heuristics. However, several studies have been conducted using heuristics. Hearst et al. (2015) found that using the heuristics for visualizations along with asking questions about the data resulted in complementary results as the questions about the data could compensate for heuristics that were difficult to understand and apply. Heli Väätäjä et al. (2016) found that heuristics related to interaction, veracity, and aesthetics needed to be added to the Forsell and Johansson (2010) set. They also noted that a lack of domain knowledge caused the evaluators issues in conducting a heuristic evaluation. We conducted a controlled experiment to determine what factors might impact the expert evaluators' capability to conduct a heuristic evaluation of a static information visualization. In particular, we wanted to understand how their familiarity with the visualizations and their experience in conducting heuristic evaluations impacted their evaluations of visualizations. We recruited 10 participants who were domain experts in the visualization field each having experience with one of more of the following: user experience design or research, user interface development, and human computer interaction research. We used a heuristic set proposed by Forsell and Johansson. Participants were also asked to complete a demographic survey in which they rated their experience with each visualization type generally, their experience conducting heuristic evaluations, their experience using each visualization type to extract information, and their experience developing and creating each visualization type. The participants were shown a series of 5 common visualizations (Scatterplots, Sunbursts, Tree Maps, Parallel Sets, and Area Graphs) all displaying the VAST 2008 Mini Challenge Two- Migrant Boats data . Participants were given a suggested analytical question related to each visualization to keep in mind as they applied the 10 heuristics to each visualization. They were asked if they could find any usability problems in the visualizations and which heuristic(s) helped them to identify these problems. The participants were asked to rate how relevant each heuristic was for evaluating each visualization along with rating how confident they felt in their ability to apply the heuristic to evaluate each visualization. At the conclusion of the study, participants provided qualitative feedback on the usability issues of each visualization. Additionally, we collected eye tracking data on 6 of the 10 participants. We will be using this data to determine how long participants looked at the various visualizations and what parts of the visualizations they focused on. We had two hypotheses for this empirical evaluation: 1.The Forsell and Johansson heuristics of Orientation and help, Data set reduction, and Prompting are less useful for static visualizations because they require some interaction in order to test completely. 2.Participants that do not have experience with heuristic evaluation will provide lower evaluation scores for the heuristics compared to those that have experience. Related to hypothesis 1, as our study used only static visualizations, interaction-related usability challenges should be harder to identify. This should result in lower usefulness ratings for those heuristics. Preliminary results indicate that participants found it more difficult to apply heuristics to unfamiliar visualizations.

Williams, Ryan G.↗