A re-analysis of the pilot eye-movement data.
Pilot eye movement data by recording eye fixations on flight instruments
AIRCRAFT INSTRUMENTATION↗
SEARCH · Search NASA
Results for “Data eye”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Instrument scanning and controlling: Using eye movement data to understand pilot behavior and strategies
Eye movement data and other parameters including instrument readings, aircraft state and position variables, and control maneuvers were recorded while pilots flew ILS simulations in a B 737. The experiment itself employed seven airline pilots, each of whom flew approximately 40 approach/landing sequences. The simulator was equipped with a night visual scene but the scene was fogged out down to approximately 60 meters (200 ft). The instrument scanning appeared to follow aircraft parameters not physical position of instruments. One important implication of the results is: pilots look for categories or packets of information. Control inputs were tabulated according to throttle, wheel position, column, and pitch trim changes. Three seconds of eye movements before and after the control input were then obtained. Analysis of the eye movement data for the controlling periods showed clear patterns. The results suggest a set of miniscan patterns which are used according to the specific details of the situation. A model is developed which integrates scanning and controlling. Differentiations are made between monitoring and controlling scans.
Dick, A. O.↗
Time-locked time-histories - A new way of examining eye-movement data
A problem often encountered when eye-movement measurement is conducted is the choice of 'indices' or 'statistics' available to present such information. The present study reports the use of the Time-Locked Time-History as a technique of value in the examination and presentation of eye-movement data. Plots created using this technique are labeled time-locked time-histories as they illustrate subject eye lookpoint during a period of time before and after a certain time-locking event. Events that occur with some degree of repetition, such as the onset or termination of control activities, warning signals, or changes in indicator positions may be utilized as time-locking events. The present study reports the use of this technique in an eye-movement study using a secondary task in which the subject must discriminate specific types of information in the display.
Comstock, J. Raymond, Jr.↗
Limitations on the Use of Eye-Tracking Data to Understand Operator Awareness
In the last 20 years, a number of accidents and incidents in commercial aviation have pointed to poor flight crew awareness of basic flight path parameters (e.g., airspeed, bank, pitch). As a result, there is a desire to improve pilot situation awareness and how attention is allocated. Eye-tracking has been a commonly used measure of awareness; it can aid in understanding whether specific indications were fixated, and perhaps how a pilot gathered information (that is, which indications in which sequence). In this paper, we discuss limitations on what eye-tracking data can reveal about pilot awareness and understanding. First, previous studies (e.g., Sarter et al., 2007) have shown that fixation on an indication may not ensure awareness or understanding. Further, an operator may have awareness of information not fixated. Additional measures—such as self-report or control inputs—can help to better establish the extent of pilot awareness and understanding. Second, sequences of fixations (scan patterns) have also become a performance measure. While a small number of recognized scan patterns have been validated for a small set of parameters on the Primary Flight Display (PFD), scan patterns have not been identified to support the broader context of flight path management or flight operations. More important is to understand the full set of drivers underlying the larger pattern of eye fixations; this approach moves away from the idea of well-established scan patterns as a marker of skilled performance and gives a larger role to pilot cognition. Pilots have various reasons to direct attention to specific elements on the interface, such as: - feedback tied to control inputs - a check on compliance with flight path targets - a reaction to an alert or a call out - attempt to understand an unexpected indication - assess progress toward a flight path target The importance of cognition is further implicated in the finding that pilot interviews show that fixating typically is accompanied by expectation; generally, pilots have a strong expectation of what value or indication they will see, which allows more efficient integration of information and an ability to identify indications that suggest an alternative account of the current system state. We will describe a range of eye-tracking measures and how they should and should not be used.
aviation↗
Analysis of Eye-Tracking Data with Regards to the Complexity of Flight Deck Information Automation and Management - Inattentional Blindness, System State Awareness, and EFB Usage
In the constant drive to further the safety and efficiency of air travel, the complexity of avionics-related systems, and the procedures for interacting with these systems, appear to be on an ever-increasing trend. While this growing complexity often yields productive results with respect to system capabilities and flight efficiency, it can place a larger burden on pilots to manage increasing amounts of information and to understand intricate system designs. Evidence supporting this observation is becoming widespread, yet has been largely anecdotal or the result of subjective analysis. One way to gain more insight into this issue is through experimentation using more objective measures or indicators. This study utilizes and analyzes eye-tracking data obtained during a high-fidelity flight simulation study wherein many of the complexities of current flight decks, as well as those planned for the next generation air transportation system (NextGen), were emulated. The following paper presents the findings of this study with a focus on electronic flight bag (EFB) usage, system state awareness (SSA) and events involving suspected inattentional blindness (IB).
Dill, Evan T.↗
Analysis of Eye-Tracking Data During Conditions Conducive to Loss of Airplane State Awareness
In the constant drive to further the safety and efficiency of air travel, the complexity of avionics-related systems and of the procedures for interacting with them appear to be on an ever-increasing trend. While this growing complexity often yields productive results with respect to system capabilities and flight efficiency, it typically places a larger burden on pilots to manage increasing amounts of information and to understand intricate system designs. This can be problematic as too much information and/or ineffective provisions of information can potentially overwhelm and/or confuse pilots, and as a result, increase the likelihood of loss of airplane state awareness (ASA). One way to gain more insight into this issue is through experimentation using more objective measures. This study summarizes an analysis of eye-tracking data obtained during a high-fidelity flight simulation study that included most of the complexities of current flight decks, as well as several planned for the next generation air transportation system. Multiple analyses were performed to understand how the 22 participating airline pilots were observing ASA-related information provided during different stages of flights and in response to specific events within these stages. Also, study findings are compared to data presented in similar previous studies to assess trends or common themes regarding how airline crews apply visual attention in complex flight deck and operational environments.
Dill, Evan T.↗
Techniques used for the analysis of oculometer eye-scanning data obtained from an air traffic control display
The methodology and techniques used to collect and analyze look-point position data from a real-time ATC display-format comparison experiment are documented. That study compared the delivery precision and controller workload of three final approach spacing aid display formats. Using an oculometer, controller lookpoint position data were collected, associated with gaze objects (e.g., moving aircraft) on the ATC display, and analyzed to determine eye-scan behavior. The equipment involved and algorithms for saving, synchronizing with the ATC simulation output, and filtering the data are described. Target (gaze object) and cross-check scanning identification algorithms are also presented. Data tables are provided of total dwell times, average dwell times, and cross-check scans. Flow charts, block diagrams, file record descriptors, and source code are included. The techniques and data presented are intended to benefit researchers in other studies that incorporate non-stationary gaze objects and oculometer equipment.
Crawford, Daniel J.↗
Limitations on the Use of Eye-Tracking Data to Understand Operator Awareness
Safety events in commercial aviation have implicated failures of attention and awareness, and the need for improved attention and awareness has pushed trainers toward eye-tracking systems as a primary tool for evaluating monitoring performance. Further, in the last 15 years, eye-tracking technology has become easier to acquire and use in operationally realistic settings. Although we believe that eye-tracking can be a useful evaluation tool, this paper describes basic limitations on relying on eye-tracking as the sole means for evaluating attention and awareness. A set of other measures are offered that can better identify where performance breakdowns occur.
aviation↗
A dynamic response and eye scanning data base useful in the development of theories and methods for the description of control/display relationships
A set of specially prepared digital tapes is reported which contain synchronized measurements of pilot scanning behavior, control response, and vehicle response obtained during instrument landing system approaches made in a fixed-base DC-8 transport simulator. The objective of the master tape is to provide a common data base which can be used by the research community to test theories, models, and methods for describing and analyzing control/display relations and interactions. The experimental conditions and tasks used to obtain the data and the detailed format of the tapes are described. Conventional instrument panel and controls were used, with simulated vertical gust and glide slope beam bend forcing functions. Continuous pilot eye fixations and scan traffic on the panel were measured. Both flight director and standard localizer/glide slope types of approaches were made, with both fixed and variable instrument range sensitivities.
Klein, R.↗
Exploration of an oculometer-based model of pilot workload
Potential relationships between eye behavior and pilot workload are discussed. A Honeywell Mark IIA oculometer was used to obtain the eye data in a fixed base transport aircraft simulation facility. The data were analyzed to determine those parameters of eye behavior which were related to changes in level of task difficulty of the simulated manual approach and landing on instruments. A number of trends and relationships between eye variables and pilot ratings were found. A preliminary equation was written based on the results of a stepwise linear regression. High variability in time spent on various instruments was related to differences in scanning strategy among pilots. A more detailed analysis of individual runs by individual pilots was performed to investigate the source of this variability more closely. Results indicated a high degree of intra-pilot variability in instrument scanning. No consistent workload related trends were found. Pupil diameter which had demonstrated a strong relationship to task difficulty was extensively re-exmained.
Krebs, M. J.↗
Geometric adjustments to account for eye eccentricity in processing horizontal and vertical eye and head movement data
Neglecting the eccentric position of the eyes in the head can lead to erroneous interpretation of ocular motor data, particularly for near targets. We discuss the geometric effects that eye eccentricity has on the processing of target-directed eye and head movement data, and we highlight two approaches to processing and interpreting such data. The first approach involves determining the true position of the target with respect to the location of the eyes in space for evaluating the efficacy of gaze, and it allows calculation of retinal error directly from measured eye, head, and target data. The second approach effectively eliminates eye eccentricity effects by adjusting measured eye movement data to yield equivalent responses relative to a specified reference location (such as the center of head rotation). This latter technique can be used to standardize measured eye movement signals, enabling waveforms collected under different experimental conditions to be directly compared, both with the measured target signals and with each other. Mathematical relationships describing these approaches are presented for horizontal and vertical rotations, for both tangential and circumferential display screens, and efforts are made to describe the sensitivity of parameter variations on the calculated results.
NASA Discipline Neuroscience↗
Analysis of Pilot Feedback Regarding the Use of State Awareness Technologies During Complex Situations
A flight simulation study was conducted at NASA Langley Research Center to evaluate flight deck systems that (1) predict aircraft energy state and/or autoflight configuration, (2) present the current state and expected future state of automated systems, and/or (3) show the state of flight-critical data systems in use by automated systems and primary flight instruments. Four new technology concepts were evaluated vis-à-vis current state-of-the-art flight deck systems and indicators. This human-in-the-loop study was conducted using commercial airline crews. Scenarios spanned a range of complex conditions and several emulated causal factors and complexity in recent accidents involving loss of state awareness by pilots (e.g. energy state, automation state, and/or system state). Data were collected via questionnaires administered after each flight, audio/video recordings, physiological data, head and eye tracking data, pilot control inputs, and researcher observations. This paper strictly focuses on findings derived from the questionnaire responses. It includes analysis of pilot subjective measures of complexity, decision making, workload, situation awareness, usability, and acceptability.
Evans, Emory↗
Evaluation of Technology Concepts for Energy, Automation, and System State Awareness in Commercial Airline Flight Decks
A pilot-in-the-loop flight simulation study was conducted at NASA Langley Research Center to evaluate flight deck systems that (1) provide guidance for recovery from low energy states and stalls, (2) present the current state and expected future state of automated systems, and/or (3) show the state of flight-critical data systems in use by automated systems and primary flight instruments. The study was conducted using 13 commercial airline crews from multiple airlines, paired by airline to minimize procedural effects. Scenarios spanned a range of complex conditions and several emulated causal and contributing factors found in recent accidents involving loss of state awareness by pilots (e.g., energy state, automation state, and/or system state). Three new technology concepts were evaluated while used in concert with current state-of-the-art flight deck systems and indicators. The technologies include a stall recovery guidance algorithm and display concept, an enhanced airspeed control indicator that shows when automation is no longer actively controlling airspeed, and enhanced synoptic pages designed to work with simplified interactive electronic checklists. An additional synoptic was developed to provide the flight crew with information about the effects of loss of flight critical data. Data was collected via questionnaires administered at the completion of flight scenarios, audio/video recordings, flight data, head and eye tracking data, pilot control inputs, and researcher observations. This paper presents findings derived from the questionnaire responses and subjective data measures including workload, situation awareness, usability, and acceptability as well as analyses of two low-energy flight events that resulted in near-stall conditions.
Kramer, Lynda J.↗
Eye-Tracking Analysis from a Flight-Director-Use and Pilot-Monitoring Study
Eye tracking may be a useful tool to investigate pilot monitoring and develop and conduct training. There is increased interest from airlines to use eye-tracking technologies in flight simulators. However, much is still unknown about how to best utilize eye-tracking data in pilot training. This paper presents eye-tracking results from a pilot-monitoring training study with 19 pilots. All pilots completed 15 monitoring challenges across four operational scenarios in a B737-700 full flight simulator. In addition, the study investigated the impact of having the flight director engaged or disengaged on the pilot monitoring side in the final approach. It was hypothesized that pilots would focus less on the primary flight display with the flight director off and look more around in the cockpit. To assess this, pilots performed half of the scenarios with the flight director on and half with the flight director off. However, pilots monitoring tended to look less at the primary flight display with the flight director on as indicated by lower Proportion Dwell Times, contrary to the hypothesis. Next, eye-tracking data were analyzed from two monitoring challenges involving waypoint restrictions and two involving extending the flaps at appropriate airspeeds. Pilots that successfully completed the challenges appeared to focus more on areas of interest that contained the most relevant information to successfully complete the challenge. In addition, successful pilots seemed to adapt their monitoring strategy more to the challenge at hand as observed by a distinct shift in focus on either the primary flight display or the navigation display depending on the challenge. Our findings suggest the importance of flexible gaze allocation across specific situations and raise the question whether and to what degree prespecified patterns of eye fixation can be identified and trained.
eye tracking↗
Eye-Tracking Analysis from a Flight-Director-Use and Pilot-Monitoring Study
Eye tracking may be a useful tool to investigate pilot monitoring and develop and conduct training. There is increased interest from airlines to use eye-tracking technologies in flight simulators. However, much is still unknown about how to best utilize eye-tracking data in pilot training. This paper presents eye-tracking results from a pilot-monitoring training study with 19 pilots. All pilots completed 15 monitoring challenges across four operational scenarios in a B737-700 full flight simulator. In addition, the study investigated the impact of having the flight director engaged or disengaged on the pilot monitoring side in the final approach. It was hypothesized that pilots would focus less on the primary flight display with the flight director off and look more around in the cockpit. To assess this, pilots performed half of the scenarios with the flight director on and half with the flight director off. However, pilots monitoring tended to look less at the primary flight display with the flight director on as indicated by lower Proportion Dwell Times, contrary to the hypothesis. Next, eye-tracking data were analyzed from two monitoring challenges involving waypoint restrictions and two involving extending the flaps at appropriate airspeeds. Pilots that successfully completed the challenges appeared to focus more on areas of interest that contained the most relevant information to successfully complete the challenge. In addition, successful pilots seemed to adapt their monitoring strategy more to the challenge at hand as observed by a distinct shift in focus on either the primary flight display or the navigation display depending on the challenge. Our findings suggest the importance of flexible gaze allocation across specific situations and raise the question whether and to what degree prespecified patterns of eye fixation can be identified and trained.
eye tracking↗
Seeing Comet IRAS with a radar eye
IRAS data in April 1983 held evidence for the approach of a comet which would pass close enough to earth to bounce radar signals off the cometary nucleus. The closest pass was calculated to be 450,000 km. Ephemerides were prepared for the object while radio observatory tracking schedules were arranged. S-band observations were selected for the JPL 64 m antenna to obtain 2.7 arcmin resolution. A 400 kW signal was generated. Two 4 hr observational periods were achieved, revealing a rough, faceted surface by using S-band in the first run and the X-band in the second. The comet was concluded irregularly shaped and roughly elliptical, with a 2 d period.
Jurgens, R. F.↗
The Lava Lake at Pele: An Analysis of High-Resolution, Multi-Wavelength Galileo Data
The eyes of Galileo: See Pele's glory at many wavelengths. Additional information is contained in the original extended abstract.
Davies, A. G.↗