A re-analysis of the pilot eye-movement data.
Pilot eye movement data by recording eye fixations on flight instruments
AIRCRAFT INSTRUMENTATION↗
SEARCH · Search NASA
Results for “Data eye”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Analysis and categorization of eye tracking data describing scanpaths
Described herein are various technologies pertaining to analysis of eye tracking data. A head and/or eyes of an observer who is viewing a visual stimulus is monitored, and eye tracking data that is representative of the path of the eyes of the observer over time (a scanpath) is generated. The eye tracking data is time-series data that defines the location of the focal point, or other measurable characteristics, of the eyes of the observer on the visual stimulus over time. A feature vector is constructed based upon the eye tracking data, where the feature vector is representative of the eye tracking data, and is thus representative of the scanpath. The feature vector is compared with other feature vectors to identify scanpaths that correspond to the scanpath represented by the feature vector.
47 OTHER INSTRUMENTATION↗
Instrument scanning and controlling: Using eye movement data to understand pilot behavior and strategies
Eye movement data and other parameters including instrument readings, aircraft state and position variables, and control maneuvers were recorded while pilots flew ILS simulations in a B 737. The experiment itself employed seven airline pilots, each of whom flew approximately 40 approach/landing sequences. The simulator was equipped with a night visual scene but the scene was fogged out down to approximately 60 meters (200 ft). The instrument scanning appeared to follow aircraft parameters not physical position of instruments. One important implication of the results is: pilots look for categories or packets of information. Control inputs were tabulated according to throttle, wheel position, column, and pitch trim changes. Three seconds of eye movements before and after the control input were then obtained. Analysis of the eye movement data for the controlling periods showed clear patterns. The results suggest a set of miniscan patterns which are used according to the specific details of the situation. A model is developed which integrates scanning and controlling. Differentiations are made between monitoring and controlling scans.
Dick, A. O.↗
Time-locked time-histories - A new way of examining eye-movement data
A problem often encountered when eye-movement measurement is conducted is the choice of 'indices' or 'statistics' available to present such information. The present study reports the use of the Time-Locked Time-History as a technique of value in the examination and presentation of eye-movement data. Plots created using this technique are labeled time-locked time-histories as they illustrate subject eye lookpoint during a period of time before and after a certain time-locking event. Events that occur with some degree of repetition, such as the onset or termination of control activities, warning signals, or changes in indicator positions may be utilized as time-locking events. The present study reports the use of this technique in an eye-movement study using a secondary task in which the subject must discriminate specific types of information in the display.
Comstock, J. Raymond, Jr.↗
Limitations on the Use of Eye-Tracking Data to Understand Operator Awareness
In the last 20 years, a number of accidents and incidents in commercial aviation have pointed to poor flight crew awareness of basic flight path parameters (e.g., airspeed, bank, pitch). As a result, there is a desire to improve pilot situation awareness and how attention is allocated. Eye-tracking has been a commonly used measure of awareness; it can aid in understanding whether specific indications were fixated, and perhaps how a pilot gathered information (that is, which indications in which sequence). In this paper, we discuss limitations on what eye-tracking data can reveal about pilot awareness and understanding. First, previous studies (e.g., Sarter et al., 2007) have shown that fixation on an indication may not ensure awareness or understanding. Further, an operator may have awareness of information not fixated. Additional measures—such as self-report or control inputs—can help to better establish the extent of pilot awareness and understanding. Second, sequences of fixations (scan patterns) have also become a performance measure. While a small number of recognized scan patterns have been validated for a small set of parameters on the Primary Flight Display (PFD), scan patterns have not been identified to support the broader context of flight path management or flight operations. More important is to understand the full set of drivers underlying the larger pattern of eye fixations; this approach moves away from the idea of well-established scan patterns as a marker of skilled performance and gives a larger role to pilot cognition. Pilots have various reasons to direct attention to specific elements on the interface, such as: - feedback tied to control inputs - a check on compliance with flight path targets - a reaction to an alert or a call out - attempt to understand an unexpected indication - assess progress toward a flight path target The importance of cognition is further implicated in the finding that pilot interviews show that fixating typically is accompanied by expectation; generally, pilots have a strong expectation of what value or indication they will see, which allows more efficient integration of information and an ability to identify indications that suggest an alternative account of the current system state. We will describe a range of eye-tracking measures and how they should and should not be used.
aviation↗
Analysis of Eye-Tracking Data with Regards to the Complexity of Flight Deck Information Automation and Management - Inattentional Blindness, System State Awareness, and EFB Usage
In the constant drive to further the safety and efficiency of air travel, the complexity of avionics-related systems, and the procedures for interacting with these systems, appear to be on an ever-increasing trend. While this growing complexity often yields productive results with respect to system capabilities and flight efficiency, it can place a larger burden on pilots to manage increasing amounts of information and to understand intricate system designs. Evidence supporting this observation is becoming widespread, yet has been largely anecdotal or the result of subjective analysis. One way to gain more insight into this issue is through experimentation using more objective measures or indicators. This study utilizes and analyzes eye-tracking data obtained during a high-fidelity flight simulation study wherein many of the complexities of current flight decks, as well as those planned for the next generation air transportation system (NextGen), were emulated. The following paper presents the findings of this study with a focus on electronic flight bag (EFB) usage, system state awareness (SSA) and events involving suspected inattentional blindness (IB).
Dill, Evan T.↗
Analysis of Eye-Tracking Data During Conditions Conducive to Loss of Airplane State Awareness
In the constant drive to further the safety and efficiency of air travel, the complexity of avionics-related systems and of the procedures for interacting with them appear to be on an ever-increasing trend. While this growing complexity often yields productive results with respect to system capabilities and flight efficiency, it typically places a larger burden on pilots to manage increasing amounts of information and to understand intricate system designs. This can be problematic as too much information and/or ineffective provisions of information can potentially overwhelm and/or confuse pilots, and as a result, increase the likelihood of loss of airplane state awareness (ASA). One way to gain more insight into this issue is through experimentation using more objective measures. This study summarizes an analysis of eye-tracking data obtained during a high-fidelity flight simulation study that included most of the complexities of current flight decks, as well as several planned for the next generation air transportation system. Multiple analyses were performed to understand how the 22 participating airline pilots were observing ASA-related information provided during different stages of flights and in response to specific events within these stages. Also, study findings are compared to data presented in similar previous studies to assess trends or common themes regarding how airline crews apply visual attention in complex flight deck and operational environments.
Dill, Evan T.↗
Techniques used for the analysis of oculometer eye-scanning data obtained from an air traffic control display
The methodology and techniques used to collect and analyze look-point position data from a real-time ATC display-format comparison experiment are documented. That study compared the delivery precision and controller workload of three final approach spacing aid display formats. Using an oculometer, controller lookpoint position data were collected, associated with gaze objects (e.g., moving aircraft) on the ATC display, and analyzed to determine eye-scan behavior. The equipment involved and algorithms for saving, synchronizing with the ATC simulation output, and filtering the data are described. Target (gaze object) and cross-check scanning identification algorithms are also presented. Data tables are provided of total dwell times, average dwell times, and cross-check scans. Flow charts, block diagrams, file record descriptors, and source code are included. The techniques and data presented are intended to benefit researchers in other studies that incorporate non-stationary gaze objects and oculometer equipment.
Crawford, Daniel J.↗
Limitations on the Use of Eye-Tracking Data to Understand Operator Awareness
Safety events in commercial aviation have implicated failures of attention and awareness, and the need for improved attention and awareness has pushed trainers toward eye-tracking systems as a primary tool for evaluating monitoring performance. Further, in the last 15 years, eye-tracking technology has become easier to acquire and use in operationally realistic settings. Although we believe that eye-tracking can be a useful evaluation tool, this paper describes basic limitations on relying on eye-tracking as the sole means for evaluating attention and awareness. A set of other measures are offered that can better identify where performance breakdowns occur.
aviation↗
A dynamic response and eye scanning data base useful in the development of theories and methods for the description of control/display relationships
A set of specially prepared digital tapes is reported which contain synchronized measurements of pilot scanning behavior, control response, and vehicle response obtained during instrument landing system approaches made in a fixed-base DC-8 transport simulator. The objective of the master tape is to provide a common data base which can be used by the research community to test theories, models, and methods for describing and analyzing control/display relations and interactions. The experimental conditions and tasks used to obtain the data and the detailed format of the tapes are described. Conventional instrument panel and controls were used, with simulated vertical gust and glide slope beam bend forcing functions. Continuous pilot eye fixations and scan traffic on the panel were measured. Both flight director and standard localizer/glide slope types of approaches were made, with both fixed and variable instrument range sensitivities.
Klein, R.↗
A New Method for Categorizing Scanpaths from Eye Tracking Data.
Abstract not provided.
Haass, Michael Joseph↗
Moving from low level eye movement data to meaningful content in dynamic environments.
Abstract not provided.
Divis, Kristin Marie↗
Exploration of an oculometer-based model of pilot workload
Potential relationships between eye behavior and pilot workload are discussed. A Honeywell Mark IIA oculometer was used to obtain the eye data in a fixed base transport aircraft simulation facility. The data were analyzed to determine those parameters of eye behavior which were related to changes in level of task difficulty of the simulated manual approach and landing on instruments. A number of trends and relationships between eye variables and pilot ratings were found. A preliminary equation was written based on the results of a stepwise linear regression. High variability in time spent on various instruments was related to differences in scanning strategy among pilots. A more detailed analysis of individual runs by individual pilots was performed to investigate the source of this variability more closely. Results indicated a high degree of intra-pilot variability in instrument scanning. No consistent workload related trends were found. Pupil diameter which had demonstrated a strong relationship to task difficulty was extensively re-exmained.
Krebs, M. J.↗
Geometric adjustments to account for eye eccentricity in processing horizontal and vertical eye and head movement data
Neglecting the eccentric position of the eyes in the head can lead to erroneous interpretation of ocular motor data, particularly for near targets. We discuss the geometric effects that eye eccentricity has on the processing of target-directed eye and head movement data, and we highlight two approaches to processing and interpreting such data. The first approach involves determining the true position of the target with respect to the location of the eyes in space for evaluating the efficacy of gaze, and it allows calculation of retinal error directly from measured eye, head, and target data. The second approach effectively eliminates eye eccentricity effects by adjusting measured eye movement data to yield equivalent responses relative to a specified reference location (such as the center of head rotation). This latter technique can be used to standardize measured eye movement signals, enabling waveforms collected under different experimental conditions to be directly compared, both with the measured target signals and with each other. Mathematical relationships describing these approaches are presented for horizontal and vertical rotations, for both tangential and circumferential display screens, and efforts are made to describe the sensitivity of parameter variations on the calculated results.
NASA Discipline Neuroscience↗
A New Data Set to Keep a Sharper Eye on Land-Air Exchanges
FLUXNET15, the latest update of the longest global record of ecosystem carbon, water, and energy fluxes, features improved data quality, new data products, and more open data sharing policies.
54 ENVIRONMENTAL SCIENCES↗
Analysis of Pilot Feedback Regarding the Use of State Awareness Technologies During Complex Situations
A flight simulation study was conducted at NASA Langley Research Center to evaluate flight deck systems that (1) predict aircraft energy state and/or autoflight configuration, (2) present the current state and expected future state of automated systems, and/or (3) show the state of flight-critical data systems in use by automated systems and primary flight instruments. Four new technology concepts were evaluated vis-à-vis current state-of-the-art flight deck systems and indicators. This human-in-the-loop study was conducted using commercial airline crews. Scenarios spanned a range of complex conditions and several emulated causal factors and complexity in recent accidents involving loss of state awareness by pilots (e.g. energy state, automation state, and/or system state). Data were collected via questionnaires administered after each flight, audio/video recordings, physiological data, head and eye tracking data, pilot control inputs, and researcher observations. This paper strictly focuses on findings derived from the questionnaire responses. It includes analysis of pilot subjective measures of complexity, decision making, workload, situation awareness, usability, and acceptability.
Evans, Emory↗
Evaluation of Technology Concepts for Energy, Automation, and System State Awareness in Commercial Airline Flight Decks
A pilot-in-the-loop flight simulation study was conducted at NASA Langley Research Center to evaluate flight deck systems that (1) provide guidance for recovery from low energy states and stalls, (2) present the current state and expected future state of automated systems, and/or (3) show the state of flight-critical data systems in use by automated systems and primary flight instruments. The study was conducted using 13 commercial airline crews from multiple airlines, paired by airline to minimize procedural effects. Scenarios spanned a range of complex conditions and several emulated causal and contributing factors found in recent accidents involving loss of state awareness by pilots (e.g., energy state, automation state, and/or system state). Three new technology concepts were evaluated while used in concert with current state-of-the-art flight deck systems and indicators. The technologies include a stall recovery guidance algorithm and display concept, an enhanced airspeed control indicator that shows when automation is no longer actively controlling airspeed, and enhanced synoptic pages designed to work with simplified interactive electronic checklists. An additional synoptic was developed to provide the flight crew with information about the effects of loss of flight critical data. Data was collected via questionnaires administered at the completion of flight scenarios, audio/video recordings, flight data, head and eye tracking data, pilot control inputs, and researcher observations. This paper presents findings derived from the questionnaire responses and subjective data measures including workload, situation awareness, usability, and acceptability as well as analyses of two low-energy flight events that resulted in near-stall conditions.
Kramer, Lynda J.↗