Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data eye”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Eye-Tracking Analysis from a Flight-Director-Use and Pilot-Monitoring Study

Eye tracking may be a useful tool to investigate pilot monitoring and develop and conduct training. There is increased interest from airlines to use eye-tracking technologies in flight simulators. However, much is still unknown about how to best utilize eye-tracking data in pilot training. This paper presents eye-tracking results from a pilot-monitoring training study with 19 pilots. All pilots completed 15 monitoring challenges across four operational scenarios in a B737-700 full flight simulator. In addition, the study investigated the impact of having the flight director engaged or disengaged on the pilot monitoring side in the final approach. It was hypothesized that pilots would focus less on the primary flight display with the flight director off and look more around in the cockpit. To assess this, pilots performed half of the scenarios with the flight director on and half with the flight director off. However, pilots monitoring tended to look less at the primary flight display with the flight director on as indicated by lower Proportion Dwell Times, contrary to the hypothesis. Next, eye-tracking data were analyzed from two monitoring challenges involving waypoint restrictions and two involving extending the flaps at appropriate airspeeds. Pilots that successfully completed the challenges appeared to focus more on areas of interest that contained the most relevant information to successfully complete the challenge. In addition, successful pilots seemed to adapt their monitoring strategy more to the challenge at hand as observed by a distinct shift in focus on either the primary flight display or the navigation display depending on the challenge. Our findings suggest the importance of flexible gaze allocation across specific situations and raise the question whether and to what degree prespecified patterns of eye fixation can be identified and trained.

eye tracking↗

Eye-Tracking Analysis from a Flight-Director-Use and Pilot-Monitoring Study

Eye tracking may be a useful tool to investigate pilot monitoring and develop and conduct training. There is increased interest from airlines to use eye-tracking technologies in flight simulators. However, much is still unknown about how to best utilize eye-tracking data in pilot training. This paper presents eye-tracking results from a pilot-monitoring training study with 19 pilots. All pilots completed 15 monitoring challenges across four operational scenarios in a B737-700 full flight simulator. In addition, the study investigated the impact of having the flight director engaged or disengaged on the pilot monitoring side in the final approach. It was hypothesized that pilots would focus less on the primary flight display with the flight director off and look more around in the cockpit. To assess this, pilots performed half of the scenarios with the flight director on and half with the flight director off. However, pilots monitoring tended to look less at the primary flight display with the flight director on as indicated by lower Proportion Dwell Times, contrary to the hypothesis. Next, eye-tracking data were analyzed from two monitoring challenges involving waypoint restrictions and two involving extending the flaps at appropriate airspeeds. Pilots that successfully completed the challenges appeared to focus more on areas of interest that contained the most relevant information to successfully complete the challenge. In addition, successful pilots seemed to adapt their monitoring strategy more to the challenge at hand as observed by a distinct shift in focus on either the primary flight display or the navigation display depending on the challenge. Our findings suggest the importance of flexible gaze allocation across specific situations and raise the question whether and to what degree prespecified patterns of eye fixation can be identified and trained.

eye tracking↗

Eye tracking studies based on attentional-resource effectiveness - 310

In the majority of cases, the primary means of information input to operators in nuclear power plants (NPPs) control rooms is through the visual channel. In this study, eye movement patterns of NPP operators are analyzed with eye tracking data obtained from simulator-based experimental studies. Two eye tracking measures of attentional-resource effectiveness in monitoring and detection tasks in NPPs which had been developed by the authors are introduced and several applications with the two eye tracking measures are discussed for the use of the measures. The underlying principle of the measures is that information sources should be selectively attended according to their importance. One of the two measures is the fixation to importance ratio (FIR), which represents attentional resource (eye fixations) spent on an information source compared to the importance of the information source. The other measure is selective attention effectiveness (SAE), which incorporates the FIRs of all information sources. The FIR represents the effectiveness on an information source, whereas the SAE represents the overall effectiveness on all information sources. Frequency and the duration of eye fixations of an operator on information sources are used as attentional resource. Finally feasible future applications with eye tracking data were discussed in terms of plant systems automation and operator training. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Seeing Comet IRAS with a radar eye

IRAS data in April 1983 held evidence for the approach of a comet which would pass close enough to earth to bounce radar signals off the cometary nucleus. The closest pass was calculated to be 450,000 km. Ephemerides were prepared for the object while radio observatory tracking schedules were arranged. S-band observations were selected for the JPL 64 m antenna to obtain 2.7 arcmin resolution. A 400 kW signal was generated. Two 4 hr observational periods were achieved, revealing a rough, faceted surface by using S-band in the first run and the X-band in the second. The comet was concluded irregularly shaped and roughly elliptical, with a 2 d period.

Jurgens, R. F.↗

Retinally stabilized differential resolution television display

A remote television viewing system employing an eye tracker is disclosed, wherein a small region of the image appears in high resolution, and the remainder of the image appears in low resolution. The eye tracker monitors the position of the viewer's line of sight. The eye tracker position data is transmitted to the remote television camera and control. Both the remote camera and television display are adapted to have selectable high-resolution and low resolution raster scan modes. The position data from the eye tracker is used to determine the point at which the high-resolution scan is to commence. The video data defining the observed image is encoded in a novel format, wherein in each data field, the data representing the position of the high resolution region of predetermined size appears first, followed by the high resolution zone video data and then the low-resolution region data. As the viewer's line of sight relative to the displayed image changes, the position of the high resolution region changes to track the viewer's line of sight.

Ruoff, C. F., Jr.↗

Role of muscle pulleys in producing eye position-dependence in the angular vestibuloocular reflex: a model-based study

It is well established that the head and eye velocity axes do not always align during compensatory vestibular slow phases. It has been shown that the eye velocity axis systematically tilts away from the head velocity axis in a manner that is dependent on eye-in-head position. The mechanisms responsible for producing these axis tilts are unclear. In this model-based study, we aimed to determine whether muscle pulleys could be involved in bringing about these phenomena. The model presented incorporates semicircular canals, central vestibular pathways, and an ocular motor plant with pulleys. The pulleys were modeled so that they brought about a rotation of the torque axes of the extraocular muscles that was a fraction of the angle of eye deviation from primary position. The degree to which the pulleys rotated the torque axes was altered by means of a pulley coefficient. Model input was head velocity and initial eye position data from passive and active yaw head impulses with fixation at 0 degrees, 20 degrees up and 20 degrees down, obtained from a previous experiment. The optimal pulley coefficient required to fit the data was determined by calculating the mean square error between data and model predictions of torsional eye velocity. For active head impulses, the optimal pulley coefficient varied considerably between subjects. The median optimal pulley coefficient was found to be 0.5, the pulley coefficient required for producing saccades that perfectly obey Listing's law when using a two-dimensional saccadic pulse signal. The model predicted the direction of the axis tilts observed in response to passive head impulses from 50 ms after onset. During passive head impulses, the median optimal pulley coefficient was found to be 0.21, when roll gain was fixed at 0.7. The model did not accurately predict the alignment of the eye and head velocity axes that was observed early in the response to passive head impulses. We found that this alignment could be well predicted if the roll gain of the angular vestibuloocular reflex was modified during the initial period of the response, while pulley coefficient was maintained at 0.5. Hence a roll gain modification allows stabilization of the retinal image without requiring a change in the pulley effect. Our results therefore indicate that the eye position-dependent velocity axis tilts could arise due to the effects of the pulleys and that a roll gain modification in the central vestibular structures may be responsible for countering the pulley effect.

NASA Discipline Neuroscience↗

[The Strategic Organization of Skill]

Eye-movement software was developed in addition to several studies that focused on expert-novice differences in the acquisition and organization of skill. These studies focused on how increasingly complex strategies utilize and incorporate visual look-ahead to calibrate action. Software for collecting, calibrating, and scoring eye-movements was refined and updated. Some new algorithms were developed for analyzing corneal-reflection eye movement data that detect the location of saccadic eye movements in space and time. Two full-scale studies were carried out which examined how experts use foveal and peripheral vision to acquire information about upcoming environmental circumstances in order to plan future action(s) accordingly.

Roberts, Ralph↗

Enhancement of Otolith Specific Ocular Responses Using Vestibular Stochastic Resonance

Introduction: Astronauts experience disturbances in sensorimotor function after spaceflight during the initial introduction to a gravitational environment, especially after long-duration missions. Our goal is to develop a countermeasure based on vestibular stochastic resonance (SR) that could improve central interpretation of vestibular input and mitigate these risks. SR is a mechanism by which noise can assist and enhance the response of neural systems to relevant, imperceptible sensory signals. We have previously shown that imperceptible electrical stimulation of the vestibular system enhances balance performance while standing on an unstable surface. Methods: Eye movement data were collected from 10 subjects during variable radius centrifugation (VRC). Subjects performed 11 trials of VRC that provided equivalent tilt stimuli from otolith and other graviceptor input without the normal concordant canal cues. Bipolar stochastic electrical stimulation, in the range of 0-1500 microamperes, was applied to the vestibular system using a constant current stimulator through electrodes placed over the mastoid process behind the ears. In the VRC paradigm, subjects were accelerated to 216 deg./s. After the subjects no longer sensed rotation, the chair oscillated along a track at 0.1 Hz to provide tilt stimuli of 10 deg. Eye movements were recorded for 6 cycles while subjects fixated on a target in darkness. Ocular counter roll (OCR) movement was calculated from the eye movement data during periods of chair oscillations. Results: Preliminary analysis of the data revealed that 9 of 10 subjects showed an average increase of 28% in the magnitude of OCR responses to the equivalent tilt stimuli while experiencing vestibular SR. The signal amplitude at which performance was maximized was in the range of 100-900 microamperes. Discussion: These results indicate that stochastic electrical stimulation of the vestibular system can improve otolith specific responses. This will have a significant impact on development of vestibular SR delivery systems to aid recovery of function in astronauts after long-duration spaceflight or in people with balance disorders.

Fiedler, Matthew↗

Enhanced Video-Oculography System

A previously developed video-oculography system has been enhanced for use in measuring vestibulo-ocular reflexes of a human subject in a centrifuge, motor vehicle, or other setting. The system as previously developed included a lightweight digital video camera mounted on goggles. The left eye was illuminated by an infrared light-emitting diode via a dichroic mirror, and the camera captured images of the left eye in infrared light. To extract eye-movement data, the digitized video images were processed by software running in a laptop computer. Eye movements were calibrated by having the subject view a target pattern, fixed with respect to the subject s head, generated by a goggle-mounted laser with a diffraction grating. The system as enhanced includes a second camera for imaging the scene from the subject s perspective, and two inertial measurement units (IMUs) for measuring linear accelerations and rates of rotation for computing head movements. One IMU is mounted on the goggles, the other on the centrifuge or vehicle frame. All eye-movement and head-motion data are time-stamped. In addition, the subject s point of regard is superimposed on each scene image to enable analysis of patterns of gaze in real time.

Moore, Steven T.↗

Unsupervised Parsing of Gaze Data with a Beta-process Vector Auto-regressive Hidden Markov Model

The first stage of analyzing eye-tracking data is commonly to code the data into sequences of fixations and saccades. This process is usually automated using simple, predetermined rules for classifying ranges of the time series into events, such as “if the dispersion of gaze samples is lower than the threshold, then code as a fixation; otherwise code as a saccade.” More recent approaches incorporate additional eye-movement categories in automated parsing algorithms, particularly glissades, by using time-varying, data-driven thresholds. We describe an alternative approach using the beta-process auto-regressive hidden Markov model (BP-AR-HMM). The BP-AR-HMM offers two main advantages over existing frameworks. First, it provides a statistical model for eye movement classification rather than a single estimate. Second, the BP-AR-HMM uses a latent process to model the number and nature of the types of eye-movements and hence is not constrained to predetermined categories. We applied the BP-AR-HMM both to high-sampling rate gaze data from Andersson, Larsson, Holmqvist, Stridh, and Nyström (2016) and to low-sampling rate data from the DIEM project (Mital, Smith, Hill, & Henderson, 2011). Driven by the data properties, the BP-AR-HMM identified clusters of samples resembling saccades, fixations and smooth pursuit, and a category that approximately corresponds to glissades (as well as blinks, errors, etc.). The BP-AR-HMM serves as an effective algorithm for data-driven event parsing alone or as an initial step in exploring the characteristics of gaze data sets.

eye tracking, fixation, fixation, saccade, smooth ↗

Physiological and Subjective Responses of Pilots During Advanced Air Mobility Flight Testing With Automated Systems

Aviation is constantly evolving, mostly due to the integration of automated systems into the National Airspace System. This presents a host of challenges and opportunities. NASA's Advanced Air Mobility (AAM) project has taken a significant leap forward with a research flight test led by the Integration of Automated Systems (IAS) sub-project. This effort focused on assessing automated flight deck algorithms essential for supporting high-density Urban Air Mobility (UAM) operations. Carrying out a two-ship flight test in UAM Maturity Level 4 scenarios, the team evaluated state-of-the-art algorithms, including Hazard Perception and Avoidance (HPA) and flight path management (FPM) systems. This presentation focuses on results of pilots' physiological and subjective responses during the flight scenarios conducted. In collaboration with Lockheed Martin Advanced Technology Laboratories (ATL), we collected and analyzed live-flight biometric data using eye tracking, mobile brain imaging, and heart rate sensors. The data provides insights into pilots' workload and cognitive engagement while navigating automated tools, leveraging both biometric data and post-encounter subjective assessments. The research highlights the interaction between human operators and automated systems, contributing valuable lessons learned about gathering human data in live-flight environments. The knowledge acquired from this endeavor enhances our understanding of human factors in automated flight and informs future studies attempting to undertake similar feats.

air mobility↗

Approach for Inferring Full-Scope Human Reliability Data Based on Simplified Simulator Data

This paper proposes a method for inferring full-scope human reliability data based on the Simplified Human Error Experimental Program (SHEEP) data. It mainly focuses on the human errors observed when using simulators with different complexity levels. In the proposed method, the manner in which human error probabilities (HEPs) change as a result of increasing simulator complexity and how simulator complexity levels are quantified represent key information for inferring full-scope data. In the present study, SHEEP error data pertaining to actual professional operators using Rancor Microworld (Rancor) (i.e., a more simplified simulator) and Compact Nuclear Simulator (CNS) (i.e., a less simplified simulator) were compared with the HuREX error data. An approach to quantifying simulator complexity levels was then proposed based on information theory and acquired eye-tracker data.

99 - GENERAL AND MISCELLANEOUS↗

Optimal control model predictions of system performance and attention allocation and their experimental validation in a display design study

The influence of different types of predictor displays in a longitudinal vertical takeoff and landing (VTOL) hover task is analyzed in a theoretical study. Several cases with differing amounts of predictive and rate information are compared. The optimal control model of the human operator is used to estimate human and system performance in terms of root-mean-square (rms) values and to compute optimized attention allocation. The only part of the model which is varied to predict these data is the observation matrix. Typical cases are selected for a subsequent experimental validation. The rms values as well as eye-movement data are recorded. The results agree favorably with those of the theoretical study in terms of relative differences. Better matching is achieved by revised model input data.

Johannsen, G.↗

Physiological and Subjective Responses of Pilots during Advanced Air Mobility Flight Testing with Automated Systems

Aviation is constantly evolving, mostly due to the integration of automated systems into the National Airspace System. This presents a host of challenges and opportunities. NASA’s Advanced Air Mobility (AAM) project has taken a significant leap forward with a research flight test led by the Integration of Automated Systems (IAS) sub-project. This effort focused on assessing automated flight deck algorithms essential for supporting high-density Urban Air Mobility (UAM) operations. Carrying out a two-ship flight test in UAM Maturity Level 4 scenarios, the team evaluated state-of-the-art algorithms, including Hazard Perception and Avoidance (HPA) and flight path management (FPM) systems. This paper investigates into pilots’ physiological and subjective responses during the flight scenarios conducted. In collaboration with Lockheed Martin Advanced Technology Laboratories (ATL), we collected and analyzed live-flight biometric data using eye tracking, mobile brain imaging, and heart rate sensors. The study provides insights into pilots’ workload and cognitive engagement while navigating automated tools, leveraging both biometric data and post-encounter subjective assessments. The research highlights the interaction between human operators and automated systems, contributing valuable lessons learned about gathering human data in live-flight environments. The knowledge acquired from this study enhances our understanding of human factors in automated flight and informs future studies attempting to undertake similar feats.

Kevin J. Monk↗

Haar-Like Wavelets on Hierarchical Trees

Here, discrete wavelet methods, originally formulated in the setting of regularly sampled signals, can be adapted to data defined on a point cloud if some multiresolution structure is imposed on the cloud. A wide variety of hierarchical clustering algorithms can be used for this purpose, and the multiresolution structure obtained can be encoded by a hierarchical tree of subsets of the cloud. Prior work introduced the use of Haar-like bases defined with respect to such trees for approximation and learning tasks on unstructured data. This paper builds on that work in two directions. First, we present an algorithm for constructing Haar-like bases on general discrete hierarchical trees. Second, with an eye towards data compression, we present thresholding techniques for data defined on a point cloud with error controlled in the $L$ $\infty$ norm and in a Hölder-type norm. In a concluding trio of numerical examples, we apply our methods to compress a point cloud dataset, study the tightness of the $L$ $\infty$ error bound, and use thresholding to identify MNIST classifiers with good generalizability.

97 MATHEMATICS AND COMPUTING↗

Quantifying Pilot Visual Attention in Low Visibility Terminal Operations

Quantifying pilot visual behavior allows researchers to determine not only where a pilot is looking and when, but holds implications for specific behavioral tracking when these data are coupled with flight technical performance. Remote eye tracking systems have been integrated into simulators at NASA Langley with effectively no impact on the pilot environment. This paper discusses the installation and use of a remote eye tracking system. The data collection techniques from a complex human-in-the-loop (HITL) research experiment are discussed; especially, the data reduction algorithms and logic to transform raw eye tracking data into quantified visual behavior metrics, and analysis methods to interpret visual behavior. The findings suggest superior performance for Head-Up Display (HUD) and improved attentional behavior for Head-Down Display (HDD) implementations of Synthetic Vision System (SVS) technologies for low visibility terminal area operations. Keywords: eye tracking, flight deck, NextGen, human machine interface, aviation

Ellis, Kyle K.↗