Search NASA⌕ Search

SEARCH · Search NASA

Results for “gaze”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Investigating the Link Between Radiologists Gaze, Diagnostic Decision, and Image Content

Objective: To investigate machine learning for linking image content, human perception, cognition, and error in the diagnostic interpretation of mammograms. Methods: Gaze data and diagnostic decisions were collected from six radiologists who reviewed 20 screening mammograms while wearing a head-mounted eye-tracker. Texture analysis was performed in mammographic regions that attracted radiologists attention and in all abnormal regions. Machine learning algorithms were investigated to develop predictive models that link: (i) image content with gaze, (ii) image content and gaze with cognition, and (iii) image content, gaze, and cognition with diagnostic error. Both group-based and individualized models were explored. Results: By pooling the data from all radiologists machine learning produced highly accurate predictive models linking image content, gaze, cognition, and error. Merging radiologists gaze metrics and cognitive opinions with computer-extracted image features identified 59% of the radiologists diagnostic errors while confirming 96.2% of their correct diagnoses. The radiologists individual errors could be adequately predicted by modeling the behavior of their peers. However, personalized tuning appears to be beneficial in many cases to capture more accurately individual behavior. Conclusions: Machine learning algorithms combining image features with radiologists gaze data and diagnostic decisions can be effectively developed to recognize cognitive and perceptual errors associated with the diagnostic interpretation of mammograms.

Tourassi, Georgia↗

Investigating the Association of Eye Gaze Pattern and Diagnostic Error in Mammography

The objective of this study was to investigate the association between eye-gaze patterns and the diagnostic accuracy of radiologists for the task of assessing the likelihood of malignancy of mammographic masses. Six radiologists (2 expert breast imagers and 4 Radiology residents of variable training) assessed the likelihood of malignancy of 40 biopsy-proven mammographic masses (20 malignant and 20 benign) on a computer monitor. Eye-gaze data were collected using a commercial remote eye-tracker. Upon reviewing each mass, the radiologists were also asked to provide their assessment regarding the probability of malignancy of the depicted mass as well as a rating regarding the perceived difficulty of the diagnostic task. The collected data were analyzed using established algorithms and various quantitative metrics were extracted to characterize the recorded gaze patterns. The extracted metrics were correlated with the radiologists diagnostic decisions and perceived complexity scores. Results showed that the visual gaze pattern of radiologists varies substantially, not only depending on their experience level but also among individuals. However, some eye gaze metrics appear to correlate with diagnostic error and perceived complexity more consistently. These results suggest that although gaze patterns are generally associated with diagnostic error and the human perceived difficulty of the diagnostic task, there are substantially individual differences that are not explained simply by the experience level of the individual performing the diagnostic task.

Voisin, Sophie↗

Gaze as a biometric

Two people may analyze a visual scene in two completely different ways. Our study sought to determine whether human gaze may be used to establish the identity of an individual. To accomplish this objective we investigated the gaze pattern of twelve individuals viewing different still images with different spatial relationships. Specifically, we created 5 visual dot-pattern tests to be shown on a standard computer monitor. These tests challenged the viewer s capacity to distinguish proximity, alignment, and perceptual organization. Each test included 50 images of varying difficulty (total of 250 images). Eye-tracking data were collected from each individual while taking the tests. The eye-tracking data were converted into gaze velocities and analyzed with Hidden Markov Models to develop personalized gaze profiles. Using leave-one-out cross-validation, we observed that these personalized profiles could differentiate among the 12 users with classification accuracy ranging between 53% and 76%, depending on the test. This was statistically significantly better than random guessing (i.e., 8.3% or 1 out of 12). Classification accuracy was higher for the tests where the users average gaze velocity per case was lower. The study findings support the feasibility of using gaze as a biometric or personalized biomarker. These findings could have implications in Radiology training and the development of personalized e-learning environments.

eye tracking↗

Gaze Estimation for Off-Angle Iris Recognition Based on the Biometric Eye Model

Iris recognition is among the highest accuracy biometrics. However, its accuracy relies on controlled high quality capture data and is negatively affected by several factors such as angle, occlusion, and dilation. Non-ideal iris recognition is a new research focus in biometrics. In this paper, we present a gaze estimation method designed for use in an off-angle iris recognition framework based on the ANONYMIZED biometric eye model. Gaze estimation is an important prerequisite step to correct an off-angle iris images. To achieve the accurate frontal reconstruction of an off-angle iris image, we first need to estimate the eye gaze direction from elliptical features of an iris image. Typically additional information such as well-controlled light sources, head mounted equipment, and multiple cameras are not available. Our approach utilizes only the iris and pupil boundary segmentation allowing it to be applicable to all iris capture hardware. We compare the boundaries with a look-up-table generated by using our biologically inspired biometric eye model and find the closest feature point in the look-up-table to estimate the gaze. Based on the results from real images, the proposed method shows effectiveness in gaze estimation accuracy for our biometric eye model with an average error of approximately 3.5 degrees over a 50 degree range.

Karakaya, Mahmut↗

Eye Gaze Tracking using Correlation Filters

In this paper, we studied a method for eye gaze tracking that provide gaze estimation from a standard webcam with a zoom lens and reduce the setup and calibration requirements for new users. Specifically, we have developed a gaze estimation method based on the relative locations of points on the top of the eyelid and eye corners. Gaze estimation method in this paper is based on the distances between top point of the eyelid and eye corner detected by the correlation filters. Advanced correlation filters were found to provide facial landmark detections that are accurate enough to determine the subjects gaze direction up to angle of approximately 4-5 degrees although calibration errors often produce a larger overall shift in the estimates. This is approximately a circle of diameter 2 inches for a screen that is arm s length from the subject. At this accuracy it is possible to figure out what regions of text or images the subject is looking but it falls short of being able to determine which word the subject has looked at.

Karakaya, Mahmut↗

Deep Gaze Velocity Analysis During Mammographic Reading for Biometric Identification of Radiologists

Several studies have confirmed that the gaze velocity of the human eye can be utilized as a behavioral biometric or personalized biomarker. In this study, we leverage the local feature representation capacity of convolutional neural networks (CNNs) for eye gaze velocity analysis as the basis for biometric identification of radiologists performing breast cancer screening. Using gaze data collected from 10 radiologists reading 100 mammograms of various diagnoses, we compared the performance of a CNN-based classification algorithm with two deep learning classifiers, deep neural network and deep belief network, and a previously presented hidden Markov model classifier. The study showed that the CNN classifier is superior compared to alternative classification methods based on macro F1-scores derived from 10-fold cross-validation experiments. Our results further support the efficacy of eye gaze velocity as a biometric identifier of medical imaging experts.

59 BASIC BIOLOGICAL SCIENCES↗

Unsupervised Parsing of Gaze Data with a Beta-process Vector Auto-regressive Hidden Markov Model

The first stage of analyzing eye-tracking data is commonly to code the data into sequences of fixations and saccades. This process is usually automated using simple, predetermined rules for classifying ranges of the time series into events, such as “if the dispersion of gaze samples is lower than the threshold, then code as a fixation; otherwise code as a saccade.” More recent approaches incorporate additional eye-movement categories in automated parsing algorithms, particularly glissades, by using time-varying, data-driven thresholds. We describe an alternative approach using the beta-process auto-regressive hidden Markov model (BP-AR-HMM). The BP-AR-HMM offers two main advantages over existing frameworks. First, it provides a statistical model for eye movement classification rather than a single estimate. Second, the BP-AR-HMM uses a latent process to model the number and nature of the types of eye-movements and hence is not constrained to predetermined categories. We applied the BP-AR-HMM both to high-sampling rate gaze data from Andersson, Larsson, Holmqvist, Stridh, and Nyström (2016) and to low-sampling rate data from the DIEM project (Mital, Smith, Hill, & Henderson, 2011). Driven by the data properties, the BP-AR-HMM identified clusters of samples resembling saccades, fixations and smooth pursuit, and a category that approximately corresponds to glissades (as well as blinks, errors, etc.). The BP-AR-HMM serves as an effective algorithm for data-driven event parsing alone or as an initial step in exploring the characteristics of gaze data sets.

eye tracking, fixation, fixation, saccade, smooth ↗

SU-E-J-187: Management of Optic Organ Motion in Fractionated Stereotactic Radiotherapy

Purpose: Fractionated stereotactic radiotherapy (FSRT) for optic nerve tumors can potentially use planning target volume (PTV) expansions as small as 1–5 mm. However, the motion of the intraorbital segment of the optic nerve has not been studied. Methods: A subject with a right optic nerve sheath meningioma underwent CT simulation in three fixed gaze positions: right, left, and fixed forward at a marker. The gross tumor volume (GTV) and the organs-at-risk (OAR) were contoured on all three scans. An IMRT plan using 10 static non-coplanar fields to 50.4 Gy in 28 fractions was designed to treat the fixed-forward gazing GTV with a 1 mm PTV, then resulting coverage was evaluated for the GTV in the three positions. As an alternative, the composite structures were computed to generate the internal target volume (ITV), 1 mm expansion free-gazing PTV, and planning organat-risk volumes (PRVs) for free-gazing treatment. A comparable IMRT plan was created for the free-gazing PTV. Results: If the patient were treated using the fixed forward gaze plan looking straight, right, and left, the V100% for the GTV was 100.0%, 33.1%, and 0.1%, respectively. The volumes of the PTVs for fixed gaze and free-gazing plans were 0.79 and 2.21 cc, respectively, increasing the PTV by a factor of 2.6. The V100% for the fixed gaze and free-gazing plans were 0.85 cc and 2.8 cc, respectively increasing the treated volume by a factor of 3.3. Conclusion: Fixed gaze treatment appears to provide greater organ sparing than free-gazing. However unanticipated intrafraction right or left gaze can produce a geometric miss. Further study of optic nerve motion appears to be warranted in areas such as intrafraction optical confirmation of fixed gaze and optimized gaze directions to minimize lens and other normal organ dose in cranial radiotherapy.

60 APPLIED LIFE SCIENCES↗

Predicting diagnostic error in radiology via eye-tracking and image analytics: Preliminary investigation in mammography

Purpose: The primary aim of the present study was to test the feasibility of predicting diagnostic errors in mammography by merging radiologists’ gaze behavior and image characteristics. A secondary aim was to investigate group-based and personalized predictive models for radiologists of variable experience levels.Methods: The study was performed for the clinical task of assessing the likelihood of malignancy of mammographic masses. Eye-tracking data and diagnostic decisions for 40 cases were acquired from four Radiology residents and two breast imaging experts as part of an IRB-approved pilot study. Gaze behavior features were extracted from the eye-tracking data. Computer-generated and BIRADS images features were extracted from the images. Finally, machine learning algorithms were used to merge gaze and image features for predicting human error. Feature selection was thoroughly explored to determine the relative contribution of the various features. Group-based and personalized user modeling was also investigated.Results: Machine learning can be used to predict diagnostic error by merging gaze behavior characteristics from the radiologist and textural characteristics from the image under review. Leveraging data collected from multiple readers produced a reasonable group model [area under the ROC curve (AUC) = 0.792 ± 0.030]. Personalized user modeling was far more accurate for the more experienced readers (AUC = 0.837 ± 0.029) than for the less experienced ones (AUC = 0.667 ± 0.099). The best performing group-based and personalized predictive models involved combinations of both gaze and image features.Conclusions: Diagnostic errors in mammography can be predicted to a good extent by leveraging the radiologists’ gaze behavior and image content.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Monolingual but not bilingual infants demonstrate racial bias in social cue use

Abstract Bilingualism exerts early and pervasive effects on cognition, observable in infancy. Thus far, investigations of infant bilingual cognition have focused on sensitivity to visual memory, executive function, and linguistic sensitivity. Much less research has focused on how bilingualism impacts processing of social cues. The present study sought to investigate whether bilingualism modulates the expression of one aspect of social processing: early racial bias. Using a gaze‐following paradigm, we investigated whether 18‐ to 20‐month‐old monolingual and bilingual infants favored their own race. Results demonstrated that monolingual infants favored their own race in following a model whose direction of gaze signaled an event. In contrast, bilingual infants demonstrated race‐neutral gaze‐following patterns, relying more heavily on the reliability of the behavior of the model over race. Findings suggest that bilingualism may have protective effects against the early emergence of racial bias.

Singh, Leher↗

SU-E-CAMPUS-T-01: Analysis of the Precision of Patient Set-Up, and Fidelity of the Delivered Dose Distribution in Proton Therapy of Ocular Tumors

Purpose: To quantify daily set-up variations in fractionated proton therapy of ocular melanomas, and to assess the effect on the fidelity of delivered distribution to the plan. Methods: In a typical five-fraction course, daily set-up is achieved by matching the position of fiducial markers in orthogonal radiographs to the images generated by treatment planning program. A patient maintains the required gaze direction voluntarily, without the aid of fixation devices. Confirmation radiographs are acquired to assess intrafractional changes. For this study, daily radiographs were analyzed to determine the daily iso-center position and apparent gaze direction, which were then transferred to the planning system to calculate the dose delivered in individual fractions, and accumulated dose for the entire course. Dose-volume metrics were compared between the planned and accumulated distributions for the tumor and organs at risk, for representative cases that varied by location within the ocular globe. Results: The analysis of the first set of cases (3 posterior, 3 transequatorial and 4 anterior tumors) revealed varying dose deviation patterns, depending on the tumor location. For anterior and posterior tumors, the largest dose increases were observed in the lens and ciliary body, while for the equatorial tumors, macula, optic nerve and disk, were most often affected. The iso-center position error was below 1.3 mm (95%-confidence interval), and the standard deviation of daily polar and azimuthal gaze set-up were 1.5 and 3 degrees, respectively. Conclusion: We quantified interfractional and intrafractional set-up variation, and estimated their effect on the delivered dose for representative cases. Current safety margins are sufficient to maintain the target coverage, however, the dose delivered to critical structures often deviates from the plan. The ongoing analysis will further explore the patterns of dose deviation, and may help to identify particular treatment scenarios which are at a higher risk for such deviations.

60 APPLIED LIFE SCIENCES↗

Employing Eye Trackers to Reduce Nuisance Alarms

When process operators anticipate an alarm prior to its annunciation, that alarm loses information value and becomes a nuisance. This study investigated using eye trackers to measure and adjust the salience of alarms with three methods of gaze-based acknowledgement (GBA) of alarms that estimate operator anticipation. When these methods detected possible alarm anticipation, the alarm’s audio and visual salience was reduced. A total of 24 engineering students (male = 14, female = 10) aged between 18 and 45 were recruited to predict alarms and control a process parameter in three scenario types (parameter near threshold, trending, or fluctuating). The study evaluated whether behaviors of the monitored parameter affected how frequently the three GBA methods were utilized and whether reducing alarm salience improved control task performance. The results did not show significant task improvement with any GBA methods (F(3,69) = 1.357, p = 0.263, partial η 2 = 0.056). However, the scenario type affected which GBA method was more utilized (X 2 (2, N = 432) = 30.147, p < 0.001). Alarm prediction hits with gaze-based acknowledgements coincided more frequently than alarm prediction hits without gaze-based acknowledgements (X 2 (1, N = 432) = 23.802, p < 0.001, OR = 3.877, 95% CI 2.25–6.68, p < 0.05). Participant ratings indicated an overall preference for the three GBA methods over a standard alarm design (F(3,63) = 3.745, p = 0.015, partial η 2 = 0.151). This study provides empirical evidence for the potential of eye tracking in alarm management but highlights the need for additional research to increase validity for inferring alarm anticipation.

99 - GENERAL AND MISCELLANEOUS↗

GazeAppraise v. 0.1

GazeAppraise advances the state of the art of gaze pattern analysis using methods that simultaneously analyze spatial and temporal characteristics of gaze patterns. GazeAppraise enables novel research in visual perception and cognition; for example, using shape features as distinguishing elements to assess individual differences in visual search strategy. Given a set of point-to-point gaze sequences, hereafter referred to as scanpaths, the method constructs multiple descriptive features for each scanpath. Once the scanpath features have been calculated, they are used to form a multidimensional vector representing each scanpath and cluster analysis is performed on the set of vectors from all scanpaths. An additional benefit of this method is the identification of causal or correlated characteristics of the stimuli, subjects, and visual task through statistical analysis of descriptive metadata distributions within and across clusters.

Wilson, Andrew↗

Fractal Analysis of Radiologists Visual Scanning Pattern in Screening Mammography

Several investigators have investigated radiologists visual scanning patterns with respect to features such as total time examining a case, time to initially hit true lesions, number of hits, etc. The purpose of this study was to examine the complexity of the radiologists visual scanning pattern when viewing 4-view mammographic cases, as they typically do in clinical practice. Gaze data were collected from 10 readers (3 breast imaging experts and 7 radiology residents) while reviewing 100 screening mammograms (24 normal, 26 benign, 50 malignant). The radiologists scanpaths across the 4 mammographic views were mapped to a single 2-D image plane. Then, fractal analysis was applied on the derived scanpaths using the box counting method. For each case, the complexity of each radiologist s scanpath was estimated using fractal dimension. The association between gaze complexity, case pathology, case density, and radiologist experience was evaluated using 3 factor fixed effects ANOVA. ANOVA showed that case pathology, breast density, and experience level are all independent predictors of the visual scanning pattern complexity. Visual scanning patterns are significantly different for benign and malignant cases than for normal cases as well as when breast parenchyma density changes.

fractal analysis↗

Fractal Analysis of Visual Search Activity for Mass Detection During Mammographic Screening

Purpose: The objective of this study was to assess the complexity of human visual search activity during mammographic screening using fractal analysis and to investigate its relationship with case and reader characteristics. Methods: The study was performed for the task of mammographic screening with simultaneous viewing of four coordinated breast views as typically done in clinical practice. Eye-tracking data and diagnostic decisions collected for 100 mammographic cases (25 normal, 25 benign, 50 malignant) and 10 readers (three board certified radiologists and seven radiology residents), formed the corpus data for this study. The fractal dimension of the readers’ visual scanning patterns was computed with the Minkowski–Bouligand box-counting method and used as a measure of gaze complexity. Individual factor and group-based interaction ANOVA analysis was performed to study the association between fractal dimension, case pathology, breast density, and reader experience level. The consistency of the observed trends depending on gaze data representation was also examined. Results: Case pathology, breast density, reader experience level, and individual reader differences are all independent predictors of the visual scanning pattern complexity when screening for breast cancer. No higher order effects were found to be significant. Conclusions: Fractal characterization of visual search behavior during mammographic screening is dependent on case properties and image reader characteristics.

47 OTHER INSTRUMENTATION↗

Assessing the Impact of Corneal Refraction and Iris Tissue Non-planarity on Iris Recognition

Assumptions regarding eye morphology are implicit in iris recognition algorithms. The cornea is assumed to have little to no effect on the view of the iris texture when the eye gaze is non-frontal, the iris is assumed flat, and the eye is assumed to be imaged via an orthographic projection. If these assumptions hold, affine transformations may be used to rectify non-frontally posed images to a frontal view and the rubber sheet model may be accurately used to normalize the iris annulus to a rectangular image. This work examines how iris recognition performance degrades when the first two assumptions are violated. Using a computer renderable eye model, a data set is created varying the presence of the cornea and a parameterized non-planarity of the iris shape across a large range of eye gaze angles. Matching scores are created using a commercial matcher. Thus, when comparing the relative impact of each assumption violation, it is observed that iris non-planarity presents a more significant problem than corneal refractive distortion with regard to iris recognition accuracy in non-frontal images.

59 BASIC BIOLOGICAL SCIENCES↗