Saliency-driven system models for cell analysis with deep learning
Not Available
60 APPLIED LIFE SCIENCES↗
SEARCH · Search NASA
Results for “eye tracking experiment”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Out of the Corner of My Eye: Foveal Semantic Load Modulates Parafoveal Processing in Reading.
In two experiments, we examined the impact of foveal semantic expectancy and congruity on parafoveal word processing during reading. Experiment 1 utilized an eye-tracking gaze contingent display change paradigm, and Experiment 2 measured event-related brain potentials (ERP) in a modified RSVP paradigm to track the time-course of foveal semantic influences on convert attentional allocation to parafoveal word processing. Furthermore, eye-tracking and ERP data converged to reveal graded effects of semantic foveal load on parafoveal processing.
97 MATHEMATICS AND COMPUTING↗
Modeling sequential context effects in diagnostic interpretation of screening mammograms
Prior research has shown that physicians’ medical decisions can be influenced by sequential context, particularly in cases where successive stimuli exhibit similar characteristics when analyzing medical images. This type of systematic error is known to psychophysicists as sequential context effect as it indicates that judgments are influenced by features of and decisions about the preceding case in the sequence of examined cases, rather than being based solely on the peculiarities unique to the present case. We determine if radiologists experience some form of context bias, using screening mammography as the use case. To this end, we explore correlations between previous perceptual behavior and diagnostic decisions and current decisions. We hypothesize that a radiologist’s visual search pattern and diagnostic decisions in previous cases are predictive of the radiologist’s current diagnostic decisions. To test our hypothesis, we tasked 10 radiologists of varied experience to conduct blind reviews of 100 four-view screening mammograms. Eye-tracking data and diagnostic decisions were collected from each radiologist under conditions mimicking clinical practice. Perceptual behavior was quantified using the fractal dimension of gaze scanpath, which was computed using the Minkowski–Bouligand box-counting method. To test the effect of previous behavior and decisions, we conducted a multifactor fixed-effects ANOVA. Further, to examine the predictive value of previous perceptual behavior and decisions, we trained and evaluated a predictive model for radiologists’ current diagnostic decisions. ANOVA tests showed that previous visual behavior, characterized by fractal analysis, previous diagnostic decisions, and image characteristics of previous cases are significant predictors of current diagnostic decisions. Additionally, predictive modeling of diagnostic decisions showed an overall improvement in prediction error when the model is trained on additional information about previous perceptual behavior and diagnostic decisions.
60 APPLIED LIFE SCIENCES↗
Electromagnetic guided couch and multileaf collimator tracking on a TrueBeam accelerator
Purpose: Couch and MLC tracking are two promising methods for real-time motion compensation during radiation therapy. So far, couch and MLC tracking experiments have mainly been performed by different research groups, and no direct comparison of couch and MLC tracking of volumetric modulated arc therapy (VMAT) plans has been published. The Varian TrueBeam 2.0 accelerator includes a prototype tracking system with selectable couch or MLC compensation. This study provides a direct comparison of the two tracking types with an otherwise identical setup. Methods: Several experiments were performed to characterize the geometric and dosimetric performance of electromagnetic guided couch and MLC tracking on a TrueBeam accelerator equipped with a Millennium MLC. The tracking system latency was determined without motion prediction as the time lag between sinusoidal target motion and the compensating motion of the couch or MLC as recorded by continuous MV portal imaging. The geometric and dosimetric tracking accuracies were measured in tracking experiments with motion phantoms that reproduced four prostate and four lung tumor trajectories. The geometric tracking error in beam’s eye view was determined as the distance between an embedded gold marker and a circular MLC aperture in continuous MV images. The dosimetric tracking error was quantified as the measured 2%/2 mm gamma failure rate of a low and a high modulation VMAT plan delivered with the eight motion trajectories using a static dose distribution as reference. Results: The MLC tracking latency was approximately 146 ms for all sinusoidal period lengths while the couch tracking latency increased from 187 to 246 ms with decreasing period length due to limitations in the couch acceleration. The mean root-mean-square geometric error was 0.80 mm (couch tracking), 0.52 mm (MLC tracking), and 2.75 mm (no tracking) parallel to the MLC leaves and 0.66 mm (couch), 1.14 mm (MLC), and 2.41 mm (no tracking) perpendicular to the leaves. The motion-induced gamma failure rate was in mean 0.1% (couch tracking), 8.1% (MLC tracking), and 30.4% (no tracking) for prostate motion and 2.9% (couch), 2.4% (MLC), and 41.2% (no tracking) for lung tumor motion. The residual tracking errors were mainly caused by inadequate adaptation to fast lung tumor motion for couch tracking and to prostate motion perpendicular to the MLC leaves for MLC tracking. Conclusions: Couch and MLC tracking markedly improved the geometric and dosimetric accuracies of VMAT delivery. However, the two tracking types have different strengths and weaknesses. While couch tracking can correct perfectly for slowly moving targets such as the prostate, MLC tracking may have considerably larger dose errors for persistent target shift perpendicular to the MLC leaves. Advantages of MLC tracking include faster dynamics with better adaptation to fast moving targets, the avoidance of moving the patient, and the potential to track target rotations and deformations.
60 APPLIED LIFE SCIENCES↗
Event-related brain potentials reveal how multiple aspects of semantic processing unfold across parafoveal and foveal vision during sentence reading
Recent event–related brain potential (ERP) experiments have demonstrated parafoveal N400 expectancy and congruity effects, showing that semantic information can be accessed from words in parafoveal vision (a conclusion also supported by some eye–tracking work). At the same time, it is unclear how higher–order integrative aspects of language comprehension unfold across the visual field during reading. In the current study, we recorded ERPs in a parafoveal flanker paradigm, while readers were instructed to read passively for comprehension or to judge the plausibility of sentences in which target words varied in their semantic expectancy and congruity. We directly replicated prior work showing graded N400 effects for parafoveal viewing, which are then not duplicated when the target words are processed foveally. Critically, although N400 effects were not modulated by task goals, a posteriorly distributed late positive component thought to reflect semantic integration processes was observed to semantic incongruities only in the plausibility judgment task. Furthermore, this effect was observed at a considerable delay, appearing only after words had moved into foveal vision. Our findings thus suggest that semantic access can be initiated in parafoveal vision, whereas central foveal vision may be necessary to enact higher–order (and task–dependent) integrative processing.
60 APPLIED LIFE SCIENCES↗
Industrial Energy Assessment Training Effectiveness Evaluation: An Eye-Tracking Study
It is essential to understand the effectiveness of any training program so it can be improved accordingly. Various studies have applied standard metrics for the evaluation of visual behavior to recognize the areas of interest that attract individuals’ attention as there is a high correlation between attentional behavior and where one is focusing on. However, through reviewing the literature, we believe that studies that applied eye-tracking technologies for training purposes are still limited, especially in the industrial energy assessment training field. In this paper, the effectiveness of industrial energy assessment training was quantitatively evaluated by measuring the attentional allocation of trainees using eye-tracking technology. Moreover, this study identifies the areas that require more focus based on evaluating the performance of subjects after receiving the training. Additionally, this research was conducted in a controlled environment to remove the distractions that may be caused by environmental factors to only concentrate on variables that influence the learning behavior of subjects. The experiment results showed that after receiving the training, the subjects’ performance in energy assessment was significantly improved in two areas: production, and recycling and waste management, and the designed training program enhanced the knowledge of participants in identifying energy-saving opportunities to the knowledge level of experienced participants.
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
Evaluation of Visualization Heuristics
Heuristics have been used since the early 1990's in the Human Computer Interaction (HCI) domain, for evaluating user interfaces. Most notably, heuristics developed by Nielsen and Molich (1990) have been used by the HCI community. Forsell and Johansson (2010) used the same methodology as Nielsen and Molich and developed a set of 10 heuristics for information visualization. Currently, neither the information visualization or the visual analytics community has adopted these heuristics. However, several studies have been conducted using heuristics. Hearst et al. (2015) found that using the heuristics for visualizations along with asking questions about the data resulted in complementary results as the questions about the data could compensate for heuristics that were difficult to understand and apply. Heli Väätäjä et al. (2016) found that heuristics related to interaction, veracity, and aesthetics needed to be added to the Forsell and Johansson (2010) set. They also noted that a lack of domain knowledge caused the evaluators issues in conducting a heuristic evaluation. We conducted a controlled experiment to determine what factors might impact the expert evaluators' capability to conduct a heuristic evaluation of a static information visualization. In particular, we wanted to understand how their familiarity with the visualizations and their experience in conducting heuristic evaluations impacted their evaluations of visualizations. We recruited 10 participants who were domain experts in the visualization field each having experience with one of more of the following: user experience design or research, user interface development, and human computer interaction research. We used a heuristic set proposed by Forsell and Johansson. Participants were also asked to complete a demographic survey in which they rated their experience with each visualization type generally, their experience conducting heuristic evaluations, their experience using each visualization type to extract information, and their experience developing and creating each visualization type. The participants were shown a series of 5 common visualizations (Scatterplots, Sunbursts, Tree Maps, Parallel Sets, and Area Graphs) all displaying the VAST 2008 Mini Challenge Two- Migrant Boats data . Participants were given a suggested analytical question related to each visualization to keep in mind as they applied the 10 heuristics to each visualization. They were asked if they could find any usability problems in the visualizations and which heuristic(s) helped them to identify these problems. The participants were asked to rate how relevant each heuristic was for evaluating each visualization along with rating how confident they felt in their ability to apply the heuristic to evaluate each visualization. At the conclusion of the study, participants provided qualitative feedback on the usability issues of each visualization. Additionally, we collected eye tracking data on 6 of the 10 participants. We will be using this data to determine how long participants looked at the various visualizations and what parts of the visualizations they focused on. We had two hypotheses for this empirical evaluation: 1.The Forsell and Johansson heuristics of Orientation and help, Data set reduction, and Prompting are less useful for static visualizations because they require some interaction in order to test completely. 2.Participants that do not have experience with heuristic evaluation will provide lower evaluation scores for the heuristics compared to those that have experience. Related to hypothesis 1, as our study used only static visualizations, interaction-related usability challenges should be harder to identify. This should result in lower usefulness ratings for those heuristics. Preliminary results indicate that participants found it more difficult to apply heuristics to unfamiliar visualizations.
Williams, Ryan G.↗
Do morphemes matter when reading compound words with transposed letters? Evidence from eye-tracking and event-related potentials
We investigate the online processing consequences of encountering compound words with transposed letters (TLs), in order to determine if cross-morpheme TLs are more disruptive to reading than those within a single morpheme, as would be predicted by accounts of obligatory morpho-orthopgrahic decomposition. Two measures of online processing, eye movements and event-related potentials (ERPs), were collected in separate experiments. Participants read sentences containing correctly spelled compound words (cupcake), or compounds with TLs occurring either across morphemes (cucpake) or within one morpheme (cupacke). Results showed that between- and within-morpheme transpositions produced equal processing costs in both measures, in the form of longer reading times (Experiment 1) and a late posterior positivity (Experiment 2) that did not differ between conditions. Our findings converge to suggest that within- and between-morpheme TLs are equally disruptive to recognition, providing evidence against obligatory morpho-orthographic processing and in favour of whole-word access of English compound words during sentence reading.
97 MATHEMATICS AND COMPUTING↗
Deep Gaze Velocity Analysis During Mammographic Reading for Biometric Identification of Radiologists
Several studies have confirmed that the gaze velocity of the human eye can be utilized as a behavioral biometric or personalized biomarker. In this study, we leverage the local feature representation capacity of convolutional neural networks (CNNs) for eye gaze velocity analysis as the basis for biometric identification of radiologists performing breast cancer screening. Using gaze data collected from 10 radiologists reading 100 mammograms of various diagnoses, we compared the performance of a CNN-based classification algorithm with two deep learning classifiers, deep neural network and deep belief network, and a previously presented hidden Markov model classifier. The study showed that the CNN classifier is superior compared to alternative classification methods based on macro F1-scores derived from 10-fold cross-validation experiments. Our results further support the efficacy of eye gaze velocity as a biometric identifier of medical imaging experts.
59 BASIC BIOLOGICAL SCIENCES↗
Fractal Analysis of Visual Search Activity for Mass Detection During Mammographic Screening
Purpose: The objective of this study was to assess the complexity of human visual search activity during mammographic screening using fractal analysis and to investigate its relationship with case and reader characteristics. Methods: The study was performed for the task of mammographic screening with simultaneous viewing of four coordinated breast views as typically done in clinical practice. Eye-tracking data and diagnostic decisions collected for 100 mammographic cases (25 normal, 25 benign, 50 malignant) and 10 readers (three board certified radiologists and seven radiology residents), formed the corpus data for this study. The fractal dimension of the readers’ visual scanning patterns was computed with the Minkowski–Bouligand box-counting method and used as a measure of gaze complexity. Individual factor and group-based interaction ANOVA analysis was performed to study the association between fractal dimension, case pathology, breast density, and reader experience level. The consistency of the observed trends depending on gaze data representation was also examined. Results: Case pathology, breast density, reader experience level, and individual reader differences are all independent predictors of the visual scanning pattern complexity when screening for breast cancer. No higher order effects were found to be significant. Conclusions: Fractal characterization of visual search behavior during mammographic screening is dependent on case properties and image reader characteristics.
47 OTHER INSTRUMENTATION↗
Infrared-Fused Vision-Based Thermoregulation Performance Estimation for Personal Thermal Comfort-Driven HVAC System Controls
Thermal comfort is one of the primary factors influencing occupant health, well-being, and productivity in buildings. Existing thermal comfort systems require occupants to frequently communicate their comfort vote via a survey which is impractical as a long-term solution. Here, we present a novel thermal infrared-fused computer vision sensing method to capture thermoregulation performance in a non-intrusive and non-invasive manner. In this method, we align thermal and visible images, detect facial segments (i.e., nose, eyes, face boundary), and accordingly read the temperatures from the appropriate coordinates in the thermal image. We focus on the human face since it is often clearly visible to cameras and is not merged into a hot background (unlike hands). We use a regularized Gaussian Mixture model to track the thermoregulation changes over time and apply a heuristic algorithm to extract hot and cold indices. We present a personalized and a generalized comfort modeling method, selected based on the availability of the occupant historical indices measurements in a neutral environment, and use the time-series of the hot and cold indices to define corrections to HVAC system operations in the form of setpoint constraints. To evaluate the efficacy of our proposed approach in responding to thermal stimuli, we designed a series of controlled experiments to simulate exposure to cold and hot environments. While applying personalized modeling showed an acceptable average accuracy of 91.3%, the generalized model’s average accuracy was only 65.2%. This shows the importance of having access to physiological records in modeling and assessing comfort. We also found that individual differences should be considered in selecting the cooling and heating rates when some knowledge of the occupant’s overall thermal preference is available.
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
Standoff Detection of Chemical Plumes Using Swept-ECQCL Remote Detection Technology: Results from EMRTC Complex Terrain Dual Tracer Experiment
As part of the Complex Terrain Dual Tracer Experiments performed in support of the LYNM program, a swept-wavelength external cavity quantum cascade laser (swept-ECQCL) remote detection system was deployed to measure chemical plume propagation with high temporal resolution. The swept-ECQCL remote detection technology was initially developed at PNNL, and is now under further development at Opticslah, LLC under SBIR funding from DOE (DOE SBIR Phase I Project DE-SC0019855, Remote Detection Technologies, Program Manager Chris Ramos). The swept-ECQCL technology provides a single-frequency infrared laser source which is rapidly scanned over a large wavelength range to measure the infrared absorption of gases, liquids, or solids. Analysis of the measured infrared absorption spectrum is used to detect, identify, and quantify the chemical species which are present. While most previous laser-based techniques used small wavelength tuning ranges to measure only a few isolated spectral lines of a few species, the swept-ECQCL provides the large tuning range needed to measure multiple species simultaneously, and to detect broad absorption features from large molecules or condensed phase materials. In addition, the swept-ECQCL systems have high enough spectral resolution and sensitivity to measure narrow lines of small molecules and determine isotope ratios. The remote detection system for gas plumes is based on the swept-ECQCL technology, and consists of a swept-ECQCL source, infrared detector, control electronics, and beam transmitting and alignment optics. The remote detection system directs the infrared output of the swept-ECQCL to a target retro reflector typically located at ~10-10,000 m distance. The swept-ECQCL wavelength is varied continuously over a large wavelength range (>1000 nm) at rates up to 1000 Hz. The swept ECQCL light reflected from the remote target is collected and focused onto an infrared photodetector. By measuring the detector signal continuously as the swept-ECQCL wavelength is varied, a time-series of absorption spectra are measured for the gases along the beam line of-sight. Based on analysis and fitting of the measured absorption spectra, the time-dependent chemical concentrations of species are determined. Multiple species and mixtures can be detected simultaneously, for all species with absorption features above the sensor noise floor. The sensor output is thus a continuous, high-speed record of identified chemicals along with their concentrations and isotope ratios of interest. The high-speed operation enables low-noise operation in conditions of atmospheric turbulence and allows tracking of fluctuating concentrations in transient chemical plumes as needed for reliable remote detection applications. All components operate with minimal cooling requirements and no cryogens are needed. In addition, the output infrared light is invisible with an intensity below the maximum permissible exposure (MPE) threshold of 100 mW/cm2 for these infrared wavelengths and thus eye safe. The measurement concept for plume detection using the swept-ECQCL remote detection system is as follows. The ECQCL beam is directed toward a remote retro-reflector, which reflects the beam back to the ECQCL system where it is focused onto an infrared photodetector. The line-of-sight from the ECQCL system to the retro-reflector defines the measurement path. The detected infrared signal is recorded continuously and detects the absorption of molecular species along the measurement path. Before a plume release, the system measures absorption from atmospheric constituents, which in this LWIR band consist primarily of lines from H 2 O and CO 2 , with additional weaker absorption from N 2 O, NH 3 , and O 3 possibly contributing. The system then measures any changes in absorption due to the tracer compounds when they enter the measurement path. The shape of absorption features is used to distinguish and identify the different tracer compounds, and the strength of the absorption is used to determine the path-integrated concentration – also called the column density.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗