Verghese, Preeti | Search NASA

NASA NTRS2005

An information maximization model of eye movements

We propose a sequential information maximization model as a general strategy for programming eye movements. The model reconstructs high-resolution visual information from a sequence of fixations, taking into account the fall-off in resolution from the fovea to the periphery. From this framework we get a simple rule for predicting fixation sequences: after each fixation, fixate next at the location that minimizes uncertainty (maximizes information) about the stimulus. By comparing our model performance to human eye movement data and to predictions from a saliency and random model, we demonstrate that our model is best at predicting fixation locations. Modeling additional biological constraints will improve the prediction of fixation sequences. Our results suggest that information maximization is a useful principle for programming eye movements.

NASA Discipline Neuroscience↗

NASA NTRS2002

Integration of speed signals in the direction of motion

Speed discrimination tasks were used to examine the spatial and temporal characteristics of the integration mechanism involved when signals are extended in the direction of motion. We varied the aspect ratio of a signal patch whose speed differed from the background, while holding the area of the signal patch constant, so that the signal patch could be either extended in the direction of motion or extended orthogonal to the direction of motion. Speed discrimination thresholds decreased dramatically as the signal patch was extended in the direction of motion. The spatial and temporal integration regions were larger than would be expected if the integration mechanism were a low-level motion detector. The mechanism was tuned for direction of motion. The data are discussed with reference to two alternative integration mechanisms: a low-level detector that is elongated in the direction of motion and a higher level integration mechanism characterized by cooperative or facilitatory interactions between low-level detectors tuned to the same direction of motion. Our data are consistent with a second-level, direction-specific process that integrates the responses of low-level motion detectors.

NASA Discipline Space Human Factors↗

NASA NTRS2002

Contour completion through depth interferes with stereoacuity

Local disparity signals must interact in visual cortex to represent boundaries and surfaces of three-dimensional (3D) objects. We investigated how disparity signals interact in 3D contours and in 3D surfaces generated from the contours. We compared flat (single disparity) stimuli with curved (multi-disparity) stimuli. We found no consistent differences in sensitivity to contours vs. surfaces; for equivalent amounts of disparity, however, observers were more sensitive to flat stimuli than curved stimuli. Poor depth sensitivity for curved stimuli cannot be explained by the larger range of disparities present in the curved surface, nor by disparity averaging, nor by poor sensitivity to the largest disparity in the stimulus. Surprisingly, sensitivity to surfaces curved in depth was improved by removing portions of the surface and thus removing disparity information. Stimulus configuration had a profound effect on stereo thresholds that cannot be accounted for by disparity-energy models of V1 processing. We suggest that higher-level 3D contour or 3D shape mechanisms are involved.

Non-NASA Center↗

NASA NTRS2002

Stereo transparency and the disparity gradient limit

Several studies (Vision Research 15 (1975) 583; Perception 9 (1980) 671) have shown that binocular fusion is limited by the disparity gradient (disparity/distance) separating image points, rather than by their absolute disparity values. Points separated by a gradient >1 appear diplopic. These results are sometimes interpreted as a constraint on human stereo matching, rather than a constraint on fusion. Here we have used psychophysical measurements on stereo transparency to show that human stereo matching is not constrained by a gradient of 1. We created transparent surfaces composed of many pairs of dots, in which each member of a pair was assigned a disparity equal and opposite to the disparity of the other member. For example, each pair could be composed of one dot with a crossed disparity of 6' and the other with uncrossed disparity of 6', vertically separated by a parametrically varied distance. When the vertical separation between the paired dots was small, the disparity gradient for each pair was very steep. Nevertheless, these opponent-disparity dot pairs produced a striking appearance of two transparent surfaces for disparity gradients ranging between 0.5 and 3. The apparent depth separating the two transparent planes was correctly matched to an equivalent disparity defined by two opaque surfaces. A test target presented between the two transparent planes was easily detected, indicating robust segregation of the disparities associated with the paired dots into two transparent surfaces with few mismatches in the target plane. Our simulations using the Tsai-Victor model show that the response profiles produced by scaled disparity-energy mechanisms can account for many of our results on the transparency generated by steep gradients.

NASA Discipline Space Human Factors↗

NASA NTRS2000

Processing Motion Signals in Complex Environments

Motion information is critical for human locomotion and scene segmentation. Currently we have excellent neurophysiological models that are able to predict human detection and discrimination of local signals. Local motion signals are insufficient by themselves to guide human locomotion and to provide information about depth, object boundaries and surface structure. My research is aimed at understanding the mechanisms underlying the combination of motion signals across space and time. A target moving on an extended trajectory amidst noise dots in Brownian motion is much more detectable than the sum of signals generated by independent motion energy units responding to the trajectory segments. This result suggests that facilitation occurs between motion units tuned to similar directions, lying along the trajectory path. We investigated whether the interaction between local motion units along the motion direction is mediated by contrast. One possibility is that contrast-driven signals from motion units early in the trajectory sequence are added to signals in subsequent units. If this were the case, then units later in the sequence would have a larger signal than those earlier in the sequence. To test this possibility, we compared contrast discrimination thresholds for the first and third patches of a triplet of sequentially presented Gabor patches, aligned along the motion direction. According to this simple additive model, contrast increment thresholds for the third patch should be higher than thresholds for the first patch.The lack of a measurable effect on contrast thresholds for these various manipulations suggests that the pooling of signals along a trajectory is not mediated by contrast-driven signals. Instead, these results are consistent with models that propose that the facilitation of trajectory signals is achieved by a second-level network that chooses the strongest local motion signals and combines them if they occur in a spatio-temporal sequence consistent with a trajectory. These results parallel the lack of increased apparent contrast along a static contour made up of similarly oriented elements.

Verghese, Preeti↗

NASA NTRS1995

Combining Speed Information Across Space

We used speed discrimination tasks to measure the ability of observers to combine speed information from multiple stimuli distributed across space. We compared speed discrimination thresholds in a classical discrimination paradigm to those in an uncertainty/search paradigm. Thresholds were measured using a temporal two-interval forced-choice design. In the discrimination paradigm, the n gratings in each interval all moved at the same speed and observers were asked to choose the interval with the faster gratings. Discrimination thresholds for this paradigm decreased as the number of gratings increased. This decrease was not due to increasing the effective stimulus area as a control experiment that increased the area of a single grating did not show a similar improvement in thresholds. Adding independent speed noise to each of the n gratings caused thresholds to decrease at a rate similar to the original no-noise case, consistent with observers combining an independent sample of speed from each grating in both the added- and no-noise cases. In the search paradigm, observers were asked to choose the interval in which one of the n gratings moved faster. Thresholds in this case increased with the number of gratings, behavior traditionally attributed to an input bottleneck. However, results from the discrimination paradigm showed that the increase was not due to observers' inability to process these gratings. We have also shown that the opposite trends of the data in the two paradigms can be predicted by a decision theory model that combines independent samples of speed information across space. This demonstrates that models typically used in classical detection and discrimination paradigms are also applicable to search paradigms. As our model does not distinguish between samples in space and time, it predicts that discrimination performance should be the same regardless of whether the gratings are presented in two spatial intervals or two temporal intervals. Our last experiment largely confirmed this prediction.

Verghese, Preeti↗

NASA NTRS1995

Combining Speed Information Across Space

We used speed discrimination tasks to measure the ability of observers to combine speed information from multiple stimuli distributed across space. We compared speed discrimination thresholds in a classical discrimination paradigm to those in an uncertainty/search paradigm. Thresholds were measured using a temporal two-interval forced-choice design. In the discrimination paradigm, the n gratings in each interval all moved at the same speed and observers were asked to choose the interval with the faster gratings. Discrimination thresholds for this paradigm decreased as the number of gratings increased. This decrease was not due to increasing the effective stimulus area as a control experiment that increased the area of a single grating did not show a similar improvement in thresholds. Adding independent speed noise to each of the n gratings caused thresholds to decrease at a rate similar to the original no-noise case, consistent with observers combining an independent sample of speed from each grating in both the added- and no-noise cases. In the search paradigm, observers were asked to choose the interval in which one of the n gratings moved faster. Thresholds in this case increased with the number of gratings, behavior traditionally attributed to an input bottleneck. However, results from the discrimination paradigm showed that the increase was not due to observers' inability to process these gratings. We have also shown that the opposite trends of the data in the two paradigms can be predicted by a decision theory model that combines independent samples of speed information across space. This demonstrates that models typically used in classical detection and discrimination paradigms are also applicable to search paradigms. As our model does not distinguish between samples in space and time, it predicts that discrimination performance should be the same regardless of whether the gratings are presented in two spatial intervals or two temporal intervals. Our last experiment largely confirmed this prediction.

Verghese, Preeti↗

NASA NTRS1995

Speed Discrimination: Multiple Stimuli Appear Better Than One

We reported that for a 21FC task with multiple moving grating patches (Gabors) in each interval, thresholds for speed discrimination decreased with the number of patches, while increasing the area of a single grating produced no such effect. Furthermore, this decrease occurred regardless of the spacing of the patches about a circle of eccentricity 4 degrees, i.e., whether they were maximally separated or almost touching. These results suggest that it is the multiple, discrete grating patches that cause thresholds to decrease, rather than the spatial arrangement. To test this hypothesis, we measured the effect of dividing a large grating into four quadrants, by superimposing a mean-luminance cross on it. The mean speed discrimination thresholds (Weber Fractions) for four observers were 19, 15, and 11 plus or minus 2%, for the single large grating, the grating with cross, and the 4 maximally-separated, small gratings, respectively. Thus, breaking up a single large grating into multiple parts caused thresholds to improve, despite the fact that less of the original patch was visible. To investigate the possible contribution of total bounding contour length, we measured the effect of coalescing three small grating patches into a single banana-shaped patch, while keeping the total contour length constant. These two conditions were compared to a single, circular Gabor patch of equivalent area that had (necessarily) a smaller contour length. Preliminary data from 3 of 4 observers were similar for the small-grating and banana configurations, but increased for the single, large grating, suggesting that contour length might play a role. We are also investigating the role of low-level factors pertinent to the large grating, such as the pooling of signals from motion units at different eccentricities, and the stimulation of extended inhibitory motion surrounds, as well as the possible contribution of topdown influences that segment the stimulus into distinct objects.

Verghese, Preeti↗

NASA NTRS1994

Constraints on Neural Mechanisms Underlying the Spatial Integration of Speed Information

We measured human ability to integrate speed information presented simultaneously at multiple locations in the visual field. Observers did a two-interval forced-choice speed discrimination task with n grating patches in each interval at 4' eccentricity from fixation. In the first (integration) paradigm, all gratings in each interval moved at the same speed and observers were asked to pick the interval containing the faster gratings. Speed discrimination improved as the number of gratings in each interval increased. The observed decrease in threshold is not due simply to an increase in the effective area because performance with a single grating two, four, or six times the area of the original grating showed no such improvement. Furthermore, the improvement with n was still observed even when the speeds of the individual gratings in each interval were independent samples from a Gaussian distribution and the grating directions were balanced (i.e. equal numbers of gratings moved to the left and right). These results indicate that the neural mechanisms responsible for the integration of speed information act as if each patch provides an independent sample of speed, independent of grating direction. The results are not consistent with simple summation across space by a directionally selective mechanism with a large receptive field. In the second (search) paradigm, only one of the gratings in an interval moved faster and observers were asked to pick this interval. In this case, thresholds increased with the number of distractor gratings. The decrease in performance with increased n is common in search tasks and is often attributed to a bottleneck in the information that observers can process simultaneously. However, the results in the integration paradigm show that subjects indeed have access to and can use additional information with increasing n, at least up to 4 patches. Finally, simple detection models predict the trends in both the search and integration paradigms without invoking an input bottleneck.

Verghese, Preeti↗

NASA NTRS1994

Constraints on Neural Mechanisms Underlying the Spatial Integration of Speed Information

We measured human ability to integrate speed information presented simultaneously at multiple locations in the visual field. Observers did a two-interval forced-choice speed discrimination task with n grating patches in each interval at 4deg eccentricity from fixation. In the first (integration) paradigm, all gratings in each interval moved at the same speed and observers were asked to pick the interval containing the faster gratings. Speed discrimination improved as the number of gratings in each interval increased. The observed decrease in threshold is not due simply to an increase in the effective area because performance with a single grating two, four, or six times the area of the original grating showed no such improvement. Furthermore, the improvement with n was still observed even when the speeds of the individual gratings in each interval were independent samples from a Gaussian distribution and the grating directions were balanced (i.e. equal numbers of gratings moved to the left and right). These results indicate that the neural mechanisms responsible for the integration of speed information act as if each patch provides an independent sample of speed, independent of grating direction. The results are not consistent with simple summation across space by a directionally selective mechanism with a large receptive field. in the second (search) paradigm, only one of the gratings in an interval moved faster and observers were asked to pick this interval. In this case, thresholds increased with the number of distractor gratings. The decrease in performance with increased n is common in search tasks and is often attributed to a bottleneck in the information that observers can process simultaneously. However, the results in the integration paradigm show that subjects indeed have access to and can use additional information with increasing n, at least up to 4 patches. Finally, simple detection models predict the trends in both the search and integration paradigms without invoking an input bottleneck.

Verghese, Preeti↗