Sensory processing delays measured with the eye-movement correlogram
No abstract available
Visual Perception/physiology↗
Engineering topics
Mulligan, J. B.
Publications and source records attributed to Mulligan, J. B..
Image processing for improved eye-tracking accuracy
Video cameras provide a simple, noninvasive method for monitoring a subject's eye movements. An important concept is that of the resolution of the system, which is the smallest eye movement that can be reliably detected. While hardware systems are available that estimate direction of gaze in real-time from a video image of the pupil, such systems must limit image processing to attain real-time performance and are limited to a resolution of about 10 arc minutes. Two ways to improve resolution are discussed. The first is to improve the image processing algorithms that are used to derive an estimate. Off-line analysis of the data can improve resolution by at least one order of magnitude for images of the pupil. A second avenue by which to improve resolution is to increase the optical gain of the imaging setup (i.e., the amount of image motion produced by a given eye rotation). Ophthalmoscopic imaging of retinal blood vessels provides increased optical gain and improved immunity to small head movements but requires a highly sensitive camera. The large number of images involved in a typical experiment imposes great demands on the storage, handling, and processing of data. A major bottleneck had been the real-time digitization and storage of large amounts of video imagery, but recent developments in video compression hardware have made this problem tractable at a reasonable cost. Images of both the retina and the pupil can be analyzed successfully using a basic toolbox of image-processing routines (filtering, correlation, thresholding, etc.), which are, for the most part, well suited to implementation on vectorizing supercomputers.
NASA Discipline Space Human Factors↗
The barberplaid illusion: plaid motion is biased by elongated apertures
The perceived direction of motion of plaids windowed by elongated spatial Gaussians is biased toward the window's long axis. The bias increases as the relative angle between the plaid motion and the long axis of the window increases, peaks at a relative angle of approximately 45 deg, and then decreases. The bias increases as the window is made narrower (at fixed height) and decreases as the component spatial frequency increases (at fixed aperture size). We examine several models of human motion processing (cross-correlation, motion-energy, intersection-of-constraints, and vector-sum), and show that none of these standard models can predict our data. We conclude that spatial integration of motion signals plays a crucial role in plaid motion perception and that current models must be explicitly expanded to include such spatial interactions.
NASA Center ARC↗
Direction of Perceived Motion and Eye Movements Show Similar Biases for Asymmetrically Windowed Moving Plaids
We have shown that moving a plaid in an asymmetric window biases the perceived direction of motion (Beutter, Mulligan & Stone, ARVO 1994). We now explore whether these biased motion signals might also drive the smooth eye-movement response by comparing the perceived and tracked directions. The human smooth oculomotor response to moving plaids appears to be driven by the perceived rather than the veridical direction of motion. This suggests that human motion perception and smooth eye movements share underlying neural motion-processing substrates as has already been shown to be true for monkeys.
Beutter, B. R.↗
Additional Twists on A Continuous Barber - Pole Illusion
The barber pole illusion is a well-known example of how the perceived direction of motion of an inherently ambiguous one-dimensional pattern is influenced by the shape of the area covered by the pattern. Similar effects may be observed for a stimulus which is restricted to a narrow band of spatial frequencies: when a sinusoidal grating is drifted behind a two-dimensional Gaussian contrast window having unequal standard deviations, the direction of perceived motion is biased in the direction of the major axis of the elliptical window (Mulligan, ARVO 1991). We have extended these results to provide insight into possible mechanisms responsible for the effect.
Mulligan, J. B.↗
The Barberplaid Illusion
Mulligan showed that the perceived direction of a moving grating can be biased by the shape of the Gaussian window in which it is viewed. We sought to determine if a 2-D pattern with an unambiguous velocity would also show such biases. Observers viewed a drifting plaid (sum of two orthogonal 2.5 c/d sinusoidal gratings of 12% contrast, each with a TF of 4 Hz.) whose contrast was modulated spatially by a stationary, asymmetric 2-D Gaussian window (i.e. unequal standard deviations in the principal directions). The direction of plaid motion with respect to the orientation of the window's major axis (Delta Theta) was varied while all other motion parameters were held fixed. Observers reported the perceived plaid direction of motion by adjusting the orientation of a pointer. All five observers showed systematic biases in perceived plaid direction that depended on Delta Theta and the aspect ratio of the Gaussian window (lambda). For circular Gaussian windows Lambda = 1), plaid direction was veridically perceived. However, biases of up to 10 deg. were found for lambda = 2 and Delta Theta = 30 deg. These data present a challenge to models of motion perception which do not explicitly consider the integration of information across the visual field.
Beutter, B. R.↗
Directions of Moving Plaids is Biased by Asymmetric Viewing Windows
Directionally selective V1 neurons are tuned to particular spatio-temporal frequencies and respond to local 1-D edge motion. At least some MT neurons however appear to respond to the actual velocity of moving 2D patterns. To better understand how the 1D local motion information available from VI is integrated to derive a 2D velocity signal we investigated human perception of moving plaids, 2-D patterns composed of the sum of two 1-D sinusoidal gratings of different orientations. We measured the effect of the shape of the viewing window on the perceived direction of plaid motion. The plaids were spatially windowed by 2-D Gaussians with unequal standard deviations (sigma 1, sigma 2). Four observers indicated perceived direction by adjusting a pointer. Direction errors were measured as a function of the difference between window orientation and true plaid direction (DELTA THETA) for several grating spatial frequencies (SF = 0.3, 0.6, 1.2 c/d) and window aspect ratios (AR = sigma 1/sigma 2 = 1, 1.4, 2, 4). Observers showed systematic errors in perceived direction (approx. 15 for AR = 4 and SF = 0.6 c/d) that peaked at DELTA THETA approx. 40. The errors increased for increasing aspect ratio and decreased for increasing spatial frequencies (or number of cycles). These results show that despite the unambiguous motion of the plaids, under these conditions human misperceive the motion. These data constrain models of motion integration from V1 to MT and, in particular, are inconsistent with algorithms that use either the Intersection of Constraints rule or cross correlation to compute the perceived direction of motion.
Beutter, B. R.↗
Direction of Moving Plaids is Biased by Asymmetric Viewing Windows
Directionally selective V1 neurons are tuned to particular spatiotemporal frequencies and respond to local 1-D edge motion. At least some MT neurons however appear to respond to the actual velocity of moving 2D patterns (Movshon et al., EBR, 11:117, 1986). To better understand how the 1D local motion information available from V1 is integrated to derive a 2D velocity signal we investigated human perception of moving plaids, 2-D patterns composed of the sum of two 1-D sinusoidal gratings of different orientations. We measured the effect of the shape of the viewing window on the perceived direction of plaid motion. The plaids were spatially windowed by 2-D Gaussians with unequal standard deviations (sigma l, sigma 2). Four observers indicated perceived direction by adjusting a pointer. Direction errors were measured as a function of the difference between window orientation and true plaid direction (delta theta) for several grating spatial frequencies (SF = 0.3, 0.6, 1.2 c/d) and window aspect ratios (AR = sigma 1/sigma 2 = 1, 1.4, 2,4). Observers showed systematic errors in perceived direction (approx. 15 degrees for R = 4 and SF = 0.6 c/d) that peaked at delta theta approximately 40 degrees. The errors increased for increasing aspect ratio and decreased for increasing spatial frequencies (or number of cycles). These results show that despite the unambiguous motion of the plaids, within asymmetric windows, human can systematically misperceive plaid direction. These data constrain models of motion integration within extrastriate cortex and, in particular, are inconsistent with algorithms that use either the Intersection of Constraints rule or cross correlation to compute velocity.
Beutter, Brent Robert↗
Vision Science And Technology At NASA
Report presents results of workshop-type conference on vision science and technology (VST) at the National Aeronautics and Space Administration. Describes VST needs of wide-ranging NASA projects, including planetary rover, automatic rendezvous and docking, study of global change, and hypersonic civilian transport aircraft.
Watson, A. B.↗
Effect Of Contrast On Perceived Motion Of A Plaid
Report desribes series of experiments examining effect of contrast on perception of moving plaids. Each plaid pattern used in experiments was sum of two drifting sinusoidal gratings of different orientations. One of many studies helping to show how brain processes visual information on moving patterns. When gratings forming plaid differ in contrast, apparent direction of motion of plaid biased up to 20 degrees toward direction of grating of higher contrast.
Stone, L. S.↗
Effect of contrast on the perceived direction of a moving plaid
A series of experiments examining the effect of contrast on the perception of moving plaids is performed. This was done to test the hypothesis put forth by Adelson and Movshon (1982) that the human visual system determines the direction of a moving plaid in a two-staged process: decomposition into component motion followed by application of the intersection of constraints rule. When the gratings within the plaid are of different contrast, the perceived direction is not predicted by the intersection of constraints rule. There is a strong (up to 20 deg) bias in the direction of the higher-contrast grating. A revised model, which incorporates a contrast-dependent weighting of perceived grating speed as observed for one-dimensional patterns (Thompson, 1982), can quantitatively predict most of the results. Results are discussed in the context of various models of human visual motion processing and of physiological responses of neurons in the primate visual system.
Stone, L. S.↗
Effect of contrast on the perception of direction of a moving pattern
A series of experiments examining the effect of contrast on the perception of moving plaids was performed to test the hypothesis that the human visual system determines the direction of a moving plaid in a two-staged process: decomposition into component motion followed by application of the intersection-of-contraints rule. Although there is recent evidence that the first tenet of the hypothesis is correct, i.e., that plaid motion is initially decomposed into the motion of the individual grating components, the nature of the second-stage combination rule has not yet been established. It was found that when the gratings within the plaid are of different contrast the preceived direction is not predicted by the intersection-of-constraints rule. There is a strong (up to 20 deg) bias in the direction of the higher-constrast grating. A revised model, which incorporates a contrast-dependent weighting of perceived grating speed as observed for one-dimensional patterns, can quantitatively predict most of the results. The results are then discussed in the context of various models of human visual motion processing and of physiological responses of neurons in the primate visual system.
Stone, L. S.↗