Engineering topics

Perrone, John A.

Publications and source records attributed to Perrone, John A..

11 records

NASA NTRS1997

Emulating the Visual Receptive Field Properties of MST Neurons with a Template Model of Heading Estimation

We have previously proposed a computational neural-network model by which the complex patterns of retinal image motion generated during locomotion (optic flow) can be processed by specialized detectors acting as templates for specific instances of self-motion. The detectors in this template model respond to global optic flow by sampling image motion over a large portion of the visual field through networks of local motion sensors with properties similar to neurons found in the middle temporal (MT) area of primate extrastriate visual cortex. The model detectors were designed to extract self-translation (heading), self-rotation, as well as the scene layout (relative distances) ahead of a moving observer, and are arranged in cortical-like heading maps to perform this function. Heading estimation from optic flow has been postulated by some to be implemented within the medial superior temporal (MST) area. Others have questioned whether MST neurons can fulfill this role because some of their receptive-field properties appear inconsistent with a role in heading estimation. To resolve this issue, we systematically compared MST single-unit responses with the outputs of model detectors under matched stimulus conditions. We found that the basic physiological properties of MST neurons can be explained by the template model. We conclude that MST neurons are well suited to support heading estimation and that the template model provides an explicit set of testable hypotheses which can guide future exploration of MST and adjacent areas within the primate superior temporal sulcus.

Perrone, John A.↗

NASA NTRS1996

Translation and Rotation Trade Off in Human Visual Heading Estimation

We have previously shown that, during simulated curvilinear motion, humans can make reasonably accurate and precise heading judgments from optic flow without either oculomotor or static-depth cues about rotation. We now systematically investigate the effect of varying the parameters of self-motion. We visually simulated 400 ms of self-motion along curved paths (constant rotation and translation rates, fixed retinocentric heading) towards two planes of random dots at 10.3 m and 22.3 m at mid-trial. Retinocentric heading judgments of 4 observers (2 naive) were measured for 12 different combinations of translation (T between 4 and 16 m/s) and rotation (R either 8 or 16 deg/s). In the range tested, heading bias and uncertainty decrease quasilinearly with T/R, but the bias also appears to depend on R. If depth is held constant, the ratio T/R can account for much of the variation in the accuracy and precision of human visual heading estimation, although further experiments are needed to resolve whether absolute rotation rate, total flow rate, or some other factor can account for the observed -2 deg shift between the bias curves.

Stone, Leland S.↗

NASA NTRS1995

Accurate Visual Heading Estimation at High Rotation Rate Without Oculomotor or Static-Depth Cues

It has been claimed that either oculomotor or static depth cues provide the signals about self-rotation necessary approx.-1 deg/s. We tested this hypothesis by simulating self-motion along a curved path with the eyes fixed in the head (plus or minus 16 deg/s of rotation). Curvilinear motion offers two advantages: 1) heading remains constant in retinotopic coordinates, and 2) there is no visual-oculomotor conflict (both actual and simulated eye position remain stationary). We simulated 400 ms of rotation combined with 16 m/s of translation at fixed angles with respect to gaze towards two vertical planes of random dots initially 12 and 24 m away, with a field of view of 45 degrees. Four subjects were asked to fixate a central cross and to respond whether they were translating to the left or right of straight-ahead gaze. From the psychometric curves, heading bias (mean) and precision (semi-interquartile) were derived. The mean bias over 2-5 runs was 3.0, 4.0, -2.0, -0.4 deg for the first author and three naive subjects, respectively (positive indicating towards the rotation direction). The mean precision was 2.0, 1.9, 3.1, 1.6 deg. respectively. The ability of observers to make relatively accurate and precise heading judgments, despite the large rotational flow component, refutes the view that extra-flow-field information is necessary for human visual heading estimation at high rotation rates. Our results support models that process combined translational/rotational flow to estimate heading, but should not be construed to suggest that other cues do not play an important role when they are available to the observer.

Stone, Leland S.↗

NASA NTRS1993

Extracting heading and temporal range from optic flow: Human performance issues

Pilots are able to extract information about their vehicle motion and environmental structure from dynamic transformations in the out-the-window scene. In this presentation, we focus on the information in the optic flow which specifies vehicle heading and distance to objects in the environment, scaled to a temporal metric. In particular, we are concerned with modeling how the human operators extract the necessary information, and what factors impact their ability to utilize the critical information. In general, the psychophysical data suggest that the human visual system is fairly robust to degradations in the visual display, e.g., reduced contrast and resolution or restricted field of view. However, extraneous motion flow, i.e., introduced by sensor rotation, greatly compromises human performance. The implications of these models and data for enhanced/synthetic vision systems are discussed.

Kaiser, Mary K.↗

NASA NTRS1992

Model for the computation of self-motion in biological systems

A technique is presented by which direction- and speed-tuned cells, such as those commonly found in the middle temporal region of the primate brain, can be utilized to analyze the patterns of retinal image motion that are generated during observer movement through the environment. The developed model determines heading by finding the peak response in a population of detectors or neurons each tuned to a particular heading direction. It is suggested that a complex interaction of multiple cell networks is required for the solution of the self-motion problem in the primate brain.

Perrone, John A.↗

NASA NTRS1991

The perception of surface layout during low level flight

Although it is fairly well established that information about surface layout can be gained from motion cues, it is not so clear as to what information humans can use and what specific information they should be provided. Theoretical analyses tell us that the information is in the stimulus. It will take more experiments to verify that this information can be used by humans to extract surface layout from the 2D velocity flow field. The visual motion factors that can affect the pilot's ability to control an aircraft and to infer the layout of the terrain ahead are discussed.

Perrone, John A.↗

NASA NTRS1990

Simple technique for optical flow estimation

The theoretical principles, design, and implementation of an image-motion detection system with possible robotics and autonomous-navigation applications are discussed. The operation of a simple one-dimensional second-derivative edge-motion detector is explained; its extension to a two-dimensional motion sensor based on the Laplacian of a Gaussian (Marr and Hildreth, 1980) is outlined; a center-surround array of 13 of these sensors (12 in a circle around a central sensor) is proposed; and processing techniques to overcome the aperture problem are examined. Simple video images involving unidirectional motion are then analyzed using a prototype version of this design; the sensors employed are based on a 15 x 15-pixel mask made up of 13 7 x 7-pixel kernels. Accurate measurements of image velocity are obtained, as required for navigation through complex environments. It is pointed out that the procedure is noniterative and well suited to implementation as a parallel network.

Perrone, John A.↗

NASA NTRS1989

Visual slant underestimation

Observers frequently underestimate the in-depth slant of rectangles under reduction conditions. This also occurs for slanted rectangles depicted on a flat display medium. Perrone (1982) provides a model for judged slant based upon properties of the 2-D trapezoidal projection of the rectangle. Two important parameters of this model are the angle of convergence of the sides of the trapezoid and the projected length of the trapezoid. This model was tested using a range of stimulus rectangles and found that the model failed to predict some of the major trends in the data. However, when the projected width of the base of the trapezoid projection was used in the model, instead of the projected length, excellent agreement between the theoretical and obtained slant judgements resulted. The good fit between the experimental data and the new model predictions indicates that perceived slant estimates are highly correlated with specifiable features in the stimulus display.

Perrone, John A.↗

NASA NTRS1989

Synthetic perspective optical flow: Influence on pilot control tasks

One approach used to better understand the impact of visual flow on control tasks has been to use synthetic perspective flow patterns. Such patterns are the result of apparent motion across a grid or random dot display. Unfortunately, the optical flow so generated is based on a subset of the flow information that exists in the real world. The danger is that the resulting optical motions may not generate the visual flow patterns useful for actual flight control. Researchers conducted a series of studies directed at understanding the characteristics of synthetic perspective flow that support various pilot tasks. In the first of these, they examined the control of altitude over various perspective grid textures (Johnson et al., 1987). Another set of studies was directed at studying the head tracking of targets moving in a 3-D coordinate system. These studies, parametric in nature, utilized both impoverished and complex virtual worlds represented by simple perspective grids at one extreme, and computer-generated terrain at the other. These studies are part of an applied visual research program directed at understanding the design principles required for the development of instruments displaying spatial orientation information. The experiments also highlight the need for modeling the impact of spatial displays on pilot control tasks.

Bennett, C. Thomas↗

NASA NTRS1989

In search of the elusive flow field

A specific set of problems must be overcome before an optical flow field can be derived from an image sequence. These problems are discussed and an outline of a scheme for overcoming these obstacles is presented. A two-dimensional motion sensor is presented which is capable of measuring edge velocity in twelve separate directions at any point in the image. However, because of the aperture problem, the sensors can only determine the velocity component in the direction orthogonal to the edge. A second stage which uses a cosine-weighted voting scheme is used to derive the true flow field from the edge velocities. The whole system is based on a parallel network of connections and weights and is potentially a very fast method of obtaining the two-dimensional flow field.

Perrone, John A.↗

NASA NTRS1986

Anisotropic responses to motion toward and away from the eye

When a rigid object moves toward the eye, it is usually perceived as being rigid. However, in the case of motion away from the eye, the motion and structure of the object are perceived nonveridically, with the percept tending to reflect the nonrigid transformations that are present in the retinal image. This difference in response to motion to and from the observer was quantified in an experiment using wire-frame computer-generated boxes which moved toward and away from the eye. Two theoretical systems are developed by which uniform three-dimensional velocity can be recovered from an expansion pattern of nonuniform velocity vectors. It is proposed that the human visual system uses two similar systems for processing motion in depth. The mechanism used for motion away from the eye produces perceptual errors because it is not suited to objects with a depth component.

Perrone, John A.↗