Comparison of Optical Flow Derivation Techniques for Retrieving Tropospheric Winds from Satellite Image Sequences
Explore the source record for details and available documents.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Optical air flow measurements can support the testing of aircraft and can be instrumental to in-flight investigations of the atmosphere or atmospheric phenomena. Furthermore, optical air flow meters potentially contribute as avionics systems to flight safety and as air data systems. The qualification of these instruments for the flight environment is where we encounter the systems in flight testing. An overview is presented of different optical air flow measurement techniques applied in flight and what can be achieved with the techniques for flight test purposes is reviewed. All in-flight optical airflow velocity measurements use light scattering. Light is scattered on both air molecules and aerosols entrained in the air. Basic principles of making optical measurements in flight, some basic optical concepts, electronic concepts, optoelectronic interfaces, and some atmospheric processes associated with natural aerosols are reviewed. Safety aspects in applying the technique are shortly addressed. The different applications of the technique are listed and some typical examples are presented. Recently NASA acquired new data on mountain rotors, mountain induced turbulence, with the ACLAIM system. Rotor position was identified using the lidar system and the potentially hazardous air flow profile was monitored by the ACLAIM system.
Optical cross correlation functions for statistical analysis of turbulent flows
The motion of an imaging sensor causes each imaged point of the scene to correspondingly describe a time trajectory on the image plane. The trajectories of all imaged points are reminiscent of a flow (e.g., of liquid) which is the source of the term 'optical flow'. Optical-flow ranging is a method by which the stream of two-dimensional images obtained from a forward-looking forward-moving passive sensor is used to compute depth (or range) to points in the field of view. Another well-known ranging method consists of triangulation based on stereo images obtained from at least two stationary sensors. In this paper we analyze the potential accuracies of a combined optical flow and stereo passive-ranging system in the context of helicopter nap-of-the-earth obstacle avoidance. The Cramer-Rao lower bound is developed for the combined system under the assumption of an unknown angular bias error common to both cameras of a stereo pair. It is shown that the depth accuracy degradations caused by a bias error is negligible for a combined optical-flow and stereo system as compared to a monocular optical-flow system.
This document has been written to assist the flight-test engineer and researcher in using optical flow measurements in flight applications. The emphasis is on describing tradeoffs in system design to provide desired measurement performance as currently understood. Optical system components are discussed with examples that illustrate the issues. The document concludes with descriptions of optical measurement systems designed for a variety of applications including aeronautics research, airspeed measurement, and turbulence hazard detection. Theoretical discussion is minimized, but numerous references are provided to supply ample opportunity for the reader to understand the theoretical underpinning of optical concepts.
This paper determined rotational and translational velocity and acceleration thresholds for the onset of cybersickness. Cybersickness causes discomfort and discourages the widespread use of virtual reality systems for both recreational and professional use. Visual motion or optic flow is known to be one of the main causes of cybersickness due to the sensory conflict it creates with the vestibular system. The aim of this experiment is to detect rotational and translational velocity and acceleration thresholds that cause the onset of cybersickness. Participants were exposed to a moving particle field in virtual reality for a few seconds per run. The field moved in different directions (longitudinal, lateral, roll, and yaw), with different velocity profiles (steady and accelerating), and different densities. Using a staircase procedure, that controlled the speed or acceleration of the field, we detected the threshold at which participant started to feel temporary symptoms of cybersickness. The optic flow was quantified for each motion type and by modifying the number of features, the same amount of optic flow was present in each scene. Having the same optic flow in each scene allows a direct comparison of the thresholds. The results show that the velocity and acceleration thresholds for rotational optic flow were significantly lower than for translational optic flow. The thresholds suggestively decreased with the decreasing particle density of the scene. Finally, it was found that all the rotational and translational thresholds strongly correlate with each other. While the mean values of the thresholds could be used as guidelines to develop virtual reality applications, the high variability between individuals implies that the individual tuning of motion controls would be more effective to reduce cybersickness while minimizing the impact on the experience of immersion.
The effect of noise in the visual environment on spatial orientation was investigated experimentally using postural stability as an objective measure. Noise in the displays was produced by randomly shifting the phase lag of the three-dimensional motion function for each individual point within the display. Greater postural sway was induced by displays containing no noise in the global optical flow pattern than displays containing noise, suggesting that spatial orientation is strongly dependent on global optic flow information in the visual field. To avoid pilot disorientation in some flight maneuvers, it is recommended that visual aids specifying global optic flow information be included in aircraft for flight environments with deficient global optic flow information.
A prototype of an advanced robotic vision system both (1) measures its own motion with respect to a stationary background and (2) detects other moving objects and estimates their motions, all by use of visual cues. Like some prior robotic and other optoelectronic vision systems, this system is based partly on concepts of optical flow and visual odometry. Whereas prior optoelectronic visual-odometry systems have been limited to frame rates of no more than 1 Hz, a visual-odometry subsystem that is part of this system operates at a frame rate of 60 to 200 Hz, given optical-flow estimates. The overall system operates at an effective frame rate of 12 Hz. Moreover, unlike prior machine-vision systems for detecting motions of external objects, this system need not remain stationary: it can detect such motions while it is moving (even vibrating). The system includes a stereoscopic pair of cameras mounted on a moving robot. The outputs of the cameras are digitized, then processed to extract positions and velocities. The initial image-data-processing functions of this system are the same as those of some prior systems: Stereoscopy is used to compute three-dimensional (3D) positions for all pixels in the camera images. For each pixel of each image, optical flow between successive image frames is used to compute the two-dimensional (2D) apparent relative translational motion of the point transverse to the line of sight of the camera. The challenge in designing this system was to provide for utilization of the 3D information from stereoscopy in conjunction with the 2D information from optical flow to distinguish between motion of the camera pair and motions of external objects, compute the motion of the camera pair in all six degrees of translational and rotational freedom, and robustly estimate the motions of external objects, all in real time. To meet this challenge, the system is designed to perform the following image-data-processing functions: The visual-odometry subsystem (the subsystem that estimates the motion of the camera pair relative to the stationary background) utilizes the 3D information from stereoscopy and the 2D information from optical flow. It computes the relationship between the 3D and 2D motions and uses a least-mean-squares technique to estimate motion parameters. The least-mean-squares technique is suitable for real-time implementation when the number of external-moving-object pixels is smaller than the number of stationary-background pixels.
Two studies were performed to determine whether a subject's response to naturalistic optical flow specifying egomotion would be affected by a concurrent attention task. In the first study subjects stood in a moving room in which various areas of the optical flow generated by room movement were visible. Subjects responded to room motion with strong compensatory sway when the entire room was visible. When the side walls of the room were completely obscured by stationary screens, leaving only the front wall visible, sway was significantly reduced, though it remained greater than in an eyes-closed control. In Exp. 2 subjects were presented with either the full room (large sway response) or the room with only the front wall visible (moderate response), each in combination with either a hard or easy verbal addition task. Preliminary results show that swaying in the fully visible room and in the room with only the front wall visible increased when combined with either the hard or easy tasks. These preliminary results suggest that at the least the pick-up of optical flow specifying egomotion is not affected by concurrent attentional activity.
Simple, rugged, lightweight transducers detect periodic vortices. Fiber-optic-coupled transducers developed to measure flows over wide dynamic ranges and over wide temperature ranges in severe environments. Used to measure flows of fuel in advanced aircraft engines. Feasibility of sensors demonstrated in tests of prototype sensor in water flowing at various temperatures and speeds. Particularly attractive for aircraft applications because optical fibers compact and make possible transmission of sensor signals at high rates with immunity from electromagnetic interference at suboptical frequencies. Sensors utilize optical-to-optical conversion via photoelastic effect.
Flight-control and navigation systems inspired by the structure and function of the visual system and brain of insects have been proposed for a class of developmental miniature robotic aircraft called "biomorphic flyers" described earlier in "Development of Biomorphic Flyers" (NPO-30554), NASA Tech Briefs, Vol. 28, No. 11 (November 2004), page 54. These form a subset of biomorphic explorers, which, as reported in several articles in past issues of NASA Tech Briefs ["Biomorphic Explorers" (NPO-20142), Vol. 22, No. 9 (September 1998), page 71; "Bio-Inspired Engineering of Exploration Systems" (NPO-21142), Vol. 27, No. 5 (May 2003), page 54; and "Cooperative Lander-Surface/Aerial Microflyer Missions for Mars Exploration" (NPO-30286), Vol. 28, No. 5 (May 2004), page 36], are proposed small robots, equipped with microsensors and communication systems, that would incorporate crucial functions of mobility, adaptability, and even cooperative behavior. These functions are inherent to biological organisms but are challenging frontiers for technical systems. Biomorphic flyers could be used on Earth or remote planets to explore otherwise difficult or impossible to reach sites. An example of an exploratory task of search/surveillance functions currently being tested is to obtain high-resolution aerial imagery, using a variety of miniaturized electronic cameras. The control functions to be implemented by the systems in development include holding altitude, avoiding hazards, following terrain, navigation by reference to recognizable terrain features, stabilization of flight, and smooth landing. Flying insects perform these and other functions remarkably well, even though insect brains contains fewer than 10(exp -4) as many neurons as does the human brain. Although most insects have immobile, fixed-focus eyes and lack stereoscopy (and hence cannot perceive depth directly), they utilize a number of ingenious strategies for perceiving, and navigating in, three dimensions. Despite their lack of stereoscopy, insects infer distances to potential obstacles and other objects from image motion cues that result from their own motions in the environment. The concept of motion of texture in images as a source of motion cues is denoted generally as the concept of optic or optical flow. Computationally, a strategy based on optical flow is simpler than is stereoscopy for avoiding hazards and following terrain. Hence, this strategy offers the potential to design vision-based control computing subsystems that would be more compact, would weigh less, and would demand less power than would subsystems of equivalent capability based on a conventional stereoscopic approach.
We have proposed previously a computational neural-network model by which the complex patterns of retinal image motion generated during locomotion (optic flow) can be processed by specialized detectors acting as templates for specific instances of self-motion. The detectors in this template model respond to global optic flow by sampling image motion over a large portion of the visual field through networks of local motion sensors with properties similar to those of neurons found in the middle temporal (MT) area of primate extrastriate visual cortex. These detectors, arranged within cortical-like maps, were designed to extract self-translation (heading) and self-rotation, as well as the scene layout (relative distances) ahead of a moving observer. We then postulated that heading from optic flow is directly encoded by individual neurons acting as heading detectors within the medial superior temporal (MST) area. Others have questioned whether individual MST neurons can perform this function because some of their receptive-field properties seem inconsistent with this role. To resolve this issue, we systematically compared MST responses with those of detectors from two different configurations of the model under matched stimulus conditions. We found that the characteristic physiological properties of MST neurons can be explained by the template model. We conclude that MST neurons are well suited to support self-motion estimation via a direct encoding of heading and that the template model provides an explicit set of testable hypotheses that can guide future exploration of MST and adjacent areas within the superior temporal sulcus.
We have previously proposed a computational neural-network model by which the complex patterns of retinal image motion generated during locomotion (optic flow) can be processed by specialized detectors acting as templates for specific instances of self-motion. The detectors in this template model respond to global optic flow by sampling image motion over a large portion of the visual field through networks of local motion sensors with properties similar to neurons found in the middle temporal (MT) area of primate extrastriate visual cortex. The model detectors were designed to extract self-translation (heading), self-rotation, as well as the scene layout (relative distances) ahead of a moving observer, and are arranged in cortical-like heading maps to perform this function. Heading estimation from optic flow has been postulated by some to be implemented within the medial superior temporal (MST) area. Others have questioned whether MST neurons can fulfill this role because some of their receptive-field properties appear inconsistent with a role in heading estimation. To resolve this issue, we systematically compared MST single-unit responses with the outputs of model detectors under matched stimulus conditions. We found that the basic physiological properties of MST neurons can be explained by the template model. We conclude that MST neurons are well suited to support heading estimation and that the template model provides an explicit set of testable hypotheses which can guide future exploration of MST and adjacent areas within the primate superior temporal sulcus.
The data obtained from two recent experiments conducted in a continuing series of experiments at the Lewis Research Center into the contamination characteristics of a 5-pound thrust MMH/N2O4 engine are presented. The primary objectives of these experiments were to establish the angular distribution of condensible exhaust products within the plume and the corresponding optical damage angular distribution of transmitting optical elements attributable to this contaminant. The plume mass flow distribution was measured by five quartz crystal microbalances (QCM's) located at the engine axis evaluation. The fifth QCM was located above the engine and 15 deg behind the nozzle exit plane. The optical damage was determined by ex-situ transmittance measurements for the wavelength range from 0.2 to 0.6 microns on 2.54 cm diameter fused silica discs also located at engine centerline elevation. Both the mass deposition and optical damage angular distributions followed the expected trend of decreasing deposition and damage as the angle between sensor or sample and the nozzle axis increased. A simple plume gas flow equation predicted the deposition distribution reasonably well for angles of up to 55 degrees. The optical damage measurements also indicated significant effects at large angles.
The goal of the present study was to investigate the adaptive effects of variation in the direction of optic flow, experienced during linear treadmill walking, on modifying locomotor trajectory. Subjects (n = 30) walked on a motorized linear treadmill at 4.0 km/h for 24 minutes while viewing the interior of a 3D virtual scene projected onto a screen 1.5 m in front of them. The virtual scene depicted constant self-motion equivalent to either 1) walking around the perimeter of a room to one s left (Rotating Room group) 2) walking down the center of a hallway (Infinite Hallway group). The scene was static for the first 4 minutes, and then constant rate self-motion was simulated for the remaining 20 minutes. Before and after the treadmill locomotion adaptation period, subjects performed five stepping trials where in each trial they marched in place to the beat of a metronome at 90 steps/min while blindfolded in a quiet room. The subject s final heading direction (deg), final X (for-aft, cm) and final Y (medio-lateral, cm) positions were measured for each trial. During the treadmill locomotion adaptation period subject s 3D torso position was measured. We found that subjects in the Rotating Room group as compared to the Infinite Hallway group: 1) showed significantly greater deviation during post exposure testing in the heading direction and Y position opposite to the direction of optic flow experienced during treadmill walking 2) showed a significant monotonically increasing torso yaw angular rotation bias in the direction of optic flow during the treadmill adaptation exposure period. Subjects in both groups showed greater forward translation (in the +X direction) during the post treadmill stepping task that differed significantly from their pre exposure performance. Subjects in both groups reported no perceptual deviation in position during the stepping tasks. We infer that 3 viewing simulated rotary self-motion during treadmill locomotion causes adaptive modification of sensory-motor integration in the control of position and trajectory during locomotion which functionally reflects adaptive changes in the integration of visual, vestibular, and proprioceptive cues. Such an adaptation in the control of position and heading direction during locomotion due to the congruence of sensory information demonstrates the potential for adaptive transfer between sensorimotor systems and suggests a common neural site for the processing and self-motion perception and concurrent adaptation in motor output. This will result in lack of subjects perception of deviation of position and trajectory during the post treadmill step test while blind folded.