SEARCH · Search NASA

Results for “optic flow”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

All sources NASA NTRS DOE OSTI

NASA NTRS1990

Velocity filtering applied to optical flow calculations

Optical flow is a method by which a stream of two-dimensional images obtained from a forward-looking passive sensor is used to map the three-dimensional volume in front of a moving vehicle. Passive ranging via optical flow is applied here to the helicopter obstacle-avoidance problem. Velocity filtering is used as a field-based method to determine range to all pixels in the initial image. The theoretical understanding and performance analysis of velocity filtering as applied to optical flow is expanded and experimental results are presented.

Barniv, Yair↗

NASA NTRS2003

Measurements of cell-generated deformations on flexible substrata using correlation-based optical flow

The optical flow algorithm presented here is a robust method that rapidly yields a high-density field of substrate displacement vectors based on two optical images. We found that one of the limiting factors, at least for inexperienced experimentalists, is the consistency of focusing or the drift in microscope focus. However, with properly collected images the standard error of the measurement was estimated to be on the order of +/- 0.10 pixels. Finally, although the discussion has been focused on the displacement of flexible substrata, a similar method should be applicable for detecting movements on other types of images, as long as the movement involves a certain degree of local coordination.

Non-NASA Center↗

NASA NTRS2005

Insect-Inspired Optical-Flow Navigation Sensors

Integrated circuits that exploit optical flow to sense motions of computer mice on or near surfaces ( optical mouse chips ) are used as navigation sensors in a class of small flying robots now undergoing development for potential use in such applications as exploration, search, and surveillance. The basic principles of these robots were described briefly in Insect-Inspired Flight Control for Small Flying Robots (NPO-30545), NASA Tech Briefs, Vol. 29, No. 1 (January 2005), page 61. To recapitulate from the cited prior article: The concept of optical flow can be defined, loosely, as the use of texture in images as a source of motion cues. The flight-control and navigation systems of these robots are inspired largely by the designs and functions of the vision systems and brains of insects, which have been demonstrated to utilize optical flow (as detected by their eyes and brains) resulting from their own motions in the environment. Optical flow has been shown to be very effective as a means of avoiding obstacles and controlling speeds and altitudes in robotic navigation. Prior systems used in experiments on navigating by means of optical flow have involved the use of panoramic optics, high-resolution image sensors, and programmable imagedata- processing computers.

Thakoor, Sarita↗

NASA NTRS1992

Error Analysis of Combined Optical-Flow and Stereo Passive Ranging

The motion of an imaging sensor causes each imaged point of the seem to describe a time trajectory on the image plane. The trajectories of all imaged points are reminiscent of a flow (eg, of liquid) which is the source of the term "optical flow". Optical-flow ranging is a method by which the stream of two-dimensional images obtained from a forward-looking forward-moving passive sensor is used to compute range to points in the field of view. Another well-known ranging method consists of triangulation based on stereo images obtained from at least two stationary sensors. In this paper we analyze the potential accuracies of a combined optical flow and stereo passive-ranging system in the context of helicopter nap-of-the-earth obstacle avoidance. The Cramer-Rao lower bound (CRLB) is developed for the combined system under the assumption of a random angular misalignment common to both cameras of a stereo pair. It is shown that the range accuracy degradations caused by misalignment is negligible for a combined optical-flow and stereo system as compared with a monocular optical-flow system.

Barniv, Yair↗

NASA NTRS1991

Optical flow versus retinal flow as sources of information for flight guidance

The appropriate description is considered of visual information for flight guidance, optical flow vs. retinal flow. Most descriptions in the psychological literature are based on the optical flow. However, human eyes move and this movement complicates the issues at stake, particularly when movement of the observer is involved. The question addressed is whether an observer, whose eyes register only retinal flow, use information in optical flow. It is suggested that the observer cannot and does not reconstruct the image in optical flow; instead they use retinal flow. Retinal array is defined as the projections of a three space onto a point and beyond to a movable, nearly hemispheric sensing device, like the retina. Optical array is defined as the projection of a three space environment to a point within that space. And flow is defined as global motion as a field of vectors, best placed on a spherical projection surface. Specifically, flow is the mapping of the field of changes in position of corresponding points on objects in three space onto a point, where that point has moved in position.

Cutting, James E.↗

NASA NTRS2019

Optical Flow for Intermediate Frame Interpolation of Multispectral Geostationary Satellite Data

Applications in areas such as weather tracking and modeling, ecosystem monitoring, wildfire detection, and land-cover change are heavily dependent on spatial and temporal resolutions of satellite observations. However, there are typically trade-offs between spatial and temporal resolutions in dataset selection. For instance, geostationary weather tracking satellites are designed to take snapshots many times throughout the day but sensor hardware limits data collection. In this work we tackle this limitation, developing a method for temporal upsampling of multi-spectral satellite imagery using optical flow video interpolation deep convolutional neural networks. The presented model, extends Super SloMo (SSM) from single optical flow estimates to multichannel where flows are computed per band. We apply this technique on 8 multi-spectral bands of NOAA/NASA's GOES-16 mesoscale dataset to temporally enhance full disk hemispheric snapshots from 15 minutes to 1 minute. Through extensive experimentation, we show SSM vastly outperforms the linear interpolation baseline and that multichannel optical flows improves performance on GOES-16. A visual analysis of optical flow vectors clearly identifies hurricanes and large-scale atmospheric dynamics. Furthermore, we discuss challenges and open questions related to optical flow and temporal interpolation of multispectral geostationary satellite imagery.

Optical Flow↗

NASA NTRSDate not supplied

Dense Feature Tracking of Atmospheric Winds with Deep Optical Flow

Atmospheric winds are a key physical phenomenon impacting natural hazards, energy transport, ocean currents, large-scale circulation, and ecosystem fluxes. Observing winds is a complex process and presents a large gap in NASA’s Earth Observation System. Atmospheric motion vectors (AMVs) aim to fill this gap by making numerical estimates of cloud movement between sequences of multi-spectral satellite images, tracking clouds and water vapor. Recent imaging hardware and software advancements have enabled the use of numerical optical flow techniques to produce accurate and dense vector fields outperforming traditional methods. This work presents WindFlow as the first machine learning based system for feature tracking atmospheric motion using optical flow. Due to the lack of large-scale satellite-based observations, we leverage high-resolution numerical simulations from NASA's GEOS-5 Nature Run to perform supervised learning and transfer to satellite images. We demonstrate that our approach using deep learning based optical flow scales to ultra-high-resolution images of size 2881x5760 with less than 1 m/s bias and 2.5 m/s average error. Four network and learning architectures are compared and it is found that recurrent all-pairs field transforms (RAFT) produces the lowest errors on all metrics for wind speed and direction. Results on held out numerical outputs shows RAFT's good performance in each of the spatial, temporal, and physical dimensions. A comparison between WindFlow and an operational AMV product against rawinsonde observations show that RAFT transfers across simulations and thermal infrared satellite observations. This work shows that machine learning based optical flow is an efficient approach to generating robust feature tracking for AMVs consistently over large regions.

Atmospheric winds↗

NASA NTRS1991

Estimation of optical flow in airborne electro-optical sensors by stochastic approximation

The essence of motion or range estimation by passive electrooptical means is the ability to determine the correspondence of picture elements in pairs of image frames and to estimate their coordinates and their disparity (relative shifts) in the image plane of an electrooptical imaging sensor. The disparity can be in successive frames due to self-motion or in simultaneous frames of a stereo pair. A key issue is to provide these estimates on-line. This paper describes the theoretical background of such an interframe shift estimator. It is based on a stochastic gradient algorithm, specifically implementing a form of stochastic approximation, which can achieve rapid convergence of the shift estimate. Analytical and numerical simulation examples for random texture and isolated features validate the feasibility and the effectiveness of the estimator.

Merhav, S. J.↗

NASA NTRS2005

Optic Flow Dominates Visual Scene Polarity in Causing Adaptive Modification of Locomotor Trajectory

Locomotion and posture are influenced and controlled by vestibular, visual and somatosensory information. Optic flow and scene polarity are two characteristics of a visual scene that have been identified as being critical in how they affect perceived body orientation and self-motion. The goal of this study was to determine the role of optic flow and visual scene polarity on adaptive modification in locomotor trajectory. Two computer-generated virtual reality scenes were shown to subjects during 20 minutes of treadmill walking. One scene was a highly polarized scene while the other was composed of objects displayed in a non-polarized fashion. Both virtual scenes depicted constant rate self-motion equivalent to walking counterclockwise around the perimeter of a room. Subjects performed Stepping Tests blindfolded before and after scene exposure to assess adaptive changes in locomotor trajectory. Subjects showed a significant difference in heading direction, between pre and post adaptation stepping tests, when exposed to either scene during treadmill walking. However, there was no significant difference in the subjects heading direction between the two visual scene polarity conditions. Therefore, it was inferred from these data that optic flow has a greater role than visual polarity in influencing adaptive locomotor function.

Nomura, Y.↗

NASA NTRS2005

Optic Flow Dominates Visual Scene Polarity in Causing Adaptive Modification of Locomotor Trajectory

Nomura, Y.↗

NASA NTRS2016

Comparison of Cross Correlation and Optical Flow Methods for Processing Retroreflective and Natural Background BOS Data

Background oriented schlieren images have historically been generated by calculating the observed pixel displacement between an image pair using normalized cross-correlation methods. This work uses optical flow data reduction methods to solve the displacement fields. A well established method used in the computer vision community, optical flow is the apparent brightness motion in an image sequence. The regularization method of Horn and Schunck is used to create schlieren images using two data sets: a supersonic shockjet plume interaction at the NASA Ames Unitary Plan Wind Tunnel, and a transonic flight test of a T-38 using a naturally occurring background performed in conjunction with NASA Ames and Armstrong research centers. Results are presented and contrasted with those using normalized cross-correlation methods. The optical flow images are found to provided significantly more detail at a decreased computational time.

schlieren↗

NASA NTRSDate not supplied

Temporal Interpolation of Geostationary Satellite Imagery with Task Specific Optical Flow

Applications of satellite data in areas such as weather tracking and modeling, ecosystem monitoring, wildfire detection, and land-cover change are heavily dependent on the trade-offs to spatial, spectral and temporal resolutions of observations. In weather tracking, high-frequency temporal observations are critical and used to improve forecasts, study severe events, and extract atmospheric motion, among others. However, while the current generation of geostationary satellites have hemispheric coverage at 10-15 minute intervals, higher temporal frequency observations are ideal for studying mesoscale severe weather events. In this work, we apply a task specific optical flow approach to temporal up-sampling using deep convolutional neural networks. We apply this technique to 16-bands of GOES-R/Advanced Baseline Imager mesoscale dataset to temporally enhance full disk hemispheric snapshots of different spatial resolutions from 15 minutes to 1 minute. Experiments show the effectiveness of task specific optical flow and multi-scale blocks for interpolating high-frequency severe weather events relative to bilinear and global optical flow baselines. Lastly, we demonstrate strong performance in capturing variability during convective precipitation events.

Optical flow, temporal interpolation, geostationar↗

NASA NTRS2017

Optical Flow for Flight and Wind Tunnel Background Oriented Schlieren Imaging

Background oriented Schlieren images have historically been generated by calculating the observed pixel displacement between a wind-on and wind-o image pair using normalized cross-correlation. This work uses optical flow to solve the displacement fields which generate the Schlieren images. A well established method used in the computer vision community, optical flow is the apparent motion in an image sequence due to brightness changes. The regularization method of Horn and Schunck is used to create Schlieren images using two data sets: a supersonic jet plume shock interaction from the NASA Ames Unitary Plan Wind Tunnel, and a transonic flight test of a T-38 aircraft using a naturally occurring background, performed in conjunction with NASA Ames and Armstrong Research Centers. Results are presented and contrasted with those using normalized cross-correlation. The optical flow Schlieren images are found to provided significantly more detail. We apply the method to historical data sets to demonstrate the broad applicability and limitations of the technique.

Image processing↗

NASA NTRS1992

Application of velocity filtering to optical-flow passive ranging

The performance of the velocity filtering method as applied to optical-flow passive ranging under real-world conditions is evaluated. The theory of the 3-D Fourier transform as applied to constant-speed moving points is reviewed, and the space-domain shift-and-add algorithm is derived from the general 3-D matched filtering formulation. The constant-speed algorithm is then modified to fit the actual speed encountered in the optical flow application, and the passband of that filter is found in terms of depth (sensor/object distance) so as to cover any given range of depths. Two algorithmic solutions for the problems associated with pixel interpolation and object expansion are developed, and experimental results are presented.

Barniv, Yair↗

NASA NTRS2021

Temporal Interpolation of Geostationary Satellite Imagery With Optical Flow

Applications of satellite data in areas such as weather tracking and modeling, ecosystem monitoring, wildfire detection, and land-cover change are heavily dependent on the tradeoffs to spatial, spectral, and temporal resolutions of observations. In weather tracking, high-frequency temporal observations are critical and used to improve forecasts, study severe events, and extract atmospheric motion, among others. However, while the current generation of geostationary (GEO) satellites has hemispheric coverage at 10-15-min intervals, higher temporal frequency observations are ideal for studying mesoscale severe weather events. In this work, we present a novel application of deep learning-based optical flow to temporal upsampling of GEO satellite imagery. We apply this technique to 16 bands of the GOES-R/Advanced Baseline Imager mesoscale dataset to temporally enhance full-disk hemispheric snapshots of different spatial resolutions from 10 to 1 min. Experiments show the effectiveness of task-specific optical flow and multiscale blocks for interpolating high-frequency severe weather events relative to bilinear and global optical flow baselines. Finally, we demonstrate strong performance in capturing variability during convective precipitation events.

Image processing↗

NASA NTRS2004

Real-time detection of moving objects from moving vehicles using dense stereo and optical flow

Dynamic scene perception is very important for autonomous vehicles operating around other moving vehicles and humans. Most work on real-time object tracking from moving platforms has used sparse features or assumed flat scene structures. We have recently extended a real-time, dense stereo system to include realtime, dense optical flow, enabling more comprehensive dynamic scene analysis. We describe algorithms to robustly estimate 6-DOF robot egomotion in the presence of moving objects using dense flow and dense stereo. We then use dense stereo and egomotion estimates to identify & other moving objects while the robot itself is moving. We present results showing accurate egomotion estimation and detection of moving people and vehicles under general 6-DOF motion of the robot and independently moving objects. The system runs at 18.3 Hz on a 1.4 GHz Pentium M laptop, computing 160x120 disparity maps and optical flow fields, egomotion, and moving object segmentation. We believe this is a significant step toward general unconstrained dynamic scene analysis for mobile robots, as well as for improved position estimation where GPS is unavailable.

egomotion↗

NASA NTRS2004

Real-time detection of moving objects from moving vehicles using dense stereo and optical flow

Dynamic scene perception is very important for autonomous vehicles operating around other moving vehicles and humans. Most work on real-time object tracking from moving platforms has used sparse features or assumed flat scene structures. We have recently extended a real-time, dense stereo system to include real-time, dense optical flow, enabling more comprehensive dynamic scene analysis. We describe algorithms to robustly estimate 6-DOF robot egomotion in the presence of moving objects using dense flow and dense stereo. We then use dense stereo and egomotion estimates to identity other moving objects while the robot itself is moving. We present results showing accurate egomotion estimation and detection of moving people and vehicles under general 6-DOF motion of the robot and independently moving objects. The system runs at 18.3 Hz on a 1.4 GHz Pentium M laptop, computing 160x120 disparity maps and optical flow fields, egomotion, and moving object segmentation. We believe this is a significant step toward general unconstrained dynamic scene analysis for mobile robots, as well as for improved position estimation where GPS is unavailable.

egomotion↗

NASA NTRSDate not supplied

Towards Physics Guided Optical Flow for Tracking Atmospheric Motion

Observations of atmospheric 3D winds are critical for improving short-range and long-range forecasting. Such advancement in forecasting directly applies to research in a number of areas including convective processes, wildfire plumes and tornado prediction. Atmospheric Motion Vectors (AMVs) provide a passively sensed approach to quantifying horizontal motion and cloud heights, which are typically sourced from geostationary sensors due to the availability of high frequency observations. Recent work has shown that estimating AMVs by tracking individual pixels with dense optical flow is a promising new direction. In this work, we compare state-of-the-art convolutional neural networks for optical flow in a physics-guided deep learning framework for predicting AMVs. The approach is semi-supervised and uses physically informed wind vectors from high-resolution numerical simulations for supervised learning followed by fine-tuning though warping and reconstruction of full-disk geostationary images (GOES-16). In the vertical direction, we use labels from the CALIPSO low-earth orbit satellite to predict cloud height from 16-band geostationary images with a neural network. We present results for both tasks on held-out time periods and secondary datasets.

Geostationary↗