Search NASA⌕ Search

SEARCH · Search NASA

Results for “visual stereo”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Bringing "Scientific Expeditions" Into the Schools

Two new technologies, the FASTexpedition and Remote FAST, have been developed that provide remote, 3D, high resolution, dynamic, interactive viewing of scientific data (such as simulations or measurements of fluid dynamics). The FASTexpedition permits one to access scientific data from the World Wide Web, take guided expeditions through the data, and continue with self controlled expeditions through the data. Remote FAST permits collaborators at remote sites to simultaneously view an analysis of scientific data being controlled by one of the collaborators. Control can be transferred between sites. These technologies are now being used for remote collaboration in joint university, industry, and NASA projects in computational fluid dynamics (CFD) and wind tunnel testing. Also, NASA Ames Research Center has initiated a project to make scientific data and guided expeditions through the data available as FASTexpeditions on the World Wide Web for educational purposes. Previously, remote visualiZation of dynamic data was done using video format (transmitting pixel information) such as video conferencing or MPEG movies on the Internet. The concept for this new technology is to send the raw data (e.g., grids, vectors, and scalars) along with viewing scripts over the Internet and have the pixels generated by a visualization tool running on the viewer's local workstation. The visualization tool that is currently used is FAST (Flow Analysis Software Toolkit). The advantages of this new technology over using video format are: 1. The visual is much higher in resolution (1280xl024 pixels with 24 bits of color) than typical video format transmitted over the network. 2. The form of the visualization can be controlled interactively (because the viewer is interactively controlling the visualization tool running on his workstation). 3. A rich variety of guided expeditions through the data can be included easily. 4. A capability is provided for other sites to see a visual analysis of one site as the analysis is interactively performed. Control of the analysis can be passed from site to site. 5. The scenes can be viewed in 3D using stereo vision. 6. The network bandwidth used for the visualization using this new technology is much smaller than when using video format. (The measured peak bandwidth used was 1 Kbit/sec whereas the measured bandwidth for a small video picture was 500 Kbits/sec.)

Watson, Val↗

Experimental study of the laminar-turbulent transition of a concave wall in a parallel flow

The instability of the laminar boundary layer flow along a concave wall was studied. Observations of these three-dimensional boundary layer phenomena were made using the hydrogen-bubble visualization technique. With the application of stereo-photogrammetric methods in the air-water system it was possible to investigate the flow processes qualitatively and quantitatively. In the case of a concave wall of sufficient curvature, a primary instability occurs first in the form of Goertler vortices with wave lengths depending upon the boundary layer thickness and the wall curvature. At the onset the amplification rate is in agreement with the linear theory. Later, during the non-linear amplification stage, periodic spanwise vorticity concentrations develop in the low velocity region between the longitudinal vortices. Then a meandering motion of the longitudinal vortex streets subsequently ensues, leading to turbulence.

Bippes, H.↗

Path Following with Slip Compensation for a Mars Rover

A software system for autonomous operation of a Mars rover is composed of several key algorithms that enable the rover to accurately follow a designated path, compensate for slippage of its wheels on terrain, and reach intended goals. The techniques implemented by the algorithms are visual odometry, full vehicle kinematics, a Kalman filter, and path following with slip compensation. The visual-odometry algorithm tracks distinctive scene features in stereo imagery to estimate rover motion between successively acquired stereo image pairs, by use of a maximum-likelihood motion-estimation algorithm. The full-vehicle kinematics algorithm estimates motion, with a no-slip assumption, from measured wheel rates, steering angles, and angles of rockers and bogies in the rover suspension system. The Kalman filter merges data from an inertial measurement unit (IMU) and the visual-odometry algorithm. The merged estimate is then compared to the kinematic estimate to determine whether and how much slippage has occurred. The kinematic estimate is used to complement the Kalman-filter estimate if no statistically significant slippage has occurred. If slippage has occurred, then a slip vector is calculated by subtracting the current Kalman filter estimate from the kinematic estimate. This slip vector is then used, in conjunction with the inverse kinematics, to determine the wheel velocities and steering angles needed to compensate for slip and follow the desired path.

Helmick, Daniel↗

The effect of monocular target blur on simulated telerobotic manipulation

A simulation involving three types of telerobotic tasks that require information about the spatial position of objects is reported. This is similar to the results of psychophysical experiments examining the effect of blur on stereoacuity. It is suggested that other psychophysical experimental results could be used to predict operator performance for other telerobotic tasks. It is demonstrated that refractive errors in the helmet-mounted stereo display system can affect performance in the three types of telerobotic tasks. The results of two sets of experiments indicate that monocular target blur of two diopters or more degrades stereo display performance to the level of monocular displays. This indicates that moderate levels of visual degradation that affect the operator's stereoacuity may eliminate the performance advantage of stereo displays.

Liu, Andrew↗

Visual specification of robot motion

The authors describe the use of stereo pairs of images to specify robot motion. The experimental setup includes a SUN workstation, a PUMA 560 robot, and an Imaging 151 vision system. An X-window environment displays stereo images of the work scene. Image processing is performed to extract linear edge segments from the images and the results are displayed on screen. Using a pointing device, the user selects a group of edges from the object relevant to the task. The 3D structure of this group of features is found by stereo triangulation and they can be displayed in 3D from any point of view. A viewpoint orthogonal to the plane defined by these 3D edges is used to specify the robot position relative to object position. The actual robot will then be moved to the specified position.

Shiu, Y. C.↗

Stereo radar for mapping and interpretation

The use of terrain imaging radar to extract elevation information by stereo viewing and measurement is discussed. Either a three dimensional visual model or elevation measurements may be obtained by simultaneous viewing or differential measurement of images obtained by a side-looking radar from two different flightpaths. Expressions describing radar image geometry, model vertical exaggeration, and stereo measurement accuracy are derived. The dependence of the exaggeration and accuracy on system parameters and key system errors is derived, discussed, and illustrated by application to several airborne and spaceborne systems and system concepts, and the results of some preliminary measurements of imagery from two airborne and one spaceborne system are given.

Graham, L.↗

Robots in space exploration

A brief outline of NASA's current robotics program is presented. Efforts are being concentrated on a roving surface vehicle for Mars exploration. This vehicle will integrate manipulative, locomotive, and visual functions and will feature an electromechanical manipulator, stereo TV cameras, a laser rangefinder, a minicomputer, and a remote off-line computer. The program hinges on the iterative development of complex scenarios describing the robot's mission and the interrelationships among its various subsystems.

Dobrotin, B. M.↗

The EPEC Algorithm for Vision Guided Manipulation: Analysis and Validation

This paper describes the simulated performance and experimental validation of a computationally efficient algorithm for improving positioning accuracy of robot arms using low speed feedback from fixed stereo cameras. The algorithm, called End-Effector Position Error Compensation (EPEC) is robust to visual occlusion of the end-effector and does not require high fidelity calibration of either the arm or stereo camera. The algorithm works by calculating an error vector between the locations of a fiducial on the arm's end-effector as predicted by arm kinematics and detected by a stereo camera triangulation. With this knowledge, the commanded target pose is adjusted to compensate for positioning errors. A simulation environment where arbitrary error can be introduced into arm-camera systems is introduced and used to provide an assessment of the performance of the algorithm under both ideal and degraded conditions.

manipulations↗

Correction techniques for depth errors with stereo three-dimensional graphic displays

Three-dimensional (3-D), 'real-world' pictorial displays that incorporate 'true' depth cues via stereopsis techniques have proved effective for displaying complex information in a natural way to enhance situational awareness and to improve pilot/vehicle performance. In such displays, the display designer must map the depths in the real world to the depths available with the stereo display system. However, empirical data have shown that the human subject does not perceive the information at exactly the depth at which it is mathematically placed. Head movements can also seriously distort the depth information that is embedded in stereo 3-D displays because the transformations used in mapping the visual scene to the depth-viewing volume (DVV) depend intrinsically on the viewer location. The goal of this research was to provide two correction techniques; the first technique corrects the original visual scene to the DVV mapping based on human perception errors, and the second (which is based on head-positioning sensor input data) corrects for errors induced by head movements. Empirical data are presented to validate both correction techniques. A combination of the two correction techniques effectively eliminates the distortions of depth information embedded in stereo 3-D displays.

Parrish, Russell V.↗

On line quantification of crystal surfaces by stereo imaging

The shape of an interface while a crystal is growing inside a crystal growth furnace is an important measurement to assess the crystal quality on-line. If the crystal surface can be visualized by video or x ray imaging, the interface shape can be determined by the stereo image processing techniques. This paper presents a methodology to determine the shape of the solid-melt interface by stereo based imaging techniques while the crystal is growing inside a transparent furnace. The methodology generates qualitative shape information provided that a good pair of stereo images of the interface can be captured. For a quantitative shape description, i.e., for the determination of interface points with respect to a fixed coordinate frame, both cameras must be calibrated. This paper illustrates the methodology for qualitative shape determination of lead bromide crystal interface.

Batur, Celal↗

Application of a Two Camera Video Imaging System to Three-Dimensional Vortex Tracking in the 80- by 120-Foot Wind Tunnel

A description is presented of two enhancements for a two-camera, video imaging system that increase the accuracy and efficiency of the system when applied to the determination of three-dimensional locations of points along a continuous line. These enhancements increase the utility of the system when extracting quantitative data from surface and off-body flow visualizations. The first enhancement utilizes epipolar geometry to resolve the stereo "correspondence" problem. This is the problem of determining, unambiguously, corresponding points in the stereo images of objects that do not have visible reference points. The second enhancement, is a method to automatically identify and trace the core of a vortex in a digital image. This is accomplished by means of an adaptive template matching algorithm. The system was used to determine the trajectory of a vortex generated by the Leading-Edge eXtension (LEX) of a full-scale F/A-18 aircraft tested in the NASA Ames 80- by 120-Foot Wind Tunnel. The system accuracy for resolving the vortex trajectories is estimated to be +/-2 inches over distance of 60 feet. Stereo images of some of the vortex trajectories are presented. The system was also used to determine the point where the LEX vortex "bursts". The vortex burst point locations are compared with those measured in small-scale tests and in flight and found to be in good agreement.

Meyn, Larry A.↗

Advanced Bayesian Method for Planetary Surface Navigation

Autonomous Exploration, Inc., has developed an advanced Bayesian statistical inference method that leverages current computing technology to produce a highly accurate surface navigation system. The method combines dense stereo vision and high-speed optical flow to implement visual odometry (VO) to track faster rover movements. The Bayesian VO technique improves performance by using all image information rather than corner features only. The method determines what can be learned from each image pixel and weighs the information accordingly. This capability improves performance in shadowed areas that yield only low-contrast images. The error characteristics of the visual processing are complementary to those of a low-cost inertial measurement unit (IMU), so the combination of the two capabilities provides highly accurate navigation. The method increases NASA mission productivity by enabling faster rover speed and accuracy. On Earth, the technology will permit operation of robots and autonomous vehicles in areas where the Global Positioning System (GPS) is degraded or unavailable.

Center, Julian↗

Beyond the cockpit: The visual world as a flight instrument

The use of cockpit instruments to guide flight control is not always an option (e.g., low level rotorcraft flight). Under such circumstances the pilot must use out-the-window information for control and navigation. Thus it is important to determine the basis of visually guided flight for several reasons: (1) to guide the design and construction of the visual displays used in training simulators; (2) to allow modeling of visibility restrictions brought about by weather, cockpit constraints, or distortions introduced by sensor systems; and (3) to aid in the development of displays that augment the cockpit window scene and are compatible with the pilot's visual extraction of information from the visual scene. The authors are actively pursuing these questions. We have on-going studies using both low-cost, lower fidelity flight simulators, and state-of-the-art helicopter simulation research facilities. Research results will be presented on: (1) the important visual scene information used in altitude and speed control; (2) the utility of monocular, stereo, and hyperstereo cues for the control of flight; (3) perceptual effects due to the differences between normal unaided daylight vision, and that made available by various night vision devices (e.g., light intensifying goggles and infra-red sensor displays); and (4) the utility of advanced contact displays in which instrument information is made part of the visual scene, as on a 'scene linked' head-up display (e.g., displaying altimeter information on a virtual billboard located on the ground).

Johnson, W. W.↗

Autonomous 3D and Radiation Mapping in Tunnel Environments Using Aerial Robots - 18156

In this paper we present the algorithms and systems developed to enable autonomous 3D and radiation mapping, as well as radiological source localization in tunnel environments using aerial robots. The developed technologies aim to address the need of autonomous robotic inspection of nuclear sites such as facilities in the process of being decommissioned. As a motivational example, the PUREX tunnels at the Hanford Site are considered and the robot is designed to be able to conduct multi-modal 3D/radiation characterization of the tunnel environment without any prior knowledge or map provided beforehand. In order to enable the necessary GPS-denied simultaneous localization and mapping in dark, visually-degraded tunnel environments, a multi-modal mapping unit was developed which fuses the data from stereo vision cameras synchronized with flashing LEDs, inertial sensors, and three time-of-flight 3D depth sensors. The robot's pose and surrounding map are estimated at 20 Hz through a depth-enhanced visual- inertial localization and mapping framework. Provided this ability to estimate the robot's pose and develop a dense map in real-time, a receding horizon sampling-based autonomous exploration path planning algorithm was utilized and equips the robot with the ability to explore its environment given no prior map. The aforementioned key robotic functionalities are further extended through the integration of miniaturized fully solid-state scintillation detectors, utilizing advanced scintillators and Silicon Photomultipliers. The derived sensor data is employed for radiation mapping, which when fused with the 3D maps and the spectroscopic source localization methods, allow the aerial robotic platform to localize the radiation source and identify the specific source isotope. The source location is estimated through a geometric algorithm which can localize a source given only three measurements and short dwell times. The developed systems were tested using two small aerial robot platforms of the F450 and F550 frame classes with weights of 2.6 kg and 2.9 kg respectively. All localization and planning as well as high-level control algorithms are executed onboard. The scintillation detector is integrated on the robot and its data is collected through a dedicated microcontroller. A set of field experiments were conducted inside the dark and GPS-denied environment of a 4.25 m wide, 7.5 m tall, and 137 m long railroad tunnel. A Cs-137 source was placed within the tunnel, the associated 3D/radiation maps were derived, and the source location was estimated. Through these efforts, the goal is to develop the robotic technology that would enable the autonomous systematic inspection or emergency response in nuclear waste decommissioning facilities. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Predictive Sea State Estimation for Automated Ride Control and Handling - PSSEARCH

PSSEARCH provides predictive sea state estimation, coupled with closed-loop feedback control for automated ride control. It enables a manned or unmanned watercraft to determine the 3D map and sea state conditions in its vicinity in real time. Adaptive path-planning/ replanning software and a control surface management system will then use this information to choose the best settings and heading relative to the seas for the watercraft. PSSEARCH looks ahead and anticipates potential impact of waves on the boat and is used in a tight control loop to adjust trim tabs, course, and throttle settings. The software uses sensory inputs including IMU (Inertial Measurement Unit), stereo, radar, etc. to determine the sea state and wave conditions (wave height, frequency, wave direction) in the vicinity of a rapidly moving boat. This information can then be used to plot a safe path through the oncoming waves. The main issues in determining a safe path for sea surface navigation are: (1) deriving a 3D map of the surrounding environment, (2) extracting hazards and sea state surface state from the imaging sensors/map, and (3) planning a path and control surface settings that avoid the hazards, accomplish the mission navigation goals, and mitigate crew injuries from excessive heave, pitch, and roll accelerations while taking into account the dynamics of the sea surface state. The first part is solved using a wide baseline stereo system, where 3D structure is determined from two calibrated pairs of visual imagers. Once the 3D map is derived, anything above the sea surface is classified as a potential hazard and a surface analysis gives a static snapshot of the waves. Dynamics of the wave features are obtained from a frequency analysis of motion vectors derived from the orientation of the waves during a sequence of inputs. Fusion of the dynamic wave patterns with the 3D maps and the IMU outputs is used for efficient safe path planning.

Huntsberger, Terrance L.↗

Planetary Rover Localization Within Orbital Maps

This paper introduces an advanced rover localization system suitable for autonomous planetary exploration in the absence of Global Positioning System (GPS) infrastructure. Given an existing terrain map (image and elevation) obtained from satellite imagery and the images provided by the rover stereo camera system, the proposed method determines the best rover location through visual odometry, 3D terrain and hori- zon matching. The system is tested on data retrieved from a 3 km traverse of the Basalt Hills quarry in California where the GPS track is used as ground truth. Experimental results show the system presented here reduces by over 60 the localization error obtained by wheel odometry.

localization↗

A Concept for the Processing and Display of Thematic Mapper Data

The thematic mapper system provides spectral information in seven carefully selected spectral bands. The challenge is to devise the best approach for presenting this complex spectral information in a pictorial format which can be understood and accepted as a standard by the growing user community. For photointerpretation purposes, the overall approach in the processing of multispectral, and especially of Thematic Mapper data is based on the Independent definition and optimization of individual panchromatic and spectral (interpretive) components and the combined display of these individual interpretive components in a perceivable manner. Processing of the Thematic Mapper data within the framework of interpretive components requires the application of special intensity, hue, saturation (IHS) and synthetic stereo (SST) display techniques. The results to date using these techniques demonstrate improved visual separability of spectral surface categories relative to standard multispectral color composites as well as a greater potential for conducting meaningful spectral-diagnostic analysis.

Haydn, R.↗