SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
A method to build a dense and reliable 3-D description of a scene from three digital images by means of passive stereovision is presented. This method uses figural continuity to improve the results of a previously developed algorithm. In particular, it copes much better with curved objects and produces results which are organized as 3-D chains of segments.
Traditional stereoscopic vision (3D) is achieved through use of two cameras arranged to emulate human eyes. While this method works on large scale projects, it becomes impractical to use on small scale designs, such as surgical endoscopes, in which the operational area doesn’t allow the immensity of dual camera systems. This project is focused on developing a stereoscopic endoscope using a single camera and Conjugated Multiple-Bandpass Filters (CMBF) to create 3D images. Each filter is designed to allow only a distinct spectrum of light to pass through. The stereoscopic image can be obtained by using filters that reflect and reject wavelengths, complementary to one another. A major concern in all stereovision is crosstalk, defined as the light from one eye image that is present in the other eye image. This incomplete isolation causes deterioration of the 3D image. In our system, the crosstalk comes from imperfect filters. The filter spectrums overlap at certain wavelengths, causing a dim outline of the right eye image to leak into the left eye image and vice versa, a phenomenon known as ghosting. Knowledge of the extent of this phenomenon is critical to creating sustainable, effective stereovision.
This paper addresses the problem of stereopair data compression. Two fundamentally different techniques for compressing stereopairs are discussed. The first technique, called disparity-compensated transform-domain predictive coding, attempts to minimize the mean-square error between the original stereopair and the compressed stereopair. The second technique, called mixed-resolution coding, is a psychophysically justified technique that exploits known facts about human stereovision to code stereopairs in a subjectively acceptable manner. A method for assessing the quality of compressed stereopairs is also presented. It involves measuring the ability of an observer to perceive depth in coded stereopairs. It is found that observers generally perceived objects to be further away in compressed stereopairs than they did in originals. Finally, the problem of coding stereopairs is considered from a rate-distortion perspective. It is proved that the rate distortion limit for coding stereopairs cannot in general be achieved by a coder that first codes and decodes the right picture sequence independently of the left picture sequence, and then codes and decodes the left picture sequence given the decoded right picture sequence.
This paper presents a general overview of the Marsokhod rover mission. The autonomous navigation for a Mars exploration rover is controlled by a vision system which has been developed on the basis of two CCD cameras, stereovision and path planning algorithms. Its performances have been tested on a Mars-like experimentation site.
The purpose of this project was to aid the EVA Robotic Assistant project by evaluating and designing the necessary interfaces for two stereo vision heads - the TracLabs Biclops pan-tilt-verge head, and the Helpmate Zebra pan-tilt-verge head. The first half of the project consisted of designing the necessary software interface so that the other modules of the EVA Robotic Assistant had proper access to all of the functionalities offered by each of the stereovision heads. This half took most of the project time, due to a lack of ready-made CORBA drivers for either of the heads. Once this was overcome, the evaluation stage of the project began. The second half of the project was to take these interfaces and to evaluate each of the stereo vision heads in terms of usefulness to the project. In the key project areas such as stability and reliability, the Zebra pan-tilt-verge head came out on top. However, the Biclops did have many more advantages over the Zebra, such as: lower power consumption, faster communications, and a simpler, cleaner API. Overall, the Biclops pan-tilt-verge head outperformed the Zebra pan-tilt-verge head.
A mobile version of the NASA/DARPA Robonaut humanoid recently completed initial autonomy trials working directly with humans in cluttered environments. This compact robot combines the upper body of the Robonaut system with a Segway Robotic Mobility Platform yielding a dexterous, maneuverable humanoid ideal for interacting with human co-workers in a range of environments. This system uses stereovision to locate human teammates and tools and a navigation system that uses laser range and vision data to follow humans while avoiding obstacles. Tactile sensors provide information to grasping algorithms for efficient tool exchanges. The autonomous architecture utilizes these pre-programmed skills to form complex behaviors. The initial behavior demonstrates a robust capability to assist a human by acquiring a tool from a remotely located individual and then following the human in a cluttered environment with the tool for future use.
The Mars Exploration Rovers (MER) currently navigating the surface of Mars are outfitted with an advanced stereovision correlation algorithm which allows them to "see" three-dimensionally and autonomously avoid obstac'les in their path. A bottleneck of this system is that it is computationally intense and requires 3 minutes of processing for every correlated image and path choice. Taking advantage of the optimization and reprogrammability of FPGAs, the Mobility Avionics lab has reduced this process to under a second. The lab is demonstrating the advancement with a prototype rover, complete with an LN-200 inertial measurement unit (IMU), which is a flight spare from MER. The LN-200 is a space-grade, six degrees-of-freedom IMU using three fiber-optic gyroscopes and three silicon accelerometers and no moving parts. It has particular power-sequencing needs and communicates with a specialized serial protocol (SDLC over RS-422), requiring specific hardware and software for proper functionality and interfacing with an FPGA. The process of incorporating the LN-200 into the system is described herein.
The FIDO platform of the JPL has been used to evaluate the ability of autonomous obstacle avoidance developed by JPL and CNES autonomous long range path planning. The test results show that only a very small amount of energy and computing time is used to implement autonomy and that the capabilities of the rover are fully used, allowing a much longer daily traverse than purely ground-planned strategies.
We are concerned here with improving long range stereo by filtering image sequences. Traditionally, measurement errors from stereo camera systems have been approximated as 3-D Gaussians, where the mean is derived by triangulation and the covariance by linearized error propagation. However, there are two problems that arise when filtering such 3-D measurements. First, stereo triangulation suffers from a range dependent statistical bias; when filtering this leads to over-estimating the true range. Second, filtering 3-D measurements derived via linearized error propagation leads to apparent filter divergence; the estimator is biased to under-estimate range. To address the first issue, we examine the statistical behavior of stereo triangulation and show how to remove the bias by series expansion. The solution to the second problem is to filter with image coordinates as measurements instead of triangulated 3-D coordinates.
Traditional stereoscopic vision (3D) is achieved through use of two separate cameras, arranged to emulate human eyes. This method works well on most projects, but becomes impractical on small scale designs, such as surgical endoscopes. This project is focused on developing a stereoscopic endoscope, using a single camera and Conjugated Multiple?Bandpass Filters (CMBF) to produce stereoscopic vision. Each half of filter is built to allow a distinct spectrum to pass through, while blocking the complimentary spectrum. A system with complimentary filters can produce stereoscopic images. To accomplish this, the light must be filtered at the source to match the filters at the camera. Additionally, the light source and camera must be synchronized in a way that each image will show only one filter spectrum. In this paper, I will describe the design and characterization of the prototype electro?optical system, including optical throughput measurements and video produced using this method.