Search NASA⌕ Search

SEARCH · Search NASA

Results for “Robot vision systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS1994

A smart telerobotic system driven by monocular vision

A robotic system that accepts autonomously generated motion and control commands is described. The system provides images from the monocular vision of a camera mounted on a robot's end effector, eliminating the need for traditional guidance targets that must be predetermined and specifically identified. The telerobotic vision system presents different views of the targeted object relative to the camera, based on a single camera image and knowledge of the target's solid geometry.

Defigueiredo, R. J. P.↗
NASA NTRS1990

Fast Feature-Recognizing Optoelectronic System

Proposed optoelectronic system recognizes features or classifies images by processing outputs of photosensors rapidly, in parallel, through circuits developed in research on neural networks. Array of photoconductive elements serve as photomodulated connections in electronic neural network, which provides high speed data compression to generate feature vector. System able to "learn" new patterns for subsequent recognition. Potential applications in robotic vision systems and pattern recognition.

Thakoor, S.↗
NASA NTRS1994

Digital-Electronic/Optical Apparatus Would Recognize Targets

Proposed automatic target-recognition apparatus consists mostly of digital-electronic/optical cross-correlator that processes infrared images of targets. Infrared images of unknown targets correlated quickly with images of known targets. Apparatus incorporates some features of correlator described in "Prototype Optical Correlator for Robotic Vision System" (NPO-18451), and some of correlator described in "Compact Optical Correlator" (NPO-18473). Useful in robotic system; to recognize and track infrared-emitting, moving objects as variously shaped hot workpieces on conveyor belt.

Scholl, Marija S.↗
NASA NTRS2008

Range Imaging without Moving Parts

Range-imaging instruments of a type now under development are intended to generate the equivalent of three-dimensional images from measurements of the round-trip times of flight of laser pulses along known directions. These instruments could also provide information on characteristics of targets, including roughnesses and reflectivities of surfaces and optical densities of such semi-solid objects as trees and clouds. Unlike in prior range-imaging instruments based on times of flight along known directions, there would be no moving parts; aiming of the laser beams along the known directions would not be accomplished by mechanical scanning of mirrors, prisms, or other optical components. Instead, aiming would be accomplished by using solid-state devices to switch input and output beams along different fiber-optic paths. Because of the lack of moving parts, these instruments could be extraordinarily reliable, rugged, and long-lasting. An instrument of this type would include an optical transmitter that would send out a laser pulse along a chosen direction to a target. An optical receiver coaligned with the transmitter would measure the temporally varying intensity of laser light reflected from the target to determine the distance and surface characteristics of the target. The transmitter would be a combination of devices for generating precise directional laser illumination. It would include a pulsed laser, the output of which would be coupled into a fiber-optic cable with a fan-out and solid-state optical switches that would enable switching of the laser beam onto one or more optical fibers terminated at known locations in an array on a face at the focal plane of a telescope. The array would be imaged by the telescope onto the target space. The receiver optical system could share the aforementioned telescope with the transmitter or could include a separate telescope aimed in the same direction as that of the transmitting telescope. In either case, light reflected from the target would be focused by the receiver optical system onto an array of optical fibers matching the array in the transmitter. These optical fibers would couple the received light to one or more photodetector( s). Optionally, the receiver could include solid-state optical switches for choosing which optical fiber(s) would couple light to the photodetector(s). This instrument architecture is flexible and can be optimized for a wide variety of applications and levels of performance. For example, it is scalable to any number of pixels and pixel resolutions and is compatible with a variety of ranging and photodetection methodologies, including, for example, ranging by use of modulated (including pulsed and encoded) light signals. The use of fixed arrays of optical fibers to generate controlled illumination patterns would eliminate the mechanical complexity and much of the bulk of optomechanical scanning assemblies. Furthermore, digital control of the selection of the fiber-optic pathways for the transmitted beams could afford capabilities not seen in previous three-dimensional range-imaging systems. Instruments of this type could be specialized for use as, for example, proximity detectors, three-dimensional robotic vision systems, airborne terrain-mapping systems, and inspection systems.

Blair, J. Bryan↗
NASA NTRS1977

The robot's eyes - Stereo vision system for automated scene analysis

Attention is given to the robot stereo vision system which maintains the image produced by solid-state detector television cameras in a dynamic random access memory called RAPID. The imaging hardware consists of sensors (two solid-state image arrays using a charge injection technique), a video-rate analog-to-digital converter, the RAPID memory, and various types of computer-controlled displays, and preprocessing equipment (for reflexive actions, processing aids, and object detection). The software is aimed at locating objects and transversibility. An object-tracking algorithm is discussed and it is noted that tracking speed is in the 50-75 pixels/s range.

Williams, D. S.↗
NASA NTRS1987

An optical processor for object recognition and tracking

The design and development of a miniaturized optical processor that performs real time image correlation are described. The optical correlator utilizes the Vander Lugt matched spatial filter technique. The correlation output, a focused beam of light, is imaged onto a CMOS photodetector array. In addition to performing target recognition, the device also tracks the target. The hardware, composed of optical and electro-optical components, occupies only 590 cu cm of volume. A complete correlator system would also include an input imaging lens. This optical processing system is compact, rugged, requires only 3.5 watts of operating power, and weighs less than 3 kg. It represents a major achievement in miniaturizing optical processors. When considered as a special-purpose processing unit, it is an attractive alternative to conventional digital image recognition processing. It is conceivable that the combined technology of both optical and ditital processing could result in a very advanced robot vision system.

Sloan, J.↗
NASA NTRS1981

Marking parts to aid robot vision

The premarking of parts for subsequent identification by a robot vision system appears to be beneficial as an aid in the automation of certain tasks such as construction in space. A simple, color coded marking system is presented which allows a computer vision system to locate an object, calculate its orientation, and determine its identity. Such a system has the potential to operate accurately, and because the computer shape analysis problem has been simplified, it has the ability to operate in real time.

Bales, J. W.↗
NASA NTRS1989

Robotic Vision Would Combine Optics And Microwaves

Conceptual robot-vision system processes data from both microwave and visible-wavelength sensors. Concept, called "fusion of sensors," yields better information on shapes of some objects than obtained from one type of sensor alone. Proposed system fuses data from television images with polarized low-resolution radar-scattering cross sections. Using iterative procedure, generates successive approximations to shape of target by minimizing differences between observed radar returns and radar returns observed if object characterized by computed scattering transfer matrix.

Krishen, Kuma↗
NASA NTRS1991

The 1991 Goddard Conference on Space Applications of Artificial Intelligence

The purpose of this annual conference is to provide a forum in which current research and development directed at space applications of artificial intelligence can be presented and discussed. The papers in this proceeding fall into the following areas: Planning and scheduling, fault monitoring/diagnosis/recovery, machine vision, robotics, system development, information management, knowledge acquisition and representation, distributed systems, tools, neural networks, and miscellaneous applications.

Rash, James L.↗
NASA NTRS1992

Method and apparatus for predicting the direction of movement in machine vision

A computer-simulated cortical network is presented. The network is capable of computing the visibility of shifts in the direction of movement. Additionally, the network can compute the following: (1) the magnitude of the position difference between the test and background patterns; (2) localized contrast differences at different spatial scales analyzed by computing temporal gradients of the difference and sum of the outputs of paired even- and odd-symmetric bandpass filters convolved with the input pattern; and (3) the direction of a test pattern moved relative to a textured background. The direction of movement of an object in the field of view of a robotic vision system is detected in accordance with nonlinear Gabor function algorithms. The movement of objects relative to their background is used to infer the 3-dimensional structure and motion of object surfaces.

Lawton, Teri B.↗
NASA NTRS1995

Discrete Gabor Filters For Binocular Disparity Measurement

Discrete Gabor filters proposed for use in determining binocular disparity - difference between positions of same feature or object depicted in stereoscopic images produced by two side-by-side cameras aimed in parallel. Magnitude of binocular disparity used to estimate distance from cameras to feature or object. In one potential application, cameras charge-coupled-device video cameras in robotic vision system, and binocular disparities and distance estimates used as control inputs - for example, to control approaches to objects manipulated or to maintain safe distances from obstacles. Binocular disparities determined from phases of discretized Gabor transforms.

Weiman, Carl F. R.↗
NASA NTRS2008

Part Marking and Identification Materials' for MISSE

The Materials on International Space Station Experiment (MISSE) is being conducted with funding from NASA and the U.S. Department of Defense, in order to evaluate candidate materials and processes for flight hardware. MISSE modules include test specimens used to validate NASA technical standards for part markings exposed to harsh environments in low-Earth orbit and space, including: atomic oxygen, ultraviolet radiation, thermal vacuum cycling, and meteoroid and orbital debris impact. Marked test specimens are evaluated and then mounted in a passive experiment container (PEC) that is affixed to an exterior surface on the International Space Station (ISS). They are exposed to atomic oxygen and/or ultraviolet radiation for a year or more before being retrieved and reevaluated. Criteria include percent contrast, axial uniformity, print growth, error correction, and overall grade. MISSE 1 and 2 (2001-2005), MISSE 3 and 4 (2006-2007), and MISSE 5 (2005-2006) have been completed to date. Acceptable results were found for test specimens marked with Data Matrix(TradeMark) symbols by Intermec Inc. and Robotic Vision Systems Inc using: laser bonding, vacuum arc vapor deposition, gas assisted laser etch, chemical etch, mechanical dot peening, laser shot peening, laser etching, and laser induced surface improvement. MISSE 6 (2008-2009) is exposing specimens marked by DataLase(Registed TradeMark), Chemico technologies Inc., Intermec Inc., and tesa with laser-markable paint, nanocode tags, DataLase and tesa laser markings, and anodized metal labels.

Roxby, Donald↗
NASA NTRS2004

Format for Interchange and Display of 3D Terrain Data

Visible Scalable Terrain (ViSTa) is a software format for production, interchange, and display of three-dimensional (3D) terrain data acquired by stereoscopic cameras of robotic vision systems. ViSTa is designed to support scalability of data, accuracy of displayed terrain images, and optimal utilization of computational resources. In a ViSTa file, an area of terrain is represented, at one or more levels of detail, by coordinates of isolated points and/or vertices of triangles derived from a texture map that, in turn, is derived from original terrain images. Unlike prior terrain-image software formats, ViSTa includes provisions to ensure accuracy of texture coordinates. Whereas many such formats are based on 2.5-dimensional terrain models and impose additional regularity constraints on data, ViSTa is based on a 3D model without regularity constraints. Whereas many prior formats require external data for specifying image-data coordinate systems, ViSTa provides for the inclusion of coordinate-system data within data files. ViSTa admits highspeed loading and display within a Java program. ViSTa is designed to minimize file sizes and maximize compressibility and to support straightforward reduction of resolution to reduce file size for Internet-based distribution.

Backes, Paul↗
NASA NTRS1986

Robotic Vision for Welding

Vision system for robotic welder looks at weld along axis of welding electrode. Gives robot view of most of weld area, including yet-unwelded joint, weld pool, and completed weld bead. Protected within welding-torch body, lens and fiber bundle give robot closeup view of weld in progress. Relayed to video camera on robot manipulator frame, weld image provides data for automatic control of robot motion and welding parameters.

Richardson, R. W.↗
NASA NTRS1989

Use of 3D vision for fine robot motion

An integration of 3-D vision systems with robot manipulators will allow robots to operate in a poorly structured environment by visually locating targets and obstacles. However, by using computer vision for objects acquisition makes the problem of overall system calibration even more difficult. Indeed, in a CAD based manipulation a control architecture has to find an accurate mapping between the 3-D Euclidean work space and a robot configuration space (joint angles). If a stereo vision is involved, then one needs to map a pair of 2-D video images directly into the robot configuration space. Neural Network approach aside, a common solution to this problem is to calibrate vision and manipulator independently, and then tie them via common mapping into the task space. In other words, both vision and robot refer to some common Absolute Euclidean Coordinate Frame via their individual mappings. This approach has two major difficulties. First a vision system has to be calibrated over the total work space. And second, the absolute frame, which is usually quite arbitrary, has to be the same with a high degree of precision for both robot and vision subsystem calibrations. The use of computer vision to allow robust fine motion manipulation in a poorly structured world which is currently in progress is described along with the preliminary results and encountered problems.

Lokshin, Anatole↗
NASA NTRS1990

Real time visual tracking of targets in six dimensions

Six dimensional target information is produced by a target tracking vision system for use in real time target tracking by a robotic system. The vision system described in this paper produces three axes of position data and three axes of orientation data using a single camera which views a three dimensional target. The system performs target detection, target discrimination and determines the target position and orientation relative to the camera. As the target information is determined, it is communicated to a computer which is controlling the robot motion in real time. Details of the image processing algorithms and image processing hardware used in the vision system are discussed in the paper.

Walsh, Peter M.↗
NASA NTRS1987

Vision technology/algorithms for space robotics applications

The thrust of automation and robotics for space applications has been proposed for increased productivity, improved reliability, increased flexibility, higher safety, and for the performance of automating time-consuming tasks, increasing productivity/performance of crew-accomplished tasks, and performing tasks beyond the capability of the crew. This paper provides a review of efforts currently in progress in the area of robotic vision. Both systems and algorithms are discussed. The evolution of future vision/sensing is projected to include the fusion of multisensors ranging from microwave to optical with multimode capability to include position, attitude, recognition, and motion parameters. The key feature of the overall system design will be small size and weight, fast signal processing, robust algorithms, and accurate parameter determination. These aspects of vision/sensing are also discussed.

Krishen, Kumar↗
NASA NTRS2009

Head Pose Estimation Using Multilinear Subspace Analysis for Robot Human Awareness

Mobile robots, operating in unconstrained indoor and outdoor environments, would benefit in many ways from perception of the human awareness around them. Knowledge of people's head pose and gaze directions would enable the robot to deduce which people are aware of the its presence, and to predict future motions of the people for better path planning. To make such inferences, requires estimating head pose on facial images that are combination of multiple varying factors, such as identity, appearance, head pose, and illumination. By applying multilinear algebra, the algebra of higher-order tensors, we can separate these factors and estimate head pose regardless of subject's identity or image conditions. Furthermore, we can automatically handle uncertainty in the size of the face and its location. We demonstrate a pipeline of on-the-move detection of pedestrians with a robot stereo vision system, segmentation of the head, and head pose estimation in cluttered urban street scenes.

Ivanov, Tonislav↗