Venema, Steven C. | Search NASA

NASA NTRS1993

Movable Cameras And Monitors For Viewing Telemanipulator

Three methods proposed to assist operator viewing telemanipulator on video monitor in control station when video image generated by movable video camera in remote workspace of telemanipulator. Monitors rotated or shifted and/or images in them transformed to adjust coordinate systems of scenes visible to operator according to motions of cameras and/or operator's preferences. Reduces operator's workload and probability of error by obviating need for mental transformations of coordinates during operation. Methods applied in outer space, undersea, in nuclear industry, in surgery, in entertainment, and in manufacturing.

Diner, Daniel B.↗

NASA NTRS1993

Composite video and graphics display for camera viewing systems in robotics and teleoperation

A system for real-time video image display for robotics or remote-vehicle teleoperation is described that has at least one robot arm or remotely operated vehicle controlled by an operator through hand-controllers, and one or more television cameras and optional lighting element. The system has at least one television monitor for display of a television image from a selected camera and the ability to select one of the cameras for image display. Graphics are generated with icons of cameras and lighting elements for display surrounding the television image to provide the operator information on: the location and orientation of each camera and lighting element; the region of illumination of each lighting element; the viewed region and range of focus of each camera; which camera is currently selected for image display for each monitor; and when the controller coordinate for said robot arms or remotely operated vehicles have been transformed to correspond to coordinates of a selected or nonselected camera.

Diner, Daniel B.↗

NASA NTRS1992

Predictive Display For Teleoperation With Delay

Computer-graphical simulator helps operator control robotic manipulator when controlling and monitoring signals delayed in transmission. Displays phantom image of robot superimposed on delayed "real" monitoring image. Phantom responds to control signals immediately - motion predicts that of robot. After delay, real image follows motion of phantom. System includes high-fidelity, real-time computer-graphical display which gives depth, perspective, and lighting cues improving control.

Bejczy, Antal K.↗

NASA NTRS1992

Integrated Scene And Graphics For Multiple-Camera Viewing

Multiple-video-camera viewing system for monitoring telerobot undergoing development. System presents user with variety of information on single video display: picture of robot from any of five movable cameras, graphical depiction of location and orientation of camera producing current picture in middle of video display, graphical depiction of locations and orientations of other cameras, and graphical images of fields of view of cameras and three-dimensional relationship to workspace of telerobot. Display helps user control telerobot quickly and efficiently.

Diner, Daniel B.↗

NASA NTRS1991

Composite video and graphics display for multiple camera viewing system in robotics and teleoperation

A system for real-time video image display for robotics or remote-vehicle teleoperation is described that has at least one robot arm or remotely operated vehicle controlled by an operator through hand-controllers, and one or more television cameras and optional lighting element. The system has at least one television monitor for display of a television image from a selected camera and the ability to select one of the cameras for image display. Graphics are generated with icons of cameras and lighting elements for display surrounding the television image to provide the operator information on: the location and orientation of each camera and lighting element; the region of illumination of each lighting element; the viewed region and range of focus of each camera; which camera is currently selected for image display for each monitor; and when the controller coordinate for said robot arms or remotely operated vehicles have been transformed to correspond to coordinates of a selected or nonselected camera.

Diner, Daniel B.↗

NASA NTRS1991

Fusing human and machine skills for remote robotic operations

The question of how computer assists can improve teleoperator trajectory tracking during both free and force-constrained motions is addressed. Computer graphics techniques which enable the human operator to both visualize and predict detailed 3D trajectories in real-time are reported. Man-machine interactive control procedures for better management of manipulator contact forces and positioning are also described. It is found that collectively, these novel advanced teleoperations techniques both enhance system performance and significantly reduce control problems long associated with teleoperations under time delay. Ongoing robotic simulations of the 1984 space shuttle Solar Maximum EVA Repair Mission are briefly described.

Schenker, Paul S.↗

NASA NTRS1990

The phantom robot - Predictive displays for teleoperation with time delay

An enhanced teleoperation technique for time-delayed bilateral teleoperator control is discussed. The control technique selected for time delay is based on the use of a high-fidelity graphics phantom robot that is being controlled in real time (without time delay) against the static task image. Thus, the motion of the phantom robot image on the monitor predicts the motion of the real robot. The real robot's motion will follow the phantom robot's motion on the monitor with the communication time delay implied in the task. Real-time high-fidelity graphics simulation of a PUMA arm is generated and overlaid on the actual camera view of the arm. A simple camera calibration technique is used for calibrated graphics overlay. A preliminary experiment is performed with the predictive display by using a very simple tapping task. The results with this simple task indicate that predictive display enhances the human operator's telemanipulation task performance significantly during free motion when there is a long time delay. It appears, however, that either two-view or stereoscopic predictive displays are necessary for general three-dimensional tasks.

Bejczy, Antal K.↗

NASA NTRS1989

Graphic overlays in high-precision teleoperation: Current and future work at JPL

In space teleoperation additional problems arise, including signal transmission time delays. These can greatly reduce operator performance. Recent advances in graphics open new possibilities for addressing these and other problems. Currently a multi-camera system with normal 3-D TV and video graphics capabilities is being developed. Trained and untrained operators will be tested for high precision performance using two force reflecting hand controllers and a voice recognition system to control two robot arms and up to 5 movable stereo or non-stereo TV cameras. A number of new techniques of integrating TV and video graphics displays to improve operator training and performance in teleoperation and supervised automation are evaluated.

Diner, Daniel B.↗