Search NASA⌕ Search

Engineering topics

Will Pryor

Publications and source records attributed to Will Pryor.

4 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2021

Teleoperation and Visualization Interfaces for Remote Intervention in Space

Approaches to robotic manufacturing, assembly, and servicing of in-space assets range from autonomous operation to direct teleoperation, with many forms of semi-autonomous teleoperation in between. Because most approaches require one or more human operators at some level, it is important to explore the control and visualization interfaces available to those operators, taking into account the challenges due to significant telemetry time delay. We consider one motivating application of remote teleoperation, which is ground-based control of a robot on-orbit for satellite servicing. This paper presents a model-based architecture that: 1) improves visualization and situation awareness, 2) enables more effective human/robot interaction and control, and 3) detects task failures based on anomalous sensor feedback. We illustrate elements of the architecture by drawing on 10 years of our research in this area. The paper further reports the results of several multi-user experiments to evaluate the model-based architecture, on ground-based test platforms, for satellite servicing tasks subject to round-trip communication latencies of several seconds. The most significant performance gains were obtained by enhancing the operators’ situation awareness via improved visualization and by enabling them to precisely specify intended motion. In contrast, changes to the control interface, including model-mediated control or an immersive 3D environment, often reduced the reported task load but did not significantly improve task performance. Considering the challenges of fully autonomous intervention, we expect that some form of teleoperation will continue to be necessary for robotic in-situ servicing, assembly, and manufacturing tasks for the foreseeable future. We propose that effective teleoperation can be enabled by modeling the remote environment, providing operators with a fused view of the real environment and virtual model, and incorporating interfaces and control strategies that enable interactive planning, precise operation, and prompt detection of errors.

space robotics↗
NASA NTRSDate not supplied

A Virtual Reality Planning Environment for High-Risk, High-Latency Teleoperation

Teleoperation of robots in space is challenging due to high latency and limited workspace visibility. Previously, the Interactive Planning and Supervised Execution (IPSE) and Augmented Virtuality systems were developed to reduce failure risk. These tools were visualized on a 3D da Vinci surgical console and operated using the da Vinci manipulators or visualized on conventional monitors and operated with a keyboard and mouse. Experimental studies indicated operator preference for the latter. In this work, we develop a 3D virtual reality (VR) interface for IPSE, implemented on a Meta Quest 2 head-mounted display (HMD), and evaluate it against the prior 2D, keyboard-and-mouse-based interface. The results demonstrate improved operator load with the 3D VR interface, with no decrease in task performance, while also providing cost and portability benefits compared to the conventional 2D interface.

Will Pryor↗
NASA NTRSDate not supplied

A Virtual Reality Planning Environment for High-Risk, High-Latency Teleoperation

In-Space Servicing, Assembly, and Manufacturing has the potential to enable larger-scale and longer-lived infrastructure projects in space. Servicing in particular has the potential to vastly increase the usable lifetimes of satellites, both newly launched and existing. However, some of these servicing tasks require delicate manipulation and, to apply to existing satellites, need to be able to operate on structures that were not designed for servicing and, in some cases, where the exact shape of the structure is not known in advance. For this reason, human-in-the-loop ground-based teleoperation is the only option for some missions. Ground-based teleoperation presents its own difficulties. In addition to the challenge of performing delicate operations in constrained spaces, communication with the servicing platform is subject to a variable time delay on the order of 2-7 seconds, and the only visual feedback comes from camera views with limited situational awareness and viewing angles.

Teleoperation↗