Search NASA⌕ Search

SEARCH · Search NASA

Results for “Remote Supervisory Operations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Issues in human/computer control of dexterous remote hands

Much research on dexterous robot hands has been aimed at the design and control problems associated with their autonomous operation, while relatively little research has addressed the problem of direct human control. It is likely that these two modes can be combined in a complementary manner yielding more capability than either alone could provide. While many of the issues in mixed computer/human control of dexterous hands parallel those found in supervisory control of traditional remote manipulators, the unique geometry and capabilities of dexterous hands pose many new problems. Among these are the control of redundant degrees of freedom, grasp stabilization and specification of non-anthropomorphic behavior. An overview is given of progress made at the MIT AI Laboratory in control of the Salisbury 3 finger hand, including experiments in grasp planning and manipulation via controlled slip. It is also suggested how we might introduce human control into the process at a variety of functional levels.

Salisbury, K.↗

A Framework for Dynamic Architecture and Functional Allocations for Increasing Airspace Autonomy

To enable scalability of air travel for use cases such as cargo delivery, it is anticipated that future air traffic operations will involve unmanned aircraft operated by remote pilots. Of particular interest are schemes where a small number of pilots operate a large number of vehicles, mitigating high cost and pilot shortage issues. Such architectures require increased levels of automation and supervisory control modes. They also require ensuring safe operations when the command and control link to the vehicle is degraded or lost completely, rendering the vehicle autonomous. To evaluate these variable and dynamic architectures, this paper will present a framework for decomposing the functions necessary to ensure safe, orderly, and expeditious air travel, assessing the agents in the system, and classifying the levels of autonomy. Then, an example allocation to agents of roles for the function of separation assurance is presented, highlighting the dependency of the allocation on three main factors: time criticality of a potential separation violation, the ratio of pilots to vehicles, and the loss of the command and control link.

air traffic management, function allocation, auton↗

A Framework for Dynamic Architecture and Functional Allocations for Increasing Airspace Autonomy

To enable scalability of air travel for use cases such as cargo delivery, it is anticipated that future air traffic operations will involve unmanned aircraft operated by remote pilots. Of particular interest are schemes where a small number of pilots operate a large number of vehicles, mitigating high cost and pilot shortage issues. Such architectures require increased levels of automation and supervisory control modes. They also require ensuring safe operations when the command and control link to the vehicle is degraded or lost completely, rendering the vehicle autonomous. To evaluate these variable and dynamic architectures, this paper will present a framework for decomposing the functions necessary to ensure safe, orderly, and expeditious air travel, assessing the agents in the system, and classifying the levels of autonomy. Then, an example allocation to agents of roles for the function of separation assurance is presented, highlighting the dependency of the allocation on three main factors; time criticality of a potential separation violation, the ratio of pilots to vehicles, and the loss of the command and control link.

air traffic management↗

Supervisory autonomous local-remote control system design: Near-term and far-term applications

The JPL Supervisory Telerobotics Laboratory (STELER) has developed a unique local-remote robot control architecture which enables management of intermittent bus latencies and communication delays such as those expected for ground-remote operation of Space Station robotic systems via the TDRSS communication platform. At the local site, the operator updates the work site world model using stereo video feedback and a model overlay/fitting algorithm which outputs the location and orientation of the object in free space. That information is relayed to the robot User Macro Interface (UMI) to enable programming of the robot control macros. The operator can then employ either manual teleoperation, shared control, or supervised autonomous control to manipulate the object under any degree of time-delay. The remote site performs the closed loop force/torque control, task monitoring, and reflex action. This paper describes the STELER local-remote robot control system, and further describes the near-term planned Space Station applications, along with potential far-term applications such as telescience, autonomous docking, and Lunar/Mars rovers.

Zimmerman, Wayne↗

Telerobot local-remote control architecture for space flight program applications

The JPL Supervisory Telerobotics (STELER) Laboratory has developed and demonstrated a unique local-remote robot control architecture which enables management of intermittent communication bus latencies and delays such as those expected for ground-remote operation of Space Station robotic systems via the Tracking and Data Relay Satellite System (TDRSS) communication platform. The current work at JPL in this area has focused on enhancing the technologies and transferring the control architecture to hardware and software environments which are more compatible with projected ground and space operational environments. At the local site, the operator updates the remote worksite model using stereo video and a model overlay/fitting algorithm which outputs the location and orientation of the object in free space. That information is relayed to the robot User Macro Interface (UMI) to enable programming of the robot control macros. This capability runs on a single Silicon Graphics Inc. machine. The operator can employ either manual teleoperation, shared control, or supervised autonomous control to manipulate the intended object. The remote site controller, called the Modular Telerobot Task Execution System (MOTES), runs in a multi-processor VME environment and performs the task sequencing, task execution, trajectory generation, closed loop force/torque control, task parameter monitoring, and reflex action. This paper describes the new STELER architecture implementation, and also documents the results of the recent autonomous docking task execution using the local site and MOTES.

Zimmerman, Wayne↗

Results from Testing Crew-Controlled Surface Telerobotics on the International Space Station

During Summer 2013, the Intelligent Robotics Group at NASA Ames Research Center conducted a series of tests to examine how astronauts in the International Space Station (ISS) can remotely operate a planetary rover. The tests simulated portions of a proposed lunar mission, in which an astronaut in lunar orbit would remotely operate a planetary rover to deploy a radio telescope on the lunar far side. Over the course of Expedition 36, three ISS astronauts remotely operated the NASA "K10" planetary rover in an analogue lunar terrain located at the NASA Ames Research Center in California. The astronauts used a "Space Station Computer" (crew laptop), a combination of supervisory control (command sequencing) and manual control (discrete commanding), and Ku-band data communications to command and monitor K10 for 11 hours. In this paper, we present and analyze test results, summarize user feedback, and describe directions for future research.

robotics↗

Man's role in a remote orbital servicing system

The Remote Orbital Servicing System (ROSS), a focal point for NASA research in automation and robotics, is discussed in terms of the role of man in such a system. In the supervisory control mode, the ROSS operator inputs high-level goals to a strategic (nonreal-time) planner which then passes the plan or series of actions to a tactical (real-time) planner which executes the plan. Using directed control, man makes more specific commands to perform strategic planning with or without the use of the automated strategic planner. Shared computer/manual control will require a multifunction interactive display. At the teleoperator control level, a hand controller is used to command the ROSS manipulator and end effectors.

Pennington, J. E.↗

Unmanned surface traverses of Mars and Moon: Science objectives, payloads, operations

Science objectives and properties to be measured are outlined for long surface traverse missions on Mars and the Moon, with remotely-controlled roving vehicles. A series of candidate rover payloads is proposed for each planet, varying in weight, cost, purpose, and development needed. The smallest weighs 35 kg; the largest almost 300 kg. A high degree of internal control will be needed on the Mars rover, including the ability to carry out complex science sequences. Decision-making by humans in the Mars mission includes supervisory control of rover operations and selection of features and samples of geological and biological interest. For the lunar mission, less control on the rover and more on earth is appropriate. Science portions of the rover mission profile are outlined, with timelines and mileage breakdowns. Operational problem areas for Mars include control, communications, data storage, night operations, and the mission operations system. For the moon, science data storage on the rover would be unnecessary and control much simpler.

Jaffe, L. D.↗

Computer interface for mechanical arm

Man/machine interface commands computer-controlled mechanical arm. Remotely-controlled arm has six degrees of freedom and is controlled through "supervisory-control" mode, in which all motions of arm follow set of preprogramed sequences. For simplicity, few prescribed commands are required to accomplish entire operation. Applications include operating computer-controlled arm to handle radioactive of explosive materials or commanding arm to perform functions in hostile environments. Modified version using displays may be applied in medicine.

Derocher, W. L.↗

Ch. 12. A Theoretical Approach to Management of Limited Attentional Resources to Support the m:N Operation in Advanced Air Mobility Ecosystem

Advanced air mobility (AAM) technologies incorporate increasingly autonomous systems that allow fully remote, independent, and intelligent operation of air vehicles to support the transportation of goods and passengers within and across urban and rural areas. With a myriad of automated technologies enabling the AAM ecosystem, the human operator’s role will likely be a passive supervisory monitor of the air vehicles, involving increasingly fewer humans (m) that manage many more autonomous systems (N), or m:N operations. Unfortunately, the human performance literature suggests that human operators will exhibit poor supervision of numerous autonomous agents due to the limits of attentional resources in the operators. In the general human information-processing model, a human operator exercises a limited pool of attentional resources to engage various information-processing stages including detecting, perceiving, comprehending, and predicting objects around them. Yamani and Horrey (2018) expanded the human information-processing model to characterize a tradeoff between information-processing demand and resource relief that automation brings in the context of automated driving. In their model, a driver interacting with an automated driving system is assumed to reallocate resources “freed” by automation to support other information-processing stages required for successful task performance. A future AAM ecosystem enabled by an orchestration of advanced automated systems, however, requires a single operator to interact with more than one air vehicle with varying levels and degrees of automated systems, making the traditional framework of human-automation interaction insufficient. To address this gap, we provide a review of the literature on situation assessment and trust, two constructs identified as critical for a fuller understanding of intimate and intricate interactions between a human operator and multiple air vehicles equipped with increasingly autonomous systems. Then, we propose an expansion of Yamani and Horrey’s (2018) model to motivate systematic research on the human operator’s role, identify factors that influence resource allocation and guide human-centered design of an interface supporting the m:N operation in the AAM environment.

Advanced Air Mobility↗

System architecture for asynchronous multi-processor robotic control system

The architecture for the Modular Telerobot Task Execution System (MOTES) as implemented in the Supervisory Telerobotics (STELER) Laboratory is described. MOTES is the software component of the remote site of a local-remote telerobotic system which is being developed for NASA for space applications, in particular Space Station Freedom applications. The system is being developed to provide control and supervised autonomous control to support both space based operation and ground-remote control with time delay. The local-remote architecture places task planning responsibilities at the local site and task execution responsibilities at the remote site. This separation allows the remote site to be designed to optimize task execution capability within a limited computational environment such as is expected in flight systems. The local site task planning system could be placed on the ground where few computational limitations are expected. MOTES is written in the Ada programming language for a multiprocessor environment.

Steele, Robert D.↗

Touch sensors and control.

Description of the equipment employed and results obtained in experiments with tactile feedback and different levels of automatic control. In the experiments described tactile feedback was investigated by incorporating a touch sensing and touch display system into a teleoperator, while the levels of automatic control were investigated by incorporating supervisory control features in the teleoperator control system. In particular, a hand contact system which senses and reproduces to the operator the contact between the end-effector and the object being touched or manipulated is described, as well as a jaw contact system which senses and reproduces to the operator the shape and location of the object held in the remote jaws, and an arm control system consisting of a control station where the operator controls the motion of the arm by transmitting commands, a remote station that accepts the commands and uses them, and a communications link that limits information flow. In addition, an algorithmic language for remote manipulation is described, and the desired features that an automatic arm controller should possess are reviewed.

Hill, J. W.↗

Martian and lunar science with remotely-controlled long-range surface vehicles

Science objectives are outlined for long surface traverse missions on Mars and the moon, with remotely-controlled roving vehicles. Series of candidate rover science payloads are proposed, varying in purpose, development needed, cost, and weight (35 to almost 300 kg). A high degree of internal control will be needed on the Mars rover, including the ability to carry out complex science sequences. Decision-making by humans in the Mars mission includes supervisory control of rover operations and selection of features and samples of geological and biological interest. For the lunar mission, less control on the rover and more on earth is appropriate. Operational problem areas for Mars include control, communications, data storage, night operations, and the mission operations system. For the moon, science data storage on the rover would be unnecessary and control much simpler.

Jaffe, L. D.↗

JPL space station telerobotic engineering prototype development: Advanced telerobotics system technology

The objective of the Advanced Telerobotics System Technology Task is to develop/prototype advanced telerobotics supervisory and shared control to enhance Intra-Vehicular Activity (IVA) teleoperation in the Space Station. The technology provides enhanced telerobotics capabilities while operating within the expected constraints of computation limitations, time delay, and bus bandwidth. A local site operator interface has also been developed for specifying teleoperation and shared control modes as well as supervised autonomous macros for execution at the remote site. The primary objective of the task is to transfer the advanced technology to appropriate flight centers to enhance the baseline Station capabilities.

Backes, Paul G.↗

Supervised Remote Robot with Guided Autonomy and Teleoperation (SURROGATE): A Framework for Whole-Body Manipulation

The use of the cognitive capabilties of humans to help guide the autonomy of robotics platforms in what is typically called "supervised-autonomy" is becoming more commonplace in robotics research. The work discussed in this paper presents an approach to a human-in-the-loop mode of robot operation that integrates high level human cognition and commanding with the intelligence and processing power of autonomous systems. Our framework for a "Supervised Remote Robot with Guided Autonomy and Teleoperation" (SURROGATE) is demonstrated on a robotic platform consisting of a pan-tilt perception head, two 7-DOF arms connected by a single 7-DOF torso, mounted on a tracked-wheel base. We present an architecture that allows high-level supervisory commands and intents to be specified by a user that are then interpreted by the robotic system to perform whole body manipulation tasks autonomously. We use a concept of "behaviors" to chain together sequences of "actions" for the robot to perform which is then executed real time.

Hebert, Paul↗

US automated rendezvous and capture capabilities review. Remote umbilical system abstract

This document will describe the technology developed at Kennedy Space Center (KSC) to demonstrate automatic tracking, docking, and mating of umbilical systems. Specifically the use of a real time six degree of freedom (6DOF) target tracking vision system, (developed by Adaptive Automation, Inc. under contract to KSC), is discussed in detail. The paper describes the use of mechanical compliance in the docking, mating, and tracking-after-mating operations. The vision system computes six coordinates that define the position and orientation of a three dimensional target using data from a single CCD camera. The camera is mounted on a 6DOF robot arm. After target coordinates are computed, they are transmitted to a supervisory computer which controls the robot motion in real time. Details of the image processing algorithms, image processing hardware, and target configuration used in the vision system are discussed in the paper. The motion of the space vehicle relative to the service structure after mating led us to the development of a compliant system that allows enough displacement of the target relative to the camera so that tracking after mating may continue. This reduces internal stresses between flight and ground hardware.

Delcastillo, Eduardo Lopez↗

UMI - An interactive supervisory and shared control system for telerobotics

An interactive user interface, User-Macro-Interface (UMI), and its complete task execution system are developed and implemented for utilization by an operator to describe, simulate and execute tasks on a multiarm telerobot. The sequences or primitives can be executed on a graphics simulator or on the JPL Telerobot which incorporates two task execution manipulators, one manipulation used for positioning cameras, and two 6-degree-of-freedom force-reflecting hand controllers employed for shared and teleoperation modes of execution. The UMI interface is to be used as the operator interface at a local command site to prepare and send commands to a remote space telerobot.

Backes, Paul G.↗

Diagnostics in the Extendable Integrated Support Environment (EISE)

Extendable Integrated Support Environment (EISE) is a real-time computer network consisting of commercially available hardware and software components to support systems level integration, modifications, and enhancement to weapons systems. The EISE approach offers substantial potential savings by eliminating unique support environments in favor of sharing common modules for the support of operational weapon systems. An expert system is being developed that will help support diagnosing faults in this network. This is a multi-level, multi-expert diagnostic system that uses experiential knowledge relating symptoms to faults and also reasons from structural and functional models of the underlying physical model when experiential reasoning is inadequate. The individual expert systems are orchestrated by a supervisory reasoning controller, a meta-level reasoner which plans the sequence of reasoning steps to solve the given specific problem. The overall system, termed the Diagnostic Executive, accesses systems level performance checks and error reports, and issues remote test procedures to formulate and confirm fault hypotheses.

Brink, James R.↗