Search NASASearch

Engineering topics

Diftler, Myron

Publications and source records attributed to Diftler, Myron.

Towards Autonomous Operations of the Robonaut 2 Humanoid Robotic Testbed

The Robonaut project has been conducting research in robotics technology on board the International Space Station (ISS) since 2012. Recently, the original upper body humanoid robot was upgraded by the addition of two climbing manipulators ("legs"), more capable processors, and new sensors, as shown in Figure 1. While Robonaut 2 (R2) has been working through checkout exercises on orbit following the upgrade, technology development on the ground has continued to advance. Through the Active Reduced Gravity Offload System (ARGOS), the Robonaut team has been able to develop technologies that will enable full operation of the robotic testbed on orbit using similar robots located at the Johnson Space Center. Once these technologies have been vetted in this way, they will be implemented and tested on the R2 unit on board the ISS. The goal of this work is to create a fully-featured robotics research platform on board the ISS to increase the technology readiness level of technologies that will aid in future exploration missions. Technology development has thus far followed two main paths, autonomous climbing and efficient tool manipulation. Central to both technologies has been the incorporation of a human robotic interaction paradigm that involves the visualization of sensory and pre-planned command data with models of the robot and its environment. Figure 2 shows screenshots of these interactive tools, built in rviz, that are used to develop and implement these technologies on R2. Robonaut 2 is designed to move along the handrails and seat track around the US lab inside the ISS. This is difficult for many reasons, namely the environment is cluttered and constrained, the robot has many degrees of freedom (DOF) it can utilize for climbing, and remote commanding for precision tasks such as grasping handrails is time-consuming and difficult. Because of this, it is important to develop the technologies needed to allow the robot to reach operator-specified positions as autonomously as possible. The most important progress in this area has been the work towards efficient path planning for high DOF, highly constrained systems. Other advances include machine vision algorithms for localizing and automatically docking with handrails, the ability of the operator to place obstacles in the robot's virtual environment, autonomous obstacle avoidance techniques, and constraint management.

Badger, Julia

Utilization of the NASA Robonaut as a Surgical Avatar in Telemedicine

The concept of teleoperated robotic surgery is not new; however, most of the work to date has utilized specialized robots designed for specific set of surgeries. This activity explores the use of a humanoid robot to perform surgical procedures using the same hand held instruments that a human surgeon employs. For this effort, the tele-operated Robonaut (R2) was selected due to its dexterity, its ability to perform a wide range of tasks, and its adaptability to changing environments. To evaluate this concept, a series of challenges was designed with the goal of assessing the feasibility of utilizing Robonaut as a telemedicine based surgical avatar.

Dean, Marc

Robonaut 2 - Building a Robot on the International Space Station

In 2010, the Robonaut Project embarked on a multi‐phase mission to perform technology demonstrations on‐board the International Space Station (ISS), showcasing state of the art robotics technologies through the use of Robonaut 2 (R2). This phased approach implements a strategy that allows for the use of ISS as a test bed during early development to both demonstrate capability and test technology while still making advancements in the earth based laboratories for future testing and operations in space. While R2 was performing experimental trials onboard the ISS during the first phase, engineers were actively designing for Phase 2, Intra‐Vehicular Activity (IVA) Mobility, that utilizes a set of zero‐g climbing legs outfitted with grippers to grasp handrails and seat tracks. In addition to affixing the new climbing legs to the existing R2 torso, it became clear that upgrades to the torso to both physically accommodate the climbing legs and to expand processing power and capabilities of the robot were required. In addition to these upgrades, a new safety architecture was also implemented in order to account for the expanded capabilities of the robot. The IVA climbing legs not only needed to attach structurally to the R2 torso on ISS, but also required power and data connections that did not exist in the upper body. The climbing legs were outfitted with a blind mate adapter and coarse alignment guides for easy installation, but the upper body required extensive rewiring to accommodate the power and data connections. This was achieved by mounting a custom adapter plate to the torso and routing the additional wiring through the waist joint to connect to the new set of processors. In addition to the power and data channels, the integrated unit also required updated electronics boards, additional sensors and updated processors to accommodate a new operating system, software platform, and custom control system. In order to perform the unprecedented task of building a robot in space, extensive practice sessions and meticulous procedures were required. Since crew training time is at a premium, the R2 team took a skills‐based training approach to ensure the astronauts were proficient with a basic skill set while refining the detailed procedures over several practice sessions and simulations. In addition to the crew activities, meticulous ground procedures were required in order to upgrade firmware on the upper body motor drivers. The new firmware for the IVA mobility unit needed to be deployed using the old software system. This also provided an opportunity to upgrade the upper body joints with new software and allowed for limited insight into the success of the updates. Complete verification that the updated firmware was successfully loaded was not confirmed until the rewiring of the upper body torso was complete.

Diftler, Myron

RoboGlove - A Robonaut Derived Multipurpose Assistive Device

The RoboGlove is an assistive device that can augment human strength, endurance or provide directed motion for use in rehabilitation. RoboGlove is a spinoff of the highly successful Robonaut 2 (R2) system developed as part of a partnership between General Motors and NASA. This extremely lightweight device employs an actuator system based on the R2 finger drive system to transfer part or the entire grasp load from human tendons to artificial ones contained in the glove. Steady state loads ranging from 15 to 20 lbs. and peaks approaching 50 lbs. are achievable. The technology holds great promise for use with space suit gloves to reduce fatigue during space walks. Tactile sensing, miniaturized electronics, and on-board processing provide sufficient flexibility for applications in many industries. The following describes the design, mechanical/electrical integration, and control features of the glove.

Diftler, Myron

Robonaut 2 - IVA Experiments On-Board ISS and Development Towards EVA Capability

Robonaut 2 (R2) has completed its fixed base activities on-board the ISS and is scheduled to receive its climbing legs in early 2014. In its continuing line of firsts, the R2 torso finished up its on-orbit activities on its stanchion with the manipulation of space blanket materials and performed multiple tasks under teleoperation control by IVA astronauts. The successful completion of these two IVA experiments is a key step in Robonaut's progression towards an EVA capability. Integration with the legs and climbing inside the ISS will provide another important part of the experience that R2 will need prior to performing tasks on the outside of ISS. In support of these on-orbit activities, R2 has been traversing across handrails in simulated zero-g environments and working with EVA tools and equipment on the ground to determine manipulation strategies for an EVA Robonaut. R2 made significant advances in robotic manipulation of deformable materials in space while working with its softgoods task panel. This panel features quarter turn latches that secure a space blanket to the task panel structure. The space blanket covers two cloth cubes that are attached with Velcro to the structure. R2 was able to open and close the latches, pull back the blanket, and remove the cube underneath. R2 simulated cleaning up an EVA worksite as well, by replacing the cube and reattaching the blanket. In order to interact with the softgoods panel, R2 has both autonomously and with a human in the loop identified and localized these deformable objects. Using stereo color cameras, R2 identified characteristic elements on the softgoods panel then extracted the location and orientation of the object in its field of view using stereo disparity and kinematic transforms. R2 used both vision processing and supervisory control to successfully accomplish this important task. Teleoperation is a key capability for Robonaut's effectiveness as an EVA system. To build proficiency, crewmembers have attempted increasingly difficult tasks using R2 inside the Station. After donning motion capture equipment and a virtual reality visor, Expedition 34/35 flight engineer Tom Marshburn began operations with simple hand movements. Having gained confidence, Marshburn guided R2's arms in a leader-follower exercise with crewmate Chris Cassidy. He was also able to use the hand to grab a tumbling roll of tape, a task only demonstrable in microgravity. Later efforts saw Cassidy handle softgoods through shared control with ground operators, mimicking an activity previously achieved using only autonomy. Robotic climbing through the ISS on handrails requires both precision motion and compliant grasps in order to both position grippers on handrails/seat track and prevent large internal forces. R2 climbs using actively controlled compliance and torque limiting to meet both the precision and softness requirements. During a step, the attached leg is controlled to be strong and stiff in order to maintain precision trajectory tracking. The swing leg is controlled to be stiff but weak to minimize unintentional impact forces while maintaining precision. During a simulated dual limb grasp (as shown in Figure 1), the R2 controller maintains one limb rigid and one limb soft to prevent large internal forces from building up. R2's grippers also use a form of force control to limit grip force while not fully closed on either a handrail or seat track thus limiting unintentional forces on cables/objects that may be present in R2's translational path. The on-board torso R2 safety system relies on a single end-effector velocity limit to prevent potential impact forces from exceeding Station maximum load requirements. R2's mobile configuration required modifications to the velocity limiting safety function due to its large, dynamic inertia. R2's legs maneuver the robot's mass creating configuration dependent, joint-relative inertias. A single all-encompassing velocity limit to cover worst case inertia is prohibitively low. The upgraded R2 control and safety systems solve this problem using momentum limiting, momentum control, and kinetic energy minimization. Momentum and kinetic energy take the robot mass into account relieving low velocity restrictions on low inertia end-effectors while ensuring that the overall mass of R2 is limited from hazardous velocities. The momentum of R2's five safety nodes (each of the four end-effectors and the body) is monitored and compared to a single momentum limit. If any of the five nodes exceeds the safety limit, the motor power is removed and the robot comes to a stop. Momentum control/limiting also provides a simple, reliable method to integrate hand held tools into the safety system by providing the tool mass to the control system thus automatically reducing the allowable velocity of the end-effector with the tool. Work on the ground continues to build the skill set for an EVA Robonaut. Recent experiments (Figure 2) demonstrate how a teleoperator can use R2 to manipulate a tether hook, an important safety precaution on spacewalks. Another task displayed Robonaut's ability to pull back a protective jacket over a hose and search for damage, as well as inspect a quick-disconnect fitting for debris. Demonstrations such as these are indicative of EVA work done on ISS, specifically seen during a series of spacewalks over 2012 and 2013 where astronauts searched for an ammonia leak in one of the external cooling loops. Through experiments both on ISS and on the ground, R2 is evolving and providing the information needed to plan out the upgrades that will make an EVA Robonaut an effective tool. With the addition of legs, R2 will start climbing inside the space station and supply invaluable information on how the climbing strategies and task stabilization techniques must be refined. Ground R2 systems will continue to work with additional EVA tools and equipment in preparation for onboard IVA testing and future EVA applications.

Diftler, Myron

X1: A Robotic Exoskeleton for In-Space Countermeasures and Dynamometry

Bone density loss and muscle atrophy are among the National Aeronautics and Space Administration's (NASA) highest concerns for crew health in space. Countless hours are spent maintaining an exercise regimen aboard the International Space Station (ISS) to counteract the effect of zero-gravity. Looking toward the future, NASA researchers are developing new compact and innovative exercise technologies to maintain crew health as missions increase in length and take humans further out into the solar system. The X1 Exoskeleton, initially designed for assisted mobility on Earth, was quickly theorized to have far-reaching potential as both an in-space countermeasures device and a dynamometry device to measure muscle strength. This lower-extremity device has the ability to assist or resist human movement through the use of actuators positioned at the hips and knees. Multiple points of adjustment allow for a wide range of users, all the while maintaining correct joint alignment. This paper discusses how the X1 Exoskeleton may fit NASA's onorbit countermeasures needs.

Rea, Rochelle

Robonaut 2 - Preparing for Intra-Vehicular Mobility on the International Space Station

Robonaut 2 (R2) has been undergoing experimental trials on board the International Space Station (ISS) for more than a year. This upper-body anthropomorphic robotic system shown in Figure 1 has been making steady progress after completing its initial checkout. R2 demonstrated free space motion, physically interacted with its human crew mates, manipulated interfaces on its task board and has even used its first tool. This steady growth in capability will lead R2 to its next watershed milestone. Developers are currently testing prototype robotic climbing appendages and a battery backpack in preparation of sending flight versions of both subsystems to the ISS in late 2013. Upon integration of its new components, R2 will be able to go mobile inside the space station with a twofold agenda. First, R2 will learn to maneuver in microgravity in the best possible laboratory for such a task. Second, it will start providing early payback to the ISS program by helping with intra-vehicular (IVA) maintenance tasks. The experience gained inside the ISS will be invaluable in reducing risk when R2 moves to its next stage and is deployed as an extra-vehicular (EVA) tool. Even on its current fixed base stanchion, R2 has already shown its capability of performing several maintenance tasks on the ISS. It has measured the air flow through one of the stations vents and provided previously unavailable real time flow data to ground operators. R2 has cleaned its first handrail, exciting some crew members that perhaps Saturday morning housekeeping on the station may someday become a task they can hand off to their robotic colleague. Other tasks, including using radio frequency identification (RFID) tools for inventory tasks or vacuuming air filters, have also been suggested and will be explored. Once mobile, R2 will take on these tasks and more to free up crew time for more important science and exploration pursuits. In addition to task exploration, research and testing is happening on orbit to prepare for R2 mobility operations. The current vision system in R2 s head is being used to identify and localize IVA handrails throughout the US Lab and ground control software is being updated and integrated in advance of supporting mobility operations.

Badger, Julia

Advancing Robotic Control for Space Exploration Using Robonaut 2

Robonaut 2, or R2, arrived on the International Space Station (ISS) in February 2011 and is currently being tested in preparation for its role initially as an Intra-Vehicular Activity (IVA) tool and eventually as a robot that performs Extra-Vehicular Activities (EVA). Robonaut 2, is a state of the art dexterous anthropomorphic robotic torso designed for assisting astronauts. R2 features increased force sensing, greater range of motion, higher bandwidth, and improved dexterity over its predecessor. Robonaut 2 is unique in its ability to safely allow humans in its workspace and to perform significant tasks in a workspace designed for humans. The current operational paradigm involves either the crew or the ground control team running semi-autonomous scripts on the robot as both the astronaut and the ground team monitor R2 and the data it produces. While this is appropriate for the check-out phase of operations, the future plans for R2 will stress the current operational framework. The approach described here will outline a suite of operational modes that will be developed for Robonaut 2. These operational modes include teleoperation, shared control, directed autonomy, and supervised autonomy, and they cover a spectrum of human involvement in controlling R2.

Badger, Julia

Robonaut 2 (R2) Overview

This slide presentation reviews the development and uses of the second robot designed to work in space. The presentation reviews the motivation for developing Robonaut, the cooperative commercial relationship with General Motors, the evolution design of Robonaut Robonaut 2 improvements over the first robonaut (R1), Robonaut 2's hand dexterity, finger impedance control, tactile system, finger haptics, arm control, strength, neck movement and head sensors, human interaction, and the controller. Also the plans for use on board the International Space Station are reviewed. The patent for the Phalange Tactile Load Cell is included.

Diftler, Myron

A Miniature Force Sensor for Prosthetic Hands

Tactile sensing is an important part of the development of new prosthetic hands. A number of approaches to establishing an afferent pathway back to the patient for tactile information are becoming available including tactors and direct stimulation of the afferent nerves. Tactile information can also be used by low-level control systems that perform simple tasks for the patient such as establishing a stable grasp and maintaining the grasping forces needed to hold an object. This abstract reports on the design of a small fingertip load cell based on semi-conductor strain gauges. Since this load cell is so small (measuring only 8.5mm in diameter and 6.25 mm in height), it easily fits into the tip of an anthropomorphic mechatronic hand. This load cell is tested by comparing a time series of force and moment data with reference data acquired from a much larger high-precision commercial load cell.

Platt, Robert

Humanoid Mobile Manipulation Using Controller Refinement

An important class of mobile manipulation problems are move-to-grasp problems where a mobile robot must navigate to and pick up an object. One of the distinguishing features of this class of tasks is its coarse-to-fine structure. Near the beginning of the task, the robot can only sense the target object coarsely or indirectly and make gross motion toward the object. However, after the robot has located and approached the object, the robot must finely control its grasping contacts using precise visual and haptic feedback. In this paper, it is proposed that move-to-grasp problems are naturally solved by a sequence of controllers that iteratively refines what ultimately becomes the final solution. This paper introduces the notion of a refining sequence of controllers and characterizes this type of solution. The approach is demonstrated in a move-to-grasp task where Robonaut, the NASA/JSC dexterous humanoid, is mounted on a mobile base and navigates to and picks up a geological sample box. In a series of tests, it is shown that a refining sequence of controllers decreases variance in robot configuration relative to the sample box until a successful grasp has been achieved.

Platt, Robert

Humanoid Mobile Manipulation Using Controller Refinement

An important class of mobile manipulation problems are move-to-grasp problems where a mobile robot must navigate to and pick up an object. One of the distinguishing features of this class of tasks is its coarse-to-fine structure. Near the beginning of the task, the robot can only sense the target object coarsely or indirectly and make gross motion toward the object. However, after the robot has located and approached the object, the robot must finely control its grasping contacts using precise visual and haptic feedback. This paper proposes that move-to-grasp problems are naturally solved by a sequence of controllers that iteratively refines what ultimately becomes the final solution. This paper introduces the notion of a refining sequence of controllers and characterizes this type of solution. The approach is demonstrated in a move-to-grasp task where Robonaut, the NASA/JSC dexterous humanoid, is mounted on a mobile base and navigates to and picks up a geological sample box. In a series of tests, it is shown that a refining sequence of controllers decreases variance in robot configuration relative to the sample box until a successful grasp has been achieved.

Platt, Robert

Innovative Robot Archetypes for In-Space Construction and Maintenance

The space environment presents unique challenges and opportunities in the assembly, inspection and maintenance of orbital and transit spaceflight systems. While conventional Extra-Vehicular Activity (EVA) technology, out of necessity, addresses each of the challenges, relatively few of the opportunities have been exploited due to crew safety and reliability considerations. Extra-Vehicular Robotics (EVR) is one of the least-explored design spaces but offers many exciting innovations transcending the crane-like Space Shuttle and International Space Station Remote Manipulator System (RMS) robots used for berthing, coarse positioning and stabilization. Microgravity environments can support new robotic archetypes with locomotion and manipulation capabilities analogous to undersea creatures. Such diversification could enable the next generation of space science platforms and vehicles that are too large and fragile to launch and deploy as self-contained payloads. Sinuous manipulators for minimally invasive inspection and repair in confined spaces, soft-stepping climbers with expansive leg reach envelopes and free-flying nanosatellite cameras can access EVA worksites generally not accessible to humans in spacesuits. These and other novel robotic archetypes are presented along with functionality concepts

Rehnmark, Fredrik

Tactile Sensors for the NASA/DARPA Robonaut

Tactile sensors are providing the foundation for developing autonomous grasping skills for the NASA/DARPA Robonaut, a dexterous humanoid robot. The sensors originally developed for the Utah/MIT hand are now incorporated into a rugged glove for Robonaut. These custom gloves compliment the human like dexterity available in the Robonaut hands. The sensors and gloves are discussed showing a progression in using advanced materials and construction techniques to enhance sensitivity and overall sensor coverage. The force data provided by the gloves can be used to improve dexterous, tool and power grasping primitives. Experiments with the latest gloves focus on the use of tools, specifically a power drill used to approximate an astronaut's torque tool.

Martin, Toby B.

Robonaut: a robot designed to work with humans in space

The Robotics Technology Branch at the NASA Johnson Space Center is developing robotic systems to assist astronauts in space. One such system, Robonaut, is a humanoid robot with the dexterity approaching that of a suited astronaut. Robonaut currently has two dexterous arms and hands, a three degree-of-freedom articulating waist, and a two degree-of-freedom neck used as a camera and sensor platform. In contrast to other space manipulator systems, Robonaut is designed to work within existing corridors and use the same tools as space walking astronauts. Robonaut is envisioned as working with astronauts, both autonomously and by teleoperation, performing a variety of tasks including, routine maintenance, setting up and breaking down worksites, assisting crew members while outside of spacecraft, and serving in a rapid response capacity.

Man-Machine Systems

Humanoids Designed to do Work

NASA began with the challenge of building a robot fo r doing assembly, maintenance, and diagnostic work in the Og environment of space. A robot with human form was then chosen as the best means of achieving that mission. The goal was not to build a machine to look like a human, but rather, to build a system that could do the same work. Robonaut could be inserted into the existing space environment, designed for a population of astronauts, and be able to perform many of the same tasks, with the same tools, and use the same interfaces. Rather than change that world to accommodate the robot, instead Robonaut accepts that it exists for humans, and must conform to it. While it would be easier to build a robot if all the interfaces could be changed, this is not the reality of space at present, where NASA has invested billions of dollars building spacecraft like the Space Shuttle and International Space Station. It is not possible to go back in time, and redesign those systems to accommodate full automation, but a robot can be built that adapts to them. This paper describes that design process, and the res ultant solution, that NASA has named Robonaut.

Ambrose, Robert

Coordinated control of a dual-arm dexterous robot using full immersion telepresence and virtual reality

Telepresence is an approach to teleoperation that provides egocentric, intuitive interactions between an operator and a remote environment. This approach takes advantage of the natural cognitive and sensory motor skills of an on-board crew and effectively transfers them to a slave robot. A dual alarm dexterous robot operating under telepresence control has been developed and initial evaluations of the system performing candidate EVA, IVA and planetary geological tasks were conducted. The results of our evaluation showed that telepresence control is very effective in transferring the operator's skills to the slave robot. However, the results also showed that, due to the kinematic and dynamics inconsistencies between the operator and the robot, a limited amount of intelligent automation is also required to carry out some to the tasks. Therefore, several enhancements have been made to the original system to increase the automated capabilities of the control system without losing the benefits of telepresence.

Li, Larry

Telepresence control of a dual-arm dexterous robot

Telepresence is an approach to teleoperation that provides egocentric, intuitive interactions between an operator and a remote environment. This approach takes advantage of the natural cognitive and sensory-motor skills of an on-orbit crew and effectively transfers them to a slave robot. A dual-arm dexterous robot operating under telepresence control has been developed and is being evaluated. Preliminary evaluation revealed several important observations that suggest the directions of future enhancement.

Li, Larry