Search NASA⌕ Search

SEARCH · Search NASA

Results for “human robot interfaces”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

NASA research in teleoperation and robotics

Increased automation is necessary in future NASA missions. Drivers for automation include constrained funding and physical resources as well as mission capabilities not achievable through conventional means. The application of emerging technology in manipulators and machine intelligence will enable the development of robotic devices remotely commanded by human operators to increase man's productivity in space. The Office of Aeronautics and Space Technology (OAST) has established a program for research in teleoperation and robotics. The program's near-term focus is a Remote Orbital Servicing System (ROSS). The longer range goals include: (1) basic research in autonomous operations, (2) human factors research on the man-machine interface to remote systems, and (3) system integration and analysis of advanced concepts. This paper reviews the current NASA research and technology and considers future work needed to meet the OAST goals.

Meintel, A. J., Jr.↗

Development and Deployment of Robonaut 2 to the International Space Station

The development of the Robonaut 2 (R2) system was a joint endeavor with NASA and General Motors, producing robots strong enough to do work, yet safe enough to be trusted to work near humans. To date two R2 units have been produced, designated as R2A and R2B. This follows more than a decade of work on the Robonaut 1 units that produced advances in dexterity, tele-presence, remote supervision across time delay, combining mobility with manipulation, human-robot interaction, force control and autonomous grasping. Design challenges for the R2 included higher speed, smaller packaging, more dexterous fingers, more sensitive perception, soft drivetrain design, and the overall implementation of a system software approach for human safety, At the time of this writing the R2B unit was poised for launch to the International Space Station (ISS) aboard STS-133. R2 will be the first humanoid robot in space, and is arguably the most sophisticated robot in the world, bringing NASA into the 21st century as the world's leader in this field. Joining the other robots already on ISS, the station is now an exciting lab for robot experiments and utilization. A particular challenge for this project has been the design and certification of the robot and its software for work near humans. The 3 layer software systems will be described, and the path to ISS certification will be reviewed. R2 will go through a series of ISS checkout tests during 2011. A taskboard was shipped with the robot that will be used to compare R2B's dexterous manipulation in zero gravity with the ground robot s ability to handle similar objects in Earth s gravity. R2's taskboard has panels with increasingly difficult tasks, starting with switches, progressing to connectors and eventually handling softgoods. The taskboard is modular, and new interfaces and experiments will be built up using equipment already on ISS. Since the objective is to test R2 performing tasks with human interfaces, hardware abounds on ISS and the crew will be involved to help select tasks that are dull, dirty or dangerous. Future plans for R2 include a series of upgrades, evolving from static IVA (Intravehicular Activity) operations, to mobile IVA, then EVA (Extravehicular Activity).

Ambrose, Robert O.↗

The Hopper: A Wearable Robotic Device Testbed for Micro-Gravity Bone-Loading Proof-of-Concept

Wearable robotic systems are showing increased potential for addressing crew countermeasures needs. Wearable robots offer a compactness, programmability, and eccentric loading capability not present in more conventional exercise equipment. Correspondingly, advancements in the man to machine interface has progressed, allowing for higher loads to be applied directly to the person in new and novel ways. Recently, the X1 exoskeleton, a lower extremity wearable robot originally designed for mobility assistance and rehabilitation, underwent human subject testing to assess its potential as a knee dynamometer. This was of interest to NASA physiologists because currently strength is not assessed in flight due to hardware limitations, and thus there is a poor understanding of the time course of in-flight changes to muscle strength. The study concluded that the X1 compared well with the Biodex, the "gold standard" in terrestrial dynamometry, with coefficients of variation less than 6.0%. In a following study, the X1 powered ankle was evaluated for its efficacy in exercising calf muscles. Current on-orbit countermeasures equipment does not adequately protect the calf from atrophy. The results of this study were also positive (targeted muscle activity demonstrated via comparing pre- and post-exercise magnetic resonance imaging T2 measurements), again showing the efficacy of wearable robotic devices for addressing the countermeasure needs of our astronauts. Based on these successes and lessons learned, the Grasshopper was co-developed between IHMC (Florida Institute for Human and Machine Cognition) and NASA. The Grasshopper, or the Hopper for short, is a wearable robotic device designed to address muscle and bone density loss for astronauts spending extended periods of time in micro-gravity. The Grasshopper connects to the user's torso like a hiking backpack, over the shoulders and around the waist. At the feet are footplates that strap to the user. There are two actuators, one at each "knee" joint, which are capable of high fidelity torque control. Because the Hopper uses motors instead of gravity to create the load on the user, the device is suited for use on space missions. Exercise in zero-gravity conditions is critical to maintain muscle strength and bone mass. In operation, the actuators try to fold up, or collapse, the device, putting a compressive load between the user's feet and torso. This force is similar to carrying a heavy backpack. The user then bends and extends his or her knees, replicating a weightlifting squat exercise. The applied load is precisely controlled by a computer, and can be programmed to simulate gravitation loads or any desired load prescription, such as free-weight squat exercise. It is even possible to perform eccentric exercises, or negatives, without the need for a spotter. Because the hip joints, as well as the spine and long leg bones, are in the applied load path, there is the potential to stimulate bone growth, countering the typical bone loss when astronauts return from extended duration space travel.

Beck, C. E.↗

NASA Deep Space Network Commitments for Human Missions to the Moon and Beyond

NASA’s Deep Space Network (DSN) serves as a critical element in the exploration of deep space, typically supporting 30-40 operational missions at any given time, each with unique characteristics and telecommunications requirements. In order to meet the needs of its diverse customer base, DSN relies on the Mission Support Definition and Commitments Office to interface with its customers and to develop, negotiate, and document the appropriate service commitments to meet each mission’s needs. Members of this office provide the needed support throughout each mission’s lifetime. While DSN’s primary focus in recent years has been supporting scientific missions by robotic spacecraft deployed across the solar system, the network is ramping-up to provide support for human spaceflight (HSF) endeavours to the moon and beyond, starting with the Artemis missions which aim to land humans on the lunar surface in the 2020’s. These HSF missions pose unique challenges for the DSN, including technical, operational, and programmatic concerns. Examples of challenges in each of these areas are provided, along with descriptions of how they are being addressed and open issues remaining.

Turcios, Ricky↗

Presence of Mind... A Reaction to Sheridan's "Musing on Telepresence"

What are the benefits and significance of developing a scientifically useful measure of the human sense of presence in an environment? Such a scale could be conceived to measure the extent to which users of telerobotics interfaces feel or behave as if they were present at the site of a remotely controlled robot. The essay examines some issues raised in order to identify characteristics, a scale of 'presence' ought to have to be useful as an explanatory scientific concept. It also addresses the utility of worrying about developing such a scale at all. To be useful in the same manner as a traditional scientific concept such as mass, for example, it is argued that such scales not only need to be precisely defined and co-vary with determinative factors but also need to establish equivalence classes of its independent constituents. This simplifying property is important for either subjective or objective scales of presence and arises if the constituents of presence are truly independent.

Ellis, Stephen R.↗

Aviation Safety Research at NASA Langley: Applications of Physiological Computing and Neuroergonomics

The emerging field of research, known as Neuroergonomics, maintains that in order to investigate complex real-world behavior it is necessary to undePhysiological Computing systems are technological systems that incorporate physiological data from humans into their functionality or display these data at their interfaces. Neuroergonomics examines the brain mechanisms and underlying human–technology interaction in increasingly naturalistic settings representative of work and in everyday-life situations. The presenters will introduce Physiological Computing and Neuroergonomics in applications that vary from social robotics and videogames in laboratory settings to firearms training in virtual reality to aviation operations in highly ecological environments.

Aviation Safety Research↗

Potential Lunar In-Situ Resource Utilization Experiments and Mission Scenarios

The extraction and use of resources on the Moon, known as In-Situ Resource Utilization (ISRU), can potentially reduce the cost and risk of human lunar exploration while also increasing science achieved. By not having to bring all of the shielding and mission consumables from Earth and being able to make products on the Moon, missions may require less mass to accomplish the same objectives, carry more science equipment, go to more sites of exploration, and/or provide options to recover from failures not possible with delivery of spares and consumables from Earth alone. The concept of lunar ISRU has been considered and studied for decades, and scientists and engineers were theorizing and even testing concepts for how to extract oxygen from lunar soil even before the Apollo 11 mission to the Moon. There are four main areas where ISRU can significantly impact how human missions to the Moon will be performed: mission consumable production, civil engineering and construction, energy production, storage, and transfer, and manufacturing and repair. The area that has the greatest impact on mission mass, hardware design and selection, and mission architecture is mission consumable production, in particular, the ability to make propellants, life support consumables, and fuel cell reagents. Mission consumable production allows for refueling and reuse of spacecraft, increasing power production and storage, and increased capabilities and failure tolerance for crew life support. The other three areas allow for decreased mission risk due to radiation and plume damage, alternative power systems, and failure recover capabilities while also enabling infrastructure growth over Earth delivered assets. However, while lunar ISRU has significant potential for mass, cost, and risk reduction for human lunar missions, it has never been demonstrated before in space. To demonstrate that ISRU can meet mission needs and to increase confidence in incorporating ISRU capabilities into mission architectures, terrestrial laboratory and analog field testing along with robotic precursor missions are required. A stepwise approach with international collaboration is recommended. The first step is to understand the resources available through orbital and surface exploration missions. Resources of particular interest are hydrogen, hydroxyl, water, and other polar volatile resources recently measured by Chandrayaan, Lunar Reconnaissance Orbiter (LRO), and the Lunar Crater Observation and Sensing Satellite (LCROSS). The second step is to demonstrate critical aspects of ISRU systems to prove ISRU is feasible under lunar environmental and resource conditions (ex. subscale oxygen extraction from regolith). The third step is to perform integrated missions with ISRU and other connected systems, such as power, consumable storage, surface mobility, and life support at a relevant mission scale to demonstrate ISRU capabilities as well as the critical interfaces with other exploration systems. If possible, the mission should demonstrate the use of ISRU products (ex. in a rocket engine or fuel cell). This dress rehearsal mission would be the final step before full implementation of ISRU into human missions, and may be performed during human lunar exploration activities. This stepwise approach is the most conservative approach, and may only be possible with international cooperation due to the limited number of robotic missions each nation/space agency can perform within their budget.

Sanders, Gerald B.↗

YADA: Yet Another Distributed Architecture for Real-Time Robotic Control Systems

This paper presents YADA, a new software architecture for real-time robotic control systems that is minimal, modular, and fully transparent. YADA divides control software into decoupled behavior, user-interface, and hardware-level bus modules. This decoupling at the module level is accomplished by auto-generating human-readable message types that are tailored to the hardware topology oft he current system. These message types provide modules with a common framework for exchanging state information and relaying commands to devices while being agnostic to the communication protocol itself. We also detail how to structure behavior and bus modules to facilitate modularity and flexibility with third party software. YADA has been used with success on several technology development testbeds at JPL, an example of which is given in this paper, and has proven to provide developers a light-weight and highly reconfigurable system for efficient debugging and practical code sharing

Godart, Peter↗

Cooperative control - The interface challenge for men and automated machines

The research issues associated with the increasing autonomy and independence of machines and their evolving relationships to human beings are explored. The research, conducted by Langley Research Center (LaRC), will produce a new social work order in which the complementary attributes of robots and human beings, which include robots' greater strength and precision and humans' greater physical and intellectual dexterity, are necessary for systems of cooperation. Attention is given to the tools for performing the research, including the Intelligent Systems Research Laboratory (ISRL) and industrial manipulators, as well as to the research approaches taken by the Automation Technology Branch (ATB) of LaRC to achieve high automation levels. The ATB is focusing on artificial intelligence research through DAISIE, a system which tends to organize its environment into hierarchical controller/planner abstractions.

Hankins, W. W., III↗

Planar and finger-shaped optical tactile sensors for robotic applications

Progress is described regarding the development of optical tactile sensors specifically designed for application to dexterous robotics. These sensors operate on optical principles involving the frustration of total internal reflection at a waveguide/elastomer interface and produce a grey-scale tactile image that represents the normal (vertical) forces of contact. The first tactile sensor discussed is a compact, 32 x 32 planar sensor array intended for mounting on a parallel-jaw gripper. Optical fibers were employed to convey the tactile image to a CCD camera and microprocessor-based image analysis system. The second sensor had the shape and size of a human fingertip and was designed for a dexterous robotic hand. It contained 256 sensing sites (taxels) distributed in a dual-density pattern that included a tactile fovea near the tip measuring 13 x 13 mm and containing 169 taxels. The design and construction details of these tactile sensors are presented, in addition to photographs of tactile imprints.

Begej, Stefan↗

The use of interactive computer vision and robot hand controllers for enhancing manufacturing safety

Current available robotic systems provide limited support for CAD-based model-driven visualization, sensing algorithm development and integration, and automated graphical planning systems. This paper describes ongoing work which provides the functionality necessary to apply advanced robotics to automated manufacturing and assembly operations. An interface has been built which incorporates 6-DOF tactile manipulation, displays for three dimensional graphical models, and automated tracking functions which depend on automated machine vision. A set of tools for single and multiple focal plane sensor image processing and understanding has been demonstrated which utilizes object recognition models. The resulting tool will enable sensing and planning from computationally simple graphical objects. A synergistic interplay between human and operator vision is created from programmable feedback received from the controller. This approach can be used as the basis for implementing enhanced safety in automated robotics manufacturing, assembly, repair and inspection tasks in both ground and space applications. Thus, an interactive capability has been developed to match the modeled environment to the real task environment for safe and predictable task execution.

Marzwell, Neville I.↗

Knowledge representation system for assembly using robots

Assembly robots combine the benefits of speed and accuracy with the capability of adaptation to changes in the work environment. However, an impediment to the use of robots is the complexity of the man-machine interface. This interface can be improved by providing a means of using a priori-knowledge and reasoning capabilities for controlling and monitoring the tasks performed by robots. Robots ought to be able to perform complex assembly tasks with the help of only supervisory guidance from human operators. For such supervisory quidance, it is important to express the commands in terms of the effects desired, rather than in terms of the motion the robot must undertake in order to achieve these effects. A suitable knowledge representation can facilitate the conversion of task level descriptions into explicit instructions to the robot. Such a system would use symbolic relationships describing the a priori information about the robot, its environment, and the tasks specified by the operator to generate the commands for the robot.

Jain, A.↗

Predictive Interfaces for Long-Distance Tele-Operations

We address the development of predictive tele-operator interfaces for humanoid robots with respect to two basic challenges. Firstly, we address automating the transition from fully tele-operated systems towards degrees of autonomy. Secondly, we develop compensation for the time-delay that exists when sending telemetry data from a remote operation point to robots located at low earth orbit and beyond. Humanoid robots have a great advantage over other robotic platforms for use in space-based construction and maintenance because they can use the same tools as astronauts do. The major disadvantage is that they are difficult to control due to the large number of degrees of freedom, which makes it difficult to synthesize autonomous behaviors using conventional means. We are working with the NASA Johnson Space Center's Robonaut which is an anthropomorphic robot with fully articulated hands, arms, and neck. We have trained hidden Markov models that make use of the command data, sensory streams, and other relevant data sources to predict a tele-operator's intent. This allows us to achieve subgoal level commanding without the use of predefined command dictionaries, and to create sub-goal autonomy via sequence generation from generative models. Our method works as a means to incrementally transition from manual tele-operation to semi-autonomous, supervised operation. The multi-agent laboratory experiments conducted by Ambrose et. al. have shown that it is feasible to directly tele-operate multiple Robonauts with humans to perform complex tasks such as truss assembly. However, once a time-delay is introduced into the system, the rate of tele\ioperation slows down to mimic a bump and wait type of activity. We would like to maintain the same interface to the operator despite time-delays. To this end, we are developing an interface which will allow for us to predict the intentions of the operator while interacting with a 3D virtual representation of the expected state of the robot. The predictive interface anticipates the intention of the operator, and then uses this prediction to initiate appropriate sub-goal autonomy tasks.

Wheeler, Kevin R.↗

Meeting the challenges of installing a mobile robotic system

The challenges of integrating a mobile robotic system into an application environment are many. Most problems inherent to installing the mobile robotic system fall into one of three categories: (1) the physical environment - location(s) where, and conditions under which, the mobile robotic system will work; (2) the technological environment - external equipment with which the mobile robotic system will interact; and (3) the human environment - personnel who will operate and interact with the mobile robotic system. The successful integration of a mobile robotic system into these three types of application environment requires more than a good pair of pliers. The tools for this job include: careful planning, accurate measurement data (as-built drawings), complete technical data of systems to be interfaced, sufficient time and attention of key personnel for training on how to operate and program the robot, on-site access during installation, and a thorough understanding and appreciation - by all concerned - of the mobile robotic system's role in the security mission at the site, as well as the machine's capabilities and limitations. Patience, luck, and a sense of humor are also useful tools to keep handy during a mobile robotic system installation. This paper will discuss some specific examples of problems in each of three categories, and explore approaches to solving these problems. The discussion will draw from the author's experience with on-site installations of mobile robotic systems in various applications. Most of the information discussed in this paper has come directly from knowledge learned during installations of Cybermotion's SR2 security robots. A large part of the discussion will apply to any vehicle with a drive system, collision avoidance, and navigation sensors, which is, of course, what makes a vehicle autonomous. And it is with these sensors and a drive system that the installer must become familiar in order to foresee potential trouble areas in the physical, technical, and human environment.

Decorte, Celeste↗

NASA's Space Launch System: A Flagship for Exploration Beyond Earth's Orbit

The National Aeronautics and Space Administration s (NASA) Space Launch System (SLS) Program, managed at the Marshall Space Flight Center, is making progress toward delivering a new capability for exploration beyond Earth orbit in an austere economic climate. This fact drives the SLS team to find innovative solutions to the challenges of designing, developing, fielding, and operating the largest rocket in history. To arrive at the current SLS plan, government and industry experts carefully analyzed hundreds of architecture options and arrived at the one clear solution to stringent requirements for safety, affordability, and sustainability over the decades that the rocket will be in operation. This paper will explore ways to fit this major development within the funding guidelines by using existing engine assets and hardware now in testing to meet a first launch by 2017. It will explain the SLS Program s long-range plan to keep the budget within bounds, yet evolve the 70 metric ton (t) initial lift capability to 130-t lift capability after the first two flights. To achieve the evolved configuration, advanced technologies must offer appropriate return on investment to be selected through a competitive process. For context, the SLS will be larger than the Saturn V that took 12 men on 6 trips for a total of 11 days on the lunar surface over 4 decades ago. Astronauts train for long-duration voyages on the International Space Station, but have not had transportation to go beyond Earth orbit in modern times, until now. NASA is refining its mission manifest, guided by U.S. Space Policy and the Global Exploration Roadmap. Launching the Orion Multi-Purpose Cargo Vehicle s first autonomous certification flight in 2017, followed by a crewed flight in 2021, the SLS will offer a robust way to transport international crews and the air, water, food, and equipment they need for extended trips to asteroids, Lagrange Points, and Mars. In addition, the SLS will accommodate high-priority science experiments. SLS affordability initiatives include streamlining interfaces, applying risk-based insight into contracted work, centralizing systems engineering and integration, and nurturing a learning culture that continually benchmarks its performance against successful ventures. As this paper will explain, the SLS is making measurable progress toward becoming a global infrastructure asset for robotic and human scouts of all nations by harnessing business and technological innovations to deliver sustainable solutions for space exploration.

May, Todd↗

NASA's Space Launch System: A Flagship for Exploration Beyond Earth's Orbit

The National Aeronautics and Space Administration's (NASA) Space Launch System (SLS) Program, managed at the Marshall Space Flight Center, is making progress toward delivering a new capability for exploration beyond Earth orbit in an austere economic climate. This fact drives the SLS team to find innovative solutions to the challenges of designing, developing, fielding, and operating the largest rocket in history. To arrive at the current SLS plan, government and industry experts carefully analyzed hundreds of architecture options and arrived at the one clear solution to stringent requirements for safety, affordability, and sustainability over the decades that the rocket will be in operation. This paper will explore ways to fit this major development within the funding guidelines by using existing engine assets and hardware now in testing to meet a first launch by 2017. It will explain the SLS Program s long-range plan to keep the budget within bounds, yet evolve the 70 metric ton (t) initial lift capability to 130-t lift capability after the first two flights. To achieve the evolved configuration, advanced technologies must offer appropriate return on investment to be selected through a competitive process. For context, the SLS will be larger than the Saturn V that took 12 men on 6 trips for a total of 11 days on the lunar surface over 4 decades ago. Astronauts train for long-duration voyages on the International Space Station, but have not had transportation to go beyond Earth orbit in modern times, until now. NASA is refining its mission manifest, guided by U.S. Space Policy and the Global Exploration Roadmap. Launching the Orion Multi-Purpose Crew Vehicle s (MPCV s) first autonomous certification flight in 2017, followed by a crewed flight in 2021, the SLS will offer a robust way to transport international crews and the air, water, food, and equipment they need for extended trips to asteroids, Lagrange Points, and Mars. In addition, the SLS will accommodate high-priority science experiments. SLS affordability initiatives include streamlining interfaces, applying risk-based insight into contracted work, centralizing systems engineering and integration, and nurturing a learning culture that continually benchmarks its performance against successful ventures. As this paper will explain, the SLS is making measurable progress toward becoming a global infrastructure asset for robotic and human scouts of all nations by harnessing business and technological innovations to deliver sustainable solutions for space exploration.

May, Todd A.↗

Excavator Design Validation

The Excavator Design Validation tool verifies excavator designs by automatically generating control systems and modeling their performance in an accurate simulation of their expected environment. Part of this software design includes interfacing with human operations that can be included in simulation-based studies and validation. This is essential for assessing productivity, versatility, and reliability. This software combines automatic control system generation from CAD (computer-aided design) models, rapid validation of complex mechanism designs, and detailed models of the environment including soil, dust, temperature, remote supervision, and communication latency to create a system of high value. Unique algorithms have been created for controlling and simulating complex robotic mechanisms automatically from just a CAD description. These algorithms are implemented as a commercial cross-platform C++ software toolkit that is configurable using the Extensible Markup Language (XML). The algorithms work with virtually any mobile robotic mechanisms using module descriptions that adhere to the XML standard. In addition, high-fidelity, real-time physics-based simulation algorithms have also been developed that include models of internal forces and the forces produced when a mechanism interacts with the outside world. This capability is combined with an innovative organization for simulation algorithms, new regolith simulation methods, and a unique control and study architecture to make powerful tools with the potential to transform the way NASA verifies and compares excavator designs. Energid's Actin software has been leveraged for this design validation. The architecture includes parametric and Monte Carlo studies tailored for validation of excavator designs and their control by remote human operators. It also includes the ability to interface with third-party software and human-input devices. Two types of simulation models have been adapted: high-fidelity discrete element models and fast analytical models. By using the first to establish parameters for the second, a system has been created that can be executed in real time, or faster than real time, on a desktop PC. This allows Monte Carlo simulations to be performed on a computer platform available to all researchers, and it allows human interaction to be included in a real-time simulation process. Metrics on excavator performance are established that work with the simulation architecture. Both static and dynamic metrics are included.

Pholsiri, Chalongrath↗

Adjustable Autonomy Testbed

The Adjustable Autonomy Testbed (AAT) is a simulation-based testbed located in the Intelligent Systems Laboratory in the Automation, Robotics and Simulation Division at NASA Johnson Space Center. The purpose of the testbed is to support evaluation and validation of prototypes of adjustable autonomous agent software for control and fault management for complex systems. The AA T project has developed prototype adjustable autonomous agent software and human interfaces for cooperative fault management. This software builds on current autonomous agent technology by altering the architecture, components and interfaces for effective teamwork between autonomous systems and human experts. Autonomous agents include a planner, flexible executive, low level control and deductive model-based fault isolation. Adjustable autonomy is intended to increase the flexibility and effectiveness of fault management with an autonomous system. The test domain for this work is control of advanced life support systems for habitats for planetary exploration. The CONFIG hybrid discrete event simulation environment provides flexible and dynamically reconfigurable models of the behavior of components and fluids in the life support systems. Both discrete event and continuous (discrete time) simulation are supported, and flows and pressures are computed globally. This provides fast dynamic simulations of interacting hardware systems in closed loops that can be reconfigured during operations scenarios, producing complex cascading effects of operations and failures. Current object-oriented model libraries support modeling of fluid systems, and models have been developed of physico-chemical and biological subsystems for processing advanced life support gases. In FY01, water recovery system models will be developed.

Malin, Jane T.↗