Search NASA⌕ Search

SEARCH · Search NASA

Results for “human-robot teams”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Science Operations During Planetary Surface Exploration: Desert-RATS Tests 2009-2011

NASA s Research and Technology Studies (RATS) team evaluates technology, human-robotic systems and extravehicular equipment for use in future human space exploration missions. Tests are conducted in simulated space environments, or analog tests, using prototype instruments, vehicles, and systems. NASA engineers, scientists and technicians from across the country gather annually with representatives from industry and academia to perform the tests. Test scenarios include future missions to near-Earth asteroids (NEA), the moon and Mars.. Mission simulations help determine system requirements for exploring distant locations while developing the technical skills required of the next generation of explorers.

Cohen, Barbara↗

Human-Robot Site Survey and Sampling for Space Exploration

NASA is planning to send humans and robots back to the Moon before 2020. In order for extended missions to be productive, high quality maps of lunar terrain and resources are required. Although orbital images can provide much information, many features (local topography, resources, etc) will have to be characterized directly on the surface. To address this need, we are developing a system to perform site survey and sampling. The system includes multiple robots and humans operating in a variety of team configurations, coordinated via peer-to-peer human-robot interaction. In this paper, we present our system design and describe planned field tests.

Fong, Terrence↗

Envisioning an Analog Work Domain Across Deep-Ocean Exploration and Human-Robot Spaceflight Exploration

What if one existing work domain could be leveraged to inform an instantiation of a second type of work domain? This is the question that informed a three year NASA-funded study, SUBSEA (Systematic Underwater Biogeochemical Science and Exploration Analog), on the use of ocean science and exploration via telepresence as an analog for future human-robot spaceflight. SUBSEA included two field programs performed in 2018 and 2019. Each was comprised of a multidisciplinary team of natural scientists studying deep-sea venting sites in tandem with a team of social scientists conducting work ethnography to understand the existing ocean exploration domain. This paper presents results from the 2018 field program which includes analyses that were required to generate specific “flight-like” conditions for the 2019 field program.

Miller, Matthew J.↗

Working and Learning with Knowledge in the Lobes of a Humanoid's Mind

Humanoid class robots must have sufficient dexterity to assist people and work in an environment designed for human comfort and productivity. This dexterity, in particular the ability to use tools, requires a cognitive understanding of self and the world that exceeds contemporary robotics. Our hypothesis is that the sense-think-act paradigm that has proven so successful for autonomous robots is missing one or more key elements that will be needed for humanoids to meet their full potential as autonomous human assistants. This key ingredient is knowledge. The presented work includes experiments conducted on the Robonaut system, a NASA and the Defense Advanced research Projects Agency (DARPA) joint project, and includes collaborative efforts with a DARPA Mobile Autonomous Robot Software technical program team of researchers at NASA, MIT, USC, NRL, UMass and Vanderbilt. The paper reports on results in the areas of human-robot interaction (human tracking, gesture recognition, natural language, supervised control), perception (stereo vision, object identification, object pose estimation), autonomous grasping (tactile sensing, grasp reflex, grasp stability) and learning (human instruction, task level sequences, and sensorimotor association).

Ambrose, Robert↗

Space Networking Demonstrated for Distributed Human-Robotic Planetary Exploration

Communications and networking experts from the NASA Glenn Research Center designed and implemented an innovative communications infrastructure for a simulated human-robotic planetary mission. The mission, which was executed in the Arizona desert during the first 2 weeks of September 2002, involved a diverse team of researchers from several NASA centers and academic institutions.

Bizon, Thomas P.↗

Interaction Challenges in Human-Robot Space Exploration

In January 2004, NASA established a new, long-term exploration program to fulfill the President's Vision for U.S. Space Exploration. The primary goal of this program is to establish a sustained human presence in space, beginning with robotic missions to the Moon in 2008, followed by extended human expeditions to the Moon as early as 2015. In addition, the program places significant emphasis on the development of joint human-robot systems. A key difference from previous exploration efforts is that future space exploration activities must be sustainable over the long-term. Experience with the space station has shown that cost pressures will keep astronaut teams small. Consequently, care must be taken to extend the effectiveness of these astronauts well beyond their individual human capacity. Thus, in order to reduce human workload, costs, and fatigue-driven error and risk, intelligent robots will have to be an integral part of mission design.

Fong, Terrence↗

Desert Research and Technology Study 2003 Trip Report/ICES Paper

The Advanced Extra-vehicular Activity (EVA) team of the National Aeronautics and Space Administration (NASA) Johnson Space Center (JSC) Crew and Thermal Systems Division (CTSD) participated in the Desert Research and Technology Study (RATS) in September 2003, at Meteor Crater, AZ. The Desert RATS is an integrated remote field site te t with team members from several NASA centers (Johnson Space Center; Glenn and Ames Research Centers) and universities (Bowling Green State University, University of Cincinnati, Massachusetts Institute of Technology) participating. Each week of the two-week field test had a primary focus. The primary test hardware for the first week was the I-Gravity Lunar Rover Training Vehicle, or Grover, which was on loan to NASA from the United States Geological Survey (USGS) Astrogeology Research Program. The 2003 Grover driving test results serve as a rover performance characterization baseline for the Science, Crew, Operation and Utility Testbed (SCOUT) project team, which will be designing and fabricating a next generation roving vehicle prototype in Fiscal Year (FY) 2004. The second week of testing focused on EVA geologic traverses that utilized a geologic sample field analysis science trailer and also focused on human-robotic interaction between the suited subjects and the EVA Robotic Assistant (ERA). This paper will review the Advanced EVA team's role in the context of the overall Desert RATS, as well as the EVA team results and lessons learned. For information regarding other test participants' results, the authors can refer interested parties to the test reports produced by those Desert RATS teams.

Ross, Amy↗

Human-Robot Interaction in High Vulnerability Domains

Future NASA missions will require successful integration of the human with highly complex systems. Highly complex systems are likely to involve humans, automation, and some level of robotic assistance. The complex environments will require successful integration of the human with automation, with robots, and with human-automation-robot teams to accomplish mission critical goals. Many challenges exist for the human performing in these types of operational environments with these kinds of systems. Systems must be designed to optimally integrate various levels of inputs and outputs based on the roles and responsibilities of the human, the automation, and the robots; from direct manual control, shared human-robotic control, or no active human control (i.e. human supervisory control). It is assumed that the human will remain involved at some level. Technologies that vary based on contextual demands and on operator characteristics (workload, situation awareness) will be needed when the human integrates into these systems. Predictive models that estimate the impact of the technologies on the system performance and the on the human operator are also needed to meet the challenges associated with such future complex human-automation-robot systems in extreme environments.

workload↗

Robotic Technology Development at Ames: The Intelligent Robotics Group and Surface Telerobotics

Future human missions to the Moon, Mars, and other destinations offer many new opportunities for exploration. But, astronaut time will always be limited and some work will not be feasible for humans to do manually. Robots, however, can complement human explorers, performing work autonomously or under remote supervision from Earth. Since 2004, the Intelligent Robotics Group has been working to make human-robot interaction efficient and effective for space exploration. A central focus of our research has been to develop and field test robots that benefit human exploration. Our approach is inspired by lessons learned from the Mars Exploration Rovers, as well as human spaceflight programs, including Apollo, the Space Shuttle, and the International Space Station. We conduct applied research in computer vision, geospatial data systems, human-robot interaction, planetary mapping and robot software. In planning for future exploration missions, architecture and study teams have made numerous assumptions about how crew can be telepresent on a planetary surface by remotely operating surface robots from space (i.e. from a flight vehicle or deep space habitat). These assumptions include estimates of technology maturity, existing technology gaps, and likely operational and functional risks. These assumptions, however, are not grounded by actual experimental data. Moreover, no crew-controlled surface telerobotic system has yet been fully tested, or rigorously validated, through flight testing. During Summer 2013, we conducted a series of tests to examine how astronauts in the International Space Station (ISS) can remotely operate a planetary rover across short time delays. The tests simulated portions of a proposed human-robotic Lunar Waypoint mission, in which astronauts in lunar orbit remotely operate a planetary rover on the lunar Farside to deploy a radio telescope array. We used these tests to obtain baseline-engineering data.

robotics↗

Integrated Human-Robotic Missions to the Moon and Mars: Mission Operations Design Implications

For most of the history of space exploration, human and robotic programs have been independent, and have responded to distinct requirements. The NASA Vision for Space Exploration calls for the return of humans to the Moon, and the eventual human exploration of Mars; the complexity of this range of missions will require an unprecedented use of automation and robotics in support of human crews. The challenges of human Mars missions, including roundtrip communications time delays of 6 to 40 minutes, interplanetary transit times of many months, and the need to manage lifecycle costs, will require the evolution of a new mission operations paradigm far less dependent on real-time monitoring and response by an Earthbound operations team. Robotic systems and automation will augment human capability, increase human safety by providing means to perform many tasks without requiring immediate human presence, and enable the transfer of traditional mission control tasks from the ground to crews. Developing and validating the new paradigm and its associated infrastructure may place requirements on operations design for nearer-term lunar missions. The authors, representing both the human and robotic mission operations communities, assess human lunar and Mars mission challenges, and consider how human-robot operations may be integrated to enable efficient joint operations, with the eventual emergence of a unified exploration operations culture.

Korth, David↗

Integrated Human-Robotic Missions to the Moon and Mars: Mission Operations Design Implications

For most of the history of space exploration, human and robotic programs have been independent, and have responded to distinct requirements. The NASA Vision for Space Exploration calls for the return of humans to the Moon, and the eventual human exploration of Mars; the complexity of this range of missions will require an unprecedented use of automation and robotics in support of human crews. The challenges of human Mars missions, including roundtrip communications time delays of 6 to 40 minutes, interplanetary transit times of many months, and the need to manage lifecycle costs, will require the evolution of a new mission operations paradigm far less dependent on real-time monitoring and response by an Earthbound operations team. Robotic systems and automation will augment human capability, increase human safety by providing means to perform many tasks without requiring immediate human presence, and enable the transfer of traditional mission control tasks from the ground to crews. Developing and validating the new paradigm and its associated infrastructure may place requirements on operations design for nearer-term lunar missions. The authors, representing both the human and robotic mission operations communities, assess human lunar and Mars mission challenges, and consider how human-robot operations may be integrated to enable efficient joint operations, with the eventual emergence of a unified exploration operations culture.

human robotic missions↗

Integrated human-robotic missions to the Moon and Mars : mission operations design implications

For most of the history of space exploration, human and robotic programs have been independent, and have responded to distinct requirements. The NASA Vision for Space Exploration calls for the return of humans to the Moon, and the eventual human exploration of Mars; the complexity of this range of missions will require an unprecedented use of automation and robotics in support of human crews. The challenges of human Mars missions, including roundtrip communications time delays of 6 to 40 minutes, interplanetary transit times of many months, and the need to manage lifecycle costs, will require the evolution of a new mission operations paradigm far less dependent on real-time monitoring and response by an Earthbound operations team. Robotic systems and automation will augment human capability, increase human safety by providing means to perform many tasks without requiring immediate human presence, and enable the transfer of traditional mission control tasks from the ground to crews. Developing and validating the new paradigm and its associated infrastructure may place requirements on operations design for nearer-term lunar missions. The authors, representing both the human and robotic mission operations communities, assess human lunar and Mars mission challenges, and consider how human-robot operations may be integrated to enable efficient joint operations, with the eventual emergence of a unified exploration operations culture.

Lee, Young↗

Space-to-Ground Interactions While Conducting Scientific Fieldwork Under Mars Mission Constraints

The Biologic Analog Science Associated with Lava Terrains (BASALT) project is a 4-year program dedicated to iteratively designing, implementing, and evaluating concepts of operations (ConOps) and supporting capabilities to enable and enhance scientific exploration for future human Mars missions. BASALT incorporates three field deployments during which real (non-simulated) biological and geochemical field science is conducted at two high-fidelity Mars analog locations under simulated Mars mission conditions, including communication de-lays and data transmission limitations. BASALT’s primary science objective is to investigate how the redox conditions of altered basaltic environments affect the development of microbial communities in these Mars-relevant settings. Field sites include the active East Rift Zone on the Big Island of Hawaii, reminiscent of early Mars when basaltic volcanism and interaction with water were widespread, and the dormant eastern Snake River Plain in Idaho, similar to present-day Mars where basaltic volcanism is rare and most evidence for volcano-driven hydrothermal activity is relict. BASALT’s primary science operations objective is to investigate exploration ConOps and capabilities that facilitate scientific return during human-robotic exploration under Mars mission constraints. Each field deployment consists of ten extravehicular activities (EVAs) on the volcanic flows in which two extravehicular and two intravehicular (IV) crew-members conduct the science while communicating across time delay and under bandwidth constraints with an Earth-based Mission Support Center (MSC) comprised of expert scientists and operators. Communication latencies of 5 and 15-minute one-way light time and low (0.512 Mb/s uplink, 1.54 Mb/s down-link) and high (5.0 Mb/s uplink, 10.0 Mb/s downlink) bandwidth conditions are being evaluated. EVA crewmembers communicate with the MSC via voice and text messaging and provide scientific instrument data, still imagery, video streams, and GPS tracking information. The MSC reviews this data across delay and provides recommendations for presampling and sampling tasks. The scientists used dynamic leaderboards (priority rank-ing lists), to track and rank candidate samples relative to one another and against the science objectives for the current EVA and the overall mission. Updates to the dynamic leaderboards are relayed regularly to the IV crewmembers to provide scientific feedback from Earth and to help minimize crew idle time (time spent waiting for Earth input during which no productive tasks are performed). EVA timelines are strategically designed to enable continuous (delayed) feedback from an Earth-based science team while simultaneously minimizing crew idle time. Such timelines are operationally advantageous, reducing transport costs by eliminating the need for crews to return to the same locations on multiple EVAs while still providing opportunities for recommendations from science experts on Earth, and scientifically advantageous by minimizing the potential for cross-contamination across sites. This paper will highlight the space-to-ground interaction results from the three BASALT field deployments, including planned versus actual EVA time-line data, ground assimilation times (the amount of time available to the MSC to provide input to the crew), and idle time. Furthermore, we describe how these results vary under the different communication latency and bandwidth conditions. Together, these data will provide a basis for guiding and prioritizing capability development for future human exploration missions.

Beaton, Kara H.↗

Intra-EVA Space-to-Ground Interactions when Conducting Scientific Fieldwork Under Simulated Mars Mission Constraints

The Biologic Analog Science Associated with Lava Terrains (BASALT) project is a four-year program dedicated to iteratively designing, implementing, and evaluating concepts of operations (ConOps) and supporting capabilities to enable and enhance scientific exploration for future human Mars missions. The BASALT project has incorporated three field deployments during which real (non-simulated) biological and geochemical field science have been conducted at two high-fidelity Mars analog locations under simulated Mars mission conditions, including communication delays and data transmission limitations. BASALT's primary Science objective has been to extract basaltic samples for the purpose of investigating how microbial communities and habitability correlate with the physical and geochemical characteristics of chemically altered basalt environments. Field sites include the active East Rift Zone on the Big Island of Hawai'i, reminiscent of early Mars when basaltic volcanism and interaction with water were widespread, and the dormant eastern Snake River Plain in Idaho, similar to present-day Mars where basaltic volcanism is rare and most evidence for volcano-driven hydrothermal activity is relict. BASALT's primary Science Operations objective has been to investigate exploration ConOps and capabilities that facilitate scientific return during human-robotic exploration under Mars mission constraints. Each field deployment has consisted of ten extravehicular activities (EVAs) on the volcanic flows in which crews of two extravehicular and two intravehicular crewmembers conducted the field science while communicating across time delay and under bandwidth constraints with an Earth-based Mission Support Center (MSC) comprised of expert scientists and operators. Communication latencies of 5 and 15 min one-way light time and low (0.512 Mb/s uplink, 1.54 Mb/s downlink) and high (5.0 Mb/s uplink, 10.0 Mb/s downlink) bandwidth conditions were evaluated. EVA crewmembers communicated with the MSC via voice and text messaging. They also provided scientific instrument data, still imagery, video streams from chest-mounted cameras, GPS location tracking information. The MSC monitored and reviewed incoming data from the field across delay and provided recommendations for pre-sampling and sampling tasks based on their collective expertise. The scientists used dynamic priority ranking lists, referred to as dynamic leaderboards, to track and rank candidate samples relative to one another and against the science objectives for the current EVA and the overall mission. Updates to the dynamic leaderboards throughout the EVA were relayed regularly to the IV crewmembers. The use of these leaderboards enabled the crew to track the dynamic nature of the MSC recommendations and helped minimize crew idle time (defined as time spent waiting for input from Earth during which no other productive tasks are being performed). EVA timelines were strategically designed to enable continuous (delayed) feedback from an Earth-based Science Team while simultaneously minimizing crew idle time. Such timelines are operationally advantageous, reducing transport costs by eliminating the need for crews to return to the same locations on multiple EVAs while still providing opportunities for recommendations from science experts on Earth, and scientifically advantageous by minimizing the potential for cross-contamination across sites. This paper will highlight the space-to-ground interaction results from the three BASALT field deployments, including planned versus actual EVA timeline data, ground assimilation times (defined as the amount of time available to the MSC to provide input to the crew), and idle time. Furthermore, we describe how these results vary under the different communication latency and bandwidth conditions. Together, these data will provide a basis for guiding and prioritizing capability development for future human exploration missions.

Beaton, Kara H.↗

CRCNS21 Computational Models of Multisensory Integration by Upper Limb in Humanoids and Amputees

This international collaborative research project between Johns Hopkins University (JHU) and the Technical University of Munich (TUM) investigated how the human brain processes and integrates multiple types of sensory information, such as touch and force, with the goal of improving prosthetic limbs for amputees and advancing sensory capabilities in humanoid robots. The research advanced our understanding of how the brain responds to sensory feedback in upper-limb amputees. Through experiments in which amputees received electrical stimulation while performing phantom hand movements, we demonstrated that sensory feedback activates the cortical sensorimotor and multisensory regions, and that these regions communicate dynamically during stimulation. Experiments with intact-limb participants explored the integration of visual, haptic, and force feedback, as well as in virtual reality motor training, further showing how the brain processes multimodal sensory information. In addition, this research inspired work on examining the reliability of where amputees perceive sensations over time, which contributed to a successful doctoral fellowship for continued investigation. Our collaborators at TUM improved multimodal sensor technology combining tactile and thermal feedback for humanoid robots, demonstrating the feasibility of integrating multiple sensor types into a unified system for detecting and responding to environmental stimuli. The experimental methods and analysis techniques developed across both teams, including functional network analysis and multimodal sensor integration, provide a foundation for future research in prosthetics and robotics. This research benefits the public by generating knowledge about how amputees process restored sensory information. Advances in humanoid sensing contribute to safer human-robot interaction. The project also fostered international collaboration and cross-disciplinary training: one TUM doctoral student spent a summer at JHU working on multimodal sensor integration, while two JHU students traveled to TUM to host workshops on neuromorphic sensory encoding and sensory integration.

42 ENGINEERING↗

Advantages of Brahms for Specifying and Implementing a Multiagent Human-Robotic Exploration System

We have developed a model-based, distributed architecture that integrates diverse components in a system designed for lunar and planetary surface operations: an astronaut's space suit, cameras, all-terrain vehicles, robotic assistant, crew in a local habitat, and mission support team. Software processes ('agents') implemented in the Brahms language, run on multiple, mobile platforms. These mobile agents interpret and transform available data to help people and robotic systems coordinate their actions to make operations more safe and efficient. The Brahms-based mobile agent architecture (MAA) uses a novel combination of agent types so the software agents may understand and facilitate communications between people and between system components. A state-of-the-art spoken dialogue interface is integrated with Brahms models, supporting a speech-driven field observation record and rover command system. An important aspect of the methodology involves first simulating the entire system in Brahms, then configuring the agents into a runtime system Thus, Brahms provides a language, engine, and system builder's toolkit for specifying and implementing multiagent systems.

Clancey, William J.↗

Robotic and Human-Tended Collaborative Drilling Automation for Subsurface Exploration

Future in-situ lunar/martian resource utilization and characterization, as well as the scientific search for life on Mars, will require access to the subsurface and hence drilling. Drilling on Earth is hard - an art form more than an engineering discipline. Human operators listen and feel drill string vibrations coming from kilometers underground. Abundant mass and energy make it possible for terrestrial drilling to employ brute-force approaches to failure recovery and system performance issues. Space drilling will require intelligent and autonomous systems for robotic exploration and to support human exploration. Eventual in-situ resource utilization will require deep drilling with probable human-tended operation of large-bore drills, but initial lunar subsurface exploration and near-term ISRU will be accomplished with lightweight, rover-deployable or standalone drills capable of penetrating a few tens of meters in depth. These lightweight exploration drills have a direct counterpart in terrestrial prospecting and ore-body location, and will be designed to operate either human-tended or automated. NASA and industry now are acquiring experience in developing and building low-mass automated planetary prototype drills to design and build a pre-flight lunar prototype targeted for 2011-12 flight opportunities. A successful system will include development of drilling hardware, and automated control software to operate it safely and effectively. This includes control of the drilling hardware, state estimation of both the hardware and the lithography being drilled and state of the hole, and potentially planning and scheduling software suitable for uncertain situations such as drilling. Given that Humans on the Moon or Mars are unlikely to be able to spend protracted EVA periods at a drill site, both human-tended and robotic access to planetary subsurfaces will require some degree of standalone, autonomous drilling capability. Human-robotic coordination will be important, either between a robotic drill and humans on Earth, or a human-tended drill and its visiting crew. The Mars Analog Rio Tinto Experiment (MARTE) is a current project that studies and simulates the remote science operations between an automated drill in Spain and a distant, distributed human science team. The Drilling Automation for Mars Exploration (DAME) project, by contrast: is developing and testing standalone automation at a lunar/martian impact crater analog site in Arctic Canada. The drill hardware in both projects is a hardened, evolved version of the Advanced Deep Drill (ADD) developed by Honeybee Robotics for the Mars Subsurface Program. The current ADD is capable of 20m, and the DAME project is developing diagnostic and executive software for hands-off surface operations of the evolved version of this drill. The current drill automation architecture being developed by NASA and tested in 2004-06 at analog sites in the Arctic and Spain will add downhole diagnosis of different strata, bit wear detection, and dynamic replanning capabilities when unexpected failures or drilling conditions are discovered in conjunction with simulated mission operations and remote science planning. The most important determinant of future 1unar and martian drilling automation and staffing requirements will be the actual performance of automated prototype drilling hardware systems in field trials in simulated mission operations. It is difficult to accurately predict the level of automation and human interaction that will be needed for a lunar-deployed drill without first having extensive experience with the robotic control of prototype drill systems under realistic analog field conditions. Drill-specific failure modes and software design flaws will become most apparent at this stage. DAME will develop and test drill automation software and hardware under stressful operating conditions during several planned field campaigns. Initial results from summer 2004 tests show seven identifi distinct failure modes of the drill: cuttings-removal issues with low-power drilling into permafrost, and successful steps at executive control and initial automation.

Glass, Brian↗

Towards Human-Friendly Efficient Control of Multi-Robot Teams

This paper explores means to increase efficiency in performing tasks with multi-robot teams, in the context of natural Human-Multi-Robot Interfaces (HMRI) for command and control. The motivating scenario is an emergency evacuation by a transport convoy of unmanned ground vehicles (UGVs) that have to traverse, in shortest time, an unknown terrain. In the experiments the operator commands, in minimal time, a group of rovers through a maze. The efficiency of performing such tasks depends on both, the levels of robots' autonomy, and the ability of the operator to command and control the team. The paper extends the classic framework of levels of autonomy (LOA), to levels/hierarchy of autonomy characteristic of Groups (G-LOA), and uses it to determine new strategies for control. An UGVoriented command language (UGVL) is defined, and a mapping is performed from the human-friendly gesture-based HMRI into the UGVL. The UGVL is used to control a team of 3 robots, exploring the efficiency of different G-LOA; specifically, by (a) controlling each robot individually through the maze, (b) controlling a leader and cloning its controls to followers, and (c) controlling the entire group. Not surprisingly, commands at increased G-LOA lead to a faster traverse, yet a number of aspects are worth discussing in this context.

multi-robot control↗