Improving Human-Robot Interaction and Control Through Augmented Reality
No abstract provided.
47 OTHER INSTRUMENTATION↗
SEARCH · Search NASA
Results for “human-robot interaction”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
The need for reproducible research in soft robotics
In recent years we have witnessed the rise of commercialization efforts for soft robotic technology, including soft grippers (Soft Robotics, Inc.), stretchable sensors (StretchSense, Inc. and Lightlace, Inc.), and platforms for human-robot interaction (Festo Inc., Meta Reality Labs, Toyota Research Institute, and Disney Research). However, commercialization as a whole lags the trends enjoyed by other robotic technology at equivalent points in their respective lifecycles.
43 PARTICLE ACCELERATORS↗
Autonomous Inspection of Geologic Repositories: Current State of the Art and Future Directions
Geological repositories for nuclear waste, including spent nuclear fuel, present a significant challenge for traditional International Atomic Energy Agency (IAEA) safeguards tools due to their inaccessibility and demanding operational conditions. The IAEA has been working closely with Member State organizations currently involved in repository construction and planning, including Euratom, the Finnish and Swedish regulatory authorities, and relevant facility operators. However, the verification challenge remains unsolved, and there persists an out- standing need for tools and approaches that will help the IAEA verify that no nuclear material is diverted from a repository environment. The challenge is also not static. Activities must encompass verification of the design, prior to and during the construction/operation phase, and post backfill. Throughout these various phases, it is imperative that the IAEA maintains a continuity of knowledge (CoK) of all material including information on material inventory and flow. This paper highlights these challenges and outlines how they might be addressed by using remote or autonomous vehicles. Specifically, we discuss the current state of the art in robotic autonomy for known or partially known environment mapping and patrolling, as well as shared autonomy, where humans collaborate with closed loop autonomation to complete tasks. We explore the feasibility of using rovers for these verification tasks, along with the challenges associated with system implementation. Hardware and software suggestions are provided based on the adoption of similar technologies in other comparable areas and ability to close technical gaps. Lastly, human-robotic interactions are considered based on the challenges of the environment of the repository and effective deployment and continued operation of the robot system.
12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
CRCNS21 Computational Models of Multisensory Integration by Upper Limb in Humanoids and Amputees
This international collaborative research project between Johns Hopkins University (JHU) and the Technical University of Munich (TUM) investigated how the human brain processes and integrates multiple types of sensory information, such as touch and force, with the goal of improving prosthetic limbs for amputees and advancing sensory capabilities in humanoid robots. The research advanced our understanding of how the brain responds to sensory feedback in upper-limb amputees. Through experiments in which amputees received electrical stimulation while performing phantom hand movements, we demonstrated that sensory feedback activates the cortical sensorimotor and multisensory regions, and that these regions communicate dynamically during stimulation. Experiments with intact-limb participants explored the integration of visual, haptic, and force feedback, as well as in virtual reality motor training, further showing how the brain processes multimodal sensory information. In addition, this research inspired work on examining the reliability of where amputees perceive sensations over time, which contributed to a successful doctoral fellowship for continued investigation. Our collaborators at TUM improved multimodal sensor technology combining tactile and thermal feedback for humanoid robots, demonstrating the feasibility of integrating multiple sensor types into a unified system for detecting and responding to environmental stimuli. The experimental methods and analysis techniques developed across both teams, including functional network analysis and multimodal sensor integration, provide a foundation for future research in prosthetics and robotics. This research benefits the public by generating knowledge about how amputees process restored sensory information. Advances in humanoid sensing contribute to safer human-robot interaction. The project also fostered international collaboration and cross-disciplinary training: one TUM doctoral student spent a summer at JHU working on multimodal sensor integration, while two JHU students traveled to TUM to host workshops on neuromorphic sensory encoding and sensory integration.
42 ENGINEERING↗
Examining Autonomous Inspection of Geologic Repositories
Geological repositories for nuclear waste, including spent nuclear fuel, present a significant challenge for traditional International Atomic Energy Agency (IAEA) safeguards tools due to their inaccessibility and demanding operational conditions. The IAEA has been working closely with Member State organizations currently involved in repository construction and planning including Euratom, the Finnish and Swedish regulatory authorities, and relevant facility operators. However, the verification challenge remains unsolved, and there persists an out-standing need for tools and approaches that will help the IAEA verify that no nuclear material is diverted from a repository environment. The challenge is also not static as activities must encompass verification of the design prior to and during the construction/operation phase, and post backfill. Throughout these various phases, it is imperative that the IAEA maintains a continuity of knowledge (CoK) of all material, including information on material inventory and flow. This paper highlights these challenges and outlines how they might be addressed by using remote or autonomous vehicles. Specifically, it discusses the current state of the art in robotic autonomy for known or partially known environment mapping and patrolling, as well as shared autonomy, where humans collaborate with closed loop autonomation to complete tasks. The feasibility of using rovers for these verification tasks is explored, along with the challenges associated with system implementation. Hardware and software suggestions are provided based on the adoption of similar technologies in other comparable areas and ability to close technical gaps. Finally, human-robotic interactions are considered based on the challenges of the environment of the repository and effective deployment and continued operation of the robot system
autonomous monitoring↗
Autonomous Monitoring of Nuclear Repositories: Current State of the Art and Future Directions
Geological repositories for nuclear waste, including spent nuclear fuel, present a significant challenge for traditional International Atomic Energy Agency (IAEA) safeguards tools due to their inaccessibility and demanding operational conditions. The IAEA has been working closely with Member State organizations currently involved in repository construction and planning, including Euratom, the Finnish and Swedish regulatory authorities, and relevant facility operators. However, the verification challenge remains unsolved, and there persists an out- standing need for tools and approaches that will help the IAEA verify that no nuclear material is diverted from a repository environment. The challenge is also not static. Activities must encompass verification of the design, prior to and during the construction/operation phase, and post backfill. Throughout these various phases, it is imperative that the IAEA maintains a continuity of knowledge (CoK) of all material including information on material inventory and flow. This paper highlights these challenges and outlines how they might be addressed by using remote or autonomous vehicles. Specifically, we discuss the current state of the art in robotic autonomy for known or partially known environment mapping and patrolling, as well as shared autonomy, where humans collaborate with closed-loop autonomation to complete tasks. We explore the feasibility of using rovers for these verification tasks, along with the challenges associated with system implementation. Hardware and software suggestions are provided based on the adoption of similar technologies in other comparable areas and ability to close technical gaps. Lastly, human-robotic interactions are considered based on the challenges of the environment of the repository and effective deployment and continued operation of the robot system.
geologic repository, safeguards, IAEA, Robotics↗
Extra Robotic Legs for Bearing Equipment Loads During Emergency Response - 19532
The Extra Robotic Legs (XRL) system is a robotic augmentation worn by a human operator that consists of two articulated robot legs that help bear a heavy backpack payload and the operator's own weight. The design was driven by a need to increase the effectiveness of Department of Energy hazardous material emergency response personnel who are encumbered by their Personal Protective Equipment. A prototype was fabricated utilizing insights gained from force analyses and human-robot interaction safety requirements. A seamless hybrid control architecture was developed to allow the operator command over the pace of the stand-to-squat transition. Initial tests of balance control while performing squatting transitions indicate the feasibility of the XRL System. The legs will ultimately walk, climb stairs, crouch down, and crawl with the operator while eliminating all equipment loads on the operator. (authors)
12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
Performance Evaluation of Augmented Teleoperation of Contact Manipulation Tasks
At Argonne National Laboratory, an enhanced telerobotic concept has been suggested by providing augmented virtual fixtures for precise and dexterous manipulation. The proposed technology incorporated a human-robot interface that can assist personnel on the processes of Deactivation and Decommissioning in sites of high radiation. It has been implemented on a dual-arm robot system, known as Baxter, by integrating the Robotic Operating System (ROS) with 3D sensors and visual-haptic operator interface. However, what remained before its practical utilization is the capability for precisely placing the virtual fixtures. To this end, the objectives involved camera calibration, which required hardware fabrication and setup, as well as modification and implementation of ROS. The goal of this Research and Development is to develop an augmented-reality- based operator interface for human-inclusive, intelligent, and autonomous robotic system for the Deactivation and Decommissioning (D and D) of radioactive sites. The objectives are to develop: Collaborative Robot; Multi-modal Mixed-Reality Human-Robot Interface; Intelligent and Autonomous Behaviors. In order to achieve this, Baxter's Head-Kinect camera and Left-Hand camera need to be calibrated to overlap the real environment with the simulated environment. Camera calibration, which is crucial for precisely placing the virtual fixtures, was successful after running the simulations. The real and simulated environments overlapped, permitting the utilization of augmented teleoperation and the dexterous manipulation of Baxter for D and D applications in nuclear sites. Future steps: Performance evaluation of augmented teleoperation of contact manipulation tasks: Multiple-Camera 3D Reconstruction and Automation. Oculus Interface: Augmented reality and machine learning for enhanced telerobotic operation (Augmented Tele-autonomy): Machine-learning techniques for complex and flexible autonomous robotic behaviors. Interactive remote operation of robotic systems. Mesh cutting with simulation and real robot.
12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗