SEARCH · Search NASA

Results for “Haptic feedback”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Skin-integrated stretchable actuators toward skin-compatible haptic feedback and closed-loop human-machine interactions

Abstract Skin-integrated haptic interfaces that can relay a wealth of information from the machine to the human are of great interest. However, existing haptic devices are not yet able to produce haptic cues that are compatible with the skin. In this work, we present the stretchable soft actuators for haptic feedback, which can match the perception range, spatial resolution, and stretchability of the skin. Pressure-amplification structures are fabricated using a scalable self-assembly process to ensure an output pressure beyond the skin perception threshold. Due to the minimized device size, the actuator array can be fabricated with a sufficiently high spatial resolution, which makes the haptic device applicable for skin locations with the highest spatial acuity. A haptic feedback system is demonstrated by employing the developed soft actuators and highly sensitive pressure sensors. Two proof-of-concept applications are developed to illustrate the capability of transferring information related to surface textures and object shapes acquired at the robot side to the user side.

Chen, Si↗

DOE OSTI2022

Multichannel haptic feedback unlocks prosthetic hand dexterity

Abstract Loss of tactile sensations is a major roadblock preventing upper limb-absent people from multitasking or using the full dexterity of their prosthetic hands. With current myoelectric prosthetic hands, limb-absent people can only control one grasp function at a time even though modern artificial hands are mechanically capable of individual control of all five digits. In this paper, we investigated whether people could precisely control the grip forces applied to two different objects grasped simultaneously with a dexterous artificial hand. Toward that end, we developed a novel multichannel wearable soft robotic armband to convey artificial sensations of touch to the robotic hand users. Multiple channels of haptic feedback enabled subjects to successfully grasp and transport two objects simultaneously with the dexterous artificial hand without breaking or dropping them, even when their vision of both objects was obstructed. Simultaneous transport of the objects provided a significant time savings to perform the deliveries in comparison to a one-at-a-time approach. This paper demonstrated that subjects were able to integrate multiple channels of haptic feedback into their motor control strategies to perform a complex simultaneous object grasp control task with an artificial limb, which could serve as a paradigm shift in the way prosthetic hands are operated.

60 APPLIED LIFE SCIENCES↗

NASA NTRS2001

Finite Element Methods for real-time Haptic Feedback of Soft-Tissue Models in Virtual Reality Simulators

We have applied the linear elastic finite element method to compute haptic force feedback and domain deformations of soft tissue models for use in virtual reality simulators. Our results show that, for virtual object models of high-resolution 3D data (>10,000 nodes), haptic real time computations (>500 Hz) are not currently possible using traditional methods. Current research efforts are focused in the following areas: 1) efficient implementation of fully adaptive multi-resolution methods and 2) multi-resolution methods with specialized basis functions to capture the singularity at the haptic interface (point loading). To achieve real time computations, we propose parallel processing of a Jacobi preconditioned conjugate gradient method applied to a reduced system of equations resulting from surface domain decomposition. This can effectively be achieved using reconfigurable computing systems such as field programmable gate arrays (FPGA), thereby providing a flexible solution that allows for new FPGA implementations as improved algorithms become available. The resulting soft tissue simulation system would meet NASA Virtual Glovebox requirements and, at the same time, provide a generalized simulation engine for any immersive environment application, such as biomedical/surgical procedures or interactive scientific applications.

Frank, Andreas O.↗

DOE OSTI2021

TangibleData: Interactive Data Visualization with Mid-Air Haptics

In this paper, we investigate the effects of mid-air haptics in interactive 3D data visualization. We build an interactive 3D data visualization tool that adapts hand gestures and mid-air haptics to provide tangible interaction in VR using ultrasound haptic feedback on 3D data visualization. We consider two types of 3D visualization datasets and provide different data encoding methods for haptic representations. Two user experiments are conducted to evaluate the effectiveness of our approach. The first experimental results show that adding a mid-air haptic modality can be beneficial regardless of noise conditions and useful for handling occlusion or discerning density and volume information. The second experiment results further show the strengths and weaknesses of direct touch and indirect touch modes. Our findings can shed light on designing and implementing a tangible interaction on 3D data visualization with mid-air haptic feedback.

Bhardwaj, Ayush↗

NASA NTRS2006

Humanoid Mobile Manipulation Using Controller Refinement

An important class of mobile manipulation problems are move-to-grasp problems where a mobile robot must navigate to and pick up an object. One of the distinguishing features of this class of tasks is its coarse-to-fine structure. Near the beginning of the task, the robot can only sense the target object coarsely or indirectly and make gross motion toward the object. However, after the robot has located and approached the object, the robot must finely control its grasping contacts using precise visual and haptic feedback. In this paper, it is proposed that move-to-grasp problems are naturally solved by a sequence of controllers that iteratively refines what ultimately becomes the final solution. This paper introduces the notion of a refining sequence of controllers and characterizes this type of solution. The approach is demonstrated in a move-to-grasp task where Robonaut, the NASA/JSC dexterous humanoid, is mounted on a mobile base and navigates to and picks up a geological sample box. In a series of tests, it is shown that a refining sequence of controllers decreases variance in robot configuration relative to the sample box until a successful grasp has been achieved.

Platt, Robert↗

NASA NTRS2006

Humanoid Mobile Manipulation Using Controller Refinement

An important class of mobile manipulation problems are move-to-grasp problems where a mobile robot must navigate to and pick up an object. One of the distinguishing features of this class of tasks is its coarse-to-fine structure. Near the beginning of the task, the robot can only sense the target object coarsely or indirectly and make gross motion toward the object. However, after the robot has located and approached the object, the robot must finely control its grasping contacts using precise visual and haptic feedback. This paper proposes that move-to-grasp problems are naturally solved by a sequence of controllers that iteratively refines what ultimately becomes the final solution. This paper introduces the notion of a refining sequence of controllers and characterizes this type of solution. The approach is demonstrated in a move-to-grasp task where Robonaut, the NASA/JSC dexterous humanoid, is mounted on a mobile base and navigates to and picks up a geological sample box. In a series of tests, it is shown that a refining sequence of controllers decreases variance in robot configuration relative to the sample box until a successful grasp has been achieved.

Platt, Robert↗

NASA NTRS2017

NASA's Hybrid Reality Lab: One Giant Leap for Full Dive

This presentation demonstrates how NASA is using consumer VR headsets, game engine technology and NVIDIA's GPUs to create highly immersive future training systems augmented with extremely realistic haptic feedback, sound, additional sensory information, and how these can be used to improve the engineering workflow. Include in this presentation is an environment simulation of the ISS, where users can interact with virtual objects, handrails, and tracked physical objects while inside VR, integration of consumer VR headsets with the Active Response Gravity Offload System, and a space habitat architectural evaluation tool. Attendees will learn how the best elements of real and virtual worlds can be combined into a hybrid reality environment with tangible engineering and scientific applications.

Delgado, Francisco J.↗

NASA NTRS2020

Evaluation of Low Cost, User-Centered Alerting Devices for the Mitigation of Flight Crew Spatial Disorientation

The National Aeronautics and Space Administration (NASA) is conducting research into technologies which have the potential to reduce flight crew Spatial Disorientation (SD). While flight deck technology has advanced rapidly over the past fifty (50) years, the reported occurrences of flight crew SD have not decreased. The Cost-Effective Devices for Alerting Research (CEDAR) effort has focused on the identification and development of low cost, user-centered alerting solutions for the purpose of mitigating the occurrence of flight crew SD. This effort seeks to evaluate both existing technologies as well as new and emerging technologies which have a viable path to implementation in commercial aviation within the next five (5) years. This research is intended to develop a proof-of-concept for real-time SD mitigation which could eventually be utilized to improve safety in future air transport operations. NASA has partnered with the United States Naval Aeromedical Research Unit in Dayton, OH (NAMRU-D) to conduct flight crew SD research utilizing their Disorientation Research Device (DRD), dubbed “The Kraken”. This high-tech simulator features never-before-seen capabilities for side-by-side commercial aviation flight crew SD research, and is capable of re-creating the forces necessary to induce SD illusions in a safe and repeatable manner. Prototype SD mitigation solutions were incorporated into this simulator for scenario-based testing and evaluation using airline pilots within a contextually representative operational environment. SD mitigation technology prototypes designed to provide haptic feedback for both alerting and guidance, as well as innovative visual and aural alerting displays were evaluated. In December 2014, as a result of analyzing eighteen (18) loss-of-control events, the Commercial Aviation Safety Team (CAST) recommended research into flight deck technologies that have potential to mitigate the problems and contributing factors that lead to flight crew loss of airplane state awareness (ASA) and conditions likely to produce SD. The aviation community (government, industry and academia) have been charged with conducting research into cost-effective, user-centered flight deck alerting systems to alert flight crews; especially for the two conditions that produced SD (sub-threshold rolls and the somatogravic illusion). Somatogravic illusions are defined as illusions in which “there is a false perception of attitude on exposure to a force vector that differs in direction and/or magnitude from the normal gravitational force”. The sub-threshold roll illusion (aka the “leans” illusion) is a false sensation of roll attitude. A prolonged roll of less than two degrees becomes physiologically imperceptible to the pilot, and can lead to an incorrect perception of aircraft orientation. The sub-threshold roll illusion forms the entry point for the “graveyard spiral”, a maneuver in which the pilot’s corrective action (based on their false perception of aircraft orientation) causes the aircraft to spiral down into the ground. In both of these SD illusions, it is when the pilot attempts to correct the aircraft’s attitude (based on a false perception of its state) that problems arise, sometimes with lethal consequences.

Ronald J Daiker↗

DOE OSTI2021

Object manipulation in immersive virtual environments: Hand Motion tracking technology and snap-to-fit function

There have been recent efforts to use virtual reality and manipulation to train construction workers and inspection. However, there is a lack of research efforts comparing and evaluating virtual manipulation hardware for construction tasks. Moreover, the current practice of virtual manipulation has limited functionality to guide users with the placement of objects in virtual environments. To address these issues, this paper presents 1) a detailed case study that compares three types of manipulation hardware (image-based, infrared-based, and magnetic-based) for construction applications and 2) a snap-to-fit method that improves the VM through solving limitations of the advanced virtual reality interaction metaphors. The latter enhances the placement process for manipulation by comparing two models (e.g., scan and BIM models) for proper placement in assembly scenarios. Finally, the case study results show that magnetic-based systems outperform others in construction scenarios. Lastly, the snap-to-fit function was validated in terms of accuracy and time performance.

42 ENGINEERING↗

NASA NTRS2002

Nanomanipulation and Lithography for Carbon Nanotube Based Nondestructive Evaluation Sensor Development

Carbon nanotubes (CNTs) offer great potential for advanced sensor development due to the unique electronic transport properties of the material. However, a significant obstacle to the realization of practical CNT devices is the formation of reliable and reproducible CNT to metallic contacts. In this work, scanning probe techniques are explored for both fabrication of metallic junctions and positioning of singlewalled CNTs across these junctions. The use of a haptic force feedback interface to a scanning probe microscope is used to enable movement of nanotubes over micron length scales with nanometer precision. In this case, imaging of the surface is performed with light or intermittent contact to the surface. Increased tip-to-sample interaction forces are then applied to either create junctions or position CNTs. The effect of functionalization of substrate surfaces on the movement and tribology of the materials is also studied. The application of these techniques to the fabrication of CNT-based sensors for nondestructive evaluation applications is discussed.

Wincheski, Buzz↗

DOE OSTI2026

CRCNS21 Computational Models of Multisensory Integration by Upper Limb in Humanoids and Amputees

This international collaborative research project between Johns Hopkins University (JHU) and the Technical University of Munich (TUM) investigated how the human brain processes and integrates multiple types of sensory information, such as touch and force, with the goal of improving prosthetic limbs for amputees and advancing sensory capabilities in humanoid robots. The research advanced our understanding of how the brain responds to sensory feedback in upper-limb amputees. Through experiments in which amputees received electrical stimulation while performing phantom hand movements, we demonstrated that sensory feedback activates the cortical sensorimotor and multisensory regions, and that these regions communicate dynamically during stimulation. Experiments with intact-limb participants explored the integration of visual, haptic, and force feedback, as well as in virtual reality motor training, further showing how the brain processes multimodal sensory information. In addition, this research inspired work on examining the reliability of where amputees perceive sensations over time, which contributed to a successful doctoral fellowship for continued investigation. Our collaborators at TUM improved multimodal sensor technology combining tactile and thermal feedback for humanoid robots, demonstrating the feasibility of integrating multiple sensor types into a unified system for detecting and responding to environmental stimuli. The experimental methods and analysis techniques developed across both teams, including functional network analysis and multimodal sensor integration, provide a foundation for future research in prosthetics and robotics. This research benefits the public by generating knowledge about how amputees process restored sensory information. Advances in humanoid sensing contribute to safer human-robot interaction. The project also fostered international collaboration and cross-disciplinary training: one TUM doctoral student spent a summer at JHU working on multimodal sensor integration, while two JHU students traveled to TUM to host workshops on neuromorphic sensory encoding and sensory integration.

42 ENGINEERING↗

NASA NTRS1999

Electrorheological Fluid Based Force Feedback Device

Parallel to the efforts to develop fully autonomous robots, it is increasingly being realized that there are applications where it is essential to have a fully controlled robot and "feel" its operating conditions, i.e. telepresence. This trend is a result of the increasing efforts to address tasks where humans can perform significantly better but, due to associated hazards, distance, physical limitations and other causes, only robots can be employed to perform these tasks. Such robots need to be assisted by a human that remotely controls the operation. To address the goal of operating robots as human surrogates, the authors launched a study of mechanisms that provide mechanical feedback. For this purpose, electrorheological fluids (ERF) are being investigated for the potential application as miniature haptic devices. This family of electroactive fluids has the property of changing the viscosity during electrical stimulation. Consequently, ERF can be used to produce force feedback haptic devices for tele-operated control of medical and space robotic systems. Forces applied at the robot end-effector due to a compliant environment are reflected to the user using an ERF device where a change in the system viscosity will occur proportionally to the transmitted force. Analytical model and control algorithms are being developed taking into account the non-linearities of these type of devices. This paper will describe the concept and the developed mechanism of ERF based force feedback. The test process and the physical properties of this device will be described and the results of preliminary tests will be presented.

Pfeiffer, Charles↗

NASA NTRSDate not supplied

Neo – Mars Adaptive Training Integrative Knowledge System (MATRIKS) to Improve Operational Performance and its Neural Basis for Spaceflight

With prolonged mission durations, spaceflight crews will become increasingly dependent on onboard technologies for knowledge acquisition and maintenance. It is expected that not all skills and knowledge required for these missions can be retained and retrieved based on pre-mission training alone. Limited and delayed communication will significantly constrain support from Mission Control and crews will increasingly rely on autonomous onboard technologies to successfully perform post-landing operations. With the present project we will target NASA’s particular interest in developing and assessing an adaptive, just-in-time countermeasure that will consolidate and improve skills that are most relevant to space flight operations. To achieve this aim, NASA established a Virtual NASA Specialized Center of Research (VNSCOR)referred to as “Mars Adaptive Training Integrative Knowledge System (MATRIKS)”, comprising the following three projects: (1) “Trinity–Multi-Environment Virtual Training for Long Duration Exploration Missions”, PI: A. Anderson (UC Boulder); (2) “Morpheus–A Haptic Sensory Supplement to Optimize In-Flight Adaptive Training for Human Control of Spacecraft Robotic Arms”, PI: S. Robinson, UC Davis); and the present project “Neo–Adaptive Training integrative knowledge System to Improve Operational Performance and its Neural Basis for Spaceflight” (UPenn, PI: A.C. Stahn). Neo leverages a validated workstation called 6DF that simulates a rendezvous and docking maneuver using real spacecraft flight dynamics. It is designed to (1) train and improve sensorimotor skills relevant for inflight and post-landing operational tasks; (2) feature an autonomous and adaptive training approach that does not rely on feedback from flight operations on the ground; (3) maximize the transfer of mission-relevant motor skills; (4) allow the assessment of the neural circuitry underlying the task; and (5) deliver the training in a motivating and meaningful way to astronauts. Neocomprises two overarching aims: First, we will identify the neural circuitry underlying spaceflight relevant tasks by performing a subset of the 6DFtaskduring functional magnetic resonance imaging (MRI)in a total of up to N=30 subjects with varying levels of 6DF training experience. Second, as part of the above-mentioned VNSCOR MATRIKS the proposed 6DF autonomous intelligent tutor system will be integrated in an additive manner with a haptic feedback intervention (Morpheus), and a multi-environment virtual trainer(Trinity).It is expected that Neo, Morpheus and Trinity mutually complement each other to facilitate an effective countermeasure tool to acquire and retain operational skills that are critical for exploration class missions. To assess the efficacy of this combined effort, the VNSCOR MATRIKS will collect data inN=16 crew members in one HERA campaign of 45 days duration with N=16 crew members(four missions with N=4 crew member seach).The primary goal is to identify changes in operational performance as assessed by NASA’s simulator of Canadarm2 operations, i.e., Robotic On-board Trainer (ROBoT-r) in response to MATRIKS. As part of Neo we will also identify if, and to what extent MATRIKS will promote transfer to general cognitive performance (Cognition battery), distinctive visuo-spatial tasks critical for telerobotic tasks (Spatial Cognition battery), and affect brain structural changes and the neural circuitry of key brain networks expected to be relevant for spaceflight-related performance. At the conclusion of the research, we will have defined and demonstrated the use of a neuroscience-based, adaptive training integrative knowledge system to potentially mitigate visuo-spatial and sensorimotor brain changes associated with prolonged isolation and confinement to reduce the likelihood or impact of potential decrements in human performance capabilities during long-duration space missions. The expected significance of this 4-year project relates to its relevance for facilitating effective countermeasure tools to acquire and retain operational skills that are critical for exploration class missions. This will support the development of necessary countermeasures and technologies in support of human space exploration, focusing on mitigating operational performance risks.

A C Stahn↗

NASA NTRS1999

Haptic stabilization of posture: changes in arm proprioception and cutaneous feedback for different arm orientations

Postural sway during quiet stance is attenuated by actively maintained contact of the index finger with a stationary surface, even if the level of applied force (<1 N) cannot provide mechanical stabilization. In this situation, changes in force level at the fingertip lead changes in center of foot pressure by approximately 250 ms. These and related findings indicate that stimulation of the fingertip combined with proprioceptive information about the hand and arm can serve as an active sensor of body position relative to the point of contact. A geometric analysis of the relationship between hand and torso displacement during body sway led to the prediction that arm and hand proprioceptive and finger somatosensory information about body sway would be maximized with finger contact in the plane of body sway. Therefore, the most postural stabilization should be possible with such contact. To test this analysis, subjects touched a laterally versus anteriorly placed surface while in each of two stances: the heel-to-toe tandem Romberg stance that reduces medial-lateral stability and the heel-to-heel, toes-outward, knees-bent, "duck stance" that reduces fore-aft stability. Postural sway was always least with finger contact in the unstable plane: for the tandem stance, lateral fingertip contact was significantly more effective than frontal contact, and, for the duck stance, frontal contact was more effective than lateral fingertip contact. Force changes at the fingertip led changes in center of pressure of the feet by approximately 250 ms for both fingertip contact locations for both test stances. These results support the geometric analysis, which showed that 1) arm joint angles change by the largest amount when fingertip contact is maintained in the plane of greatest sway, and 2) the somatosensory cues at the fingertip provide both direction and amplitude information about sway when the finger is contacting a surface in the unstable plane.

Non-NASA Center↗

NASA NTRS2000

Roughness Perception of Haptically Displayed Fractal Surfaces

Surface profiles were generated by a fractal algorithm and haptically rendered on a force feedback joystick, Subjects were asked to use the joystick to explore pairs of surfaces and report to the experimenter which of the surfaces they felt was rougher. Surfaces were characterized by their root mean square (RMS) amplitude and their fractal dimension. The most important factor affecting the perceived roughness of the fractal surfaces was the RMS amplitude of the surface. When comparing surfaces of fractal dimension 1.2-1.35 it was found that the fractal dimension was negatively correlated with perceived roughness.

Costa, Michael A.↗

NASA NTRS1996

Kinematic/Dynamic Characteristics for Visual and Kinesthetic Virtual Environments

Work was carried out on two topics of principal importance to current progress in virtual environment research at NASA Ames and elsewhere. The first topic was directed at maximizing the temporal dynamic response of visually presented Virtual Environments (VEs) through reorganization and optimization of system hardware and software. The final results of this portion of the work was a VE system in the Advanced Display and Spatial Perception Laboratory at NASA Ames capable of updating at 60 Hz (the maximum hardware refresh rate) with latencies approaching 30 msec. In the course of achieving this system performance, specialized hardware and software tools for measurement of VE latency and analytic models correlating update rate and latency for different system configurations were developed. The second area of activity was the preliminary development and analysis of a novel kinematic architecture for three Degree Of Freedom (DOF) haptic interfaces--devices that provide force feedback for manipulative interaction with virtual and remote environments. An invention disclosure was filed on this work and a patent application is being pursued by NASA Ames. Activities in these two areas are expanded upon below.

Bortolussi, Michael R.↗

NASA NTRS2009

TPSAS-NF1676L-9785-DND

Evaluate feasibility of inferring aspects of pilot state using active (force-feedback) side-stick, including a) contact with stick (haptic monitoring), b) Desire to change automation support level, c) pilot workload, and d) stress. Conduct human-in-the loop experiment to generate database for off-line investigation of potential signals and identification methods

Ken Goodrich↗

NASA NTRS2000

Congenitally blind individuals rapidly adapt to coriolis force perturbations of their reaching movements

Reaching movements made to visual targets in a rotating room are initially deviated in path and endpoint in the direction of transient Coriolis forces generated by the motion of the arm relative to the rotating environment. With additional reaches, movements become progressively straighter and more accurate. Such adaptation can occur even in the absence of visual feedback about movement progression or terminus. Here we examined whether congenitally blind and sighted subjects without visual feedback would demonstrate adaptation to Coriolis forces when they pointed to a haptically specified target location. Subjects were tested pre-, per-, and postrotation at 10 rpm counterclockwise. Reaching to straight ahead targets prerotation, both groups exhibited slightly curved paths. Per-rotation, both groups showed large initial deviations of movement path and curvature but within 12 reaches on average had returned to prerotation curvature levels and endpoints. Postrotation, both groups showed mirror image patterns of curvature and endpoint to the per-rotation pattern. The groups did not differ significantly on any of the performance measures. These results provide compelling evidence that motor adaptation to Coriolis perturbations can be achieved on the basis of proprioceptive, somatosensory, and motor information in the complete absence of visual experience.

NASA Discipline Neuroscience↗