Search NASA⌕ Search

SEARCH · Search NASA

Results for “haptic”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

CRCNS21 Computational Models of Multisensory Integration by Upper Limb in Humanoids and Amputees

This international collaborative research project between Johns Hopkins University (JHU) and the Technical University of Munich (TUM) investigated how the human brain processes and integrates multiple types of sensory information, such as touch and force, with the goal of improving prosthetic limbs for amputees and advancing sensory capabilities in humanoid robots. The research advanced our understanding of how the brain responds to sensory feedback in upper-limb amputees. Through experiments in which amputees received electrical stimulation while performing phantom hand movements, we demonstrated that sensory feedback activates the cortical sensorimotor and multisensory regions, and that these regions communicate dynamically during stimulation. Experiments with intact-limb participants explored the integration of visual, haptic, and force feedback, as well as in virtual reality motor training, further showing how the brain processes multimodal sensory information. In addition, this research inspired work on examining the reliability of where amputees perceive sensations over time, which contributed to a successful doctoral fellowship for continued investigation. Our collaborators at TUM improved multimodal sensor technology combining tactile and thermal feedback for humanoid robots, demonstrating the feasibility of integrating multiple sensor types into a unified system for detecting and responding to environmental stimuli. The experimental methods and analysis techniques developed across both teams, including functional network analysis and multimodal sensor integration, provide a foundation for future research in prosthetics and robotics. This research benefits the public by generating knowledge about how amputees process restored sensory information. Advances in humanoid sensing contribute to safer human-robot interaction. The project also fostered international collaboration and cross-disciplinary training: one TUM doctoral student spent a summer at JHU working on multimodal sensor integration, while two JHU students traveled to TUM to host workshops on neuromorphic sensory encoding and sensory integration.

42 ENGINEERING↗
NASA NTRS1992

Microgravity vestibular investigations (10-IML-1)

Our perception of how we are oriented in space is dependent on the interaction of virtually every sensory system. For example, to move about in our environment we integrate inputs in our brain from visual, haptic (kinesthetic, proprioceptive, and cutaneous), auditory systems, and labyrinths. In addition to this multimodal system for orientation, our expectations about the direction and speed of our chosen movement are also important. Changes in our environment and the way we interact with the new stimuli will result in a different interpretation by the nervous system of the incoming sensory information. We will adapt to the change in appropriate ways. Because our orientation system is adaptable and complex, it is often difficult to trace a response or change in behavior to any one source of information in this synergistic orientation system. However, with a carefully designed investigation, it is possible to measure signals at the appropriate level of response (both electrophysiological and perceptual) and determine the effect that stimulus rearrangement has on our sense of orientation. The environment of orbital flight represents the stimulus arrangement that is our immediate concern. The Microgravity Vestibular Investigations (MVI) represent a group of experiments designed to investigate the effects of orbital flight and a return to Earth on our orientation system.

Reschke, Millard F.↗
NASA NTRS1991

Implementation issues for a compact 6 degree of freedom force reflecting handcontroller with cueing of modes

Teleoperated control requires a master human interface device that can provide haptic input and output which reflect the responses of a slave robotic system. The effort reported in this paper addresses the design and prototyping of a six degree-of-freedom (DOF) Cartesian coordinate hand controller for this purpose. The device design recommended is an XYZ stage attached to a three-roll wrist which positions a flight-type handgrip. Six degrees of freedom are transduced and control brushless DC motor servo electronics similar in design to those used in computer controlled robotic manipulators. This general approach supports scaled force, velocity, and position feedback to aid an operator in achieving telepresence. The generality of the device and control system characteristics allow the use of inverse dynamics robotic control methodology to project slave robot system forces and inertias to the operator (in scaled form) and at the same time to reduce the apparent inertia of the robotic handcontroller itself. The current control design, which is not multiple fault tolerant, can be extended to make flight control or space use possible. The proposed handcontroller will have advantages in space-based applications where an operator must control several robot arms in a simultaneous and coordinated fashion. It will also have applications in intravehicular activities (within the Space Station) such as microgravity experiments in metallurgy and biological experiments that require isolation from the astronauts' environment. For ground applications, the handcontroller will be useful in underwater activities where the generality of the proposed handcontroller becomes an asset for operation of many different manipulator types. Also applications will emerge in the Military, Construction, and Maintenance/Manufacturing areas including ordnance handling, mine removal, NBC (Nuclear, Chemical, Biological) operations, control of vehicles, and operating strength and agility enhanced machines. Future avionics applications including advanced helicopter and aircraft control may also become important.

Jacobus, Heidi↗
NASA NTRS1996

Kinematic/Dynamic Characteristics for Visual and Kinesthetic Virtual Environments

Work was carried out on two topics of principal importance to current progress in virtual environment research at NASA Ames and elsewhere. The first topic was directed at maximizing the temporal dynamic response of visually presented Virtual Environments (VEs) through reorganization and optimization of system hardware and software. The final results of this portion of the work was a VE system in the Advanced Display and Spatial Perception Laboratory at NASA Ames capable of updating at 60 Hz (the maximum hardware refresh rate) with latencies approaching 30 msec. In the course of achieving this system performance, specialized hardware and software tools for measurement of VE latency and analytic models correlating update rate and latency for different system configurations were developed. The second area of activity was the preliminary development and analysis of a novel kinematic architecture for three Degree Of Freedom (DOF) haptic interfaces--devices that provide force feedback for manipulative interaction with virtual and remote environments. An invention disclosure was filed on this work and a patent application is being pursued by NASA Ames. Activities in these two areas are expanded upon below.

Bortolussi, Michael R.↗
NASA NTRS1997

Cognitive Sciences

Session MP4 includes short reports on: (1) Face Recognition in Microgravity: Is Gravity Direction Involved in the Inversion Effect?; (2) Motor Timing under Microgravity; (3) Perceived Self-Motion Assessed by Computer-Generated Animations: Complexity and Reliability; (4) Prolonged Weightlessness Reference Frames and Visual Symmetry Detection; (5) Mental Representation of Gravity During a Locomotor Task; and (6) Haptic Perception in Weightlessness: A Sense of Force or a Sense of Effort?

Source record↗
NASA NTRS2001

Simulation of Physical Experiments in Immersive Virtual Environments

An object-oriented event-driven immersive Virtual environment is described for the creation of virtual labs (VLs) for simulating physical experiments. Discussion focuses on a number of aspects of the VLs, including interface devices, software objects, and various applications. The VLs interface with output devices, including immersive stereoscopic screed(s) and stereo speakers; and a variety of input devices, including body tracking (head and hands), haptic gloves, wand, joystick, mouse, microphone, and keyboard. The VL incorporates the following types of primitive software objects: interface objects, support objects, geometric entities, and finite elements. Each object encapsulates a set of properties, methods, and events that define its behavior, appearance, and functions. A container object allows grouping of several objects. Applications of the VLs include viewing the results of the physical experiment, viewing a computer simulation of the physical experiment, simulation of the experiments procedure, computational steering, and remote control of the physical experiment. In addition, the VL can be used as a risk-free (safe) environment for training. The implementation of virtual structures testing machines, virtual wind tunnels, and a virtual acoustic testing facility is described.

Noor, Ahmed K.↗
NASA NTRS2002

Nanomanipulation and Lithography for Carbon Nanotube Based Nondestructive Evaluation Sensor Development

Carbon nanotubes (CNTs) offer great potential for advanced sensor development due to the unique electronic transport properties of the material. However, a significant obstacle to the realization of practical CNT devices is the formation of reliable and reproducible CNT to metallic contacts. In this work, scanning probe techniques are explored for both fabrication of metallic junctions and positioning of singlewalled CNTs across these junctions. The use of a haptic force feedback interface to a scanning probe microscope is used to enable movement of nanotubes over micron length scales with nanometer precision. In this case, imaging of the surface is performed with light or intermittent contact to the surface. Increased tip-to-sample interaction forces are then applied to either create junctions or position CNTs. The effect of functionalization of substrate surfaces on the movement and tribology of the materials is also studied. The application of these techniques to the fabrication of CNT-based sensors for nondestructive evaluation applications is discussed.

Wincheski, Buzz↗
NASA NTRS2003

Analysis of human postural responses to recoverable falls

We studied the kinematics and kinetics of human postural responses to "recoverable falls." To induce brief falling we used a Hold and Release (H&R) paradigm. Standing subjects actively resisted a force applied to their sternum. When this force was quickly released they were suddenly off balance. For a brief period, approximately 125 ms, until restoring forces were generated to shift the center of foot pressure in front of the center of mass, the body was in a forward fall acted on by gravity and ground support forces. We were able to describe the whole-body postural behavior following release using a multilink inverted pendulum model in a regime of "small oscillations." A three-segment model incorporating upper body, upper leg, and lower leg, with active stiffness and damping at the joints was fully adequate to fit the kinematic data from all conditions. The significance of our findings is that in situations involving recoverable falls or loss of balance the earliest responses are likely dependent on actively-tuned, reflexive mechanisms yielding stiffness and damping modulation of the joints. We demonstrate that haptic cues from index fingertip contact with a stationary surface lead to a significantly smaller angular displacement of the torso and a more rapid recovery of balance. Our H&R paradigm and associated model provide a quantifiable approach to studying recovery from potential falling in normal and clinical subjects.

NASA Discipline Space Human Factors↗
NASA NTRS1998

Two memories for geographical slant: separation and interdependence of action and awareness

The present study extended previous findings of geographical slant perception, in which verbal judgments of the incline of hills were greatly overestimated but motoric (haptic) adjustments were much more accurate. In judging slant from memory following a brief or extended time delay, subjects' verbal judgments were greater than those given when viewing hills. Motoric estimates differed depending on the length of the delay and place of response. With a short delay, motoric adjustments made in the proximity of the hill did not differ from those evoked during perception. When given a longer delay or when taken away from the hill, subjects' motoric responses increased along with the increase in verbal reports. These results suggest two different memorial influences on action. With a short delay at the hill, memory for visual guidance is separate from the explicit memory informing the conscious response. With short or long delays away from the hill, short-term visual guidance memory no longer persists, and both motor and verbal responses are driven by an explicit representation. These results support recent research involving visual guidance from memory, where actions become influenced by conscious awareness, and provide evidence for communication between the "what" and "how" visual processing systems.

NASA Discipline Space Human Factors↗
NASA NTRS2000

Congenitally blind individuals rapidly adapt to coriolis force perturbations of their reaching movements

Reaching movements made to visual targets in a rotating room are initially deviated in path and endpoint in the direction of transient Coriolis forces generated by the motion of the arm relative to the rotating environment. With additional reaches, movements become progressively straighter and more accurate. Such adaptation can occur even in the absence of visual feedback about movement progression or terminus. Here we examined whether congenitally blind and sighted subjects without visual feedback would demonstrate adaptation to Coriolis forces when they pointed to a haptically specified target location. Subjects were tested pre-, per-, and postrotation at 10 rpm counterclockwise. Reaching to straight ahead targets prerotation, both groups exhibited slightly curved paths. Per-rotation, both groups showed large initial deviations of movement path and curvature but within 12 reaches on average had returned to prerotation curvature levels and endpoints. Postrotation, both groups showed mirror image patterns of curvature and endpoint to the per-rotation pattern. The groups did not differ significantly on any of the performance measures. These results provide compelling evidence that motor adaptation to Coriolis perturbations can be achieved on the basis of proprioceptive, somatosensory, and motor information in the complete absence of visual experience.

NASA Discipline Neuroscience↗
NASA NTRS1998

Auditory cues for orientation and postural control in sighted and congenitally blind people

This study assessed whether stationary auditory information could affect body and head sway (as does visual and haptic information) in sighted and congenitally blind people. Two speakers, one placed adjacent to each ear, significantly stabilized center-of-foot-pressure sway in a tandem Romberg stance, while neither a single speaker in front of subjects nor a head-mounted sonar device reduced center-of-pressure sway. Center-of-pressure sway was reduced to the same level in the two-speaker condition for sighted and blind subjects. Both groups also evidenced reduced head sway in the two-speaker condition, although blind subjects' head sway was significantly larger than that of sighted subjects. The advantage of the two-speaker condition was probably attributable to the nature of distance compared with directional auditory information. The results rule out a deficit model of spatial hearing in blind people and are consistent with one version of a compensation model. Analysis of maximum cross-correlations between center-of-pressure and head sway, and associated time lags suggest that blind and sighted people may use different sensorimotor strategies to achieve stability.

NASA Discipline Neuroscience↗
NASA NTRS2006

Humanoid Mobile Manipulation Using Controller Refinement

An important class of mobile manipulation problems are move-to-grasp problems where a mobile robot must navigate to and pick up an object. One of the distinguishing features of this class of tasks is its coarse-to-fine structure. Near the beginning of the task, the robot can only sense the target object coarsely or indirectly and make gross motion toward the object. However, after the robot has located and approached the object, the robot must finely control its grasping contacts using precise visual and haptic feedback. In this paper, it is proposed that move-to-grasp problems are naturally solved by a sequence of controllers that iteratively refines what ultimately becomes the final solution. This paper introduces the notion of a refining sequence of controllers and characterizes this type of solution. The approach is demonstrated in a move-to-grasp task where Robonaut, the NASA/JSC dexterous humanoid, is mounted on a mobile base and navigates to and picks up a geological sample box. In a series of tests, it is shown that a refining sequence of controllers decreases variance in robot configuration relative to the sample box until a successful grasp has been achieved.

Platt, Robert↗
NASA NTRS2006

Humanoid Mobile Manipulation Using Controller Refinement

An important class of mobile manipulation problems are move-to-grasp problems where a mobile robot must navigate to and pick up an object. One of the distinguishing features of this class of tasks is its coarse-to-fine structure. Near the beginning of the task, the robot can only sense the target object coarsely or indirectly and make gross motion toward the object. However, after the robot has located and approached the object, the robot must finely control its grasping contacts using precise visual and haptic feedback. This paper proposes that move-to-grasp problems are naturally solved by a sequence of controllers that iteratively refines what ultimately becomes the final solution. This paper introduces the notion of a refining sequence of controllers and characterizes this type of solution. The approach is demonstrated in a move-to-grasp task where Robonaut, the NASA/JSC dexterous humanoid, is mounted on a mobile base and navigates to and picks up a geological sample box. In a series of tests, it is shown that a refining sequence of controllers decreases variance in robot configuration relative to the sample box until a successful grasp has been achieved.

Platt, Robert↗
NASA NTRS2007

Telerobotic Surgery: An Intelligent Systems Approach to Mitigate the Adverse Effects of Communication Delay

An extremely innovative approach has been presented, which is to have the surgeon operate through a simulator running in real-time enhanced with an intelligent controller component to enhance the safety and efficiency of a remotely conducted operation. The use of a simulator enables the surgeon to operate in a virtual environment free from the impediments of telecommunication delay. The simulator functions as a predictor and periodically the simulator state is corrected with truth data. Three major research areas must be explored in order to ensure achieving the objectives. They are: simulator as predictor, image processing, and intelligent control. Each is equally necessary for success of the project and each of these involves a significant intelligent component in it. These are diverse, interdisciplinary areas of investigation, thereby requiring a highly coordinated effort by all the members of our team, to ensure an integrated system. The following is a brief discussion of those areas. Simulator as a predictor: The delays encountered in remote robotic surgery will be greater than any encountered in human-machine systems analysis, with the possible exception of remote operations in space. Therefore, novel compensation techniques will be developed. Included will be the development of the real-time simulator, which is at the heart of our approach. The simulator will present real-time, stereoscopic images and artificial haptic stimuli to the surgeon. Image processing: Because of the delay and the possibility of insufficient bandwidth a high level of novel image processing is necessary. This image processing will include several innovative aspects, including image interpretation, video to graphical conversion, texture extraction, geometric processing, image compression and image generation at the surgeon station. Intelligent control: Since the approach we propose is in a sense predictor based, albeit a very sophisticated predictor, a controller, which not only optimizes end effector trajectory but also avoids error, is essential. We propose to investigate two different approaches to the controller design. One approach employs an optimal controller based on modern control theory; the other one involves soft computing techniques, i.e. fuzzy logic, neural networks, genetic algorithms and hybrids of these.

Cardullo, Frank M.↗
NASA NTRS2008

Carbon Nanotube/Polymer Nanocomposites Flexible Stress and Strain Sensors

Conformable stress and strain sensors are required for monitoring the integrity of airframe structures as well as for sensing the mechanical stimuli in prosthetic arms. For this purpose, we have developed a series of piezoresistive single-wall carbon nanotube (SWCNT)/polymer nanocomposites. The electromechanical coupling of pressure with resistance changes in these nanocomposites is exceptionally greater than that of metallic piezoresistive materials. In fact, the piezoresistive stress coefficient (pi) of a SWCNT/polymer nanocomposite is approximately two orders of magnitude higher than that of a typical metallic piezoresistive. The piezoresistive stress coefficient is a function of the nanotube concentration wherein the maximum value occurs at a concentration just above the percolation threshold concentration (phi approx. 0.05 %). This response appears to originate from a change in intrinsic resistivity under compression/tension. A systematic study of the effect of the modulus of the polymer matrix on piezoresistivity allowed us to make flexible and conformable sensors for biomedical applications. The prototype haptic sensors using these nanocomposites are demonstrated. The piezocapacitive properties of SWCNT/polymer are also characterized by monitoring the capacitance change under pressure.

Kang, Jin Ho↗
NASA NTRS2008

Piloted Evaluation of the H-Mode, a Variable Autonomy Control System, in Motion-Based Simulation

As aircraft become able to autonomously respond to a range of situations with performance surpassing human operators, we are compelled to look for new methods that help understand their use and guide the design of new, more effective forms of automation and interaction. The "H-mode" is one such method and is based on the metaphor of a well-trained horse. The concept allows the pilot to manage a broad range of control automation functionality, from augmented manual control to FMS-like coupling and automation initiated actions, using a common interface system and easily learned set of interaction skills. The interface leverages familiar manual control interfaces (e.g., the control stick) and flight displays through the addition of contextually dependent haptic-multimodal elements. The concept is relevant to manned and remotely piloted vehicles. This paper provides an overview of the H-mode concept followed by a presentation of the results from a recent evaluation conducted in a motion-based simulator. The evaluation focused on assessing the overall usability and flying qualities of the concept with an emphasis on the effects of turbulence and cockpit motion. Because the H-mode results in interactions between traditional flying qualities and management of higher-level flight path automation, these effects are of particular interest. The results indicate that the concept may provide a useful complement or replacement to conventional interfaces, and retains the usefulness in the presence of turbulence and motion.

Goodrich, Kenneth H.↗
NASA NTRS2009

Space Flight and Manual Control: Implications for Sensorimotor Function on Future Missions

Control of vehicles, and other complex mechanical motion systems, is a high-level integrative function of the central nervous system (CNS) that requires good visual acuity, eye-hand coordination, spatial (and, in some cases, geographic) orientation perception, and cognitive function. Existing evidence from space flight research (Paloski et.al., 2008, Clement and Reschke 2008, Reschke et al., 2007) demonstrates that the function of each of these systems is altered by removing (and subsequently by reintroducing) a gravitational field that can be sensed by vestibular, proprioceptive, and haptic receptors and used by the CNS for spatial orientation, navigation, and coordination of movements. Furthermore, much of the operational performance data collected as a function of space flight has not been available for independent analysis, and those data that have been reviewed are equivocal owing to uncontrolled environmental and/or engineering factors. Thus, our current understanding, when it comes to manual control, is limited primarily to a review of those situations where manual control has been a factor. One of the simplest approaches to the manual control problem is to review shuttle landing data. See the Figure below for those landing for which we have Shuttle velocities over the runway threshold.

Reschke, Millard F.↗