Search NASA⌕ Search

SEARCH · Search NASA

Results for “sensory feedback”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Telepresence for touch and proprioception in teleoperator systems

The control and operation of mechanical manipulators by a human and the use of sensory tactile and force feedback is reviewed. The terms telepresence, teleproprioception, and teletouch are defined and relevant technologies that have or could have been applied to teleoperation are discussed. An ideal method of tactile sensory feedback for teleoperators that is based upon reproduction of the object's contour is discussed, and its practicality considered. Previously developed components that could be used to build a system incorporating sensory tactile and force feedback are presented.

Hagner, David G.↗

Cybernetic prosthesis

Design and development of a prosthetic device fitted to an above elbow amputee is reported that derives control information from the human to modulate power to an actuator to drive the substitute limb. In turn, the artificial limb generates sensory information feedback to the human nervous system and brain. This synergetic unity feeds efferent or motor control information from the human to the machine, and the machine responds, delivering afferent or sensory information back to the man.

Mann, R. W.↗

Anthropomorphic Remote Manipulator

Two-armed telerobot undergoing development manipulates objects with dexterity approaching that of human. Designed to be remotely operated by human. Operator wears harness with exoskeletonlike sleeves and gloves; remote manipulator follows operator's arm, hand, and finger movements and feeds back position and force information so operator has sense of manipulating object held by telerobot. Developed for use in outer space. Suited for such terrestrial uses as handling materials and maintaining equipment in hazardous environments where mechanical dexterity and nearly instantaneous feedback of sensory information needed.

Jau, Bruno M.↗

The development of system components to provide proprioceptive and tactile information to the human for future telepresence systems

System components are presented that are being implemented to augment teleoperated systems by providing both force and tactile information to the human operator. The concept proposed is the control of a manipulator to perform tasks; i.e., flight line maintenance and repair of combat aircraft or satellites while under the control of a human operator at a remote location to maintain mission effectiveness in a hostile environment. The human would control the motion of the manipulator via a master system with information from the remote site being fed back by direct stimulation of the humans sensory mechanisms or by graphic interpretation of displays. We are interested in providing the operator feedback of position, force, auditory, vision, and tactile information to aide in the human's cognitive ability to control the manipulator. This sensory information from the remote site would then be presented to the operator in such a manner as to enhance his performance while providing him a sense of being present at the remote location, this is known as telepresence. Also discussed is the research done by the Human Sensory Feedback (HSF) facility at the Armstrong Laboratory to provide tactile and proprioceptive feedback to the operator. The system components of this system includes tactile sensor and stimulators, dexterous robotic hands, and the control of positioning and operating industrial robots with exoskeletal mechanisms.

Wright, Ammon K.↗

Effects of Multisensory Virtual Reality Nature on Affect, Presence, and Restorativeness

Virtual reality (VR) can provide access to restorative environments and sensory stimulation for individuals in isolated, confined, and extreme environments. We developed a nature-based VR intervention featuring three scenes (Garden, Forest, Beach) and examined the effects of multisensory augmentation with location-based olfactory, wind, and thermal stimuli (VR+OWT). Over a two-week period, fifty-one participants were assigned to a no-intervention control, standard audiovisual VR, or augmented VR (VR+OWT) condition. Data collection included weekly assessments of affect, stress, and cognitive performance; post-VR measures of affect, presence, and perceived restorativeness; and open-ended feedback. Both VR and VR+OWT groups produced immediate and sustained reductions in negative affect with no sustained systematic benefits on cognitive performance. The addition of olfactory, wind, and thermal stimuli enhanced presence for some scenes; however, feedback indicated that sensory mismatches and stimulus intensity occasionally detracted from the experience and may have contributed to lower coherence ratings in the VR+OWT group. In contrast, the perceived restorativeness of the VR environment was driven primarily by scene content (Garden vs Forest vs Beach) rather than the level of sensory stimulation. These findings support the potential of virtual nature to promote well-being and underscore the importance of coherence across sensory modalities for multisensory augmentation.

Virtual Reality Intervention↗

Flying Unmanned Aircraft: A Pilot's Perspective

The National Aeronautics and Space Administration (NASA) is pioneering various Unmanned Aircraft System (UAS) technologies and procedures which may enable routine access to the National Airspace System (NAS), with an aim for Next Gen NAS. These tools will aid in the development of technologies and integrated capabilities that will enable high value missions for science, security, and defense, and open the door to low-cost, extreme-duration, stratospheric flight. A century of aviation evolution has resulted in accepted standards and best practices in the design of human-machine interfaces, the displays and controls of which serve to optimize safe and efficient flight operations and situational awareness. The current proliferation of non-standard, aircraft-specific flight crew interfaces in UAS, coupled with the inherent limitations of operating UAS without in-situ sensory input and feedback (aural, visual, and vestibular cues), has increased the risk of mishaps associated with the design of the "cockpit." The examples of current non- or sub- standard design features range from "annoying" and "inefficient", to those that are difficult to manipulate or interpret in a timely manner, as well as to those that are "burdensome" and "unsafe." A concerted effort is required to establish best practices and standards for the human-machine interfaces, for the pilot as well as the air traffic controller. In addition, roles, responsibilities, knowledge, and skill sets are subject to redefining the terms, "pilot" and "air traffic controller", with respect to operating UAS, especially in the Next-Gen NAS. The knowledge, skill sets, training, and qualification standards for UAS operations must be established, and reflect the aircraft-specific human-machine interfaces and control methods. NASA s recent experiences flying its MQ-9 Ikhana in the NAS for extended duration, has enabled both NASA and the FAA to realize the full potential for UAS, as well as understand the implications of current limitations. Ikhana is a Predator-B/Reaper UAS, built by General Atomics, Aeronautical Systems, Inc., and modified for research. Since 2007, the aircraft has been flown seasonally with a wing-mounted pod containing an infrared scanner, utilized to provide real-time wildfire geo-location data to various fire-fighting agencies in the western U.S. The multi-agency effort included an extensive process to obtain flight clearance from the FAA to operate under special provisions, given that UAS in general do not fully comply with current airspace regulations (e.g. sense-and-avoid requirements).

Pestana, Mark E.↗

Straight Ahead in Microgravity

This joint ESA-NASA study will address adaptive changes in spatial orientation related to the subjective straight ahead, and the use of a vibrotactile sensory aid to reduce perceptual errors. The study will be conducted before and after long-duration expeditions to the International Space Station (ISS) to examine how spatial processing of target location is altered following exposure to microgravity. This project specifically addresses the sensorimotor research gap "What are the changes in sensorimotor function over the course of a mission?" Six ISS crewmembers will be requested to participate in three preflight sessions (between 120 and 60 days prior to launch) and then three postflight sessions on R+0/1 day, R+4 +/-2 days, and R+8 +/-2 days. The three specific aims include: (a) fixation of actual and imagined target locations at different distances; (b) directed eye and arm movements along different spatial reference frames; and (c) the vestibulo-ocular reflex during translation motion with fixation targets at different distances. These measures will be compared between upright and tilted conditions. Measures will then be compared with and without a vibrotactile sensory aid that indicates how far one has tilted relative to the straight-ahead direction. The flight study was been approved by the medical review boards and will be implemented in the upcoming Informed Crew Briefings to solicit flight subject participation. Preliminary data has been recorded on 6 subjects during parabolic flight to examine the spatial coding of eye movements during roll tilt relative to perceived orientations while free-floating during the microgravity phase of parabolic flight or during head tilt in normal gravity. Binocular videographic recordings obtained in darkness allowed us to quantify the mean deviations in gaze trajectories along both horizontal and vertical coordinates relative to the aircraft and head orientations. During some parabolas, a vibrotactile sensory aid provided feedback of body orientation relative to the plane coordinates. RESULTS Both variability and curvature of gaze trajectories increased during roll tilt compared to the upright position. The saccades were less accurate during parabolic flight compared to measurements obtained in normal gravity. Although subjects were instructed to look off in the distance while performing the eye movements, fixation distance varied with vertical gaze direction independent of whether the saccades were made along perceived aircraft or head orientations. The increased errors in gaze trajectories along both perceived orientations during microgravity can be attributed to the otolith's role in spatial coding of eye movements. A change in an individual's egocentric reference might have negative consequences on evaluating the direction of an approaching object or on the accuracy of reaching movements or locomotion. Consequently, investigating how microgravity affects the target location will have theoretical, operational and even clinical implications for future space exploration missions. The use of vibrotactile feedback as a sensorimotor countermeasure is applicable to balance therapy applications for vestibular loss patients and the elderly to mitigate risks due to loss of orientation.

Wood, S. J.↗

NASA's Hybrid Reality Lab: One Giant Leap for Full Dive

This presentation demonstrates how NASA is using consumer VR headsets, game engine technology and NVIDIA's GPUs to create highly immersive future training systems augmented with extremely realistic haptic feedback, sound, additional sensory information, and how these can be used to improve the engineering workflow. Include in this presentation is an environment simulation of the ISS, where users can interact with virtual objects, handrails, and tracked physical objects while inside VR, integration of consumer VR headsets with the Active Response Gravity Offload System, and a space habitat architectural evaluation tool. Attendees will learn how the best elements of real and virtual worlds can be combined into a hybrid reality environment with tangible engineering and scientific applications.

Delgado, Francisco J.↗

Electrotactile and vibrotactile displays for sensory substitution systems

Sensory substitution systems provide their users with environmental information through a human sensory channel (eye, ear, or skin) different from that normally used or with the information processed in some useful way. The authors review the methods used to present visual, auditory, and modified tactile information to the skin and discuss present and potential future applications of sensory substitution, including tactile vision substitution (TVS), tactile auditory substitution, and remote tactile sensing or feedback (teletouch). The relevant sensory physiology of the skin, including the mechanisms of normal touch and the mechanisms and sensations associated with electrical stimulation of the skin using surface electrodes (electrotactile, or electrocutaneous, stimulation), is reviewed. The information-processing ability of the tactile sense and its relevance to sensory substitution is briefly summarized. The limitations of current tactile display technologies are discussed.

Kaczmarek, Kurt A.↗

Cortical potentials evoked by confirming and disconfirming feedback following an auditory discrimination.

Vertex potentials elicited by visual feedback signals following an auditory intensity discrimination have been studied with eight subjects. Feedback signals which confirmed the prior sensory decision elicited small P3s, while disconfirming feedback elicited P3s that were larger. On the average, the latency of P3 was also found to increase with increasing disparity between the judgment and the feedback information. These effects were part of an overall dichotomy in wave shape following confirming vs disconfirming feedback. These findings are incorporated in a general model of the role of P3 in perceptual decision making.

Squires, K. C.↗

Human Interfaces In Teleoperations And Virtual Environments

Conference report contains compilation of papers relating to interactions between humans and machines from perspectives of telepresence and sensorimotor adaptation, measurement and evaluation of performance, and design principles and predictive models. Topics discussed include neural networks, sensory technology, display, and feedback controls. Covers state of art of remote sensing and control by humans for space or other operations.

Durlach, Nathaniel I.↗

Does the vestibular system contribute to head direction cell activity in the rat?

Head direction cells (HDC) located in several regions of the brain, including the anterior dorsal nucleus of the thalamus (ADN), postsubiculum (PoS), and lateral mammillary nuclei (LMN), provide the neural substrate for the determination of head direction. Although activity of HDC is influenced by various sensory signals and internally generated cues, lesion studies and some anatomical and physiological evidence suggest that vestibular inputs are critical for the maintenance of directional sensitivity of these cells. However, vestibular inputs must be transformed considerably in order to signal head direction, and the neuronal circuitry that accomplishes this signal processing has not been fully established. Furthermore, it is unclear why the removal of vestibular inputs abolishes the directional sensitivity of HDC, as visual and other sensory inputs and motor feedback signals strongly affect the firing of these neurons and would be expected to maintain their directional-related activity. Further physiological studies will be required to establish the role of vestibular system in producing HDC responses, and anatomical studies are needed to determine the neural circuitry that mediates vestibular influences on determination of head direction.

Review, Tutorial↗

Evaluation of Intranasal Scopolamine for the Prevention of Wave Motion Induced Motion Sickness While Maintaining Performance on Operationally Relevant Tasks

Motion sickness represents one of the greatest clinical challenges impacting crew activities during and following g-transitions. Our overall goal is to characterize the effectiveness of motion sickness countermeasures during controlled laboratory experiments using capsule wave motion simulation and during field testing in operational environments. This laboratory study focused on prevention of motion sickness using intranasal scopolamine using a double-blinded repeated measures design in 30 subjects (19M, 11F). Intranasal scopolamine was provided by Defender Pharmaceuticals, Inc. (DPI-386 Nasal Gel, referred to as Inscop) self-administered by a nasal pump (Aptar Pharma) that delivers 0.4 mg dose (0.2 mg / nostril). During each session, subjects were exposed to complex wave motion on a six degree-of-freedom platform that included pitch, roll and heave at provocative stimulus frequencies (0.1-0.25 Hz) while seated in an illuminated cabin deprived of external visual cues. Motion sickness symptoms were compared across treatment and placebo control sessions counterbalanced across subjects and separated by at least one week. The time-to-motion sickness endpoint was based on severe malaise, defined as symptom score of ≥8 points using the Pensacola Diagnostic Index [1]. The bioavailability of scopolamine for each session was estimated from plasma concentrations obtained every 15 min[2]. Side effects during the treatment session were minimal, and performance was not impaired on a test battery including motion perception tracking, tablet-based eye-hand coordination and psychomotor vigilance testing. The plasma concentration remained near-peak levels throughout the 45 min motion sickness testing for most subjects. The percentile ranking on the Motion Sickness Susceptibility Questionnaire [MSSQ, 3]was moderately correlated with the motion sickness time-to-endpoint during the placebo control session (rho = –0.3, p=0.056). Seventeen subjects did not reach an endpoint during their placebo session and were eliminated from subsequent analysis. Another subject was excluded due to insufficient plasma concentration during the treatment session. For the remaining 12 subjects, the change in time-to-motion sickness endpoint between placebo and treatment sessions was moderately correlated with plasma concentration (rho =0.48, p = 0.056), improving on average 4.4 ± 18.4 min, mean ± std with Inscop versus placebo. Our results are consistent with previous findings that intranasal delivery of scopolamine can be effective at reducing motion sickness symptoms with minimal cognitive or sedative side effects. Future work is needed to optimize the delivery of Inscop for rescue (treatment) of symptoms following g-transitions as one of the key advantages of this formulation is self-administration in a suited environment. We will also explore how the combination of Inscop with non-pharmaceutical sensory aids, e.g., vibrotactile feedback of Earth vertical, may further mitigate motion sickness and improve task performance.

S J Wood↗

Evaluating Sensory Augmentation as A Non-Pharmaceutical Tool to Mitigate Motion Sickness and Enhance Sensorimotor Task Performance: A Pilot Study Using Simulated Capsule Wave Motion

Wave motion during capsule recovery operations can result in motion sickness and performance decrements exacerbating reentry sickness following long duration spaceflight. The purpose of this pilot study was (1) to validate a capsule wave motion simulation as a platform to evaluate motion sickness countermeasures and (2) to evaluate a sensory augmentation belt providing vibrotactile feedback of gravitational upright. Ten healthy subjects ages 38.0 ± 10.1 (6M|4F) were exposed to complex wave motions on a six degree-of-freedom platform that included pitch, roll, and heave at provocative stimulus frequencies (0.1-0.25 Hz) while seated in an illuminated cabin deprived of external visual cues. Subjects reported acute symptoms for up to three consecutive 15 min trials or until they reached a motion sickness endpoint of 8 pts on the Pensacola Diagnostic Index (PDI). Five subjects were randomly assigned to the Sensory Augmentation (SA) group while the other five served as controls (CN group). Based on a Motion Sickness Susceptibility Questionnaire, the two groups had similar motion sickness histories (susceptibility percentile ranking of CN group = 27.5 ± 63.6 in the CN group versus 27.5 ± 37.0 in the SA group, median ± IQR). The vibrotactile feedback consisted of a single array of 8 electromechanical tactors positioned around the torso on an adjustable belt (Engineering Acoustics, Inc) that utilized an integrated inertial measurement unit (IMU) to indicate the direction of upright (e.g., subject’s back tactor on during forward tilt). During each wave motion trial subjects performed a battery of four different tasks: tracking Earth vertical using a joystick with and without a secondary task (Paced Auditory Serial Addition Test), an eye-hand target acquisition task on a cabin-fixed tablet, and the psychomotor vigilance test (PVT). All ten subjects reported varying levels of motion sickness with 6 of 10 reaching a symptom endpoint. Interestingly, subjects anecdotally reported that engagement in the joystick tracking task was less provocative than tasks involving the cabin-fixed tablet or periods of no activity. Sensory augmentation appeared to delay symptom onset, with 2 of 5 subjects reaching an endpoint within the first 15 min trial in the CN group versus none in the SA group (PDI after 15 min = 6.0 ± 2.5 in the CN group versus 3.4 ± 2.5 in the SA group, mean ±std). Sensory augmentation also improved performance on the joystick tracking task at lower stimulus frequencies (0.1 Hz in roll and 0.2 Hz in pitch). Both CN and SA groups maintained a consistent level of performance on the eye-hand target acquisition and PVT throughout the baseline (no motion) and wave motion periods. Our results validated that the simulated capsule wave motion paradigm provides an effective motion sickness stressor. This paradigm is currently being used to investigate the efficacy of intranasal scopolamine to mitigate motion sickness. Sensory augmentation using vibrotactile feedback appears to improve spatial awareness and delay symptom onset during complex passive motion. One advantage of this portable belt design is that it incorporates all tactor drive and IMU circuitry and therefore could continue to be worn by crewmembers and serve as a balance aid during egress and ambulation with recovery operations.

A M Bollinger↗