SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Cardiovascular deconditioning caused by microcirculatory changes which reduce proprioceptor sensory input of unanesthetized rat
Two-armed telerobot undergoing development manipulates objects with dexterity approaching that of human. Designed to be remotely operated by human. Operator wears harness with exoskeletonlike sleeves and gloves; remote manipulator follows operator's arm, hand, and finger movements and feeds back position and force information so operator has sense of manipulating object held by telerobot. Developed for use in outer space. Suited for such terrestrial uses as handling materials and maintaining equipment in hazardous environments where mechanical dexterity and nearly instantaneous feedback of sensory information needed.
System components are presented that are being implemented to augment teleoperated systems by providing both force and tactile information to the human operator. The concept proposed is the control of a manipulator to perform tasks; i.e., flight line maintenance and repair of combat aircraft or satellites while under the control of a human operator at a remote location to maintain mission effectiveness in a hostile environment. The human would control the motion of the manipulator via a master system with information from the remote site being fed back by direct stimulation of the humans sensory mechanisms or by graphic interpretation of displays. We are interested in providing the operator feedback of position, force, auditory, vision, and tactile information to aide in the human's cognitive ability to control the manipulator. This sensory information from the remote site would then be presented to the operator in such a manner as to enhance his performance while providing him a sense of being present at the remote location, this is known as telepresence. Also discussed is the research done by the Human Sensory Feedback (HSF) facility at the Armstrong Laboratory to provide tactile and proprioceptive feedback to the operator. The system components of this system includes tactile sensor and stimulators, dexterous robotic hands, and the control of positioning and operating industrial robots with exoskeletal mechanisms.
Virtual reality (VR) can provide access to restorative environments and sensory stimulation for individuals in isolated, confined, and extreme environments. We developed a nature-based VR intervention featuring three scenes (Garden, Forest, Beach) and examined the effects of multisensory augmentation with location-based olfactory, wind, and thermal stimuli (VR+OWT). Over a two-week period, fifty-one participants were assigned to a no-intervention control, standard audiovisual VR, or augmented VR (VR+OWT) condition. Data collection included weekly assessments of affect, stress, and cognitive performance; post-VR measures of affect, presence, and perceived restorativeness; and open-ended feedback. Both VR and VR+OWT groups produced immediate and sustained reductions in negative affect with no sustained systematic benefits on cognitive performance. The addition of olfactory, wind, and thermal stimuli enhanced presence for some scenes; however, feedback indicated that sensory mismatches and stimulus intensity occasionally detracted from the experience and may have contributed to lower coherence ratings in the VR+OWT group. In contrast, the perceived restorativeness of the VR environment was driven primarily by scene content (Garden vs Forest vs Beach) rather than the level of sensory stimulation. These findings support the potential of virtual nature to promote well-being and underscore the importance of coherence across sensory modalities for multisensory augmentation.
The National Aeronautics and Space Administration (NASA) is pioneering various Unmanned Aircraft System (UAS) technologies and procedures which may enable routine access to the National Airspace System (NAS), with an aim for Next Gen NAS. These tools will aid in the development of technologies and integrated capabilities that will enable high value missions for science, security, and defense, and open the door to low-cost, extreme-duration, stratospheric flight. A century of aviation evolution has resulted in accepted standards and best practices in the design of human-machine interfaces, the displays and controls of which serve to optimize safe and efficient flight operations and situational awareness. The current proliferation of non-standard, aircraft-specific flight crew interfaces in UAS, coupled with the inherent limitations of operating UAS without in-situ sensory input and feedback (aural, visual, and vestibular cues), has increased the risk of mishaps associated with the design of the "cockpit." The examples of current non- or sub- standard design features range from "annoying" and "inefficient", to those that are difficult to manipulate or interpret in a timely manner, as well as to those that are "burdensome" and "unsafe." A concerted effort is required to establish best practices and standards for the human-machine interfaces, for the pilot as well as the air traffic controller. In addition, roles, responsibilities, knowledge, and skill sets are subject to redefining the terms, "pilot" and "air traffic controller", with respect to operating UAS, especially in the Next-Gen NAS. The knowledge, skill sets, training, and qualification standards for UAS operations must be established, and reflect the aircraft-specific human-machine interfaces and control methods. NASA s recent experiences flying its MQ-9 Ikhana in the NAS for extended duration, has enabled both NASA and the FAA to realize the full potential for UAS, as well as understand the implications of current limitations. Ikhana is a Predator-B/Reaper UAS, built by General Atomics, Aeronautical Systems, Inc., and modified for research. Since 2007, the aircraft has been flown seasonally with a wing-mounted pod containing an infrared scanner, utilized to provide real-time wildfire geo-location data to various fire-fighting agencies in the western U.S. The multi-agency effort included an extensive process to obtain flight clearance from the FAA to operate under special provisions, given that UAS in general do not fully comply with current airspace regulations (e.g. sense-and-avoid requirements).
This joint ESA-NASA study will address adaptive changes in spatial orientation related to the subjective straight ahead, and the use of a vibrotactile sensory aid to reduce perceptual errors. The study will be conducted before and after long-duration expeditions to the International Space Station (ISS) to examine how spatial processing of target location is altered following exposure to microgravity. This project specifically addresses the sensorimotor research gap "What are the changes in sensorimotor function over the course of a mission?" Six ISS crewmembers will be requested to participate in three preflight sessions (between 120 and 60 days prior to launch) and then three postflight sessions on R+0/1 day, R+4 +/-2 days, and R+8 +/-2 days. The three specific aims include: (a) fixation of actual and imagined target locations at different distances; (b) directed eye and arm movements along different spatial reference frames; and (c) the vestibulo-ocular reflex during translation motion with fixation targets at different distances. These measures will be compared between upright and tilted conditions. Measures will then be compared with and without a vibrotactile sensory aid that indicates how far one has tilted relative to the straight-ahead direction. The flight study was been approved by the medical review boards and will be implemented in the upcoming Informed Crew Briefings to solicit flight subject participation. Preliminary data has been recorded on 6 subjects during parabolic flight to examine the spatial coding of eye movements during roll tilt relative to perceived orientations while free-floating during the microgravity phase of parabolic flight or during head tilt in normal gravity. Binocular videographic recordings obtained in darkness allowed us to quantify the mean deviations in gaze trajectories along both horizontal and vertical coordinates relative to the aircraft and head orientations. During some parabolas, a vibrotactile sensory aid provided feedback of body orientation relative to the plane coordinates. RESULTS Both variability and curvature of gaze trajectories increased during roll tilt compared to the upright position. The saccades were less accurate during parabolic flight compared to measurements obtained in normal gravity. Although subjects were instructed to look off in the distance while performing the eye movements, fixation distance varied with vertical gaze direction independent of whether the saccades were made along perceived aircraft or head orientations. The increased errors in gaze trajectories along both perceived orientations during microgravity can be attributed to the otolith's role in spatial coding of eye movements. A change in an individual's egocentric reference might have negative consequences on evaluating the direction of an approaching object or on the accuracy of reaching movements or locomotion. Consequently, investigating how microgravity affects the target location will have theoretical, operational and even clinical implications for future space exploration missions. The use of vibrotactile feedback as a sensorimotor countermeasure is applicable to balance therapy applications for vestibular loss patients and the elderly to mitigate risks due to loss of orientation.
This presentation demonstrates how NASA is using consumer VR headsets, game engine technology and NVIDIA's GPUs to create highly immersive future training systems augmented with extremely realistic haptic feedback, sound, additional sensory information, and how these can be used to improve the engineering workflow. Include in this presentation is an environment simulation of the ISS, where users can interact with virtual objects, handrails, and tracked physical objects while inside VR, integration of consumer VR headsets with the Active Response Gravity Offload System, and a space habitat architectural evaluation tool. Attendees will learn how the best elements of real and virtual worlds can be combined into a hybrid reality environment with tangible engineering and scientific applications.
Sensory substitution systems provide their users with environmental information through a human sensory channel (eye, ear, or skin) different from that normally used or with the information processed in some useful way. The authors review the methods used to present visual, auditory, and modified tactile information to the skin and discuss present and potential future applications of sensory substitution, including tactile vision substitution (TVS), tactile auditory substitution, and remote tactile sensing or feedback (teletouch). The relevant sensory physiology of the skin, including the mechanisms of normal touch and the mechanisms and sensations associated with electrical stimulation of the skin using surface electrodes (electrotactile, or electrocutaneous, stimulation), is reviewed. The information-processing ability of the tactile sense and its relevance to sensory substitution is briefly summarized. The limitations of current tactile display technologies are discussed.
Vertex potentials elicited by visual feedback signals following an auditory intensity discrimination have been studied with eight subjects. Feedback signals which confirmed the prior sensory decision elicited small P3s, while disconfirming feedback elicited P3s that were larger. On the average, the latency of P3 was also found to increase with increasing disparity between the judgment and the feedback information. These effects were part of an overall dichotomy in wave shape following confirming vs disconfirming feedback. These findings are incorporated in a general model of the role of P3 in perceptual decision making.
Conference report contains compilation of papers relating to interactions between humans and machines from perspectives of telepresence and sensorimotor adaptation, measurement and evaluation of performance, and design principles and predictive models. Topics discussed include neural networks, sensory technology, display, and feedback controls. Covers state of art of remote sensing and control by humans for space or other operations.
Head direction cells (HDC) located in several regions of the brain, including the anterior dorsal nucleus of the thalamus (ADN), postsubiculum (PoS), and lateral mammillary nuclei (LMN), provide the neural substrate for the determination of head direction. Although activity of HDC is influenced by various sensory signals and internally generated cues, lesion studies and some anatomical and physiological evidence suggest that vestibular inputs are critical for the maintenance of directional sensitivity of these cells. However, vestibular inputs must be transformed considerably in order to signal head direction, and the neuronal circuitry that accomplishes this signal processing has not been fully established. Furthermore, it is unclear why the removal of vestibular inputs abolishes the directional sensitivity of HDC, as visual and other sensory inputs and motor feedback signals strongly affect the firing of these neurons and would be expected to maintain their directional-related activity. Further physiological studies will be required to establish the role of vestibular system in producing HDC responses, and anatomical studies are needed to determine the neural circuitry that mediates vestibular influences on determination of head direction.
Motion sickness represents one of the greatest clinical challenges impacting crew activities during and following g-transitions. Our overall goal is to characterize the effectiveness of motion sickness countermeasures during controlled laboratory experiments using capsule wave motion simulation and during field testing in operational environments. This laboratory study focused on prevention of motion sickness using intranasal scopolamine using a double-blinded repeated measures design in 30 subjects (19M, 11F). Intranasal scopolamine was provided by Defender Pharmaceuticals, Inc. (DPI-386 Nasal Gel, referred to as Inscop) self-administered by a nasal pump (Aptar Pharma) that delivers 0.4 mg dose (0.2 mg / nostril). During each session, subjects were exposed to complex wave motion on a six degree-of-freedom platform that included pitch, roll and heave at provocative stimulus frequencies (0.1-0.25 Hz) while seated in an illuminated cabin deprived of external visual cues. Motion sickness symptoms were compared across treatment and placebo control sessions counterbalanced across subjects and separated by at least one week. The time-to-motion sickness endpoint was based on severe malaise, defined as symptom score of ≥8 points using the Pensacola Diagnostic Index [1]. The bioavailability of scopolamine for each session was estimated from plasma concentrations obtained every 15 min[2]. Side effects during the treatment session were minimal, and performance was not impaired on a test battery including motion perception tracking, tablet-based eye-hand coordination and psychomotor vigilance testing. The plasma concentration remained near-peak levels throughout the 45 min motion sickness testing for most subjects. The percentile ranking on the Motion Sickness Susceptibility Questionnaire [MSSQ, 3]was moderately correlated with the motion sickness time-to-endpoint during the placebo control session (rho = –0.3, p=0.056). Seventeen subjects did not reach an endpoint during their placebo session and were eliminated from subsequent analysis. Another subject was excluded due to insufficient plasma concentration during the treatment session. For the remaining 12 subjects, the change in time-to-motion sickness endpoint between placebo and treatment sessions was moderately correlated with plasma concentration (rho =0.48, p = 0.056), improving on average 4.4 ± 18.4 min, mean ± std with Inscop versus placebo. Our results are consistent with previous findings that intranasal delivery of scopolamine can be effective at reducing motion sickness symptoms with minimal cognitive or sedative side effects. Future work is needed to optimize the delivery of Inscop for rescue (treatment) of symptoms following g-transitions as one of the key advantages of this formulation is self-administration in a suited environment. We will also explore how the combination of Inscop with non-pharmaceutical sensory aids, e.g., vibrotactile feedback of Earth vertical, may further mitigate motion sickness and improve task performance.
Wave motion during capsule recovery operations can result in motion sickness and performance decrements exacerbating reentry sickness following long duration spaceflight. The purpose of this pilot study was (1) to validate a capsule wave motion simulation as a platform to evaluate motion sickness countermeasures and (2) to evaluate a sensory augmentation belt providing vibrotactile feedback of gravitational upright. Ten healthy subjects ages 38.0 ± 10.1 (6M|4F) were exposed to complex wave motions on a six degree-of-freedom platform that included pitch, roll, and heave at provocative stimulus frequencies (0.1-0.25 Hz) while seated in an illuminated cabin deprived of external visual cues. Subjects reported acute symptoms for up to three consecutive 15 min trials or until they reached a motion sickness endpoint of 8 pts on the Pensacola Diagnostic Index (PDI). Five subjects were randomly assigned to the Sensory Augmentation (SA) group while the other five served as controls (CN group). Based on a Motion Sickness Susceptibility Questionnaire, the two groups had similar motion sickness histories (susceptibility percentile ranking of CN group = 27.5 ± 63.6 in the CN group versus 27.5 ± 37.0 in the SA group, median ± IQR). The vibrotactile feedback consisted of a single array of 8 electromechanical tactors positioned around the torso on an adjustable belt (Engineering Acoustics, Inc) that utilized an integrated inertial measurement unit (IMU) to indicate the direction of upright (e.g., subject’s back tactor on during forward tilt). During each wave motion trial subjects performed a battery of four different tasks: tracking Earth vertical using a joystick with and without a secondary task (Paced Auditory Serial Addition Test), an eye-hand target acquisition task on a cabin-fixed tablet, and the psychomotor vigilance test (PVT). All ten subjects reported varying levels of motion sickness with 6 of 10 reaching a symptom endpoint. Interestingly, subjects anecdotally reported that engagement in the joystick tracking task was less provocative than tasks involving the cabin-fixed tablet or periods of no activity. Sensory augmentation appeared to delay symptom onset, with 2 of 5 subjects reaching an endpoint within the first 15 min trial in the CN group versus none in the SA group (PDI after 15 min = 6.0 ± 2.5 in the CN group versus 3.4 ± 2.5 in the SA group, mean ±std). Sensory augmentation also improved performance on the joystick tracking task at lower stimulus frequencies (0.1 Hz in roll and 0.2 Hz in pitch). Both CN and SA groups maintained a consistent level of performance on the eye-hand target acquisition and PVT throughout the baseline (no motion) and wave motion periods. Our results validated that the simulated capsule wave motion paradigm provides an effective motion sickness stressor. This paradigm is currently being used to investigate the efficacy of intranasal scopolamine to mitigate motion sickness. Sensory augmentation using vibrotactile feedback appears to improve spatial awareness and delay symptom onset during complex passive motion. One advantage of this portable belt design is that it incorporates all tactor drive and IMU circuitry and therefore could continue to be worn by crewmembers and serve as a balance aid during egress and ambulation with recovery operations.
Postural instability (relative to pre-flight) has been observed in all shuttle astronauts studied upon return from orbital missions. Postural stability was more closely examined in four shuttle astronaut subjects before and after an 8 day orbital mission. Results of the pre- and post-flight postural stability studies were compared with a larger (n = 34) study of astronauts returning from shuttle missions of similar duration. Results from both studies indicated that inadequate vestibular feedback was the most significant sensory deficit contributing to the postural instability observed post flight. For two of the four IML-1 astronauts, post-flight postural instability and rate of recovery toward their earth-normal performance matched the performance of the larger sample. However, post-flight postural control in one returning astronaut was substantially below mean performance. This individual, who was within normal limits with respect to postural control before the mission, indicated that recovery to pre-flight postural stability was also interrupted by a post-flight pitch plane rotation test. A similar, though less extreme departure from the mean recovery trajectory was present in another astronaut following the same post-flight rotation test. The pitch plane rotation stimuli included otolith stimuli in the form of both transient tangential and constant centripetal linear acceleration components. We inferred from these findings that adaptation on orbit and re-adaptation on earth involved a change in sensorimotor integration of vestibular signals most likely from the otolith organs.
Integration of multi-sensory inputs to detect tilts relative to gravity is critical for sensorimotor control of upright orientation. Displaying body orientation using electrotactile feedback to the tongue has been developed by Bach-y-Rita and colleagues as a sensory aid to maintain upright stance with impaired vestibular feedback. MacDougall et al. (2006) recently demonstrated that unpredictably varying Galvanic vestibular stimulation (GVS) significantly increased anterior-posterior (AP) sway during rotational sway referencing with eyes closed. The purpose of this study was to assess the influence of electrotactile feedback on postural control performance with pseudorandom binaural bipolar GVS. Postural equilibrium was measured with a computerized hydraulic platform in 10 healthy adults (6M, 4F, 24-65 y). Tactile feedback (TF) of pitch and roll body orientation was derived from a two-axis linear accelerometer mounted on a torso belt and displayed on a 144-point electrotactile array held against the anterior dorsal tongue (BrainPort, Wicab, Inc., Middleton, WI). Subjects were trained to use TF by voluntarily swaying to draw figures on their tongue, both with and without GVS. Subjects were required to keep the intraoral display in their mouths on all trials, including those that did not provide TF. Subjects performed 24 randomized trials (20 s duration with eyes closed) including four support surface conditions (fixed, rotational sway-referenced, translating the support surface proportional to AP sway, and combined rotational-translational sway-referencing), each repeated twice with and without GVS, and with combined GVS and TF. Postural performance was assessed using deviations from upright (peak-to-peak and RMS sway) and convergence toward stability limits (time and distance to base of support boundaries). Postural stability was impaired with GVS in all platform conditions, with larger decrements in performance during trials with rotation sway-referencing. Electrotactile feedback improved performance with GVS toward non-GVS levels, again with the greatest improvement during trials with rotation sway-referencing. These results demonstrate the effectiveness of tongue electrotactile feedback in providing sensory substitution to maintain postural stability with distorted vestibular input.
Virtual environments offer unique training opportunities, particularly for training astronauts and preadapting them to the novel sensory conditions of microgravity. Two unresolved human factors issues in virtual reality (VR) systems are: 1) potential "cybersickness", and 2) maladaptive sensorimotor performance following exposure to VR systems. Interestingly, these aftereffects are often quite similar to adaptive sensorimotor responses observed in astronauts during and/or following space flight. Initial interpretation of novel sensory information may be inappropriate and result in perceptual errors. Active exploratory behavior in a new environment, with resulting feedback and the formation of new associations between sensory inputs and response outputs, promotes appropriate perception and motor control in the new environment. Thus, people adapt to consistent, sustained alterations of sensory input such as those produced by microgravity, unilateral labyrinthectomy and experimentally produced stimulus rearrangements. The purpose of this research was to compare disturbances in sensorimotor coordination produced by dome and head-mounted virtual environment displays and to examine the effects of exposure duration, and repeated exposures to VR systems. The first study examined disturbances in balance control, and the second study examined disturbances in eye-head-hand (EHH) and eye-head coordination.
Virtual environments offer unique training opportunities, particularly for training astronauts and preadapting them to the novel sensory conditions of microgravity. Two unresolved human factors issues in virtual reality (VR) systems are: 1) potential "cybersickness", and 2) maladaptive sensorimotor performance following exposure to VR systems. Interestingly, these aftereffects are often quite similar to adaptive sensorimotor responses observed in astronauts during and/or following space flight. Changes in the environmental sensory stimulus conditions and the way we interact with the new stimuli may result in motion sickness, and perceptual, spatial orientation and sensorimotor disturbances. Initial interpretation of novel sensory information may be inappropriate and result in perceptual errors. Active exploratory behavior in a new environment, with resulting feedback and the formation of new associations between sensory inputs and response outputs, promotes appropriate perception and motor control in the new environment. Thus, people adapt to consistent, sustained alterations of sensory input such as those produced by microgravity, unilateral labyrinthectomy and experimentally produced stimulus rearrangements. Adaptation is revealed by aftereffects including perceptual disturbances and sensorimotor control disturbances. The purpose of the current study was to compare disturbances in postural control produced by dome and head-mounted virtual environment displays, and to examine the effects of exposure duration, and repeated exposures to VR systems. Forty-one subjects (21 men, 20 women) participated in the study with an age range of 21-49 years old. One training session was completed in order to achieve stable performance on the posture and VR tasks before participating in the experimental sessions. Three experimental sessions were performed each separated by one day. The subjects performed a navigation and pick and place task in either a dome or head-mounted display (HMD) VR system for either 30 or 60 min. The environment was a square room with 15 pedestals on two opposite walls. The objects appeared on one set of pedestals and the subject s objective was to move the objects to the other set of pedestals. After the subject picked up an object, a pathway appeared and they were required to follow the pathway to the other side of the room. The subject was instructed to perform the task as quickly and accurately as possible, avoiding hitting walls and other any obstacles and placing the object on the center of the pedestal. Postural equilibrium was measured (using the Equitest CDP balance system, Neurocom, International) before, immediately after, and at 1 hr, 2 hr, 4 hr and 6 hr following exposure to VR. Postural equilibrium was measured during quiet stance with eyes open, eyes closed and vision and/or ankle proprioceptive inputs selectively altered by servo-controlling the visual surround and/or support surface to the subject s center of mass sway. Posture data was normalized using a log transformation and motion sickness data were normalized using the square root. In general, we found that exposure to VR resulted in decrements in postural stability. The largest decrements were observed in the tests performed immediately following exposure to VR and showed a fairly rapid recovery across the remaining test sessions. In addition, subjects generally showed improvement across days. We found significant main effects for day and time for the composite equilibrium score and for sensory organization tests (SOT) 1, 2 and 6. Significant main effects were observed for day for SOT 3 and 5. Although we found no significant main effects for gender (when center of gravity was used as a covariate), we did observe significant gender X time interaction effects for composite equilibrium and for SOT 1, 3, 4 and 5. Women appeared to show larger decrements in postural stability immediately after exposure to VR than men, but recover more quickly than n. Finally, we found no significant main effects for type of VR device or for exposure duration, however, these factors did interact with other factors during some of the SOTs. Subjects exhibited rapid recovery of motion sickness symptoms across time following exposure to VR and significantly less severe symptoms across days. We did not observe main effects for gender, type of device or duration of exposure. Individuals recovered from the detrimental effects of exposure to virtual reality on postural control and motion sickness within one hour. Sickness severity and initial decrements in postural equilibrium decreases over days, which suggests that subjects become dual-adapted over time. These findings provide some direction for developing training schedules for VR users that facilitate adaptation, and support the idea that preflight training of astronauts may serve as useful countermeasure for the sensorimotor effects of space flight.
Sensory supplementation can be incorporated as online feedback for improving spatial orientation awareness for manual control tasks (e.g. TSAS, Shuttle ZAG study). Preliminary data with vestibular patients and TBI military population is promising for rehabilitation training. Recommend that sensory supplementation be incorporated as a training component in an integrated countermeasure approach.