Search NASA⌕ Search

SEARCH · Search NASA

Results for “visual cueing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

A Flight Training Simulator for Instructing the Helicopter Autorotation Maneuver (Enhanced Version)

Autorotation is a maneuver that permits a safe helicopter landing when the engine loses power. A catastrophe may occur if the pilot's control inputs are incorrect, insufficient, excessive, or poorly timed. Due to the danger involved, full-touchdown autorotations are very rarely practiced. Because in-flight autorotation training is risky, time-consuming, and expensive, the objective of the project was to develop the first helicopter flight simulator expressly designed to train students in this critical maneuver. A central feature of the project was the inclusion of an enhanced version of the Pilot-Rotorcraft Intelligent Symbology Management Simulator (PRISMS), a virtual-reality system developed by Anacapa Sciences and Thought Wave. A task analysis was performed to identify the procedural steps in the autorotation, to inventory the information needed to support student task performance, to identify typical errors, and to structure the simulator's practice environment. The system provides immediate knowledge of results, extensive practice of perceptual-motor skills, part-task training, and augmented cueing in a realistic cockpit environment. Additional work, described in this report, extended the capabilities of the simulator in three areas: 1. Incorporation of visual training aids to assist the student in learning the proper appearance of the visual scene when the maneuver is being properly performed; 2. Introduction of the requirement to land at a particular spot, as opposed to the wide, flat open field initially used, and development of appropriate metrics of success; and 3. Inclusion of wind speed and wind direction settings (and random variability settings) to add a more realistic challenge in "hitting the spot."

Rogers, Steven P.↗

Sleep deprivation influences some but not all processes of supervisory attention

Does one night of sleep deprivation alter processes of supervisory attention in general or only a specific subset of such processes? Twenty college-aged volunteers, half female, performed a choice reaction time task. A cue indicated that compatible (e.g., right button, right-pointing arrow) or incompatible (e.g., left button, right-pointing arrow) responses were to be given to a stimulus that followed 50 or 500 ms later. The paradigm assessed response inhibition, task-shifting skill, and task strategy-processes inherent in supervisory attention. Performance, along with heart rate, was assessed for 12 hr following normal sleep or a night of complete sleep deprivation. Sleep deprivation altered neither preparation for task shifting nor response inhibition. The ability to use preparatory bias to speed performance did decrease with sleep deprivation. Sleep deprivation appears to selectively affect this supervisory attention process, which is perceived as an active effort to cope with a challenging task.

NASA Discipline Regulatory Physiology↗

How to reinforce perception of depth in single two-dimensional pictures

The physical conditions of the display of single 2-D pictures, which produce images realistically, were studied by using the characteristics of the intake of the information for visual depth perception. Depth sensitivity, which is defined as the ratio of viewing distance to depth discrimination threshold, was introduced in order to evaluate the availability of various cues for depth perception: binocular parallax, motion parallax, accommodation, convergence, size, texture, brightness, and air-perspective contrast. The effects of binocular parallax in different conditions, the depth sensitivity of which is greatest at a distance of up to about 10 m, were studied with the new versatile stereoscopic display. From these results, four conditions to reinforce the perception of depth in single pictures were proposed, and these conditions are met by the old viewing devices and the new high-definition and wide television displays.

S. Nagata↗

Personal Experience with the PVHD and Opinion of Situations in Which a Wide Field of View (FOV) PVHD Might Be Helpful

Personal experience with the PVHD indicates that it should have great promise in easing cockpit workload, improving situational awareness, and reducing spatial disorientation. It should not be assumed that the PVHD will automatically cue the pilot to his attitude without some training or exposure. Some measure of attention needs to be devoted to attitude although this can easily be accomplished by the peripheral visual fields without tying up central vision. The PVHD would appear useful in any aircraft that flies in spatially disorienting/misorienting conditions, such as night, weather, or formation. It would appear to be particularly useful in aircraft, that by their design, are especially disorienting in such circumstances.

Mcnaughton, G. B.↗

Context-dependent adaptation of visually-guided arm movements and vestibular eye movements: role of the cerebellum

Accurate motor control requires adaptive processes that correct for gradual and rapid perturbations in the properties of the controlled object. The ability to quickly switch between different movement synergies using sensory cues, referred to as context-dependent adaptation, is a subject of considerable interest at present. The potential function of the cerebellum in context-dependent adaptation remains uncertain, but the data reviewed below suggest that it may play a fundamental role in this process.

NASA Discipline Neuroscience↗

The Role of Tactile Cueing in Multimodal Displays: Application in Complex Task Environments for Space Exploration

This paper reviews the potential role of tactile cueing in multimodal displays that will need to be developed to enable Extravehicular Activity (EVA) and telerobotic exploration for both Moon and Mars missions. Specific missions to be accomplished during EVA surface and space operations will include construction and assembly, surface and geologic exploration, and excavation for protective shelter from radiation and significant solar particle events. EVA crews have limited time, resources, mobility, visibility and dexterity, and activities take place in a perceptually impoverished environment. Limitations include a loss of spatial reference frame leading to spatial disorientation, a loss of information normally provided by the auditory and somato-sensory systems, and a restricted field of view. In addition, in non-surface operations crew must be able to navigate and operate in a fully six degree of freedom (DoF) environment. Fatigue resulting from suited EVA tasks will also critically affect performance and safety. In order to mitigate these factors, it is important that crews be well trained prior to executing actual missions. There is a critical need to design multimodal interfaces to optimize performance under these conditions for both training and actual operations. Because of the high level of complexity of the EVA environment on the one hand, and the “sensory restrictions” on the other, it makes sense to envisage enhancements to the astronauts’ visual environment. Such an enriched environment may include virtual auditory as well as tactile inputs.

multimodal displays↗

Temporal MTF of Motion Perception

Although human motion sensing mechanisms can be stimulated by rapid changes in the visual input the response of the motion mechanisms themselves is rather sluggish, i.e. they cannot track rapid changes in the speed or direction of a moving stimulus when there are no positional cues to the variation. We tested the ability of human observers to detect sinusoidal perturbations in the velocity of a moving stimulus at a variety of temporal frequencies and drift velocities; the results show a low-pass temporal characteristic, and performance is degraded at high velocities.

Mulligan, Jeffrey B.↗

Multimodal Pilot Behavior in Multi-Axis Tracking Tasks with Time-Varying Motion Cueing Gains

In a large number of motion-base simulators, adaptive motion filters are utilized to maximize the use of the available motion envelope of the motion system. However, not much is known about how the time-varying characteristics of such adaptive filters affect pilots when performing manual aircraft control. This paper presents the results of a study investigating the effects of time-varying motion filter gains on pilot control behavior and performance. An experiment was performed in a motion-base simulator where participants performed a simultaneous roll and pitch tracking task, while the roll and/or pitch motion filter gains changed over time. Results indicate that performance increases over time with increasing motion gains. This increase is a result of a time-varying adaptation of pilots' equalization dynamics, characterized by increased visual and motion response gains and decreased visual lead time constants. Opposite trends are found for decreasing motion filter gains. Even though the trends in both controlled axes are found to be largely the same, effects are less significant in roll. In addition, results indicate minor cross-coupling effects between pitch and roll, where a cueing variation in one axis affects the behavior adopted in the other axis.

motion simulators↗

Advanced Multimodal Solutions for Information Presentation

High-workload, fast-paced, and degraded sensory environments are the likeliest candidates to benefit from multimodal information presentation. For example, during EVA (Extra-Vehicular Activity) and telerobotic operations, the sensory restrictions associated with a space environment provide a major challenge to maintaining the situation awareness (SA) required for safe operations. Multimodal displays hold promise to enhance situation awareness and task performance by utilizing different sensory modalities and maximizing their effectiveness based on appropriate interaction between modalities. During EVA, the visual and auditory channels are likely to be the most utilized with tasks such as monitoring the visual environment, attending visual and auditory displays, and maintaining multichannel auditory communications. Previous studies have shown that compared to unimodal displays (spatial auditory or 2D visual), bimodal presentation of information can improve operator performance during simulated extravehicular activity on planetary surfaces for tasks as diverse as orientation, localization or docking, particularly when the visual environment is degraded or workload is increased. Tactile displays offer a third sensory channel that may both offload information processing effort and provide a means to capture attention when urgently required. For example, recent studies suggest that including tactile cues may result in increased orientation and alerting accuracy, improved task response time and decreased workload, as well as provide self-orientation cues in microgravity on the ISS (International Space Station). An important overall issue is that context-dependent factors like task complexity, sensory degradation, peripersonal vs. extrapersonal space operations, workload, experience level, and operator fatigue tend to vary greatly in complex real-world environments and it will be difficult to design a multimodal interface that performs well under all conditions. As a possible solution, adaptive systems have been proposed in which the information presented to the user changes as a function of taskcontext-dependent factors. However, this presupposes that adequate methods for detecting andor predicting such factors are developed. Further, research in adaptive systems for aviation suggests that they can sometimes serve to increase workload and reduce situational awareness. It will be critical to develop multimodal display guidelines that include consideration of smart systems that can select the best display method for a particular contextsituation.The scope of the current work is an analysis of potential multimodal display technologies for long duration missions and, in particular, will focus on their potential role in EVA activities. The review will address multimodal (combined visual, auditory andor tactile) displays investigated by NASA, industry, and DoD (Dept. of Defense). It also considers the need for adaptive information systems to accommodate a variety of operational contexts such as crew status (e.g., fatigue, workload level) and task environment (e.g., EVA, habitat, rover, spacecraft). Current approaches to guidelines and best practices for combining modalities for the most effective information displays are also reviewed. Potential issues in developing interface guidelines for the Exploration Information System (EIS) are briefly considered.

multimodal display↗

Virtual acoustics displays

The real time acoustic display capabilities are described which were developed for the Virtual Environment Workstation (VIEW) Project at NASA-Ames. The acoustic display is capable of generating localized acoustic cues in real time over headphones. An auditory symbology, a related collection of representational auditory 'objects' or 'icons', can be designed using ACE (Auditory Cue Editor), which links both discrete and continuously varying acoustic parameters with information or events in the display. During a given display scenario, the symbology can be dynamically coordinated in real time with 3-D visual objects, speech, and gestural displays. The types of displays feasible with the system range from simple warnings and alarms to the acoustic representation of multidimensional data or events.

Wenzel, Elizabeth M.↗

The effect of visual-motion time-delays on pilot performance in a simulated pursuit tracking task

An experimental study was made to determine the effect on pilot performance of time delays in the visual and motion feedback loops of a simulated pursuit tracking task. Three major interrelated factors were identified: task difficulty either in the form of airplane handling qualities or target frequency, the amount and type of motion cues, and time delay itself. In general, the greater the task difficulty, the smaller the time delay that could exist without degrading pilot performance. Conversely, the greater the motion fidelity, the greater the time delay that could be tolerated. The effect of motion was, however, pilot dependent.

Miller, G. K., Jr.↗

Sensorimotor integration in human postural control

It is generally accepted that human bipedal upright stance is achieved by feedback mechanisms that generate an appropriate corrective torque based on body-sway motion detected primarily by visual, vestibular, and proprioceptive sensory systems. Because orientation information from the various senses is not always available (eyes closed) or accurate (compliant support surface), the postural control system must somehow adjust to maintain stance in a wide variety of environmental conditions. This is the sensorimotor integration problem that we investigated by evoking anterior-posterior (AP) body sway using pseudorandom rotation of the visual surround and/or support surface (amplitudes 0.5-8 degrees ) in both normal subjects and subjects with severe bilateral vestibular loss (VL). AP rotation of body center-of-mass (COM) was measured in response to six conditions offering different combinations of available sensory information. Stimulus-response data were analyzed using spectral analysis to compute transfer functions and coherence functions over a frequency range from 0.017 to 2.23 Hz. Stimulus-response data were quite linear for any given condition and amplitude. However, overall behavior in normal subjects was nonlinear because gain decreased and phase functions sometimes changed with increasing stimulus amplitude. "Sensory channel reweighting" could account for this nonlinear behavior with subjects showing increasing reliance on vestibular cues as stimulus amplitudes increased. VL subjects could not perform this reweighting, and their stimulus-response behavior remained quite linear. Transfer function curve fits based on a simple feedback control model provided estimates of postural stiffness, damping, and feedback time delay. There were only small changes in these parameters with increasing visual stimulus amplitude. However, stiffness increased as much as 60% with increasing support surface amplitude. To maintain postural stability and avoid resonant behavior, an increase in stiffness should be accompanied by a corresponding increase in damping. Increased damping was achieved primarily by decreasing the apparent time delay of feedback control rather than by changing the damping coefficient (i.e., corrective torque related to body-sway velocity). In normal subjects, stiffness and damping were highly correlated with body mass and moment of inertia, with stiffness always about 1/3 larger than necessary to resist the destabilizing torque due to gravity. The stiffness parameter in some VL subjects was larger compared with normal subjects, suggesting that they may use increased stiffness to help compensate for their loss. Overall results show that the simple act of standing quietly depends on a remarkably complex sensorimotor control system.

NASA Discipline Neuroscience↗

Context-Dependent Arm Pointing Adaptation

We sought to determine the effectiveness of head posture as a contextual cue to facilitate adaptive transitions in manual control during visuomotor distortions. Subjects performed arm pointing movements by drawing on a digitizing tablet, with targets and movement trajectories displayed in real time on a computer monitor. Adaptation was induced by presenting the trajectories in an altered gain format on the monitor. The subjects were shown visual displays of their movements that corresponded to either 0.5 or 1.5 scaling of the movements made. Subjects were assigned to three groups: the head orientation group tilted the head towards the right shoulder when drawing under a 0.5 gain of display and towards the left shoulder when drawing under a 1.5 gain of display, the target orientation group had the home & target positions rotated counterclockwise when drawing under the 0.5 gain and clockwise for the 1.5 gain, the arm posture group changed the elbow angle of the arm they were not drawing with from full flexion to full extension with 0.5 and 1.5 gain display changes. To determine if contextual cues were associated with display alternations, the gain changes were returned to the standard (1.0) display. Aftereffects were assessed to determine the efficacy of the head orientation contextual cue. . compared to the two control cues. The head orientation cue was effectively associated with the multiple gains. The target orientation cue also demonstrated some effectiveness while the.arm posture cue did not. The results demonstrate that contextual cues can be used to switch between multiple adaptive states. These data provide support for the idea that static head orientation information is a crucial component to the arm adaptation process. These data further define the functional linkage between head posture and arm pointing movements.

Seidler, R. D.↗

Context-dependent arm pointing adaptation

We sought to determine the effectiveness of head posture as a contextual cue to facilitate adaptive transitions in manual control during visuomotor distortions. Subjects performed arm pointing movements by drawing on a digitizing tablet, with targets and movement trajectories displayed in real time on a computer monitor. Adaptation was induced by presenting the trajectories in an altered gain format on the monitor. The subjects were shown visual displays of their movements that corresponded to either 0.5 or 1.5 scaling of the movements made. Subjects were assigned to three groups: the head orientation group tilted the head towards the right shoulder when drawing under a 0.5 gain of display and towards the left shoulder when drawing under a 1.5 gain of display; the target orientation group had the home and target positions rotated counterclockwise when drawing under the 0.5 gain and clockwise for the 1.5 gain; the arm posture group changed the elbow angle of the arm they were not drawing with from full flexion to full extension with 0.5 and 1.5 gain display changes. To determine if contextual cues were associated with display alternations, the gain changes were returned to the standard (1.0) display. Aftereffects were assessed to determine the efficacy of the head orientation contextual cue compared to the two control cues. The head orientation cue was effectively associated with the multiple gains. The target orientation cue also demonstrated some effectiveness while the arm posture cue did not. The results demonstrate that contextual cues can be used to switch between multiple adaptive states. These data provide support for the idea that static head orientation information is a crucial component to the arm adaptation process. These data further define the functional linkage between head posture and arm pointing movements.

Clinical Trial↗

Tactical Versus Strategic Behavior: General Aviation Piloting in Convective Weather Scenarios

We commonly describe environments and behavioral responses to environmental conditions as 'tactical' and 'strategic.' However theoretical research defining relevant environmental characteristics is rare, as are empirical investigations that would inform such theory. This paper discusses General Aviation (GA) pilots' descriptions of tactical/strategic conditions with respect to weather flying, and evaluates their ratings along a tactical/strategic scale in response to real convective weather scenarios experienced during a flight experiment with different weather information cues. Perceived risk was significantly associated with ratings for all experimental conditions. In addition, environmental characteristics were found to be predictive of ratings for Traditional IMC (instrument meteorological conditions), i.e., aural weather information only, and Traditional VMC (visual meteorological conditions), i.e., aural information and an external view. The paper also presents subjects' comments regarding use of Graphical Weather Information Systems (GWISs) to support tactical and strategic weather flying decisions and concludes with implications for the design and use of GWISs.

Latorella, Kara A.↗

Visual information for judging temporal range

Work in our laboratory suggests that pilots can extract temporal range information (i.e., the time to pass a given waypoint) directly from out-the-window motion information. This extraction does not require the use of velocity or distance, but rather operates solely on a 2-D motion cue. In this paper, we present the mathematical derivation of this information, psychophysical evidence of human observers' sensitivity, and possible advantages and limitations of basing vehicle control on this parameter.

Kaiser, Mary K.↗

Modification of Otolith-Ocular Reflexes, Motion Perception and Manual Control During Variable Radius Centrifugation Following Space Flight

Two joint ESA-NASA studies are examining changes in otolith-ocular reflexes and motion perception following short duration space flights, and the operational implications of post-flight tilt-translation ambiguity for manual control performance. Vibrotactile feedback of tilt orientation is also being evaluated as a countermeasure to improve performance during a closed-loop nulling task. Data is currently being collected on astronaut subjects during 3 preflight sessions and during the first 8 days after Shuttle landings. Variable radius centrifugation is utilized to elicit otolith reflexes in the lateral plane without concordant roll canal cues. Unilateral centrifugation (400 deg/s, 3.5 cm radius) stimulates one otolith positioned off-axis while the opposite side is centered over the axis of rotation. During this paradigm, roll-tilt perception is measured using a subjective visual vertical task and ocular counter-rolling is obtained using binocular video-oculography. During a second paradigm (216 deg/s, less than 20 cm radius), the effects of stimulus frequency (0.15 - 0.6 Hz) are examined on eye movements and motion perception. A closed-loop nulling task is also performed with and without vibrotactile display feedback of chair radial position. Data collection is currently ongoing. Results to date suggest there is a trend for perceived tilt and translation amplitudes to be increased at the low and medium frequencies on landing day compared to pre-flight. Manual control performance is improved with vibrotactile feedback. One result of this study will be to characterize the variability (gain, asymmetry) in both otolith-ocular responses and motion perception during variable radius centrifugation, and measure the time course of post-flight recovery. This study will also address how adaptive changes in otolith-mediated reflexes correspond to one's ability to perform closed-loop nulling tasks following G-transitions, and whether manual control performance can be improved with vibrotactile feedback of orientation.

Wood, Scott J.↗

ZAG-Otolith: Modification of Otolith-Ocular Reflexes, Motion Perception and Manual Control during Variable Radius Centrifugation Following Space Flight

Two joint ESA-NASA studies are examining changes in otolith-ocular reflexes and motion perception following short duration space flights, and the operational implications of post-flight tilt-translation ambiguity for manual control performance. Vibrotactile feedback of tilt orientation is also being evaluated as a countermeasure to improve performance during a closed-loop nulling task. METHODS. Data is currently being collected on astronaut subjects during 3 preflight sessions and during the first 8 days after Shuttle landings. Variable radius centrifugation is utilized to elicit otolith reflexes in the lateral plane without concordant roll canal cues. Unilateral centrifugation (400 deg/s, 3.5 cm radius) stimulates one otolith positioned off-axis while the opposite side is centered over the axis of rotation. During this paradigm, roll-tilt perception is measured using a subjective visual vertical task and ocular counter-rolling is obtained using binocular video-oculography. During a second paradigm (216 deg/s, <20 cm radius), the effects of stimulus frequency (0.15 - 0.6 Hz) are examined on eye movements and motion perception. A closed-loop nulling task is also performed with and without vibrotactile display feedback of chair radial position. PRELIMINARY RESULTS. Data collection is currently ongoing. Results to date suggest there is a trend for perceived tilt and translation amplitudes to be increased at the low and medium frequencies on landing day compared to pre-flight. Manual control performance is improved with vibrotactile feedback. DISCUSSION. One result of this study will be to characterize the variability (gain, asymmetry) in both otolithocular responses and motion perception during variable radius centrifugation, and measure the time course of postflight recovery. This study will also address how adaptive changes in otolith-mediated reflexes correspond to one's ability to perform closed-loop nulling tasks following G-transitions, and whether manual control performance can be improved with vibrotactile feedback of orientation.

Wood, S. J.↗