Search NASA⌕ Search

SEARCH · Search NASA

Results for “visual cueing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Role of orientation reference selection in motion sickness

The objectives of this proposal were developed to further explore and quantify the orientation reference selection abilities of subjects and the relation, if any, between motion sickness and orientation reference selection. The overall objectives of this proposal are to determine (1) if motion sickness susceptibility is related to sensory orientation reference selection abilities of subjects, (2) if abnormal vertical canal-otolith function is the source of these abnormal posture control strategies and if it can be quantified by vestibular and oculomotor reflex measurements, and (3) if quantifiable measures of perception of vestibular and visual motion cues can be related to motion sickness susceptibility and to orientation reference selection ability demonstrated by tests which systematically control the sensory imformation available for orientation.

Peterka, Robert J.↗

Role of orientation reference selection in motion sickness, supplement 2S

Previous experiments with moving platform posturography have shown that different people have varying abilities to resolve conflicts among vestibular, visual, and proprioceptive sensory signals. The conceptual basis of the present proposal hinges on the similarities between the space motion sickness problem and the sensory orientation reference selection problems associated with benign paroxysmal positional vertigo (BPPV) syndrome. These similarities include both etiology related to abnormal vertical canal-otolith function, and motion sickness initiating events provoked by pitch and roll head movements. The objectives are to explore and quantify the orientation reference selection abilities of subjects and the relation of this selection to motion sickness in humans. The overall objectives are to determine: if motion sickness susceptibility is related to sensory orientation reference selection abilities of subjects; if abnormal vertical canal-otolith function is the source of abnormal posture control strategies and if it can be quantified by vestibular and oculomotor reflex measurements, and if it can be quantified by vestibular and oculomotor reflex measurements; and quantifiable measures of perception of vestibular and visual motion cues can be related to motion sickness susceptibility and to orientation reference selection ability.

Peterka, Robert J.↗

Effect of Display Color on Pilot Performance and Describing Functions

A study has been conducted with the full-spectrum, calligraphic, computer-generated display system to determine the effect of chromatic content of the visual display upon pilot performance during the landing approach maneuver. This study utilizes a new digital chromatic display system, which has previously been shown to improve the perceived fidelity of out-the-window display scenes, and presents the results of an experiment designed to determine the effects of display color content by the measurement of both vertical approach performance and pilot-describing functions. This method was selected to more fully explore the effects of visual color cues used by the pilot. Two types of landing approaches were made: dynamic and frozen range, with either a landing approach scene or a perspective array display. The landing approach scene was presented with either red runway lights and blue taxiway lights or with the colors reversed, and the perspective array with red lights, blue lights, or red and blue lights combined. The vertical performance measures obtained in this experiment indicated that the pilots performed best with the blue and red/blue displays. and worst with the red displays. The describing-function system analysis showed more variation with the red displays. The crossover frequencies were lowest with the red displays and highest with the combined red/blue displays, which provided the best overall tracking, performance. Describing-function performance measures, vertical performance measures, and pilot opinion support the hypothesis that specific colors in displays can influence the pilots' control characteristics during the final approach.

Chase, Wendell D.↗

Effects of Symbol Brightness Cueing on Attention During a Visual Search of a Cockpit Display of Traffic Information

This study investigated visual search performance for target aircraft symbols on a Cockpit Display of Traffic Information (CDTI). Of primary interest was the influence of target brightness (intensity) and highlighting validity (search directions) on the ability to detect a target aircraft among distractor aircraft. Target aircraft were distinguished by an airspace course that conflicted with Ownship (that is, the participant's aircraft). The display could present all (homogeneous) bright aircraft, all (homogeneous) dim aircraft, or mixed bright and dim aircraft, with the target aircraft being either bright or dim. In the mixed intensity condition, participants may or may not have been instructed whether the target was bright or dim. Results indicated that highlighting validity facilitated better detection times. However, instead of bright targets being detected faster, dim targets were found to be detected more slowly in the mixed intensity display than in the homogeneous display. This relative slowness may be due to a delay in confirming the dim aircraft to be a target when it it was among brighter distractor aircraft. This hypothesis will be tested in future research. Funding for this work was provided by the Advanced Air Transportation Technologies Project of NASA's Airspace Operation Systems Program.

Johnson, Walter W.↗

Ambiguous Tilt and Translation Motion Cues in Astronauts after Space Flight

Adaptive changes during space flight in how the brain integrates vestibular cues with visual, proprioceptive, and somatosensory information can lead to impaired movement coordination, vertigo, spatial disorientation, and perceptual illusions following transitions between gravity levels. This joint ESA-NASA pre- and post-flight experiment is designed to examine both the physiological basis and operational implications for disorientation and tilt-translation disturbances in astronauts following short-duration space flights. The first specific aim is to examine the effects of stimulus frequency on adaptive changes in eye movements and motion perception during independent tilt and translation motion profiles. Roll motion is provided by a variable radius centrifuge. Pitch motion is provided by NASA's Tilt-Translation Sled in which the resultant gravitoinertial vector remains aligned with the body longitudinal axis during tilt motion (referred to as the Z-axis gravitoinertial or ZAG paradigm). We hypothesize that the adaptation of otolith-mediated responses to these stimuli will have specific frequency characteristics, being greatest in the mid-frequency range where there is a crossover of tilt and translation. The second specific aim is to employ a closed-loop nulling task in which subjects are tasked to use a joystick to null-out tilt motion disturbances on these two devices. The stimuli consist of random steps or sum-of-sinusoids stimuli, including the ZAG profiles on the Tilt-Translation Sled. We hypothesize that the ability to control tilt orientation will be compromised following space flight, with increased control errors corresponding to changes in self-motion perception. The third specific aim is to evaluate how sensory substitution aids can be used to improve manual control performance. During the closed-loop nulling task on both devices, small tactors placed around the torso vibrate according to the actual body tilt angle relative to gravity. We hypothesize that performance on the closed-loop tilt control task will be improved with this tactile display feedback of tilt orientation. The current plans include testing on eight crewmembers following Space Shuttle missions or short stay onboard the International Space Station. Measurements are obtained pre-flight at L-120 (plus or minus 30), L-90 (plus or minus 30), and L-30, (plus or minus 10) days and post-flight at R+0, R+1, R+2 or 3, R+4 or 5, and R+8 days. Pre-and post-flight testing (from R+1 on) is performed in the Neuroscience Laboratory at the NASA Johnson Space Center on both the Tilt-Translation Device and a variable radius centrifuge. A second variable radius centrifuge, provided by DLR for another joint ESA-NASA project, has been installed at the Baseline Data Collection Facility at Kennedy Space Center to collect data immediately after landing. ZAG was initiated with STS-122/1E and the first post-flight testing will take place after STS-123/1JA landing.

Clement, G.↗

Leveraging M and S in Soft Skills Training for the DoD

Soft skills, also called "people skills," are typically hard to observe, quantify and measure. These skills have to do with how we relate to each other; communicating, listening, engaging in dialogue, giving feedback, cooperating as a team member, solving problems and resolving conflicts. Most of the soft skills training is scenario based, utilizing written or video-based scenarios. with limited or no branching, as well as quantitative feedback. This paper will outline a game-based approach to configurable, scenario-based, soft skills training. The paper will discuss the application of realistic visual behavior cues (e.g. body language, vocal inflection, facial expressions) and how these can benefit the learner. Using the concept of a "virtual vignette" this paper will discuss a prototype system intended to leach suicide prevention and provide qualitative feedback to the learner. The paper will also explore other soft skills training applications for this technology

Cimino, James D.↗

Fused Reality for Enhanced Flight Test Capabilities

The feasibility of using Fused Reality-based simulation technology to enhance flight test capabilities has been investigated. In terms of relevancy to piloted evaluation, there remains no substitute for actual flight tests, even when considering the fidelity and effectiveness of modern ground-based simulators. In addition to real-world cueing (vestibular, visual, aural, environmental, etc.), flight tests provide subtle but key intangibles that cannot be duplicated in a ground-based simulator. There is, however, a cost to be paid for the benefits of flight in terms of budget, mission complexity, and safety, including the need for ground and control-room personnel, additional aircraft, etc. A Fused Reality(tm) (FR) Flight system was developed that allows a virtual environment to be integrated with the test aircraft so that tasks such as aerial refueling, formation flying, or approach and landing can be accomplished without additional aircraft resources or the risk of operating in close proximity to the ground or other aircraft. Furthermore, the dynamic motions of the simulated objects can be directly correlated with the responses of the test aircraft. The FR Flight system will allow real-time observation of, and manual interaction with, the cockpit environment that serves as a frame for the virtual out-the-window scene.

Bachelder, Ed↗

Re-Design and Beat Testing of the Man-Machine Integration Design and Analysis System: MIDAS

The Man-machine Design and Analysis System (MIDAS) is a human factors design and analysis system that combines human cognitive models with 3D CAD models and rapid prototyping and simulation techniques. MIDAS allows designers to ask 'what if' types of questions early in concept exploration and development prior to actual hardware development. The system outputs predictions of operator workload, situational awareness and system performance as well as graphical visualization of the cockpit designs interacting with models of the human in a mission scenario. Recently, MIDAS was re-designed to enhance functionality and usability. The goals driving the redesign include more efficient processing, GUI interface, advances in the memory structures, implementation of external vision models and audition. These changes were detailed in an earlier paper. Two Beta test sites with diverse applications have been chosen. One Beta test site is investigating the development of a new airframe and its interaction with the air traffic management system. The second Beta test effort will investigate 3D auditory cueing in conjunction with traditional visual cueing strategies including panel-mounted and heads-up displays. The progress and lessons learned on each of these projects will be discussed.

Shively, R. Jay↗

Using Dynamic Interface Modeling and Simulation to Develop a Launch and Recovery Flight Simulation for a UH-60A Blackhawk

Joint Shipboard Helicopter Integration Process (JSHIP) is a Joint Test and Evaluation (JT&E) program sponsored by the Office of the Secretary of Defense (OSD). Under the JSHDP program is a simulation effort referred to as the Dynamic Interface Modeling and Simulation System (DIMSS). The purpose of DIMSS is to develop and test the processes and mechanisms that facilitate ship-helicopter interface testing via man-in-the-loop ground-based flight simulators. Specifically, the DIMSS charter is to develop an accredited process for using a flight simulator to determine the wind-over-the-deck (WOD) launch and recovery flight envelope for the UH-60A ship/helicopter combination. DIMSS is a collaborative effort between the NASA Ames Research Center and OSD. OSD determines the T&E and warfighter training requirements, provides the programmatics and dynamic interface T&E experience, and conducts ship/aircraft interface tests for validating the simulation. NASA provides the research and development element, simulation facility, and simulation technical experience. This paper will highlight the benefits of the NASA/JSHIP collaboration and detail achievements of the project in terms of modeling and simulation. The Vertical Motion Simulator (VMS) at NASA Ames Research Center offers the capability to simulate a wide range of simulation cueing configurations, which include visual, aural, and body-force cueing devices. The system flexibility enables switching configurations io allow back-to-back evaluation and comparison of different levels of cueing fidelity in determining minimum training requirements. The investigation required development and integration of several major simulation system at the VMS. A new UH-60A BlackHawk interchangeable cab that provides an out-the-window (OTW) field-of-view (FOV) of 220 degrees in azimuth and 70 degrees in elevation was built. Modeling efforts involved integrating Computational Fluid Dynamics (CFD) generated data of an LHA ship airwake and integrating a real-time ship motion model developed based on a batch model from Naval Surface Warfare Center. Engineering development and integration of a three degrees-of-freedom (DOF) dynamic seat to simulate high frequency rotor-dynamics dependent motion cues for use in conjunction with the large motion system was accomplished. The development of an LHA visual model in several different levels of resolution and an aural cueing system in which three separate fidelity levels could be selected were developed. VMS also integrated a PC-based E&S simFUSION system to investigate cost effective IG alternatives. The DIMSS project consists of three phases that follow an approved Validation, Verification and accreditation (VV&A) process. The first phase will support the accreditation of the individual subsystems and models. The second will follow the verification and validation of the integrated subsystems and models, and will address fidelity requirements of the integrated models and subsystems. The third and final phase will allow the verification and validation of the full system integration. This VV&A process will address the utility of the simulated WOD launch and recovery envelope. Simulations supporting the first two stages have been completed and the data is currently being reviewed and analyzed.

Sweeney, Christopher↗

The effect of spurious angular accelerations on tracking in dynamic simulation

A laboratory study was conducted to investigate the effect of spurious simulator yaw motions on a pilot's control performance. A second objective was to compare the efficiency of static and dynamic simulator tracking in previously unexamined vehicle dynamics. Twelve airline pilots served as subjects in a moving-base flight simulator under congruent-motion, spurious-motion, and no-motion conditions. The results indicated a significant increase in the amount of error with increasing levels of spurious motion during the initially administered series of trials. The influence of spurious motion, however, was absent in a second series of trials. The data suggest that the pilots learned to compensate in their performance for the spurious inputs. It was also found that congruent visual and rotational cueing produced superior performance to that of tracking with visual information alone.

Beck, L. J.↗

Roll tracking effects of G-vector tilt and various types of motion washout

In a dogfight scenario, the task was to follow the target's roll angle while suppressing gust disturbances. All subjects adopted the same behavioral strategies in following the target while suppressing the gusts, and the MFP-fitted math model response was generally within one data symbol width. The results include the following: (1) comparisons of full roll motion (both with and without the spurious gravity tilt cue) with the static case. These motion cues help suppress disturbances with little net effect on the visual performance. Tilt cues were clearly used by the pilots but gave only small improvement in tracking errors. (2) The optimum washout (in terms of performance close to real world, similar behavioral parameters, significant motion attenuation (60 percent), and acceptable motion fidelity) was the combined attenuation and first-order washout. (3) Various trends in parameters across the motion conditions were apparent, and are discussed with respect to a comprehensive model for predicting adaptation to various roll motion cues.

Jex, H. R.↗

Simulator study of the effect of visual-motion time delays on pilot tracking performance with an audio side task

The effect of time delay was determined in the visual and motion cues in a flight simulator on pilot performance in tracking a target aircraft that was oscillating sinusoidally in altitude only. An audio side task was used to assure the subject was fully occupied at all times. The results indicate that, within the test grid employed, about the same acceptable time delay (250 msec) was obtained for a single aircraft (fighter type) by each of two subjects for both fixed-base and motion-base conditions. Acceptable time delay is defined as the largest amount of delay that can be inserted simultaneously into the visual and motion cues before performance degradation occurs. A statistical analysis of the data was made to establish this value of time delay. Audio side task provided quantitative data that documented the subject's work level.

Riley, D. R.↗

A model for the pilot's use of motion cues in roll-axis tracking tasks

Simulated target-following and disturbance-regulation tasks were explored with subjects using visual-only and combined visual and motion cues. The effects of motion cues on task performance and pilot response behavior were appreciably different for the two task configurations and were consistent with data reported in earlier studies for similar task configurations. The optimal-control model for pilot/vehicle systems provided a task-independent framework for accounting for the pilot's use of motion cues. Specifically, the availability of motion cues was modeled by augmenting the set of perceptual variables to include position, rate, acceleration, and accleration-rate of the motion simulator, and results were consistent with the hypothesis of attention-sharing between visual and motion variables. This straightforward informational model allowed accurate model predictions of the effects of motion cues on a variety of response measures for both the target-following and disturbance-regulation tasks.

Levison, W. H.↗

Runway Texture and Grid Pattern Effects on Rate-of-Descent Perception

To date, perceptual errors occur in determining descent rate from a computer-generated image in flight simulation. Pilots tend to touch down twice as hard in simulation than in flight, and more training time is needed in simulation before reaching steady-state performance. Barnes suggested that recognition of range may be the culprit, and he cited that problems such as collimated objects, binocular vision, and poor resolution lead to poor estimation of the velocity vector. Brown's study essentially ruled out that the lack of binocular vision is the problem. Dorfel added specificity to the problem by showing that pilots underestimated range in simulated scenes by 50% when 800 ft from the runway threshold. Palmer and Petitt showed that pilots are able to distinguish between a 1.7 ft/sec and 2.9 ft/sec sink rate when passively observing sink rates in a night scene. Platform motion also plays a role, as previous research has shown that the addition of substantial platform motion improves pilot estimates of vertical velocity and results in simulated touchdown rates more closely resembling flight. This experiment examined how some specific variations in the visual scene properties affect a pilot's perception of sink rate. It extended another experiment that focused on the visual and motion cues necessary for helicopter autorotations. In that experiment, pilots performed steep approaches to a runway. The visual content of the runway and its surroundings varied in two ways: texture and rectangular grid spacing. Four textures, included a no-texture case, were evaluated. Three grid spacings, including a no-grid case, were evaluated. The results showed that pilot better controlled their vertical descent rates when good texture cues were present. No significant differences were found for the grid manipulation. Using those visual scenes a simple psychophysics, experiment was performed. The purpose was to determine if the variations in the visual scenes allowed pilots to better perceive vertical velocity. To determine that answer, pilots passively viewed a particular visual scene in which the vehicle was descending at two different rates. Pilots had to select which of the two rates they thought was the fastest rate. The difference between the two rates changed using a staircase method, depending on whether or not the pilot was correct, until a minimum threshold between the two descent rates was reached. This process was repeated for all of the visual scenes to decide whether or not the visual scenes did allow pilots to perceive vertical velocity better among them. All of the data have yet to be analyzed; however, neither the effects of grid nor texture revealed any statistically significant trends. On further examination of the staircase method employed, a possibility exists that the lack of an evident trend may be due to the exit criterion used during the study. As such, the experiment will be repeated with an improved exit criterion in February. Results of this study will be presented in the submitted paper.

Schroeder, J. A.↗

Simulation for STS flight crew training

Training activities for flights of the Space Shuttle Orbiter are performed in the most complicated flight simulation facility yet assembled. The Shuttle Mission Simulator (SMS) provides training for the entire mission from prelaunch to postlanding. An extensive pilot-cues environment is provided in which visual, aural, and motion cues are presented. The planning and execution of training on the simulator must take into account the complexity of the Shuttle systems, the complexity of the procedures and crew interface on the Shuttle, and the complexity of the mission, itself. The major points of this training program are highlighted.

Hughes, F. E.↗

Vestibular plasticity following orbital spaceflight: recovery from postflight postural instability

Results of previous studies suggested that the vestibular mediated postural instability observed in astronauts upon return to earth from orbital spaceflight may be exacerbated by an increased weighting of visual inputs for spatial orientation and control of movement. This study was performed to better understand the roles of visual and somatosensory contributions to recovery of normal sensori-motor postural control in returning astronauts. Preflight and postflight, 23 astronaut volunteers were presented randomly with three trials of six sensory organization test (SOT) conditions in the EquiTest system test battery. Sagittal plane center-of-gravity (COG) excursions computed from ground reaction forces were significantly higher on landing day than preflight for those test conditions presenting sway-referenced visual and/or somatosensory orientation cues. The ratio of summed peak-to-peak COG sway amplitudes on the two sway-referenced vision tests (SOTs 3 + 6) compared to the two eyes closed tests (SOTs 2 + 5) was increased on landing day, indicating an increased reliance on visual orientation cues for postural control. The ratio of peak-to-peak COG excursions on sway-referenced surfaces (SOTs 4, 5 & 6) to an earth fixed support surfaces (SOTs 1, 2 & 3) increased even more after landing suggesting primary reliance on somatosensory orientation cues for recovery of postflight postural stability. Readaptation to sway-referenced support surfaces took longer than readaptation to sway-referenced vision. The increased reliance on visual and somatosensory inputs disappeared in all astronauts 4-8 days following return to earth.

NASA Program Space Physiology and Countermeasures↗

Design parameters for a stereoptic television system based on direct vision depth perception cues

Remotely controlled systems which use television for visual feedback require that depth cues be available to the operator. A number of techniques have been developed to provide stereoptic video. An analysis of parameters of such systems as related to the depth cues of convergence and retinal disparity was carried out. Parameter requirements were determined for the provision of natural and exaggerated stereoptic cues and expressions were developed for range resolution limits based on the retinal disparity threshold. An empirical study was conducted using a stereoptic video system to determine threshold values

Shields, N. L., Jr.↗

Operator vision aids for space teleoperation assembly and servicing

This paper investigates concepts for visual operator aids required for effective telerobotic control. Operator visual aids, as defined here, mean any operational enhancement that improves man-machine control through the visual system. These concepts were derived as part of a study of vision issues for space teleoperation. Extensive literature on teleoperation, robotics, and human factors was surveyed to definitively specify appropriate requirements. This paper presents these visual aids in three general categories of camera/lighting functions, display enhancements, and operator cues. In the area of camera/lighting functions concepts are discussed for: (1) automatic end effector or task tracking; (2) novel camera designs; (3) computer-generated virtual camera views; (4) computer assisted camera/lighting placement; and (5) voice control. In the technology area of display aids, concepts are presented for: (1) zone displays, such as imminent collision or indexing limits; (2) predictive displays for temporal and spatial location; (3) stimulus-response reconciliation displays; (4) graphical display of depth cues such as 2-D symbolic depth, virtual views, and perspective depth; and (5) view enhancements through image processing and symbolic representations. Finally, operator visual cues (e.g., targets) that help identify size, distance, shape, orientation and location are discussed.

Brooks, Thurston L.↗