Search NASA⌕ Search

SEARCH · Search NASA

Results for “visual cueing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Does the vestibular system contribute to head direction cell activity in the rat?

Head direction cells (HDC) located in several regions of the brain, including the anterior dorsal nucleus of the thalamus (ADN), postsubiculum (PoS), and lateral mammillary nuclei (LMN), provide the neural substrate for the determination of head direction. Although activity of HDC is influenced by various sensory signals and internally generated cues, lesion studies and some anatomical and physiological evidence suggest that vestibular inputs are critical for the maintenance of directional sensitivity of these cells. However, vestibular inputs must be transformed considerably in order to signal head direction, and the neuronal circuitry that accomplishes this signal processing has not been fully established. Furthermore, it is unclear why the removal of vestibular inputs abolishes the directional sensitivity of HDC, as visual and other sensory inputs and motor feedback signals strongly affect the firing of these neurons and would be expected to maintain their directional-related activity. Further physiological studies will be required to establish the role of vestibular system in producing HDC responses, and anatomical studies are needed to determine the neural circuitry that mediates vestibular influences on determination of head direction.

Review, Tutorial↗

A visual motion simulator for general aviation compensated within the nonlinear adaptive washout for actuator lag

A description is presented of the general aviation aircraft simulator recently acquired by the Langley Research Center, summarizing the complement of instruments, radio/navigation equipment, control loading, and other features. Emphasis is placed mainly on the two-degree-of-freedom motion drives developed for this simulator and the presentation of the dynamic response of the motion system (without washout) in terms of amplitude ratio and phase lag as a function of frequency. The nonlinear adaptive washout based on continuous steepest descent optimization presents cues in pitch rate, surge, roll rate, and sway, and allows for actuator lag compensation.

Ashworth, B. R.↗

Somatosensory motion after-effect following earth-horizontal rotation about the Z-axis - A new illusion

During rotation about the Z-axis while recumbent one is exposed to a changing pattern of pressure cues over the body surface. If the body is only loosely padded in the experimental apparatus, then apparent motion of part of the body surface may be experienced sometime after rotation has been terminated. This somatosensory motion aftereffect of opposite sign is temporarily abolished if one looks at the affected body area, but is again re-experienced when the gaze is shifted elsewhere. The similarity of this motion aftereffect to those contingent on vestibular and visual stimulation is discussed.

Lackner, J. R.↗

A methodology for the assessment of manned flight simulator fidelity

A relatively simple analytical methodology for assessing the fidelity of manned flight simulators for specific vehicles and tasks is offered. The methodology is based upon an application of a structural model of the human pilot, including motion cue effects. In particular, predicted pilot/vehicle dynamic characteristics are obtained with and without simulator limitations. A procedure for selecting model parameters can be implemented, given a probable pilot control strategy. In analyzing a pair of piloting tasks for which flight and simulation data are available, the methodology correctly predicted the existence of simulator fidelity problems. The methodology permitted the analytical evaluation of a change in simulator characteristics and indicated that a major source of the fidelity problems was a visual time delay in the simulation.

Hess, Ronald A.↗

Spatial Cognitive Performance During Adaptation to Conflicting Tilt-Translation Stimuli as a Sensorimotor Spaceflight Analog

The need to resolve new patterns of sensory feedback in altered gravitoinertial environments requires cognitive processes to develop appropriate reference frames for spatial orientation awareness. The purpose of this study was to examine deficits in spatial cognitive performance during adaptation to conflicting tilt-translation stimuli. Fourteen subjects were tilted within a lighted enclosure that simultaneously translated at one of 3 frequencies. Tilt and translation motion was synchronized to maintain the resultant gravitoinertial force aligned with the longitudinal body axis, resulting in a mismatch analogous to spaceflight in which the canals and vision signal tilt while the otoliths do not. Changes in performance on different spatial cognitive tasks were compared 1) without motion, 2) with tilt motion alone (pitch at 0.15, 0.3 and 0.6 Hz or roll at 0.3 Hz), and 3) with conflicting tilt-translation motion. The adaptation paradigm was continued for up to 30 min or until the onset of nausea. The order of the adaptation conditions were counter-balanced across 4 different test sessions. There was a significant effect of stimulus frequency on both motion sickness and spatial cognitive performance. Only 3 of 14 were able to complete the full 30 min protocol at 0.15 Hz, while 7 of 14 completed 0.3 Hz and 13 of 14 completed 0.6 Hz. There were no changes in simple visual-spatial cognitive tests, e.g., mental rotation or match-to-sample. There were significant deficits during 0.15 Hz adaptation in both accuracy and reaction time during a spatial reference task in which subjects are asked to identify a match of a 3D reoriented cube assemblage. Our results are consistent with antidotal reports of cognitive impairment that are common during sensorimotor adaptation with G-transitions. We conclude that these cognitive deficits stem from the ambiguity of spatial reference frames for central processing of inertial motion cues.

Kayanickupuram, A. J.↗

The Human Challenges of Remotely Piloted Aircraft Systems

Remotely Piloted Aircraft (RPA) range from small electric quadcopters that are flown close to the ground within visual range of the operator, to larger systems capable of extended flight in airspace shared with conventional aircraft. Before RPA can operate routinely and safely in civilian airspace, we need to understand the unique human factors associated with these aircraft. RPA pilots participated in focus groups where they were asked to recall critical incidents that either presented a threat to safety, or highlighted a case where the pilot contributed to system resilience or mission success. Ninety incidents were gathered from focus-groups. Human factor issues included the impact of reduced sensory cues, traffic separation in the absence of an out-the-window view, control latencies, vigilance during monotonous and ultra-long endurance flights, control station design considerations, transfer of control between control stations, the management of lost link procedures, and decision-making during emergencies. Some of these concerns have received significant attention in the literature, or are analogous to human factors of manned aircraft. Although many of the reported incidents were related to pilot error, the participants also provided examples of the positive contribution that humans make to the operation of highly-automated systems.

Hobbs, Alan↗

Correction techniques for depth errors with stereo three-dimensional graphic displays

Three-dimensional (3-D), 'real-world' pictorial displays that incorporate 'true' depth cues via stereopsis techniques have proved effective for displaying complex information in a natural way to enhance situational awareness and to improve pilot/vehicle performance. In such displays, the display designer must map the depths in the real world to the depths available with the stereo display system. However, empirical data have shown that the human subject does not perceive the information at exactly the depth at which it is mathematically placed. Head movements can also seriously distort the depth information that is embedded in stereo 3-D displays because the transformations used in mapping the visual scene to the depth-viewing volume (DVV) depend intrinsically on the viewer location. The goal of this research was to provide two correction techniques; the first technique corrects the original visual scene to the DVV mapping based on human perception errors, and the second (which is based on head-positioning sensor input data) corrects for errors induced by head movements. Empirical data are presented to validate both correction techniques. A combination of the two correction techniques effectively eliminates the distortions of depth information embedded in stereo 3-D displays.

Parrish, Russell V.↗

Communications Dashboard (Control Rooms Take a Cue from Facebook), Chapter 1

Papers published via IEEE and AIAA conferences have presented an overview of how social media could benefit NASA working environments in general and proposed three specific social applications to benefit space flight control operations. One of them, Communications Dashboard, would help a real time flight controller keep up with both the "big picture" and significant details of operations via a cohesive interface similar to those of social networking services (SNS). Instead of recreational social features, "CommDash" would support functions like console logging, categorized and threaded text chat streams with enhanced accountability and graphics display features, high-level status displays driven by telemetry or other events, and an on-screen hailing function for requesting voice or text stream conversation. Moving certain voice conversations to text streams would reduce confusion and stress in two ways. Within text conversations, there would be far less repetition of content since text conversations have visual persistence and are reviewable instantly, e.g., there s no need to brief new participants to a discussion -- they just read what s already there. Remaining voice traffic would stand out more clearly, and quieter voice loops means fewer "say again" calls and less distraction from visual and mental tasks, thus less stress. (Most flight controllers monitor 4 or 5 voice loops at once.) Links could be created from console log entries to chat selections so that underlying details are readily available yet unobtrusive. This would reduce the confusion that rises from having multiple and sometimes divergent copies of the same information due to cut/copy and paste operations, attachments, and asynchronous editing. This concept could apply to a plethora of real time control environments and to other settings with lots of information juggling. This paper explores the dashboard concept in further detail and chronicles the first phase of a NASA IT Labs (Information Technology) project that could lead to a working system

Scott, David w.↗

Effect of short-term exposure to stereoscopic three-dimensional flight displays on real-world depth perception

High-fidelity color pictorial displays that incorporate depth cues in the display elements are currently available. Depth cuing applied to advanced head-down flight display concepts potentially enhances the pilot's situational awareness and improves task performance. Depth cues provided by stereopsis exhibit constraints that must be fully understood so depth cuing enhancements can be adequately realized and exploited. A fundamental issue (the goal of this investigation) is whether the use of head-down stereoscopic displays in flight applications degrade the real-world depth perception of pilots using such displays. Stereoacuity tests are used in this study as the measure of interest. Eight pilots flew repeated simulated landing approaches using both nonstereo and stereo 3-D head-down pathway-in-the-sky displays. At this decision height of each approach (where the pilot changes to an out-the-window view to obtain real-world visual references) the pilots changed to a stereoacuity test that used real objects. Statistical analysis of stereoacuity measures (data for a control condition of no exposure to any electronic flight display compared with data for changes from nonstereo and from stereo displays) reveals no significant differences for any of the conditions. Therefore, changing from short-term exposure to a head-down stereo display has no more effect on real-world relative depth perception than does changing from a nonstereo display. However, depth perception effects based on sized and distance judgements and on long-term exposure remain issues to be investigated.

Busquets, Anthony M.↗

Integration of the Shuttle RMS/CBM Positioning Virtual Environment Simulation

Constructing the International Space Station, or other structures, in space presents a number of problems. In particular, payload restrictions for the Space Shuttle and other launch mechanisms prohibit assembly of large space-based structures on Earth. Instead, a number of smaller modules must be boosted into orbit separately and then assembled to form the final structure. The assembly process is difficult, as docking interfaces such as Common Berthing Mechanisms (CBMS) must be precisely positioned relative to each other to be within the "capture envelope" (approximately +/- 1 inch and +/- 0.3 degrees from the nominal position) and attach properly. In the case of the Space Station, the docking mechanisms are to be positioned robotically by an astronaut using the 55-foot-long Remote Manipulator System (RMS) robot arm. Unfortunately, direct visual or video observation of the placement process is difficult or impossible in many scenarios. One method that has been tested for aligning the CBMs uses a boresighted camera mounted on one CBM to view a standard target on the opposing CBM. While this method might be sufficient to achieve proper positioning with considerable effort, it does not provide a high level of confidence that the mechanisms have been placed within capture range of each other. It also does nothing to address the risk of inadvertent contact between the CBMS, which could result in RMS control software errors. In general, constraining the operator to a single viewpoint with few, if any, depth cues makes the task much more difficult than it would be if the target could be viewed in three-dimensional space from various viewpoints. The actual work area could be viewed by an astronaut during EVA; however, it would be extremely impractical to have an astronaut control the RMS while spacewalking. On the other hand, a view of the RMS and CBMs to be positioned in a virtual environment aboard the Space Shuttle orbiter or Space Station could provide similar benefits more safely and conveniently with little additional cost. In order to render and view the RMS and CBMs in a virtual world, the position and orientation of the end effector in three-dimensional space must be known with a high degree of accuracy. A precision video alignment sensor has been developed which can determine the position and orientation of the controlled element relative to the target CBM within approximately one-sixteenth inch and 0.07 angular degrees. Such a sensor could replace or augment the boresighted camera mentioned above. The computer system used to render the virtual world and the position tracking systems which might be used to monitor the user's movements (in order to adjust the viewpoint in virtual space) are small enough to carry to orbit. Thus, such a system would be feasible for use in constructing structures in space.

Dumas, Joseph D.↗

Primate translational vestibuloocular reflexes. II. Version and vergence responses to fore-aft motion

To maintain binocular fixation on near targets during fore-aft translational disturbances, largely disjunctive eye movements are elicited the amplitude and direction of which should be tuned to the horizontal and vertical eccentricities of the target. The eye movements generated during this task have been investigated here as trained rhesus monkeys fixated isovergence targets at different horizontal and vertical eccentricities during 10 Hz fore-aft oscillations. The elicited eye movements complied with the geometric requirements for binocular fixation, although not ideally. First, the corresponding vergence angle for which the movement of each eye would be compensatory was consistently less than that dictated by the actual fixation parameters. Second, the eye position with zero sensitivity to translation was not straight ahead, as geometrically required, but rather exhibited a systematic dependence on viewing distance and vergence angle. Third, responses were asymmetric, with gains being larger for abducting and downward compared with adducting and upward gaze directions, respectively. As frequency was varied between 4 and 12 Hz, responses exhibited high-pass filter properties with significant differences between abduction and adduction responses. As a result of these differences, vergence sensitivity increased as a function of frequency with a steeper slope than that of version. Despite largely undercompensatory version responses, vergence sensitivity was closer to ideal. Moreover, the observed dependence of vergence sensitivity on vergence angle, which was varied between 2.5 and 10 MA, was largely linear rather than quadratic (as geometrically predicted). We conclude that the spatial tuning of eye velocity sensitivity as a function of gaze and viewing distance follows the general geometric dependencies required for the maintenance of foveal visual acuity. However, systematic deviations from ideal behavior exist that might reflect asymmetric processing of abduction/adduction responses perhaps because of different functional dependencies of version and vergence eye movement components during translation.

NASA Program Biomedical Research and Countermeasur↗

4DoF Drift Free Navigation Using Inertial Cues and Optical Flow

In this paper, we describe a novel approach in fusing optical flow with inertial cues (3D acceleration and 3D angular velocities) in order to navigate a Micro Aerial Vehicle (MAV) drift free in 4DoF and metric velocity. Our approach only requires two consecutive images with a minimum of three feature matches. It does not require any (point) map nor any type of feature history. Thus it is an inherently failsafe approach that is immune to map and feature-track failures. With these minimal requirements we show in real experiments that the system is able to navigate drift free in all angles including yaw, in one metric position axis, and in 3D metric velocity. Furthermore, it is a power-on-and-go system able to online self-calibrate the inertial biases, the visual scale and the full 6DoF extrinsic transformation parameters between camera and IMU.

reconnissance↗

Rotorcraft Research at the NASA Vertical Motion Simulator

In the 1970 s the role of the military helicopter evolved to encompass more demanding missions including low-level nap-of-the-earth flight and operation in severely degraded visual environments. The Vertical Motion Simulator (VMS) at the NASA Ames Research Center was built to provide a high-fidelity simulation capability to research new rotorcraft concepts and technologies that could satisfy these mission requirements. The VMS combines a high-fidelity large amplitude motion system with an adaptable simulation environment including interchangeable and configurable cockpits. In almost 30 years of operation, rotorcraft research on the VMS has contributed significantly to the knowledge-base on rotorcraft performance, handling qualities, flight control, and guidance and displays. These contributions have directly benefited current rotorcraft programs and flight safety. The high fidelity motion system in the VMS was also used to research simulation fidelity. This research provided a fundamental understanding of pilot cueing modalities and their effect on simulation fidelity.

Aponso, Bimal Lalith↗

Molecular Mechanisms of Circadian Regulation During Spaceflight

The physiology of both vertebrates and invertebrates follows internal rhythms coordinated in phase with the 24-hour daily light cycle. This circadian clock is governed by a central pacemaker, the suprachiasmatic nucleus (SCN) in the brain. However, peripheral circadian clocks or oscillators have been identified in most tissues. How the central and peripheral oscillators are synchronized is still being elucidated. Light is the main environmental cue that entrains the circadian clock. Under the absence of a light stimulus, the clock continues its oscillation in a free-running condition. In general, three functional compartments of the circadian clock are defined. The vertebrate retina contains endogenous clocks that control many aspects of retinal physiology, including retinal sensitivity to light, neurohormone synthesis (melatonin and dopamine), rod disk shedding, signalling pathways and gene expression. Neurons with putative local circadian rhythm generation are found among all the major neuron populations in the mammalian retina. In the mouse, clock genes and function are more localized to the inner retinal and ganglion cell layers. The photoreceptor, however, secrete melatonin which may still serve a an important circadian signal. The reception and transmission of the non-visual photic stimulus resides in a small subpopulation (1-3%) or retinal ganglion cells (RGC) that express the pigment melanopsin (Opn4) and are called intrisically photoreceptive RGC (ipRGC). Melanopsin peak absorption is at 420 nm and all the axons of the ipRGC reach the SCN. A common countermeasure for circadian re-entrainment utilizes blue-green light to entrain the circadian clock and mitigate the risk of fatigue and health and performance decrement due to circadian rhythm disruption. However, an effective countermeasure targeting the photoreceptor system requires that the basic circadian molecular machinery remains intact during spaceflight. We hypothesize that spaceflight may affect ipRGC and melanopsin expression, which may be a contributing cause of circadian disruption during spaceflight.

Zanello, S. B.↗

The Cognitive Challenges of Flying a Remotely Piloted Aircraft

A large variety of Remotely Piloted Aircraft (RPA) designs are currently in production or in development. These aircraft range from small electric quadcopters that are flown close to the ground within visual range of the operator, to larger systems capable of extended flight in airspace shared with conventional aircraft. Before RPA can operate routinely and safely in civilian airspace, we need to understand the unique human factors associated with these aircraft. The task of flying an RPA in civilian airspace involves challenges common to the operation of other highly-automated systems, but also introduces new considerations for pilot perception, decision-making, and action execution. RPA pilots participated in focus groups where they were asked to recall critical incidents that either presented a threat to safety, or highlighted a case where the pilot contributed to system resilience or mission success. Ninety incidents were gathered from focus-groups. Human factor issues included the impact of reduced sensory cues, traffic separation in the absence of an out-the-window view, control latencies, vigilance during monotonous and ultra-long endurance flights, control station design considerations, transfer of control between control stations, the management of lost link procedures, and decision-making during emergencies. Some of these concerns have received significant attention in the literature, or are analogous to human factors of manned aircraft. The presentation will focus on issues that are poorly understood, and have not yet been the subject of extensive human factors study. Although many of the reported incidents were related to pilot error, the participants also provided examples of the positive contribution that humans make to the operation of highly-automated systems.

remote pilot station↗

Human Perception of Ambiguous Inertial Motion Cues

Human daily activities on Earth involve motions that elicit both tilt and translation components of the head (i.e. gazing and locomotion). With otolith cues alone, tilt and translation can be ambiguous since both motions can potentially displace the otolithic membrane by the same magnitude and direction. Transitions between gravity environments (i.e. Earth, microgravity and lunar) have demonstrated to alter the functions of the vestibular system and exacerbate the ambiguity between tilt and translational motion cues. Symptoms of motion sickness and spatial disorientation can impair human performances during critical mission phases. Specifically, Space Shuttle landing records show that particular cases of tilt-translation illusions have impaired the performance of seasoned commanders. This sensorimotor condition is one of many operational risks that may have dire implications on future human space exploration missions. The neural strategy with which the human central nervous system distinguishes ambiguous inertial motion cues remains the subject of intense research. A prevailing theory in the neuroscience field proposes that the human brain is able to formulate a neural internal model of ambiguous motion cues such that tilt and translation components can be perceptually decomposed in order to elicit the appropriate bodily response. The present work uses this theory, known as the GIF resolution hypothesis, as the framework for experimental hypothesis. Specifically, two novel motion paradigms are employed to validate the neural capacity of ambiguous inertial motion decomposition in ground-based human subjects. The experimental setup involves the Tilt-Translation Sled at Neuroscience Laboratory of NASA JSC. This two degree-of-freedom motion system is able to tilt subjects in the pitch plane and translate the subject along the fore-aft axis. Perception data will be gathered through subject verbal reports. Preliminary analysis of perceptual data does not indicate that the GIF resolution hypothesis is completely valid for non-rotational periodic motions. Additionally, human perception of translation is impaired without visual or spatial reference. The performance of ground-base subjects in estimating tilt after brief training is comparable with that of crewmembers without training.

Zhang, Guan-Lu↗

Effects of Different Heave Motion Components on Pilot Pitch Control Behavior

The study described in this paper had two objectives. The first objective was to investigate if a different weighting of heave motion components decomposed at the center of gravity, allowing for a higher fidelity of individual components, would result in pilot manual pitch control behavior and performance closer to that observed with full aircraft motion. The second objective was to investigate if decomposing the heave components at the aircraft's instantaneous center of rotation rather than at the center of gravity could result in additional improvements in heave motion fidelity. Twenty-one general aviation pilots performed a pitch attitude control task in an experiment conducted on the Vertical Motion Simulator at NASA Ames under different hexapod motion conditions. The large motion capability of the Vertical Motion Simulator also allowed for a full aircraft motion condition, which served as a baseline. The controlled dynamics were of a transport category aircraft trimmed close to the stall point. When the ratio of center of gravity pitch heave to center of gravity heave increased in the hexapod motion conditions, pilot manual control behavior and performance became increasingly more similar to what is observed with full aircraft motion. Pilot visual and motion gains significantly increased, while the visual lead time constant decreased. The pilot visual and motion time delays remained approximately constant and decreased, respectively. The neuromuscular damping and frequency both decreased, with their values more similar to what is observed with real aircraft motion when there was an equal weighting of the heave of the center of gravity and heave due to rotations about the center of gravity. In terms of open- loop performance, the disturbance and target crossover frequency increased and decreased, respectively, and their corresponding phase margins remained constant and increased, respectively. The decomposition point of the heave components only had limited effects on pilot manual control behavior and performance.

manual control↗

The role of visual context in manual target localization

During space flight and immediately after return to the 1-g environment of earth, astronauts experience perceptual and sensory-motor disturbances. These changes result from adaptation of the astronaut to the microgravity environment of space. During space flight, sensory information from the eyes, limbs, and vestibular organs is reinterpreted by the central nervous system in order to produce appropriate body movements in the microgravity. This adaptation takes several days to develop. Upon return to earth, the changes in the sensory-motor system are no longer appropriate to a 1-g environment. Over several days, the astronaut must re-adapt to the terrestrial environment. Alterations in sensory-motor function may affect eye-head-hand coordination and, thus, the crewmember's ability to manually locate objects in extrapersonal space. Previous reports have demonstrated that crewmembers have difficulty in estimating joint and limb position and in pointing to memorized target positions on orbit and immediately postflight. The ability to point at or reach toward an object or perform other manual tasks is essential for safe Shuttle operation and may be compromised particularly during re-entry and landing sequences and during possible emergency egress from the Shuttle. An understanding of eye-head-hand coordination and the changes produced during space flight is necessary to develop effective countermeasures. This summer's project formed part of the study of the sensory cues use in the manual localization of objects.

Barry, Susan R.↗