Search NASA⌕ Search

SEARCH · Search NASA

Results for “Visual Perception”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24

Model-based VQ for image data archival, retrieval and distribution

An ideal image compression technique for image data archival, retrieval and distribution would be one with the asymmetrical computational requirements of Vector Quantization (VQ), but without the complications arising from VQ codebooks. Codebook generation and maintenance are stumbling blocks which have limited the use of VQ as a practical image compression algorithm. Model-based VQ (MVQ), a variant of VQ described here, has the computational properties of VQ but does not require explicit codebooks. The codebooks are internally generated using mean removed error and Human Visual System (HVS) models. The error model assumed is the Laplacian distribution with mean, lambda-computed from a sample of the input image. A Laplacian distribution with mean, lambda, is generated with uniform random number generator. These random numbers are grouped into vectors. These vectors are further conditioned to make them perceptually meaningful by filtering the DCT coefficients from each vector. The DCT coefficients are filtered by multiplying by a weight matrix that is found to be optimal for human perception. The inverse DCT is performed to produce the conditioned vectors for the codebook. The only image dependent parameter used in the generation of codebook is the mean, lambda, that is included in the coded file to repeat the codebook generation process for decoding.

Manohar, Mareboyana↗

Electroencephalographic imaging of higher brain function

High temporal resolution is necessary to resolve the rapidly changing patterns of brain activity that underlie mental function. Electroencephalography (EEG) provides temporal resolution in the millisecond range. However, traditional EEG technology and practice provide insufficient spatial detail to identify relationships between brain electrical events and structures and functions visualized by magnetic resonance imaging or positron emission tomography. Recent advances help to overcome this problem by recording EEGs from more electrodes, by registering EEG data with anatomical images, and by correcting the distortion caused by volume conduction of EEG signals through the skull and scalp. In addition, statistical measurements of sub-second interdependences between EEG time-series recorded from different locations can help to generate hypotheses about the instantaneous functional networks that form between different cortical regions during perception, thought and action. Example applications are presented from studies of language, attention and working memory. Along with its unique ability to monitor brain function as people perform everyday activities in the real world, these advances make modern EEG an invaluable complement to other functional neuroimaging modalities.

Non-NASA Center↗

Angular relation of axes in perceptual space

The geometry of perceptual space needs to be known to model spatial orientation constancy or to create virtual environments. To examine one main aspect of this geometry, the angular relation between the three spatial axes was measured. Experiments were performed consisting of a perceptual task in which subjects were asked to set independently their apparent vertical and horizontal plane. The visual background provided no other stimuli to serve as optical direction cues. The task was performed in a number of different body tilt positions with pitches and rolls varied in steps of 30 degs. The results clearly show the distortion of orthogonality of the perceptual space for nonupright body positions. Large interindividual differences were found. Deviations from orthogonality up to 25 deg were detected in the pitch as well as in the roll direction. Implications of this nonorthogonality on further studies of spatial perception and on the construction of virtual environments for human interaction is also discussed.

Bucher, Urs↗

Evaluation of Intranasal Scopolamine for the Prevention of Wave Motion Induced Motion Sickness While Maintaining Performance on Operationally Relevant Tasks

Motion sickness represents one of the greatest clinical challenges impacting crew activities during and following g-transitions. Our overall goal is to characterize the effectiveness of motion sickness countermeasures during controlled laboratory experiments using capsule wave motion simulation and during field testing in operational environments. This laboratory study focused on prevention of motion sickness using intranasal scopolamine using a double-blinded repeated measures design in 30 subjects (19M, 11F). Intranasal scopolamine was provided by Defender Pharmaceuticals, Inc. (DPI-386 Nasal Gel, referred to as Inscop) self-administered by a nasal pump (Aptar Pharma) that delivers 0.4 mg dose (0.2 mg / nostril). During each session, subjects were exposed to complex wave motion on a six degree-of-freedom platform that included pitch, roll and heave at provocative stimulus frequencies (0.1-0.25 Hz) while seated in an illuminated cabin deprived of external visual cues. Motion sickness symptoms were compared across treatment and placebo control sessions counterbalanced across subjects and separated by at least one week. The time-to-motion sickness endpoint was based on severe malaise, defined as symptom score of ≥8 points using the Pensacola Diagnostic Index [1]. The bioavailability of scopolamine for each session was estimated from plasma concentrations obtained every 15 min[2]. Side effects during the treatment session were minimal, and performance was not impaired on a test battery including motion perception tracking, tablet-based eye-hand coordination and psychomotor vigilance testing. The plasma concentration remained near-peak levels throughout the 45 min motion sickness testing for most subjects. The percentile ranking on the Motion Sickness Susceptibility Questionnaire [MSSQ, 3]was moderately correlated with the motion sickness time-to-endpoint during the placebo control session (rho = –0.3, p=0.056). Seventeen subjects did not reach an endpoint during their placebo session and were eliminated from subsequent analysis. Another subject was excluded due to insufficient plasma concentration during the treatment session. For the remaining 12 subjects, the change in time-to-motion sickness endpoint between placebo and treatment sessions was moderately correlated with plasma concentration (rho =0.48, p = 0.056), improving on average 4.4 ± 18.4 min, mean ± std with Inscop versus placebo. Our results are consistent with previous findings that intranasal delivery of scopolamine can be effective at reducing motion sickness symptoms with minimal cognitive or sedative side effects. Future work is needed to optimize the delivery of Inscop for rescue (treatment) of symptoms following g-transitions as one of the key advantages of this formulation is self-administration in a suited environment. We will also explore how the combination of Inscop with non-pharmaceutical sensory aids, e.g., vibrotactile feedback of Earth vertical, may further mitigate motion sickness and improve task performance.

S J Wood↗

The barberplaid illusion: plaid motion is biased by elongated apertures

The perceived direction of motion of plaids windowed by elongated spatial Gaussians is biased toward the window's long axis. The bias increases as the relative angle between the plaid motion and the long axis of the window increases, peaks at a relative angle of approximately 45 deg, and then decreases. The bias increases as the window is made narrower (at fixed height) and decreases as the component spatial frequency increases (at fixed aperture size). We examine several models of human motion processing (cross-correlation, motion-energy, intersection-of-constraints, and vector-sum), and show that none of these standard models can predict our data. We conclude that spatial integration of motion signals plays a crucial role in plaid motion perception and that current models must be explicitly expanded to include such spatial interactions.

NASA Center ARC↗

Spatial orientation and balance control changes induced by altered gravitoinertial force vectors

To better understand the mechanisms of human adaptation to rotating environments, we exposed 19 healthy subjects and 8 vestibular-deficient subjects ("abnormal"; four bilateral and four unilateral lesions) to an interaural centripetal acceleration of 1 g (resultant 45 degrees roll-tilt of 1.4 g) on a 0.8-m-radius centrifuge for periods of 90 min. The subjects sat upright (body z-axis parallel to centrifuge rotation axis) in the dark with head stationary, except during 4 min of every 10 min, when they performed head saccades toward visual targets switched on at 3- to 5-s intervals at random locations (within +/- 30 degrees) in the earth-horizontal plane. Eight of the normal subjects also performed the head saccade protocol in a stationary chair adjusted to a static roll-tilt angle of 45 degrees for 90 min (reproducing the change in orientation but not the magnitude of the gravitoinertial force on the centrifuge). Eye movements, including voluntary saccades directed along perceived earth- and head-referenced planes, were recorded before, during, and immediately after centrifugation. Postural center of pressure (COP) and multisegment body kinematics were also gathered before and within 10 min after centrifugation. Normal subjects overestimated roll-tilt during centrifugation and revealed errors in perception of head-vertical provided by directed saccades. Errors in this perceptual response tended to increase with time and became significant after approximately 30 min. Motion-sickness symptoms caused approximately 25% of normal subjects to limit their head movements during centrifugation and led three normal subjects to stop the test early. Immediately after centrifugation, subjects reported feeling tilted 10 degrees in the opposite direction, which was in agreement with the direction of their earth-referenced directed saccades. Postural COP, segmental body motion amplitude, and hip-sway frequency increased significantly after centrifugation. These postural effects were short-lived, however, with a recovery time of several postural test trials (minutes). There were also asymmetries in the direction of postcentrifugation COP and head tilt which depended on the subject's orientation during the centrifugation adaptation period (left ear or right ear out). The amount of total head movements during centrifugation correlated poorly or inversely with postcentrifugation postural stability, and the most unstable subject made no head movements. There was no decrease in postural stability after static tilt, although these subjects also reported a perceived tilt briefly after return to upright, and they also had COP asymmetries. Abnormal subjects underestimated roll-tilt during centrifugation, and their directed saccades revealed permanent spatial distortions. Bilateral abnormal subjects started out with poor postural control, but showed no postural decrements after centrifugation, while unilateral abnormal subjects had varying degrees of postural decrement, both in their everyday function and as a result of experiencing the centrifugation. In addition, three unilateral, abnormal subjects, who rode twice in opposite orientations, revealed a consistent orthogonal pattern of COP offsets after centrifugation. These results suggest that both orientation and magnitude of the gravitoinertial vector are used by the central nervous system for calibration of multiple orientation systems. A change in the background gravitoinertial force (otolith input) can rapidly initiate postural and perceptual adaptation in several sensorimotor systems, independent of a structured visual surround.

Clinical Trial↗

Multi-Resolution Elevation Mapping and Safe Landing Site Detection with Applications to Planetary Rotorcraft

In this paper, we propose a resource-efficient approach to provide an autonomous UAV with an on-board perception method to detect safe, hazard-free landing sites during flights over complex 3D terrain. We aggregate 3D measurements acquired from a sequence of monocular images by a Structure-from-Motion approach into a local, robot-centric, multi-resolution elevation map of the overflown terrain, which fuses depth measurements according to their lateral surface resolution (pixel-footprint) in a probabilistic framework based on the concept of dynamic Level of Detail. Map aggregation only requires depth maps and the associated poses, which are obtained from an on-board Visual Odometry algorithm. An efficient landing site detection method then exploits the features of the underlying multi-resolution map to detect safe landing sites based on the slope, roughness, and quality of the reconstructed terrain surface. The evaluation of the performance of the mapping and landing site detection modules are analyzed independently and jointly in simulated and realworld experiments in order to establish the efficacy of the proposed approach.

Brockers, Roland↗

Dense 3D-Reconstruction from Monocular Image Sequences for Computationally Constrained UAS

The ability to find safe landing sites over complex 3D terrain is an essential safety feature for fully autonomous small unmanned aerial systems (UAS), which requires on-board perception for 3D reconstruction and terrain analysis if the overflown terrain is unknown. This is a challenge for UAS that are limited in size, weight and computational power, such as small rotorcrafts executing autonomous missions on Earth, or in planetary applications such as the Mars Helicopter. For such a computationally constraint system, we propose a structure from motion approach that uses inputs from a single downward facing camera to produce dense point clouds of the overflown terrain in real time. In contrast to existing approaches, our method uses metric pose information from a visual-inertial odometry algorithm as camera pose priors, which allows deploying a fast pose refinement step to align camera frames such that a conventional stereo algorithm can be used for dense 3D reconstruction. We validate the performance of our approach with extensive evaluations in simulation, and demonstrate the feasibility with data from UAS flights.

Brockers, Roland↗

Yaw and pitch visual-vestibular interaction in weightlessness

Both yaw and pitch visual-vestibular interactions at two separate frequencies of chair rotation (0.2 and 0.8 Hz) in combination with a single velocity of optokinetic stimulus (36 degrees/s) were used to investigate the effects of sustained weightlessness on neural strategies adopted by astronaut subjects to cope with the stimulus rearrangement of spaceflight. Pitch and yaw oscillation in darkness at 0.2 and 0.8 Hz without optokinetic stimulation, and constant velocity linear optokinetic stimulation at 18, 36, and 54 degrees/s presented relative to the head with the subject stationary, were used as controls for the visual-vestibular interactions. The results following 8 days of space flight showed no significant changes in: (1) either the horizontal and vertical vestibulo-ocular reflex (VOR) gain, phase, or bias; (2) the yaw visual-vestibular response (VVR); or (3) the horizontal or vertical optokinetic (OKN) slow phase velocity (SPV). However, significant changes were observed: (1) when during pitch VVR at 0.2 Hz late inflight, the contribution of the optokinetic input to the combined oculomotor response was smaller than during the stationary OKN SPV measurements, followed by an increased contribution during the immediate postflight testing; and (2) when during pitch VVR at 0.8 Hz, the component of the combined oculomotor response due to the underlying vertical VOR was more efficiently suppressed early inflight and less suppressed immediately postflight compared with preflight observations. The larger OKN response during pitch VVR at 0.2 Hz and the better suppression of VOR during pitch VVR at 0.8 Hz postflight are presumably due to the increased role of vision early inflight and immediately after spaceflight, as previously observed in various studies. These results suggest that the subjects adopted a neural strategy to structure their spatial orientation in weightlessness by reweighting visual, otolith, and perhaps tactile/somatic signals.

NASA Center JSC↗

Rheoceptive mediators of graviperception in a water flea: Morphological implications of antennal-socket setae in daphnia magna

Aquatic microcrustaceans of the genus Daphnia are known to orient to light during the day. At night, in the absence of visual cues, daphnids were suspected of maintaining equilibrium by monitoring the direction of gravity through their swimming antennae. Recent investigations using simulated, weightlessness conditions coupled with absence of illumination revealed hair like structures or setae on the basal, articulating socket of the antennae that, when surgically removed, resulted in disorientation. Given the simulated weightlessness or neutrally buoyant condition that eliminated sinking of the normally negatively buoyant Daphnia, it was proposed that the antennal socket setae function as rheoceptors stimulated by the upward rush of water currents during gravity induced, sinking phase of daphnid swimming movements. This rheoceptively mediated, gravity perception hypothesis is further supported by morphological investigations. Scanning electron micrographs indicate that antennal socket setae are anatomically similar to proprioceptors used by higher crustaceans to monitor gravitational direction.

Meyers, D. G.↗

Visually guided control of movement in the context of multimodal stimulation

Flight simulation has been almost exclusively concerned with simulating the motions of the aircraft. Physically distinct subsystems are often combined to simulate the varieties of aircraft motion. Visual display systems simulate the motion of the aircraft relative to remote objects and surfaces (e.g., other aircraft and the terrain). 'Motion platform' simulators recreate aircraft motion relative to the gravitoinertial vector (i.e., correlated rotation and tilt as opposed to the 'coordinated turn' in flight). 'Control loaders' attempt to simulate the resistance of the aerodynamic medium to aircraft motion. However, there are few operational systems that attempt to simulate the motion of the pilot relative to the aircraft and the gravitoinertial vector. The design and use of all simulators is limited by poor understanding of postural control in the aircraft and its effect on the perception and control of flight. Analysis of the perception and control of flight (real or simulated) must consider that: (1) the pilot is not rigidly attached to the aircraft; and (2) the pilot actively monitors and adjusts body orientation and configuration in the aircraft. It is argued that this more complete approach to flight simulation requires that multimodal perception be considered as the rule rather than the exception. Moreover, the necessity of multimodal perception is revealed by emphasizing the complementarity rather than the redundancy among perceptual systems. Finally, an outline is presented for an experiment to be conducted at NASA ARC. The experiment explicitly considers possible consequences of coordination between postural and vehicular control.

Riccio, Gary E.↗

Visual light flash phenomenon, part C

The Apollo 16 mission provided the opportunity to obtain additional data on the characteristics and frequency of the light flashes and also provided the first opportunity to obtain a direct physical record of incident cosmic ray particles with the Apollo light flash moving emulsion detector (ALFMED). The ALFMED is an electromechanical device that is worn on the head like a helmet and supports cosmic radiation-sensitive emulsions around the head of the test subject. Two light flash observation sessions were conducted during the mission: one during translunar coast and the second during transearth coast. Characteristics of the light flashes observed and reported by the Apollo crew members were generally similar to those reported on previous missions. Analyses of the ALFMED emulsion plates are proceeding as scheduled, although results are not yet available. The ALFMED results should provide conclusive evidence establishing the correlation, if any, between the incident cosmic ray particles and the perception of light flashes as reported by Apollo crew members.

Richard E. Benson↗

Human Performance Issues of Lunar-Sited Teleoperations

Teleoperations in terrestrial environments present a number of challenges to system operators and designers. Transmission lags, restricted visual fields, and reduced or distorted tactile/kinesthetic feedback can compromise performance, especially for innerloop control tasks (e.g., vehicle or manipulator control). These problems are likely to be exacerbated in lunar operations, since teleoperation may occur across large distances. Further, the lunar environment will introduce unique concerns. For example, the teleoperated systems will reflect the reduced gravity of the moon. In addition to the novelty of these dynamics, operators will often have to cope with them while physically located in a terrestrial or microgravity environment. Similarly, the optical characteristics of the lunar environment differ from our usual experience (e.g., lack of atmospheric attenuation) in ways that may impact normative depth, distance, and motion perception. These human factors issues are related to the question of humans adapting to a lunar environment. However, teleoperations requires the operator to maintain functionality in both the control station and end-effector environments, defeating more straightforward environmental adaptation strategies.

Kaiser, Mary K.↗

Percepts of rigid motion within and across apertures

Humans consistently err in their percepts of rotational motion viewed through an aperture. Such errors provide insight into the constraints observers use to interpret retinal images. In the first of two experiments, Ss consistently perceived the fixed center of rotation for an unmarked line viewed through an aperture as located on the line, regardless of its actual location. Accuracy greatly improved with visible line endings. This finding was extended to explain why a square appears nonrigid when it rotates behind a partial occluder. This illusion may result from observers misperceiving the center of rotation of the unmarked square sides. In this situation, Ss seemed unable to apply an object rigidity constraint across apertures. These findings support a conceptualization of the visual system in which consistent local information must be clearly present before prior knowledge can be used to interpret retinal stimulation.

Shiffrar, Maggie↗

Model of human visual-motion sensing

A model of how humans sense the velocity of moving images is proposed. The model exploits constraints provided by human psychophysics, notably that motion-sensing elements appear tuned for two-dimensional spatial frequency, and by the frequency spectrum of a moving image, namely, that its support lies in the plane in which the temporal frequency equals the dot product of the spatial frequency and the image velocity. The first stage of the model is a set of spatial-frequency-tuned, direction-selective linear sensors. The temporal frequency of the response of each sensor is shown to encode the component of the image velocity in the sensor direction. At the second stage, these components are resolved in order to measure the velocity of image motion at each of a number of spatial locations and spatial frequencies. The model has been applied to several illustrative examples, including apparent motion, coherent gratings, and natural image sequences. The model agrees qualitatively with human perception.

Watson, A. B.↗

Evaluation of Low Cost, User-Centered Alerting Devices for the Mitigation of Flight Crew Spatial Disorientation

The National Aeronautics and Space Administration (NASA) is conducting research into technologies which have the potential to reduce flight crew Spatial Disorientation (SD). While flight deck technology has advanced rapidly over the past fifty (50) years, the reported occurrences of flight crew SD have not decreased. The Cost-Effective Devices for Alerting Research (CEDAR) effort has focused on the identification and development of low cost, user-centered alerting solutions for the purpose of mitigating the occurrence of flight crew SD. This effort seeks to evaluate both existing technologies as well as new and emerging technologies which have a viable path to implementation in commercial aviation within the next five (5) years. This research is intended to develop a proof-of-concept for real-time SD mitigation which could eventually be utilized to improve safety in future air transport operations. NASA has partnered with the United States Naval Aeromedical Research Unit in Dayton, OH (NAMRU-D) to conduct flight crew SD research utilizing their Disorientation Research Device (DRD), dubbed “The Kraken”. This high-tech simulator features never-before-seen capabilities for side-by-side commercial aviation flight crew SD research, and is capable of re-creating the forces necessary to induce SD illusions in a safe and repeatable manner. Prototype SD mitigation solutions were incorporated into this simulator for scenario-based testing and evaluation using airline pilots within a contextually representative operational environment. SD mitigation technology prototypes designed to provide haptic feedback for both alerting and guidance, as well as innovative visual and aural alerting displays were evaluated. In December 2014, as a result of analyzing eighteen (18) loss-of-control events, the Commercial Aviation Safety Team (CAST) recommended research into flight deck technologies that have potential to mitigate the problems and contributing factors that lead to flight crew loss of airplane state awareness (ASA) and conditions likely to produce SD. The aviation community (government, industry and academia) have been charged with conducting research into cost-effective, user-centered flight deck alerting systems to alert flight crews; especially for the two conditions that produced SD (sub-threshold rolls and the somatogravic illusion). Somatogravic illusions are defined as illusions in which “there is a false perception of attitude on exposure to a force vector that differs in direction and/or magnitude from the normal gravitational force”. The sub-threshold roll illusion (aka the “leans” illusion) is a false sensation of roll attitude. A prolonged roll of less than two degrees becomes physiologically imperceptible to the pilot, and can lead to an incorrect perception of aircraft orientation. The sub-threshold roll illusion forms the entry point for the “graveyard spiral”, a maneuver in which the pilot’s corrective action (based on their false perception of aircraft orientation) causes the aircraft to spiral down into the ground. In both of these SD illusions, it is when the pilot attempts to correct the aircraft’s attitude (based on a false perception of its state) that problems arise, sometimes with lethal consequences.

Ronald J Daiker↗

Percepts of rigid motion within and across apertures

Humans consistently err in their percepts of rotational motion viewed through an aperture. Such errors provide insight into the constraints observers use to interpret retinal images. In the first of two experiments, the subjects consistently perceived the fixed center of rotation for an unmarked line viewed through an aperture as located on the line, regardless of its actual location. Accuracy greatly improved with visible line endings. This finding was extended to explain why a square appears nonrigid when it rotates behind a partial occluder. This illusion is theorized to result from observers misperceiving the center of rotation of the unmarked square sides. In this situation, the subjects seemed unable to apply an object rigidity constraint across apertures. These findings support a conceptualization of the visual system in which consistent local information must be clearly present before prior knowledge can be used to interpret retinal stimulation.

Shiffrar, Maggie↗

Eye Movements Reveal Hierarchical Motion Processing

Purpose: In the analysis of visual motion, local features such as orientation are analyzed early in the cortical processing stream (V1), while integration across orientation and space is thought to occur in higher cortical areas such as MT, MST, etc. If all areas provide inputs to eye movement control centers, we would expect that local properties would drive eye movements with relatively short latencies, while global properties would require longer latencies. When such latencies are observed, they can provide information about when (and where?) various stimulus properties are analyzed. Methods: The stimulus employed was an elliptical Gabor patch with a drifting carrier, in which the orientations of the carrier grating and the contrast window were varied independently. We have previously demonstrated that the directional percepts evoked by this stimulus vary between the "grating direction" (the normal to the grating's orientation) and the "window direction", and that similar effects can be observed in reflexive eye movements. Subjects viewed such a stimulus while attempting to maintain steady fixation on the center of the pattern, and the small reflexive eye movements ("stare OKN") were recorded. In the middle of the trial, the orientation of either the grating or the window was rotated smoothly by 30 degrees. Results: Responses to the shift of both grating orientation and window orientation are seen in the average OKN slow phase velocity. Grating rotations produce a rapid OKN rotation to the grating direction (100 ms latency, 300 ms time constant), followed by a slower rebound to the steady state perceived direction midway between the grating and window directions. Window rotations, on the other hand, evoke a slower response (200 ms latency, 500 ms time constant). Conclusions: The results demonstrate multiple cortical inputs to eye movement control: a fast, early input driven by orientation, and a slower input from higher areas sensitive to global stimulus properties.

Mulligan, Jeffrey B.↗