SEARCH · Search NASA

Results for “visual cueing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

All sources NASA NTRS DOE OSTI

NASA NTRS2014

Initial Evaluations of LoC Prediction Algorithms Using the NASA Vertical Motion Simulator

Flying near the edge of the safe operating envelope is an inherently unsafe proposition. Edge of the envelope here implies that small changes or disturbances in system state or system dynamics can take the system out of the safe envelope in a short time and could result in loss-of-control events. This study evaluated approaches to predicting loss-of-control safety margins as the aircraft gets closer to the edge of the safe operating envelope. The goal of the approach is to provide the pilot aural, visual, and tactile cues focused on maintaining the pilot's control action within predicted loss-of-control boundaries. Our predictive architecture combines quantitative loss-of-control boundaries, an adaptive prediction method to estimate in real-time Markov model parameters and associated stability margins, and a real-time data-based predictive control margins estimation algorithm. The combined architecture is applied to a nonlinear transport class aircraft. Evaluations of various feedback cues using both test and commercial pilots in the NASA Ames Vertical Motion-base Simulator (VMS) were conducted in the summer of 2013. The paper presents results of this evaluation focused on effectiveness of these approaches and the cues in preventing the pilots from entering a loss-of-control event.

Pilot Cue↗

NASA NTRS2011

Implementation of Motion Simulation Software and Visual-Auditory Electronics for Use in a Low Gravity Robotic Testbed

The Jet Propulsion Laboratory (JPL) is developing the All-Terrain Hex-Limbed Extra-Terrestrial Explorer (ATHLETE) to assist in manned space missions. One of the proposed targets for this robotic vehicle is a near-Earth asteroid (NEA), which typically exhibit a surface gravity of only a few micro-g. In order to properly test ATHLETE in such an environment, the development team has constructed an inverted Stewart platform testbed that acts as a robotic motion simulator. This project focused on creating physical simulation software that is able to predict how ATHLETE will function on and around a NEA. The corresponding platform configurations are calculated and then passed to the testbed to control ATHLETE's motion. In addition, imitation attitude, imitation attitude control thrusters were designed and fabricated for use on ATHLETE. These utilize a combination of high power LEDs and audio amplifiers to provide visual and auditory cues that correspond to the physics simulation.

gravity↗

NASA NTRS2022

Human Stability While Exercising on a VIS Device in Zero Gravity

BACKGROUND: A Vibration Isolation and Stabilization (VIS) system is being designed for use with the European Enhanced Exploration Exercise Device (E4D) [1]. The exercise bar is attached to cables that extend and retract through openings in the E4D platform, which the subject stands on while exercising. Since the E4D is mounted on a moving VIS device, the whole system moves under the subject’s feet. While tension in the cables does help stabilize a crew member in 0g by bracing him or her against the moving platform, flexible cables do not offer full support against falling. This raises the question of whether various exercises that are successfully performed in 1g on a stationary device can be performed without losing balance in 0g on a moving device. Quantifying stability conditions and establishing stability requirements for exercise countermeasure systems is a long-standing challenge and this work helped to inform this specific need for integrated E4D/VIS flight project development. METHODS AND RESULTS: A simplified stability analysis can be attempted based on platform accelerations generated by the VIS device simulation. In this type of analysis, the subject is conceived as standing on the platform in 0g while being held down to it by the tension in the cables. If the sideways acceleration of the platform is such that the cables cannot generate a sufficient moment relative to, e.g., the heels or the toes of the subject to overcome the tipping moment from the inertial forces on the accelerated subject’s body, the subject becomes unstable. This approach, which we refer to as the ‘static’ approximation, indicated failure of all the exercises that were considered in the comprehensive VIS analysis of the E4D. It was realized, however, that platform accelerations are not externally imposed but are themselves induced by the motion of the subject’s body during exercise, and a model calculation confirmed that this drastically altered the tipping moment on the subject, with the potential to even switch the direction in which the body would tip over. This made it imperative to consider in a coupled manner both the motion of the exercising subject’s body and the induced VIS platform motion while considering stability. The coupled dynamics requirement was met by the VIS simulation incorporating time-dependent human mass properties atop the platform and driven by the inertial forces from the prescribed subject motion relative to the platform based on motion-capture recorded human trajectories in 1g on a stationary E4D [2]. To analyze simulation results, a stability criterion was also needed. We do not know how to account for the human ‘control system’ that would take visual and vestibular cues as inputs as the platform moves in 0g. We thus chose to follow an approach we had previously used to analyze the dynamic feasibility of performing a task in lunar gravity along the human body trajectory recorded in 1g [3]. In this approach, one analyzes the center of pressure (COP) between the shoes and the ground (or platform) and checks if the COP remains within the convex hull of the footprints on the ground (or platform), commonly referred to as base of support (BOS). Since pressure is vertical and, in the absence of foot restraints, positive, the COP going outside the BOS indicates that the trajectory recorded in 1g is not dynamically feasible in microgravity and/or on the moving platform of the device. The outcome of the COP-based analysis was that some of the key exercises, especially the deadlift and the back squat exercises, were found to be dynamically feasible for at least some number of the exercise cycles, this number increasing with the cable tension. While this type of stability analysis does not account for the likely alteration of the exercise trajectory from its 1g form in space, it does show that there exist at least some realistic trajectories that pass the dynamic feasibility criterion. This adds confidence that, with further adjustment by the subject of the exercise form in 0g on a moving device, a number of exercises can be performed without losing balance.

D Frenkel↗

NASA NTRS2023

NASA's Center Innovation Fund (CIF) Internal Research and Development (IRAD) Handling Qualities Study on the Mikrolar Motion Platform Test Report

In order to support the National Aeronautics and Space Administration’s (NASA) Extravehicular Activity and Surface Mobility Program (EHP), system engineers, designers, and researchers embarked on a yearlong challenge to develop a new lunar rover-based motion table simulator to study handling qualities of lunar rovers in the lunar South Pole region, support development research for any lunar rover vendor, and provide a lunar training capability for future lunar/planetary astronauts. In 1989, the United Kingdom’s Royal Air Force Institute of Aviation Medicine (RAF-IAM) stated that motion platforms are the only simulation devices capable of fully stimulating the body motion sensors. They confirmed that motion platforms can impart accelerations to the whole body and therefore exercise the automatic motion feedback-loop that operators are used to. With both visual and motion cues handling the vehicle becomes more realistic. Strachan (2019) con-firms motion cueing from a well set-up motion platform has been found to be important especially in conditions such as night or reduced visibility where motion cues may be more relied upon

Motion Table↗

NASA NTRS2012

Modeling Auditory-Haptic Interface Cues from an Analog Multi-line Telephone

The Western Electric Company produced a multi-line telephone during the 1940s-1970s using a six-button interface design that provided robust tactile, haptic and auditory cues regarding the "state" of the communication system. This multi-line telephone was used as a model for a trade study comparison of two interfaces: a touchscreen interface (iPad)) versus a pressure-sensitive strain gauge button interface (Phidget USB interface controllers). The experiment and its results are detailed in the authors' AES 133rd convention paper " Multimodal Information Management: Evaluation of Auditory and Haptic Cues for NextGen Communication Dispays". This Engineering Brief describes how the interface logic, visual indications, and auditory cues of the original telephone were synthesized using MAX/MSP, including the logic for line selection, line hold, and priority line activation.

Begault, Durand R.↗

NASA NTRS1991

Helicopter control response types for hover and low-speed near-earth tasks in degraded visual conditions

The NASA-Ames Vertical Motion Simulator and Dig 1 Computer Image Generator (CIG) have been used to simulate a helicopter cockpit in a degraded visual environment in order to assess several control-response types during low-level flight. CIG visibility was reduced to the point where the horizon and other far-field cues were indiscernible. The control-response types encompassed a rate command, an attitude command/hold, and a translational rate command; piloting tasks were hover, vertical landing, a pirouette, acceleration/deceleration, and a sidestep maneuver. Visual cue ratings with a rate-command response type were initially collected to set the usable cue environment at 3. A rate-command response type provided poor Level 2 handling qualities.

Blanken, Christopher L.↗

NASA NTRS2012

Nonlinear Motion Cueing Algorithm: Filtering at Pilot Station and Development of the Nonlinear Optimal Filters for Pitch and Roll

Telban and Cardullo have developed and successfully implemented the non-linear optimal motion cueing algorithm at the Visual Motion Simulator (VMS) at the NASA Langley Research Center in 2005. The latest version of the non-linear algorithm performed filtering of motion cues in all degrees-of-freedom except for pitch and roll. This manuscript describes the development and implementation of the non-linear optimal motion cueing algorithm for the pitch and roll degrees of freedom. Presented results indicate improved cues in the specified channels as compared to the original design. To further advance motion cueing in general, this manuscript describes modifications to the existing algorithm, which allow for filtering at the location of the pilot's head as opposed to the centroid of the motion platform. The rational for such modification to the cueing algorithms is that the location of the pilot's vestibular system must be taken into account as opposed to the off-set of the centroid of the cockpit relative to the center of rotation alone. Results provided in this report suggest improved performance of the motion cueing algorithm.

Zaychik, Kirill B.↗

NASA NTRS2005

Effect of contrast on the active control of a moving line

In many passive visual tasks, human perceptual judgments are contrast dependent. To explore whether these contrast dependencies of visual perception also affect closed-loop manual control tasks, we examined visuomotor performance as humans actively controlled a moving luminance-defined line over a range of contrasts. Four subjects were asked to use a joystick to keep a horizontal line centered on a display as its vertical position was perturbed by a sum of sinusoids under two control regimes. The total root mean square (RMS) position error decreased quasi-linearly with increasing log contrast across the tested range (mean slope across subjects: -8.0 and -7.7% per log2 contrast, for the two control regimes, respectively). Frequency-response (Bode) plots showed a systematic increase in open-loop gain (mean slope: 1.44 and 1.30 dB per log2 contrast, respectively), and decrease in phase lag with increasing contrast, which can be accounted for by a decrease in response time delay (mean slope: 32 and 40 ms per log2 contrast, respectively). The performance data are well fit by a Crossover Model proposed by McRuer and Krendel, which allowed us to identify both visual position and motion cues driving performance. This analysis revealed that the position and motion cues used to support manual control under both control regimes appear equally sensitive to changes in stimulus contrast. In conclusion, our data show that active control of a moving visual stimulus is as dependent on contrast as passive perception and suggest that this effect is attributed to a shared contrast sensitivity early in the visual pathway, before any specialization for motion processing.

Contrast Sensitivity/physiology↗

NASA NTRS2000

Transient cardio-respiratory responses to visually induced tilt illusions

Although the orthostatic cardio-respiratory response is primarily mediated by the baroreflex, studies have shown that vestibular cues also contribute in both humans and animals. We have demonstrated a visually mediated response to illusory tilt in some human subjects. Blood pressure, heart and respiration rate, and lung volume were monitored in 16 supine human subjects during two types of visual stimulation, and compared with responses to real passive whole body tilt from supine to head 80 degrees upright. Visual tilt stimuli consisted of either a static scene from an overhead mirror or constant velocity scene motion along different body axes generated by an ultra-wide dome projection system. Visual vertical cues were initially aligned with the longitudinal body axis. Subjective tilt and self-motion were reported verbally. Although significant changes in cardio-respiratory parameters to illusory tilts could not be demonstrated for the entire group, several subjects showed significant transient decreases in mean blood pressure resembling their initial response to passive head-up tilt. Changes in pulse pressure and a slight elevation in heart rate were noted. These transient responses are consistent with the hypothesis that visual-vestibular input contributes to the initial cardiovascular adjustment to a change in posture in humans. On average the static scene elicited perceived tilt without rotation. Dome scene pitch and yaw elicited perceived tilt and rotation, and dome roll motion elicited perceived rotation without tilt. A significant correlation between the magnitude of physiological and subjective reports could not be demonstrated.

NASA Center JSC↗

NASA NTRS1976

A study to determine the characteristic shapes of helicopter visual approach profiles

On previous helicopter instrument approach studies, pilot comments frequently indicated that the deceleration profiles were characterized by 'unnatural cues', and it was found that the pilots were comparing the motion and attitude cues with those obtained during visual approaches. Prior to this study, the characteristic shape of visual approach profiles had not been formally documented. Over 200 visual approaches were flown using different helicopter types, test subjects, and initial conditions, and the altitude and groundspeed profiles were measured by a precision tracking radar. The data from each approach were then processed, and the characteristic shape of the altitude, groundspeed, and deceleration profiles was determined for each set of initial conditions. These flight data were processed further using graphical analysis techniques and parameterization, which, in turn, led to developing closed-form equations that accurately describe the characteristic groundspeed and deceleration profiles. Results from this study can be used to select instrument approach profiles, to develop instrument approach control laws, and to define the corresponding hardware requirements.

Moen, G. C.↗

NASA NTRS1984

Use of Linear Perspective Scene Cues in a Simulated Height Regulation Task

As part of a long-term effort to quantify the effects of visual scene cuing and non-visual motion cuing in flight simulators, an experimental study of the pilot's use of linear perspective cues in a simulated height-regulation task was conducted. Six test subjects performed a fixed-base tracking task with a visual display consisting of a simulated horizon and a perspective view of a straight, infinitely-long roadway of constant width. Experimental parameters were (1) the central angle formed by the roadway perspective and (2) the display gain. The subject controlled only the pitch/height axis; airspeed, bank angle, and lateral track were fixed in the simulation. The average RMS height error score for the least effective display configuration was about 25% greater than the score for the most effective configuration. Overall, larger and more highly significant effects were observed for the pitch and control scores. Model analysis was performed with the optimal control pilot model to characterize the pilot's use of visual scene cues, with the goal of obtaining a consistent set of independent model parameters to account for display effects.

Levison, W. H.↗

NASA NTRS1999

A Methodology for Evaluating the Fidelity of Ground-Based Flight Simulators

An analytical and experimental investigation was undertaken to model the manner in which pilots perceive and utilize visual, proprioceptive, and vestibular cues in a ground-based flight simulator. The study was part of a larger research effort which has the creation of a methodology for determining flight simulator fidelity requirements as its ultimate goal. The study utilized a closed-loop feedback structure of the pilot/simulator system which included the pilot, the cockpit inceptor, the dynamics of the simulated vehicle and the motion system. With the exception of time delays which accrued in visual scene production in the simulator, visual scene effects were not included in this study. The NASA Ames Vertical Motion Simulator was used in a simple, single-degree of freedom rotorcraft bob-up/down maneuver. Pilot/vehicle analysis and fuzzy-inference identification were employed to study the changes in fidelity which occurred as the characteristics of the motion system were varied over five configurations i The data from three of the five pilots that participated in the experimental study were analyzed in the fuzzy inference identification. Results indicate that both the analytical pilot/vehicle analysis and the fuzzyinference identification can be used to reflect changes in simulator fidelity for the task examined.

Zeyada, Y.↗

NASA NTRS1999

A Methodology for Evaluating the Fidelity of Ground-Based Flight Simulators

An analytical and experimental investigation was undertaken to model the manner in which pilots perceive and utilize visual, proprioceptive, and vestibular cues in a ground-based flight simulator. The study was part of a larger research effort which has the creation of a methodology for determining flight simulator fidelity requirements as its ultimate goal. The study utilized a closed-loop feedback structure of the pilot/simulator system which included the pilot, the cockpit inceptor, the dynamics of the simulated vehicle and the motion system. With the exception of time delays which accrued in visual scene production in the simulator, visual scene effects were not included in this study. The NASA Ames Vertical Motion Simulator was used in a simple, single-degree of freedom rotorcraft bob-up/down maneuver. Pilot/vehicle analysis and fuzzy-inference identification were employed to study the changes in fidelity which occurred as the characteristics of the motion system were varied over five configurations. The data from three of the five pilots that participated in the experimental study were analyzed in the fuzzy-inference identification. Results indicate that both the analytical pilot/vehicle analysis and the fuzzy-inference identification can be used to reflect changes in simulator fidelity for the task examined.

Zeyada, Y.↗

NASA NTRSDate not supplied

Developing An Earth-Fixed Visual Reference to Aid Stability, Readaptation and Egress After a Water Landing

INTRODUCTION Water landings present the worst possible sensory conditions for crews trying to orient and stabilize themselves immediately after long-duration spaceflight. Of the three sensory feedback systems involved in maintaining stability (i.e., proprioceptive, vestibular, and visual), none will provide reliable orientation information under the current water landing scenarios. The proprioceptive and vestibular systems are affected during spaceflight by disuse and adaptation to microgravity. Vision may not suffer the same degradation, but the visual environment within the enclosed space of a capsule, or interior room of a recovery ship, is disorienting when subject to wave-induced motion. The result is an increased risk of fall-related injury. In a prior study, 70% (21 of 30) of nonimpaired subjects reported that the presence of an Earth-fixed horizontal line helped them stabilize when their visually enclosed environment was exposed to wave motion. In addition to aiding stability, sensory re-adaptation occurs when inputs from the three sensory systems are synchronized with one another and aligned with Earth’s gravity. The earlier an Earth-fixed visual reference can be introduced the sooner the readaptation process can begin. The goal of this project is to identify the optimal features of a device that visually presents gravitational reference cues to support stability and readaptation. METHODS The capsule sensory-condition simulator is a three-sided enclosure atop a six degree-of-freedom motion platform. A sum-of-sines equation is used to drive the motion platform, producing the simulated wave motion. The equation was derived using the frequency range present in inertial measurement unit (IMU) data collected during open-water Orion mock-up testing. The enclosure creates the nature of a floating visual environment where the walls move in relation to the standing surface. To more accurately represent the condition of postflight crewmembers, galvanic vestibular stimulation (GVS) is applied to disrupt normal vestibular function and standing on a compliant surface attenuates proprioceptive feedback. An instrumented handhold allows the subjects to stabilize themselves and serves as the primary dependent variable. Subjects are instructed to minimize handhold use so the higher forces applied to the handhold correspond to greater instability. Various forms of a visual reference have been explored. Passive systems, such as mechanical gimbals and weighted plumb bobs were eliminated from consideration because of the intertia-induced oscillations that the wave-motion causes. Laser lines presented as horizontal, vertical, or the combination of both are being used to provide the Earth-fixed visual reference. These are presented in the central visual field or periphery from laser sources that are mounted either from within or outside the visual enclosure. RESULTS Data collection for this study is currently in progress. CONCLUSIONS This study will determine whether a visual reference system can help improve stability during challenging sensory conditions and define the optimal chacteristics for such a system.

Brian T Peters↗

NASA NTRS1995

Motor adaptation to Coriolis force perturbations of reaching movements: endpoint but not trajectory adaptation transfers to the nonexposed arm

1. Reaching movements made in a rotating room generate Coriolis forces that are directly proportional to the cross product of the room's angular velocity and the arm's linear velocity. Such Coriolis forces are inertial forces not involving mechanical contact with the arm. 2. We measured the trajectories of arm movements made in darkness to a visual target that was extinguished at the onset of each reach. Prerotation subjects pointed with both the right and left arms in alternating sets of eight movements. During rotation at 10 rpm, the subjects reached only with the right arm. Postrotation, the subjects pointed with the left and right arms, starting with the left, in alternating sets of eight movements. 3. The initial perrotary reaching movements of the right arm were highly deviated both in movement path and endpoint relative to the prerotation reaches of the right arm. With additional movements, subjects rapidly regained straight movement paths and accurate endpoints despite the absence of visual or tactile feedback about reaching accuracy. The initial postrotation reaches of the left arm followed straight paths to the wrong endpoint. The initial postrotation reaches of the right arm had paths with mirror image curvature to the initial perrotation reaches of the right arm but went to the correct endpoint. 4. These observations are inconsistent with current equilibrium point models of movement control. Such theories predict accurate reaches under our experimental conditions. Our observations further show independent implementation of movement and posture, as evidenced by transfer of endpoint adaptation to the nonexposed arm without transfer of path adaptation. Endpoint control may occur at a relatively central stage that represents general constraints such as gravitoinertial force background or egocentric direction relative to both arms, and control of path may occur at a more peripheral stage that represents moments of inertia and muscle dynamics unique to each limb. 5. Endpoint and path adaptation occur despite the absence both of mechanical contact cues about the perturbing force and visual or tactile cues about movement accuracy. These findings point to the importance of muscle spindle signals, monitoring of motor commands, and possibly joint and tendon receptors in a detailed trajectory monitoring process. Muscle spindle primary and secondary afferent signals may differentially influence adaptation of movement shape and endpoint, respectively.

Non-NASA Center↗

DOE OSTI2021

Real-Time Omnidirectional Stereo Rendering: Generating 360° Surround-View Panoramic Images for Comfortable Immersive Viewing

Surround-view panoramic images and videos have become a popular form of media for interactive viewing on mobile devices and virtual reality headsets. Viewing such media provides a sense of immersion by allowing users to control their view direction and experience an entire environment. When using a virtual reality headset, the level of immersion can be improved by leveraging stereoscopic capabilities. Stereoscopic images are generated in pairs, one for the left eye and one for the right eye, and result in providing an important depth cue for the human visual system. For computer generated imagery, rendering proper stereo pairs is well known for a fixed view. However, it is much more difficult to create omnidirectional stereo pairs for a surround-view projection that work well when looking in any direction. One major drawback of traditional omnidirectional stereo images is that they suffer from binocular misalignment in the peripheral vision as a user's view direction approaches the zenith / nadir (north / south pole) of the projection sphere. This paper presents a real-time geometry-based approach for omnidirectional stereo rendering that fits into the standard rendering pipeline. Our approach includes tunable parameters that enable pole merging - a reduction in the stereo effect near the poles that can minimize binocular misalignment. Results from a user study indicate that pole merging reduces visual fatigue and discomfort associated with binocular misalignment without inhibiting depth perception.

360° panorama↗

NASA NTRS1980

Shuttle mission simulator

The simulator was designed to provide real time simulation capability for all phases of the Shuttle Transportation System orbital missions including prelaunch, ascent, onorbit operations, deorbit, entry, approach/landing, and rollout. Full mission continuity is provided in transition between these mission phases. Dual fixed and motion base crew stations, instructor/operator stations, and computer systems allow parallel, simultaneous crew training with either complex capable of being individually integrated with the mission control center. This integrated training capability allows flight control personnel training in the air/ground interface areas of tracking, telemetry (vehicle systems monitoring), uplink command control, and communications. With the exception of the simulated Data Processing System, which utilizes actual flight computers and associated flight software, all orbiter onboard systems are functionally simulated with extensive simulated malfunction capabilities. Additionally, crew out-the-window visual scenes, and aural cues are rigorously simulated.

Olasky, C.↗

NASA NTRS1982

Influence of maneuverability on helicopter combat effectiveness

A computational procedure employing a stochastic learning method in conjunction with dynamic simulation of helicopter flight and weapon system operation was used to derive helicopter maneuvering strategies. The derived strategies maximize either survival or kill probability and are in the form of a feedback control based upon threat visual or warning system cues. Maneuverability parameters implicit in the strategy development include maximum longitudinal acceleration and deceleration, maximum sustained and transient load factor turn rate at forward speed, and maximum pedal turn rate and lateral acceleration at hover. Results are presented in terms of probability of skill for all combat initial conditions for two threat categories.

Falco, M.↗