Search NASA⌕ Search

SEARCH · Search NASA

Results for “visual cueing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Visual augmentation for night flight over featureless terrain

Visual augmentation technique based on infrared cueing lights which project from the aircraft to the terrain is proposed to mitigate the problems associated with night flight over regions with featureless terrains. A series of simulation studies evaluated the effectiveness of several cueing light configurations. Results indicate that certain relatively low-cost cueing light configurations can be effectively used as pseudo-flight directors without impairing the pilot's use of available natural cues in the scene. Pilots prefer configurations which provide multiple samples of the forward terrain. Providing several 'look-aheads' helps to resolve potential vehicle/terrain state ambiguities. It is concluded that cueing lights are capable of creating visual patterns which are readily interpreted and translated to control commands, thus providing pilots with intuitive, low-workload decision aids.

Kaiser, Mary K.↗

Virtual acoustic displays

A 3D auditory display can potentially enhance information transfer by combining directional and iconic information in a quite naturalistic representation of dynamic objects in the interface. Another aspect of auditory spatial clues is that, in conjunction with other modalities, it can act as a potentiator of information in the display. For example, visual and auditory cues together can reinforce the information content of the display and provide a greater sense of presence or realism in a manner not readily achievable by either modality alone. This phenomenon will be particularly useful in telepresence applications, such as advanced teleconferencing environments, shared electronic workspaces, and monitoring telerobotic activities in remote or hazardous situations. Thus, the combination of direct spatial cues with good principles of iconic design could provide an extremely powerful and information-rich display which is also quite easy to use. An alternative approach, recently developed at ARC, generates externalized, 3D sound cues over headphones in realtime using digital signal processing. Here, the synthesis technique involves the digital generation of stimuli using Head-Related Transfer Functions (HRTF's) measured in the two ear-canals of individual subjects. Other similar approaches include an analog system developed by Loomis, et. al., (1990) and digital systems which make use of transforms derived from normative mannikins and simulations of room acoustics. Such an interface also requires the careful psychophysical evaluation of listener's ability to accurately localize the virtual or synthetic sound sources. From an applied standpoint, measurement of each potential listener's HRTF's may not be possible in practice. For experienced listeners, localization performance was only slightly degraded compared to a subject's inherent ability. Alternatively, even inexperienced listeners may be able to adapt to a particular set of HRTF's as long as they provide adequate cues for localization. In general, these data suggest that most listeners can obtain useful directional information from an auditory display without requiring the use of individually-tailored HRTF's.

Wenzel, Elizabeth M.↗

Effects of Spaceflight and Hindlimb Suspension on the Posture and Gait of Rats

Instability of posture and gait in astronauts following spaceflight (SF) is thought to result from muscle atrophy and from changes in sensory-motor integration in the CNS (central nervous system) that occur during adaptation to microgravity (micro-G). Individuals are thought to have developed, during SF, adaptive changes for the processing of proprioceptive, vestibular and visual sensory inputs with reduced weighting of gravity-based signals and increased weighting of visual and tactile cues. This sensory-motor rearrangement in the CNS apparently occurs to optimize neuromuscular system function for effective movement and postural control in micro-G. However, these adaptive changes are inappropriate for the 1 g environment and lead to disruptions in posture and gait on return to Earth. Few reports are available on the effects of SF on the motor behavior of animals. Rats studied following 18.5 - 19.5 days of SF in the COSMOS program were described as being ..'inert, apathetic, slow'.. and generally unstable. The hindlimbs of these rats were ..'thrust out from the body with fingers pulled apart and the shin unnaturally pronated'. On the 6th postflight day motor behavior was described as similar to that observed in preflight observations. Improved understanding of the mechanisms leading to these changes can be obtained in animal models through detailed analysis of neural and molecular mechanisms related to gait. To begin this process the posture and gait of rats were examined following exposure to either SF or hindlimb suspension (HLS), and during recovery from these conditions.

Fox, R. A.↗

Convection Weather Detection by General Aviation Pilots with Convectional and Data-Linked Graphical Weather Information Sources

This study compares how well general aviation (GA) pilots detect convective weather in flight with different weather information sources. A flight test was conducted in which GA pilot test subjects were given different in-flight weather information cues and flown toward convective weather of moderate or greater intensity. The test subjects were not actually flying the aircraft, but were given pilot tasks representative of the workload and position awareness requirements of the en route portion of a cross country GA flight. On each flight, one test subject received weather cues typical of a flight in visual meteorological conditions (VMC), another received cues typical of flight in instrument meteorological conditions (IMC), and a third received cues typical of flight in IMC but augmented with a graphical weather information system (GWIS). The GWIS provided the subject with near real time data-linked weather products, including a weather radar mosaic superimposed on a moving map with a symbol depicting the aircraft's present position and direction of track. At several points during each flight, the test subjects completed short questionnaires which included items addressing their weather situation awareness and flight decisions. In particular, test subjects were asked to identify the location of the nearest convective cells. After the point of nearest approach to convective weather, the test subjects were asked to draw the location of convective weather on an aeronautical chart, along with the aircraft's present position. This paper reports preliminary results on how accurately test subjects provided with these different weather sources could identify the nearest cell of moderate or greater intensity along their route of flight. Additional flight tests are currently being conducted to complete the data set.

Chamberlain, James P.↗

Flying Unmanned Aircraft: A Pilot's Perspective

The National Aeronautics and Space Administration (NASA) is pioneering various Unmanned Aircraft System (UAS) technologies and procedures which may enable routine access to the National Airspace System (NAS), with an aim for Next Gen NAS. These tools will aid in the development of technologies and integrated capabilities that will enable high value missions for science, security, and defense, and open the door to low-cost, extreme-duration, stratospheric flight. A century of aviation evolution has resulted in accepted standards and best practices in the design of human-machine interfaces, the displays and controls of which serve to optimize safe and efficient flight operations and situational awareness. The current proliferation of non-standard, aircraft-specific flight crew interfaces in UAS, coupled with the inherent limitations of operating UAS without in-situ sensory input and feedback (aural, visual, and vestibular cues), has increased the risk of mishaps associated with the design of the "cockpit." The examples of current non- or sub- standard design features range from "annoying" and "inefficient", to those that are difficult to manipulate or interpret in a timely manner, as well as to those that are "burdensome" and "unsafe." A concerted effort is required to establish best practices and standards for the human-machine interfaces, for the pilot as well as the air traffic controller. In addition, roles, responsibilities, knowledge, and skill sets are subject to redefining the terms, "pilot" and "air traffic controller", with respect to operating UAS, especially in the Next-Gen NAS. The knowledge, skill sets, training, and qualification standards for UAS operations must be established, and reflect the aircraft-specific human-machine interfaces and control methods. NASA s recent experiences flying its MQ-9 Ikhana in the NAS for extended duration, has enabled both NASA and the FAA to realize the full potential for UAS, as well as understand the implications of current limitations. Ikhana is a Predator-B/Reaper UAS, built by General Atomics, Aeronautical Systems, Inc., and modified for research. Since 2007, the aircraft has been flown seasonally with a wing-mounted pod containing an infrared scanner, utilized to provide real-time wildfire geo-location data to various fire-fighting agencies in the western U.S. The multi-agency effort included an extensive process to obtain flight clearance from the FAA to operate under special provisions, given that UAS in general do not fully comply with current airspace regulations (e.g. sense-and-avoid requirements).

Pestana, Mark E.↗

Handling Qualities Implications for Crewed Spacecraft Operations

Abstract Handling qualities embody those qualities or characteristics of an aircraft that govern the ease and precision with which a pilot is able to perform the tasks required in support of an aircraft role. These same qualities are as critical, if not more so, in the operation of spacecraft. A research, development, test, and evaluation process was put into effect to identify, understand, and interpret the engineering and human factors principles which govern the pilot-vehicle dynamic system as they pertain to space exploration missions and tasks. Toward this objective, piloted simulations were conducted at the NASA Langley Research Center and Ames Research Center for earth-orbit proximity operations and docking and lunar landing. These works provide broad guidelines for the design of spacecraft to exhibit excellent handling characteristics. In particular, this work demonstrates how handling qualities include much more than just stability and control characteristics of a spacecraft or aircraft. Handling qualities are affected by all aspects of the pilot-vehicle dynamic system, including the motion, visual and aural cues of the vehicle response as the pilot performs the required operation or task. A holistic approach to spacecraft design, including the use of manual control, automatic control, and pilot intervention/supervision is described. The handling qualities implications of design decisions are demonstrated using these pilot-in-the-loop evaluations of docking operations and lunar landings.

Bailey, Randall E.↗

Initial Evaluations of LoC Prediction Algorithms Using the NASA Vertical Motion Simulator

Flying near the edge of the safe operating envelope is an inherently unsafe proposition. Edge of the envelope here implies that small changes or disturbances in system state or system dynamics can take the system out of the safe envelope in a short time and could result in loss-of-control events. This study evaluated approaches to predicting loss-of-control safety margins as the aircraft gets closer to the edge of the safe operating envelope. The goal of the approach is to provide the pilot aural, visual, and tactile cues focused on maintaining the pilot's control action within predicted loss-of-control boundaries. Our predictive architecture combines quantitative loss-of-control boundaries, an adaptive prediction method to estimate in real-time Markov model parameters and associated stability margins, and a real-time data-based predictive control margins estimation algorithm. The combined architecture is applied to a nonlinear transport class aircraft. Evaluations of various feedback cues using both test and commercial pilots in the NASA Ames Vertical Motion-base Simulator (VMS) were conducted in the summer of 2013. The paper presents results of this evaluation focused on effectiveness of these approaches and the cues in preventing the pilots from entering a loss-of-control event.

Pilot Cue↗

Implementation of Motion Simulation Software and Visual-Auditory Electronics for Use in a Low Gravity Robotic Testbed

The Jet Propulsion Laboratory (JPL) is developing the All-Terrain Hex-Limbed Extra-Terrestrial Explorer (ATHLETE) to assist in manned space missions. One of the proposed targets for this robotic vehicle is a near-Earth asteroid (NEA), which typically exhibit a surface gravity of only a few micro-g. In order to properly test ATHLETE in such an environment, the development team has constructed an inverted Stewart platform testbed that acts as a robotic motion simulator. This project focused on creating physical simulation software that is able to predict how ATHLETE will function on and around a NEA. The corresponding platform configurations are calculated and then passed to the testbed to control ATHLETE's motion. In addition, imitation attitude, imitation attitude control thrusters were designed and fabricated for use on ATHLETE. These utilize a combination of high power LEDs and audio amplifiers to provide visual and auditory cues that correspond to the physics simulation.

gravity↗

Human Stability While Exercising on a VIS Device in Zero Gravity

BACKGROUND: A Vibration Isolation and Stabilization (VIS) system is being designed for use with the European Enhanced Exploration Exercise Device (E4D) [1]. The exercise bar is attached to cables that extend and retract through openings in the E4D platform, which the subject stands on while exercising. Since the E4D is mounted on a moving VIS device, the whole system moves under the subject’s feet. While tension in the cables does help stabilize a crew member in 0g by bracing him or her against the moving platform, flexible cables do not offer full support against falling. This raises the question of whether various exercises that are successfully performed in 1g on a stationary device can be performed without losing balance in 0g on a moving device. Quantifying stability conditions and establishing stability requirements for exercise countermeasure systems is a long-standing challenge and this work helped to inform this specific need for integrated E4D/VIS flight project development. METHODS AND RESULTS: A simplified stability analysis can be attempted based on platform accelerations generated by the VIS device simulation. In this type of analysis, the subject is conceived as standing on the platform in 0g while being held down to it by the tension in the cables. If the sideways acceleration of the platform is such that the cables cannot generate a sufficient moment relative to, e.g., the heels or the toes of the subject to overcome the tipping moment from the inertial forces on the accelerated subject’s body, the subject becomes unstable. This approach, which we refer to as the ‘static’ approximation, indicated failure of all the exercises that were considered in the comprehensive VIS analysis of the E4D. It was realized, however, that platform accelerations are not externally imposed but are themselves induced by the motion of the subject’s body during exercise, and a model calculation confirmed that this drastically altered the tipping moment on the subject, with the potential to even switch the direction in which the body would tip over. This made it imperative to consider in a coupled manner both the motion of the exercising subject’s body and the induced VIS platform motion while considering stability. The coupled dynamics requirement was met by the VIS simulation incorporating time-dependent human mass properties atop the platform and driven by the inertial forces from the prescribed subject motion relative to the platform based on motion-capture recorded human trajectories in 1g on a stationary E4D [2]. To analyze simulation results, a stability criterion was also needed. We do not know how to account for the human ‘control system’ that would take visual and vestibular cues as inputs as the platform moves in 0g. We thus chose to follow an approach we had previously used to analyze the dynamic feasibility of performing a task in lunar gravity along the human body trajectory recorded in 1g [3]. In this approach, one analyzes the center of pressure (COP) between the shoes and the ground (or platform) and checks if the COP remains within the convex hull of the footprints on the ground (or platform), commonly referred to as base of support (BOS). Since pressure is vertical and, in the absence of foot restraints, positive, the COP going outside the BOS indicates that the trajectory recorded in 1g is not dynamically feasible in microgravity and/or on the moving platform of the device. The outcome of the COP-based analysis was that some of the key exercises, especially the deadlift and the back squat exercises, were found to be dynamically feasible for at least some number of the exercise cycles, this number increasing with the cable tension. While this type of stability analysis does not account for the likely alteration of the exercise trajectory from its 1g form in space, it does show that there exist at least some realistic trajectories that pass the dynamic feasibility criterion. This adds confidence that, with further adjustment by the subject of the exercise form in 0g on a moving device, a number of exercises can be performed without losing balance.

D Frenkel↗

NASA's Center Innovation Fund (CIF) Internal Research and Development (IRAD) Handling Qualities Study on the Mikrolar Motion Platform Test Report

In order to support the National Aeronautics and Space Administration’s (NASA) Extravehicular Activity and Surface Mobility Program (EHP), system engineers, designers, and researchers embarked on a yearlong challenge to develop a new lunar rover-based motion table simulator to study handling qualities of lunar rovers in the lunar South Pole region, support development research for any lunar rover vendor, and provide a lunar training capability for future lunar/planetary astronauts. In 1989, the United Kingdom’s Royal Air Force Institute of Aviation Medicine (RAF-IAM) stated that motion platforms are the only simulation devices capable of fully stimulating the body motion sensors. They confirmed that motion platforms can impart accelerations to the whole body and therefore exercise the automatic motion feedback-loop that operators are used to. With both visual and motion cues handling the vehicle becomes more realistic. Strachan (2019) con-firms motion cueing from a well set-up motion platform has been found to be important especially in conditions such as night or reduced visibility where motion cues may be more relied upon

Motion Table↗

Modeling Auditory-Haptic Interface Cues from an Analog Multi-line Telephone

The Western Electric Company produced a multi-line telephone during the 1940s-1970s using a six-button interface design that provided robust tactile, haptic and auditory cues regarding the "state" of the communication system. This multi-line telephone was used as a model for a trade study comparison of two interfaces: a touchscreen interface (iPad)) versus a pressure-sensitive strain gauge button interface (Phidget USB interface controllers). The experiment and its results are detailed in the authors' AES 133rd convention paper " Multimodal Information Management: Evaluation of Auditory and Haptic Cues for NextGen Communication Dispays". This Engineering Brief describes how the interface logic, visual indications, and auditory cues of the original telephone were synthesized using MAX/MSP, including the logic for line selection, line hold, and priority line activation.

Begault, Durand R.↗

Helicopter control response types for hover and low-speed near-earth tasks in degraded visual conditions

The NASA-Ames Vertical Motion Simulator and Dig 1 Computer Image Generator (CIG) have been used to simulate a helicopter cockpit in a degraded visual environment in order to assess several control-response types during low-level flight. CIG visibility was reduced to the point where the horizon and other far-field cues were indiscernible. The control-response types encompassed a rate command, an attitude command/hold, and a translational rate command; piloting tasks were hover, vertical landing, a pirouette, acceleration/deceleration, and a sidestep maneuver. Visual cue ratings with a rate-command response type were initially collected to set the usable cue environment at 3. A rate-command response type provided poor Level 2 handling qualities.

Blanken, Christopher L.↗

Nonlinear Motion Cueing Algorithm: Filtering at Pilot Station and Development of the Nonlinear Optimal Filters for Pitch and Roll

Telban and Cardullo have developed and successfully implemented the non-linear optimal motion cueing algorithm at the Visual Motion Simulator (VMS) at the NASA Langley Research Center in 2005. The latest version of the non-linear algorithm performed filtering of motion cues in all degrees-of-freedom except for pitch and roll. This manuscript describes the development and implementation of the non-linear optimal motion cueing algorithm for the pitch and roll degrees of freedom. Presented results indicate improved cues in the specified channels as compared to the original design. To further advance motion cueing in general, this manuscript describes modifications to the existing algorithm, which allow for filtering at the location of the pilot's head as opposed to the centroid of the motion platform. The rational for such modification to the cueing algorithms is that the location of the pilot's vestibular system must be taken into account as opposed to the off-set of the centroid of the cockpit relative to the center of rotation alone. Results provided in this report suggest improved performance of the motion cueing algorithm.

Zaychik, Kirill B.↗

Effect of contrast on the active control of a moving line

In many passive visual tasks, human perceptual judgments are contrast dependent. To explore whether these contrast dependencies of visual perception also affect closed-loop manual control tasks, we examined visuomotor performance as humans actively controlled a moving luminance-defined line over a range of contrasts. Four subjects were asked to use a joystick to keep a horizontal line centered on a display as its vertical position was perturbed by a sum of sinusoids under two control regimes. The total root mean square (RMS) position error decreased quasi-linearly with increasing log contrast across the tested range (mean slope across subjects: -8.0 and -7.7% per log2 contrast, for the two control regimes, respectively). Frequency-response (Bode) plots showed a systematic increase in open-loop gain (mean slope: 1.44 and 1.30 dB per log2 contrast, respectively), and decrease in phase lag with increasing contrast, which can be accounted for by a decrease in response time delay (mean slope: 32 and 40 ms per log2 contrast, respectively). The performance data are well fit by a Crossover Model proposed by McRuer and Krendel, which allowed us to identify both visual position and motion cues driving performance. This analysis revealed that the position and motion cues used to support manual control under both control regimes appear equally sensitive to changes in stimulus contrast. In conclusion, our data show that active control of a moving visual stimulus is as dependent on contrast as passive perception and suggest that this effect is attributed to a shared contrast sensitivity early in the visual pathway, before any specialization for motion processing.

Contrast Sensitivity/physiology↗

Transient cardio-respiratory responses to visually induced tilt illusions

Although the orthostatic cardio-respiratory response is primarily mediated by the baroreflex, studies have shown that vestibular cues also contribute in both humans and animals. We have demonstrated a visually mediated response to illusory tilt in some human subjects. Blood pressure, heart and respiration rate, and lung volume were monitored in 16 supine human subjects during two types of visual stimulation, and compared with responses to real passive whole body tilt from supine to head 80 degrees upright. Visual tilt stimuli consisted of either a static scene from an overhead mirror or constant velocity scene motion along different body axes generated by an ultra-wide dome projection system. Visual vertical cues were initially aligned with the longitudinal body axis. Subjective tilt and self-motion were reported verbally. Although significant changes in cardio-respiratory parameters to illusory tilts could not be demonstrated for the entire group, several subjects showed significant transient decreases in mean blood pressure resembling their initial response to passive head-up tilt. Changes in pulse pressure and a slight elevation in heart rate were noted. These transient responses are consistent with the hypothesis that visual-vestibular input contributes to the initial cardiovascular adjustment to a change in posture in humans. On average the static scene elicited perceived tilt without rotation. Dome scene pitch and yaw elicited perceived tilt and rotation, and dome roll motion elicited perceived rotation without tilt. A significant correlation between the magnitude of physiological and subjective reports could not be demonstrated.

NASA Center JSC↗

A study to determine the characteristic shapes of helicopter visual approach profiles

On previous helicopter instrument approach studies, pilot comments frequently indicated that the deceleration profiles were characterized by 'unnatural cues', and it was found that the pilots were comparing the motion and attitude cues with those obtained during visual approaches. Prior to this study, the characteristic shape of visual approach profiles had not been formally documented. Over 200 visual approaches were flown using different helicopter types, test subjects, and initial conditions, and the altitude and groundspeed profiles were measured by a precision tracking radar. The data from each approach were then processed, and the characteristic shape of the altitude, groundspeed, and deceleration profiles was determined for each set of initial conditions. These flight data were processed further using graphical analysis techniques and parameterization, which, in turn, led to developing closed-form equations that accurately describe the characteristic groundspeed and deceleration profiles. Results from this study can be used to select instrument approach profiles, to develop instrument approach control laws, and to define the corresponding hardware requirements.

Moen, G. C.↗

Use of Linear Perspective Scene Cues in a Simulated Height Regulation Task

As part of a long-term effort to quantify the effects of visual scene cuing and non-visual motion cuing in flight simulators, an experimental study of the pilot's use of linear perspective cues in a simulated height-regulation task was conducted. Six test subjects performed a fixed-base tracking task with a visual display consisting of a simulated horizon and a perspective view of a straight, infinitely-long roadway of constant width. Experimental parameters were (1) the central angle formed by the roadway perspective and (2) the display gain. The subject controlled only the pitch/height axis; airspeed, bank angle, and lateral track were fixed in the simulation. The average RMS height error score for the least effective display configuration was about 25% greater than the score for the most effective configuration. Overall, larger and more highly significant effects were observed for the pitch and control scores. Model analysis was performed with the optimal control pilot model to characterize the pilot's use of visual scene cues, with the goal of obtaining a consistent set of independent model parameters to account for display effects.

Levison, W. H.↗

A Methodology for Evaluating the Fidelity of Ground-Based Flight Simulators

An analytical and experimental investigation was undertaken to model the manner in which pilots perceive and utilize visual, proprioceptive, and vestibular cues in a ground-based flight simulator. The study was part of a larger research effort which has the creation of a methodology for determining flight simulator fidelity requirements as its ultimate goal. The study utilized a closed-loop feedback structure of the pilot/simulator system which included the pilot, the cockpit inceptor, the dynamics of the simulated vehicle and the motion system. With the exception of time delays which accrued in visual scene production in the simulator, visual scene effects were not included in this study. The NASA Ames Vertical Motion Simulator was used in a simple, single-degree of freedom rotorcraft bob-up/down maneuver. Pilot/vehicle analysis and fuzzy-inference identification were employed to study the changes in fidelity which occurred as the characteristics of the motion system were varied over five configurations i The data from three of the five pilots that participated in the experimental study were analyzed in the fuzzy inference identification. Results indicate that both the analytical pilot/vehicle analysis and the fuzzyinference identification can be used to reflect changes in simulator fidelity for the task examined.

Zeyada, Y.↗