Search NASA⌕ Search

SEARCH · Search NASA

Results for “visual cueing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
NASA NTRS2017

3D-Sonification for Obstacle Avoidance in Brownout Conditions

Helicopter brownout is a phenomenon that occurs when making landing approaches in dusty environments, whereby sand or dust particles become swept up in the rotor outwash. Brownout is characterized by partial or total obscuration of the terrain, which degrades visual cues necessary for hovering and safe landing. Furthermore, the motion of the dust cloud produced during brownout can lead to the pilot experiencing motion cue anomalies such as vection illusions. In this context, the stability and guidance control functions can be intermittently or continuously degraded, potentially leading to undetected surface hazards and obstacles as well as unnoticed drift. Safe and controlled landing in brownout can be achieved using an integrated presentation of LADAR and RADAR imagery and aircraft state symbology. However, though detected by the LADAR and displayed on the sensor image, small obstacles can be difficult to discern from the background so that changes in obstacle elevation may go unnoticed. Moreover, pilot workload associated with tracking the displayed symbology is often so high that the pilot cannot give sufficient attention to the LADAR/RADAR image. This paper documents a simulation evaluating the use of 3D auditory cueing for obstacle avoidance in brownout as a replacement for or compliment to LADAR/RADAR imagery.

3D audio↗
NASA NTRS2018

Warning Alert HITL Experiment Results

Minimum Operational Performance Standards (MOPS) are being developed to support the integration of Unmanned Aircraft Systems (UAS) in the National Airspace (NAS). Input from subject matter experts and multiple research studies have informed display requirements for Detect-and-Avoid (DAA) systems aimed at supporting timely and appropriate pilot responses to collision hazards. Phase 1 DAA MOPS alerting is designed to inform pilots if an avoidance maneuver is necessary; the two highest alert levels - caution and warning - indicate how soon pilot action is required and whether there is adequate time to coordinate with the air traffic controller (ATC). Additional empirical support is needed to clarify the extent to which warning-level alerting impacts DAA task performance. The present study explores the differential effects of the auditory and visual cues provided by the DAA Warning alert, and performance implications compared to caution-only alerting are discussed.

alerting↗
NASA NTRS2018

Utility of Visual and Auditory Warning Alerting for Traffic Avoidance During UAS Operations

This presentation covers the results of a human-in-the-loop simulation that examined the effect of caution versus warning-level alerting in the context of Unmanned Aircraft System (UAS) operations in civil airspace. Minimum Operational Performance Standards (MOPS) are currently being developed by RTCA Special Committee 228 for UAS Detect-and-Avoid (DAA) systems. Input from subject matter experts and multiple research studies have informed display requirements for DAA systems aimed at supporting timely and appropriate pilot responses to collision hazards. DAA alerting is designed to inform pilots of potential threats to DAA "well clear"; the two highest alert levels - caution and warning - indicate how soon pilot action is required and whether there is adequate time to coordinate with the air traffic controller (ATC). Additional empirical support is needed to clarify the extent to which warning-level alerting impacts DAA task performance. The present study explores the differential effects of the auditory and visual cues provided by the DAA Warning alert, and performance implications compared to caution-only alerting are discussed.

detect and avoid↗
NASA NTRS2018

Flight Demonstration of Novel Atmospheric Satellite Concept

The major focus of the Phase II effort described herein is to develop and demonstrate an aircraft capable of autonomously sailing (i.e., to cruise without propulsion or external assistance), and thereby prove that the dual-aircraft platform (DAP) atmospheric satellite concept is potentially viable. This sailing mode of flight was identified as the number-1 enabling technology required for the stratospheric DAP concept (also known as Stratosat) in the NIAC (NASA Innovative Advanced Concept) Phase I effort. No scientific demonstration of this technology has ever been done or documented to our knowledge. This report describes efforts to take a major step towards the sailing mode of flight capability using a single aircraft connected by cable to a moving ground vehicle which uses sufficient crosswind to cruise without propulsion while "pulling" the ground vehicle forward (i.e., without external assistance). The development of a prototype aircraft is described in terms of novel and key hardware and software elements. A specialized prototype aircraft is described, including a novel cable release mechanism, novel "lateron" control surfaces, and a highly-accurate onboard wind measurement system. Additionally, a novel means to safely connect the aircraft to the moving ground vehicle is described involving a fishing rod/reel and integrated load cell. All of these devices were designed and developed in-house and validated in flight testing. Software is developed to provide look-up tables that give the flight condition targets (i.e., 3-D position relative to ground vehicle, forward speed, aircraft orientation, etc.), based on current wind speed and direction. These tables are successfully validated in flight simulation and used onboard the aircraft. High fidelity analysis of the aircraft aerodynamics are described - required to produce accurate target sailing flight conditions. A novel wind tunnel measurement technique is developed to accurately assess the aerodynamics of the ultra-thin cable. A new specialized flight simulator is described which is utilized to develop and verify the flight software required onboard the aircraft, and to support training of pilots for flying the aircraft while tethered to a ground vehicle. The DAP flight simulator was developed within the Matlab-Simulink framework and included detailed treatment of aircraft/cable aerodynamics, cable dynamics, experimentally-derived propeller-motor thrust curves, actuator responsiveness, and realistic air turbulence. The specialized formation flight controller algorithm, developed using this flight simulator, and onboard the aircraft is described. Finally, a novel auto-tuning software is described and verified within the flight simulator that is shown to refine the sailing flight condition targets during flight using an optimization technique involving doublet maneuvers. Virtual flights using the auto-tuning software indicate that the prototype aircraft should be able to reach and hold sailing conditions despite moderate levels of turbulence provided there is sufficient mean wind available. An overview of the flight testing program is provided. Hundreds of short flights were conducted, primarily using a “dead” short runway at Deland Municipal Airport which permitted use of a moving ground vehicle. Additional flight tests at Space Florida’s Shuttle Landing Facility are also described. First year results from these tests in which the aircraft is controlled manually, demonstrated that excessive flight testing would be required for a pilot to learn to sail with visual cues. However, second year results from autonomous flight these tests included successful demonstration of the closed-loop autonomous formation flight capability (i.e., autonomously determine, reach, and hold the required 3-D location relative to the ground vehicle required for sailing). The next step of using the auto-tune software to autonomously refine the aircraft orientation targets to finally achieve sailing remains the primary goal of future work.

Flight↗
NASA NTRS2021

Between-Simulator Comparison of Motion Filter Order and Break Frequency Interaction Effects on Pilot Control Behavior

This paper investigates the interaction effects of motion filter order and break frequency on pilots' manual control behavior and control performance using two simulators. Eighteen pilots performed the experiment in the Vertical Motion Simulator (VMS) at NASA Ames Research Center and twenty pilots in the SIMONA Research Simulator at Delft University of Technology. The experiment used a full-factorial design with three motion filter orders (first-, second-, and third-order) and two filter break frequencies (0.5 and 2.0 rad/s), in addition to reference no-motion and full-motion conditions. Key task variables, such as the quality of the motion and visual cues and the characteristics of the sidestick, were matched across both simulators. Overall, the expected effects of filter order and break frequency variations were found, with both increasing order and increasing break frequency causing pilots to use less motion feedback in their control strategy, resulting in lower tracking performance. Furthermore, across the wide range of filter orders tested in the experiment, the existing Sinacori-Schroeder motion fidelity criterion was found to be a good predictor of the interaction effects of both filter settings on pilot control behavior. For the same motion condition, there was a consistent offset in the results between simulators, due to the more high-gain control strategy adopted by a number of the VMS pilots. Still, the observed relative trends in pilot control behavior and performance between motion conditions were equivalent in both simulators and thus accurately replicated.

manual control↗
NASA NTRSDate not supplied

Evaluating Sensory Augmentation as A Non-Pharmaceutical Tool to Mitigate Motion Sickness and Enhance Sensorimotor Task Performance: A Pilot Study Using Simulated Capsule Wave Motion

Wave motion during capsule recovery operations can result in motion sickness and performance decrements exacerbating reentry sickness following long duration spaceflight. The purpose of this pilot study was (1) to validate a capsule wave motion simulation as a platform to evaluate motion sickness countermeasures and (2) to evaluate a sensory augmentation belt providing vibrotactile feedback of gravitational upright. Ten healthy subjects ages 38.0 ± 10.1 (6M|4F) were exposed to complex wave motions on a six degree-of-freedom platform that included pitch, roll, and heave at provocative stimulus frequencies (0.1-0.25 Hz) while seated in an illuminated cabin deprived of external visual cues. Subjects reported acute symptoms for up to three consecutive 15 min trials or until they reached a motion sickness endpoint of 8 pts on the Pensacola Diagnostic Index (PDI). Five subjects were randomly assigned to the Sensory Augmentation (SA) group while the other five served as controls (CN group). Based on a Motion Sickness Susceptibility Questionnaire, the two groups had similar motion sickness histories (susceptibility percentile ranking of CN group = 27.5 ± 63.6 in the CN group versus 27.5 ± 37.0 in the SA group, median ± IQR). The vibrotactile feedback consisted of a single array of 8 electromechanical tactors positioned around the torso on an adjustable belt (Engineering Acoustics, Inc) that utilized an integrated inertial measurement unit (IMU) to indicate the direction of upright (e.g., subject’s back tactor on during forward tilt). During each wave motion trial subjects performed a battery of four different tasks: tracking Earth vertical using a joystick with and without a secondary task (Paced Auditory Serial Addition Test), an eye-hand target acquisition task on a cabin-fixed tablet, and the psychomotor vigilance test (PVT). All ten subjects reported varying levels of motion sickness with 6 of 10 reaching a symptom endpoint. Interestingly, subjects anecdotally reported that engagement in the joystick tracking task was less provocative than tasks involving the cabin-fixed tablet or periods of no activity. Sensory augmentation appeared to delay symptom onset, with 2 of 5 subjects reaching an endpoint within the first 15 min trial in the CN group versus none in the SA group (PDI after 15 min = 6.0 ± 2.5 in the CN group versus 3.4 ± 2.5 in the SA group, mean ±std). Sensory augmentation also improved performance on the joystick tracking task at lower stimulus frequencies (0.1 Hz in roll and 0.2 Hz in pitch). Both CN and SA groups maintained a consistent level of performance on the eye-hand target acquisition and PVT throughout the baseline (no motion) and wave motion periods. Our results validated that the simulated capsule wave motion paradigm provides an effective motion sickness stressor. This paradigm is currently being used to investigate the efficacy of intranasal scopolamine to mitigate motion sickness. Sensory augmentation using vibrotactile feedback appears to improve spatial awareness and delay symptom onset during complex passive motion. One advantage of this portable belt design is that it incorporates all tactor drive and IMU circuitry and therefore could continue to be worn by crewmembers and serve as a balance aid during egress and ambulation with recovery operations.

A M Bollinger↗
NASA NTRSDate not supplied

Operational Implications from Field Test Results: Sensorimotor Guidelines for Exploration Missions

Two key sensorimotor objectives of the joint NASA-Russian Field Test (FT) study were (1) to quantify functional performance on long duration crewmembers as close to landing as possible, and (2) to develop a recovery timeline back to preflight baseline. The purpose of this presentation is to provide an overview of the FT results and discuss the operational implications for future exploration missions. The NASA and Russian teams conducted a total of 48 Field Tests, including 18 using a reduced Pilot FT (PFT) protocol. The combined PFT/FT cohort included 14 first-time fliers, 4F, and nine cosmonauts who repeated FT during a second mission. The mission durations were 185 ± 42 days, mean ± std. Nominally, the initial postflight session was performed in the medical test at the Soyuz landing site or at the nearby airport (R+2.2 ± 1.3 hrs, mean ± std), and then repeated multiple times throughout the postflight recovery. The common tasks performed across PFT and full FT protocols included sit-to-stand, recovery from fall (prone to stand) and tandem walk, performed in that order of increasing difficulty. The full FT protocol also included seated tasks (eccentric gaze, dysmetria finger to nose, eye-hand coordination on a tablet, grip force discrimination), a standing posture test with an upper body perturbation, a timed up and go mobility test with obstacles, and a dynamic visual acuity task during vertical oscillations. While there was considerable variability in the postflight outcome measures across crewmembers, the level of vestibular/cerebellar and sensorimotor impairment was greater than previously observed during shorter spaceflight missions. Most striking was the higher incidence of motion sickness even without constraining the standard medical interventions. Motion sensitivity prevented some crewmembers from attempting and/or completing the early testing. The recovery timeline varied with task complexity, generally taking longer when either the basis of support was limited (e.g., tandem walk) or visual cues were deprived (eyes closed). Based on this evidence, mission planners need to expect a range of response across individuals and tasks following G-transitions. Individual health assessments are recommended along with development of pre-worked, prioritized content and timelines, with the ability to change roles depending on crew readiness. Handholds and balance aids are recommended to help stabilize the crewmembers to perform specific tasks (e.g., touch screen selection) or to allow the crewmember the ability to rest with onset of symptoms. Based on anecdotal reports and performance on computerized dynamic posturography, multiple testing on landing day appeared to be beneficial for some participants, while others may have pushed beyond their motion tolerance limit in an effort to complete more FT objectives. Instead of delaying planetary surface operations to allow for recovery, our results suggest that early mobility may be important. Early active self-administered retraining, individualized based on the level of initial impairment and motion sensitivity, will enable a more efficient motor learning and enhance crew performance.

S J Wood↗
NASA NTRSDate not supplied

Field Assessment of Sensorimotor Function Following Long-Duration Spaceflight

INTRODUCTION: Field assessments of functional task performance following long duration spaceflight are critical to characterize the risk associated with sensorimotor adaptation. A portable test battery involving sit-to-stand, prone-to-stand, walk and turn with obstacle, and tandem walking has been implemented during pre- and postflight testing to provide Sensorimotor Standard Measures that could be implemented in remote test locations. METHODS: To date, 19 astronauts (12 males, 7 females) participated in this study before and after 6–8-month expeditions to the International Space Station (198 ± 70 days, mean ±std). Ethics approvals were obtained, and all subjects provided informed consent. Tests were conducted preflight, within a few hours after landing, and then 1 day and 6–11 days later. Time to stability was the outcome measure for both standing tasks, time to completion and turn rate for the walk and turn task, and percent complete steps for the tandem walking (eyes open and closed). Statistical analyses included mixed effects (multi-level) generalized linear models. RESULTS: Consistent with previous Field Tests, significant effects of spaceflight were observed during the initial testing including longer times to stabilize posture when standing, longer times to complete the short obstacle walk, and fewer correct steps during tandem walking. The recovery timeline varied with task complexity, generally taking longer when either the basis of support was limited (e.g., tandem walk) and/or visual cues were deprived (eyes closed). DISCUSSION: These data suggest that additional sensorimotor-based countermeasures may be necessary to maintain functional performance during long-duration spaceflight. Maintaining core measures as new countermeasures are implemented during future missions will be instrumental in assessing their efficacy. This test battery will also serve as the basis for developing sensorimotor assessments during future space exploration.

Scott Jonathan Wood↗
NASA NTRS2024

Evaluation of Intranasal Scopolamine for the Prevention of Wave Motion Induced Motion Sickness While Maintaining Performance on Operationally Relevant Tasks

Motion sickness represents one of the greatest clinical challenges impacting crew activities during and following g-transitions. Our overall goal is to characterize the effectiveness of motion sickness countermeasures during controlled laboratory experiments using capsule wave motion simulation and during field testing in operational environments. This laboratory study focused on prevention of motion sickness using intranasal scopolamine using a double-blinded repeated measures design in 30 subjects (19M, 11F). Intranasal scopolamine was provided by Defender Pharmaceuticals, Inc. (DPI-386 Nasal Gel, referred to as Inscop) self-administered by a nasal pump (Aptar Pharma) that delivers 0.4 mg dose (0.2 mg / nostril). During each session, subjects were exposed to complex wave motion on a six degree-of-freedom platform that included pitch, roll and heave at provocative stimulus frequencies (0.1-0.25 Hz) while seated in an illuminated cabin deprived of external visual cues. Motion sickness symptoms were compared across treatment and placebo control sessions counterbalanced across subjects and separated by at least one week. The time-to-motion sickness endpoint was based on severe malaise, defined as symptom score of ≥8 points using the Pensacola Diagnostic Index [1]. The bioavailability of scopolamine for each session was estimated from plasma concentrations obtained every 15 min[2]. Side effects during the treatment session were minimal, and performance was not impaired on a test battery including motion perception tracking, tablet-based eye-hand coordination and psychomotor vigilance testing. The plasma concentration remained near-peak levels throughout the 45 min motion sickness testing for most subjects. The percentile ranking on the Motion Sickness Susceptibility Questionnaire [MSSQ, 3]was moderately correlated with the motion sickness time-to-endpoint during the placebo control session (rho = –0.3, p=0.056). Seventeen subjects did not reach an endpoint during their placebo session and were eliminated from subsequent analysis. Another subject was excluded due to insufficient plasma concentration during the treatment session. For the remaining 12 subjects, the change in time-to-motion sickness endpoint between placebo and treatment sessions was moderately correlated with plasma concentration (rho =0.48, p = 0.056), improving on average 4.4 ± 18.4 min, mean ± std with Inscop versus placebo. Our results are consistent with previous findings that intranasal delivery of scopolamine can be effective at reducing motion sickness symptoms with minimal cognitive or sedative side effects. Future work is needed to optimize the delivery of Inscop for rescue (treatment) of symptoms following g-transitions as one of the key advantages of this formulation is self-administration in a suited environment. We will also explore how the combination of Inscop with non-pharmaceutical sensory aids, e.g., vibrotactile feedback of Earth vertical, may further mitigate motion sickness and improve task performance.

S J Wood↗
NASA NTRS1978

Evaluation of several secondary tasks in the determination of permissible time delays in simulator visual and motion cues

The effect of secondary tasks in determining permissible time delays in visual-motion simulation of a pursuit tracking task was examined. A single subject, a single set of aircraft handling qualities, and a single motion condition in tracking a target aircraft that oscillates sinusoidally in altitude were used. In addition to the basic simulator delays the results indicate that the permissible time delay is about 250 msec for either a tapping task, an adding task, or an audio task and is approximately 125 msec less than when no secondary task is involved. The magnitudes of the primary task performance measures, however, differ only for the tapping task. A power spectraldensity analysis basically confirms the result by comparing the root-mean-square performance measures. For all three secondary tasks, the total pilot workload was quite high.

Miller, G. K., Jr.↗
NASA NTRS1978

Effects of visual and motion simulation cueing systems on pilot performance during takeoffs with engine failures

Data are presented that show the effects of visual and motion during cueing on pilot performance during takeoffs with engine failures. Four groups of USAF pilots flew a simulated KC-135 using four different cueing systems. The most basic of these systems was of the instrument-only type. Visual scene simulation and/or motion simulation was added to produce the other systems. Learning curves, mean performance, and subjective data are examined. The results show that the addition of visual cueing results in significant improvement in pilot performance, but the combined use of visual and motion cueing results in far better performance.

Parris, B. L.↗
NASA NTRS1981

Pilot/vehicle model analysis of visual and motion cue requirements in flight simulation

The optimal control model for pilot/vehicle analysis is used to explore the effects of a CGI visual system and motion system dynamics on helicopter hover simulation fidelity. This is accomplished by expanding the perceptual aspects of the model to include motion sensing and by relating CGI parameters to information processing parameters of the model. Simulator fidelity is examined by comparing predicted performance and workload for flight with that predicted for various simulator configuration. The results of the analysis suggest that simulator deficiencies or a reasonable nature (by current standards) can result in substantial performance and/or workload infidelity. Both CGI and motion system effects are significant for this task. There is also a distinct interaction between the two sources of pilot cues. In particular, the presence of motion reduces the sensitivity to CGI limitations.

Lancraft, R.↗
NASA NTRS1973

Training the visual accommodation system.

Polarity cue for visual accomodation response of trained subjects to target motion direction change, considering retinal image blur and feedback relation

Cornsweet, T. N.↗
NASA NTRS1999

Helicopter Flight Simulation Motion Platform Requirements

To determine motion fidelity requirements, a series of piloted simulations was performed. Several key results were found. First, lateral and vertical translational platform cues had significant effects on fidelity. Their presence improved performance and reduced pilot workload. Second, yaw and roll rotational platform cues were not as important as the translational platform cues. In particular, the yaw rotational motion platform cue did not appear at all useful in improving performance or reducing workload. Third, when the lateral translational platform cue was combined with visual yaw rotational cues, pilots believed the platform was rotating when it was not. Thus, simulator systems can be made more efficient by proper combination of platform and visual cues. Fourth, motion fidelity specifications were revised that now provide simulator users with a better prediction of motion fidelity based upon the frequency responses of their motion control laws. Fifth, vertical platform motion affected pilot estimates of steady-state altitude during altitude repositioning. Finally, the combined results led to a general method for configuring helicopter motion systems and for developing simulator tasks that more likely represent actual flight. The overall results can serve as a guide to future simulator designers and to today's operators.

Schroeder, Jeffery Allyn↗
NASA NTRS1997

The effect of visual context on manual localization of remembered targets

This paper examines the contribution of egocentric cues and visual context to manual localization of remembered targets. Subjects pointed in the dark to the remembered position of a target previously viewed without or within a structured visual scene. Without a remembered visual context, subjects pointed to within 2 degrees of the target. The presence of a visual context with cues of straight ahead enhanced pointing performance to the remembered location of central but not off-center targets. Thus, visual context provides strong visual cues of target position and the relationship of body position to target location. Without a visual context, egocentric cues provide sufficient input for accurate pointing to remembered targets.

NASA Center JSC↗
NASA NTRS2017

Design Considerations for Attitude State Awareness and Prevention of Entry into Unusual Attitudes

Loss of control - inflight (LOC-I) has historically represented the largest category of commercial aviation fatal accidents. A review of the worldwide transport airplane accidents (2001-2010) evinced that loss of attitude or energy state awareness was responsible for a large majority of the LOC-I events. A Commercial Aviation Safety Team (CAST) study of 18 worldwide loss-of-control accidents and incidents determined that flight crew loss of attitude awareness or energy state awareness due to lack of external visual reference cues was a significant causal factor in 17 of the 18 reviewed flights. CAST recommended that "Virtual Day-Visual Meteorological Condition" (Virtual Day-VMC) displays be developed to provide the visual cues necessary to prevent loss-of-control resulting from flight crew spatial disorientation and loss of energy state awareness. Synthetic vision or equivalent systems (SVS) were identified for a design "safety enhancement" (SE-200). Part of this SE involves the conduct of research for developing minimum aviation system performance standards (MASPS) for these flight deck display technologies to aid flight crew attitude and energy state awareness similar to that of a virtual day-VMC-like environment. This paper will describe a novel experimental approach to evaluating a flight crew's ability to maintain attitude awareness and to prevent entry into unusual attitudes across several SVS optical flow design considerations. Flight crews were subjected to compound-event scenarios designed to elicit channelized attention and startle/surprise within the crew. These high-fidelity scenarios, designed from real-world events, enable evaluation of the efficacy of SVS at improving flight crew attitude awareness to reduce the occurrence of LOC-I incidents in commercial flight operations.

Ellis, Kyle K. E.↗
NASA NTRS1988

Modeling human perception and estimation of kinematic responses during aircraft landing

The thrust of this research is to determine estimation accuracy of aircraft responses based on observed cues. By developing the geometric relationships between the outside visual scene and the kinematics during landing, visual and kinesthetic cues available to the pilot were modeled. Both fovial and peripheral vision was examined. The objective was to first determine estimation accuracy in a variety of flight conditions, and second to ascertain which parameters are most important and lead to the best achievable accuracy in estimating the actual vehicle response. It was found that altitude estimation was very sensitive to the FOV. For this model the motion cue of perceived vertical acceleration was shown to be less important than the visual cues. The inclusion of runway geometry in the visual scene increased estimation accuracy in most cases. Finally, it was shown that for this model if the pilot has an incorrect internal model of the system kinematics the choice of observations thought to be 'optimal' may in fact be suboptimal.

Schmidt, David K.↗