Search NASA⌕ Search

Engineering topics

Norman, Robert M.

Publications and source records attributed to Norman, Robert M..

Flight Deck Technologies to Enable NextGen Low Visibility Surface Operations

Many key capabilities are being identified to enable Next Generation Air Transportation System (NextGen), including the concept of Equivalent Visual Operations (EVO) . replicating the capacity and safety of today.s visual flight rules (VFR) in all-weather conditions. NASA is striving to develop the technologies and knowledge to enable EVO and to extend EVO towards a Better-Than-Visual operational concept. This operational concept envisions an .equivalent visual. paradigm where an electronic means provides sufficient visual references of the external world and other required flight references on flight deck displays that enable Visual Flight Rules (VFR)-like operational tempos while maintaining and improving safety of VFR while using VFR-like procedures in all-weather conditions. The Langley Research Center (LaRC) has recently completed preliminary research on flight deck technologies for low visibility surface operations. The work assessed the potential of enhanced vision and airport moving map displays to achieve equivalent levels of safety and performance to existing low visibility operational requirements. The work has the potential to better enable NextGen by perhaps providing an operational credit for conducting safe low visibility surface operations by use of the flight deck technologies.

Prinzel, Lawrence (Lance) J., III↗

Quantifying Pilot Visual Attention in Low Visibility Terminal Operations

Quantifying pilot visual behavior allows researchers to determine not only where a pilot is looking and when, but holds implications for specific behavioral tracking when these data are coupled with flight technical performance. Remote eye tracking systems have been integrated into simulators at NASA Langley with effectively no impact on the pilot environment. This paper discusses the installation and use of a remote eye tracking system. The data collection techniques from a complex human-in-the-loop (HITL) research experiment are discussed; especially, the data reduction algorithms and logic to transform raw eye tracking data into quantified visual behavior metrics, and analysis methods to interpret visual behavior. The findings suggest superior performance for Head-Up Display (HUD) and improved attentional behavior for Head-Down Display (HDD) implementations of Synthetic Vision System (SVS) technologies for low visibility terminal area operations. Keywords: eye tracking, flight deck, NextGen, human machine interface, aviation

Ellis, Kyle K.↗

Transition of Attention in Terminal Area NextGen Operations Using Synthetic Vision Systems

This experiment investigates the capability of Synthetic Vision Systems (SVS) to provide significant situation awareness in terminal area operations, specifically in low visibility conditions. The use of a Head-Up Display (HUD) and Head-Down Displays (HDD) with SVS is contrasted to baseline standard head down displays in terms of induced workload and pilot behavior in 1400 RVR visibility levels. Variances across performance and pilot behavior were reviewed for acceptability when using HUD or HDD with SVS under reduced minimums to acquire the necessary visual components to continue to land. The data suggest superior performance for HUD implementations. Improved attentional behavior is also suggested for HDD implementations of SVS for low-visibility approach and landing operations.

Ellis, Kyle K. E.↗

The Impact of Data Communications Messages in the Terminal Area on Flight Crew Workload and Eye Scanning

This paper, to accompany a discussion panel, describes a collaborative FAA and NASA research study to determine the effect Data Communications (Data Comm) messages have on flight crew workload and eye scanning behavior in busy terminal area operations. In the Next Generation Air Transportation System Concept of Operations, for the period 2017-2022, the FAA envisions Data Comm between controllers and the flight crew to become the primary means of communicating non-time critical information. Four research conditions were defined that span current day to future equipage levels (Voice with Paper map, Data Comm with Paper map, Data Comm with Moving Map Display with ownship position displayed, Data Comm with Moving Map, ownship and taxi route displayed), and were used to create arrival and departure scenarios at Boston Logan Airport. Preliminary results for workload, situation awareness, and pilot head-up time are presented here. Questionnaire data indicated that pilot acceptability, workload, and situation awareness ratings were favorable for all of the conditions tested. Pilots did indicate that there were times during final approach and landing when they would prefer not to hear the message chime, and would not be able to make a quick response due to high priority tasks in the cockpit.

Comstock, James R., Jr.↗

Use of Data Comm by Flight Crew in High-Density Terminal Areas

This paper describes a collaborative FAA and NASA experiment using 22 commercial airline pilots to determine the effect of using Datalink Communication (Data Comm) to issue messages in busy, terminal area operations. Four conditions were defined that span current day to future flight deck equipage levels (voice communication only, Data Comm only, Data Comm with Moving Map Display, Data Comm with Moving Map displaying taxi route), and each condition was used to create an arrival and a departure scenario at the Boston Logan Airport. These eight scenarios were repeated twice for a total of 16 scenarios for each of the eleven crews. Quantitative data was collected on subject reaction time and eye tracking information. Questionnaires collected subjective feedback on workload and acceptability to the flight crew for using Data Comm in a busy terminal area. 95% of the Data Comm messages were responded to by the flight crew within one minute; however, post experiment debrief comments revealed almost unanimous consensus that two minutes was a reasonable expectation for crew response. Eye tracking data indicated an insignificant decrease in head-up time for the Pilot Flying when Data Comm was introduced; however, the Pilot Monitoring had significantly less head-up time. Data Comm workload was rated as operationally acceptable by both crew members in all conditions in flight at any altitude above the Final Approach Fix in terms of response time and workload. Results also indicate the use of Data Comm during surface operations was acceptable, the exception being the simultaneous use of voice, Data Comm, and audio chime required for an aircraft to cross an active runway. Many crews reported they believed Data Comm messages would be acceptable after the Final Approach Fix or to cross a runway if the message was not accompanied by a chime and there was not a requirement to immediately respond to the uplink message.

Baxley, Brian T.↗

The Effects of Synthetic and Enhanced Vision Technologies for Lunar Landings

Eight pilots participated as test subjects in a fixed-based simulation experiment to evaluate advanced vision display technologies such as Enhanced Vision (EV) and Synthetic Vision (SV) for providing terrain imagery on flight displays in a Lunar Lander Vehicle. Subjects were asked to fly 20 approaches to the Apollo 15 lunar landing site with four different display concepts - Baseline (symbology only with no terrain imagery), EV only (terrain imagery from Forward Looking Infra Red, or FLIR, and LIght Detection and Ranging, or LIDAR, sensors), SV only (terrain imagery from onboard database), and Fused EV and SV concepts. As expected, manual landing performance was excellent (within a meter of landing site center) and not affected by the inclusion of EV or SV terrain imagery on the Lunar Lander flight displays. Subjective ratings revealed significant situation awareness improvements with the concepts employing EV and/or SV terrain imagery compared to the Baseline condition that had no terrain imagery. In addition, display concepts employing EV imagery (compared to the SV and Baseline concepts which had none) were significantly better for pilot detection of intentional but unannounced navigation failures since this imagery provided an intuitive and obvious visual methodology to monitor the validity of the navigation solution.

Kramer, Lynda J.↗

Synthetic and Enhanced Vision System for Altair Lunar Lander

Past research has demonstrated the substantial potential of synthetic and enhanced vision (SV, EV) for aviation (e.g., Prinzel & Wickens, 2009). These augmented visual-based technologies have been shown to significantly enhance situation awareness, reduce workload, enhance aviation safety (e.g., reduced propensity for controlled flight -into-terrain accidents/incidents), and promote flight path control precision. The issues that drove the design and development of synthetic and enhanced vision have commonalities to other application domains; most notably, during entry, descent, and landing on the moon and other planetary surfaces. NASA has extended SV/EV technology for use in planetary exploration vehicles, such as the Altair Lunar Lander. This paper describes an Altair Lunar Lander SV/EV concept and associated research demonstrating the safety benefits of these technologies.

Prinzell, Lawrence J., III↗

Synthetic Vision Displays for Planetary and Lunar Lander Vehicles

Aviation research has demonstrated that Synthetic Vision (SV) technology can substantially enhance situation awareness, reduce pilot workload, improve aviation safety, and promote flight path control precision. SV, and related flight deck technologies are currently being extended for application in planetary exploration vehicles. SV, in particular, holds significant potential for many planetary missions since the SV presentation provides a computer-generated view for the flight crew of the terrain and other significant environmental characteristics independent of the outside visibility conditions, window locations, or vehicle attributes. SV allows unconstrained control of the computer-generated scene lighting, terrain coloring, and virtual camera angles which may provide invaluable visual cues to pilots/astronauts, not available from other vision technologies. In addition, important vehicle state information may be conformally displayed on the view such as forward and down velocities, altitude, and fuel remaining to enhance trajectory control and vehicle system status. The paper accompanies a conference demonstration that introduced a prototype NASA Synthetic Vision system for lunar lander spacecraft. The paper will describe technical challenges and potential solutions to SV applications for the lunar landing mission, including the requirements for high-resolution lunar terrain maps, accurate positioning and orientation, and lunar cockpit display concepts to support projected mission challenges.

Arthur, Jarvis J., III↗

Head-Worn Display Concepts for Surface Operations for Commerical Aircraft

Experiments and flight tests have shown that a Head-Up Display (HUD) and a head-down electronic moving map (EMM) can be enhanced with Synthetic Vision for airport surface operations. While great success in ground operations was demonstrated with a HUD, the research noted that two major HUD limitations during ground operations were its monochrome form and limited, fixed field-of-regard. A potential solution to these limitations found with HUDs may be emerging with Head Worn Displays (HWDs). HWDs are small display devices that may be worn without significant encumbrance to the user. By coupling the HWD with a head tracker, unlimited field-of-regard may be realized. The results of three ground simulation experiments conducted at NASA Langley Research Center are summarized. The experiments evaluated the efficacy of head-worn display applications of Synthetic Vision and Enhanced Vision technology to improve transport aircraft surface operations. The results of the experiments showed that the fully integrated HWD provided greater pilot performance with respect to staying on the path compared to using paper charts alone. Further, when comparing the HWD with the HUD concept, there were no differences in path performance. In addition, the HWD and HUD concepts were rated via paired-comparisons the same in terms of situation awareness and workload.

Arthur, Jarvis J., III↗

Design and Testing of an Unlimited Field-of-regard Synthetic Vision Head-worn Display for Commercial Aircraft Surface Operations

Experiments and flight tests have shown that a Head-Up Display (HUD) and a head-down, electronic moving map (EMM) can be enhanced with Synthetic Vision for airport surface operations. While great success in ground operations was demonstrated with a HUD, the research noted that two major HUD limitations during ground operations were their monochrome form and limited, fixed field of regard. A potential solution to these limitations found with HUDs may be emerging Head Worn Displays (HWDs). HWDs are small, lightweight full color display devices that may be worn without significant encumbrance to the user. By coupling the HWD with a head tracker, unlimited field-of-regard may be realized for commercial aviation applications. In the proposed paper, the results of two ground simulation experiments conducted at NASA Langley are summarized. The experiments evaluated the efficacy of head-worn display applications of Synthetic Vision and Enhanced Vision technology to enhance transport aircraft surface operations. The two studies tested a combined six display concepts: (1) paper charts with existing cockpit displays, (2) baseline consisting of existing cockpit displays including a Class III electronic flight bag display of the airport surface; (3) an advanced baseline that also included displayed traffic and routing information, (4) a modified version of a HUD and EMM display demonstrated in previous research; (5) an unlimited field-of-regard, full color, head-tracked HWD with a conformal 3-D synthetic vision surface view; and (6) a fully integrated HWD concept. The fully integrated HWD concept is a head-tracked, color, unlimited field-of-regard concept that provides a 3-D conformal synthetic view of the airport surface integrated with advanced taxi route clearance, taxi precision guidance, and data-link capability. The results of the experiments showed that the fully integrated HWD provided greater path performance compared to using paper charts alone. Further, when comparing the HWD with the HUD concept, there were no differences in path performance. In addition, the HWD and HUD concepts were rated via paired-comparisons the same in terms of situational awareness and workload. However, there were over twice as many taxi incursion events with the HUD than the HWD.

Arthur, Jarvis J., III↗