Search NASA⌕ Search

Engineering topics

Harwood, Kelly

Publications and source records attributed to Harwood, Kelly.

Traffic Management Advisor: Iterative Field Development and Assessment at Multiple Sites

Previous studies have demonstrated the necessity of involving users in the development of automation aids, especially for complex domains such as air traffic control (ATC). Traditional development only demanded a single field test to validate a completed system, but a more iterative combination of development and assessment ensures that the technology meets the requirements of its application domain. Exposure across an adequate spectrum of field users is also required during development, and the use of multiple development sites provides an opportunity to consider individual facility cultures as they relate to implementation strategies. The development of the Center/TRACON Automation System (CTAS) Traffic Management Advisor (TMA) at the Denver and Dallas ATC facilities demonstrates successful iterative development and assessment at multiple field sites. The use of field development changes the nature of assessment. As development progresses, periodic assessments are required to validate that system development is progressing along an appropriate track. In the development of the TMA, assessments were performed based on software in the field, and input from traffic managers was analyzed and incorporated into subsequent releases of the TMA, to be reassessed in the field. This has led to a tool with operational suitability and broad user acceptance. Assessment at multiple sites provides a more generalizable perspective that allows the production of a system that is both generic enough to be used at different sites and tailored enough to be of use at any site. In addition to providing a better understanding of specific facility requirements, the use of multiple assessment sites in the development of TMA has provided an opportunity to consider individual facility operations, procedures and cultures as they relate to development and implementation strategies.

Sanford, Beverly D.↗

Evaluation in context: ATC automation in the field

The process for incorporating advanced technologies into complex aviation systems is as important as the final product itself. This paper described a process that is currently being applied to the development and assessment of an advanced ATC automation system, CTAS. The key element of the process is field exposure early in the system development cycle. The process deviates from current established practices of system development -- where field testing is an implementation endpoint -- and has been deemed necessary by the FAA for streamlining development and bringing system functions to a level of stability and usefulness. Methods and approaches for field assessment are borrowed from human factors engineering, cognitive engineering, and usability engineering and are tailored for the constraints of an operational ATC environment. To date, the focus has been on the qualitative assessment of the match between TMA capabilities and the context for their use. Capturing the users' experience with the automation tool and understanding tool use in the context of the operational environment is important, not only for developing a tool that is an effective problem-solving instrument but also for defining meaningful operational requirements. Such requirements form the basis for certifying the safety and efficiency of the system. CTAS is the first U.S. advanced ATC automation system of its scope and complexity to undergo this field development and assessment process. With the rapid advances in aviation technologies and our limited understanding of their impact on system performance, it is time we opened our eyes to new possibilities for developing, validating, and ultimately certifying complex aviation systems.

Harwood, Kelly↗

Denver TMA assessment

This report describes the assessment of the Traffic Management Advisor (TMA) conducted at the Denver Center and TRACON, January 11-February 5, 1993. The assessment addressed the effectiveness of TMA for supporting various traffic management activities. At the Center, traffic management coordinators (TMC's) shadowed traffic operations, using TMA to make metering time and internal release decisions. At the TRACON, TMC's accessed TMA in an advisory mode for different planning activities such as staffing, distributing the traffic load, and changing the airport acceptance rate. These different opportunities for assessing TMA provide insight into TMA as a potential communication aid and planning tool. Findings from this assessment indicate that TMA can be used to support traffic management planning and decisions. TMC's at the center were able to use information provided by TMA to determine metering times as well as internal release times. At the TRACON, TMA supported decisions on airport configuration, airport acceptance rate, load distribution, proactive coordination with the center, and staffing. While findings of TMA use are generally positive, it must be kept in mind that this assessment is a snapshot in time. Not all TMA capabilities were assessed, nor were TMC's fully trained and knowledgeable on all features. Feature use will continue to evolve and strategies emerge as the TMC's gain experience with TMA over a variety of traffic situations and their understanding of TMA capabilities broadens with continued training.

Harwood, Kelly↗

Frames of reference for helicopter electronic maps - The relevance of spatial cognition and componential analysis

Computer-generated map displays for NOE and low-level helicopter flight were formed according to prior research on maps, navigational problem solving, and spatial cognition in large-scale environments. The north-up map emphasized consistency of object location, wheareas, the track-up map emphasized map-terrain congruency. A component analysis indicates that different cognitive components, e.g., orienting and absolute object location, are supported to varying degrees by properties of different frames of reference.

Harwood, Kelly↗

Frame of reference for electronic maps - The relevance of spatial cognition, mental rotation, and componential task analysis

Three experiments are reported that examine the difference between north-up and track-up maps for airborne navigation. The results of the first two experiments, conducted in a basic laboratory setting, identified the cost associated with mental rotation, when a north-up map is used. However, the data suggest that these costs are neither large nor consistent. The third experiment examined a range of tasks in a higher fidelity helicopter flight simulation, and associated the costs of north-up maps with a cognitive component related to orientation, and the costs of track-up maps with a cognitive component related to inconsistent landmark location. Different tasks are associated with different dependence on these components. The results are discussed in terms of their implications for map design, and for cognitive models of navigational processes.

Wickens, Christopher D.↗

Cognitive perspectives on map displays for helicopter flight

Currently accessible technologies are providing entirely new display concepts for enhancing helicopter navigation. Yet the effectiveness of such displays depends on the extent to which they are configured according to principles from research on human performance. Computer generated map displays in the present study were configured according to previous research on maps, navigational problem solving, and spatial cognition in large scale environments. Interest centered on the representation of different spatial relationships that would best support helicopter navigational problem solving. One map display emphasized the global relationships between objects in the environment. The other map showed the pilot's relationship to objects as he traveled through the environment. Twenty skilled pilots used the maps to complete several navigational tasks that occurred within a realistic simulation program tailored for helicopter navigation. Findings indicate that the type of task and mode of flight (low level or Nap of the Earth (NOE)) are important determinants of map display effectiveness.

Harwood, Kelly↗

TASKILLAN - A simulation to predict the validity of multiple resource models of aviation workload

A study to establish the validity of five predictive models of workload in the context of a controlled helicopter mission, TASKILLAN, is presented. Ten subjects performed simulations involving combinations of a low level flight task with three cognitive side tasks pertaining to navigation, spatial awareness, and computation. It is found that the best predictors of subjective workload are relativly simple models that integrate the total demands of task over time.

Wickens, Christopher D.↗

Attention theory and training research

This study used elements of attention theory as a methodological basis to decompose a complex training task in order to improve training efficiency. The complex task was a microcomputer flight simulation where subjects were required to control the stability of their own helicopter while acquiring and engaging enemy helicopers in a threat enviroment. Subjects were divided into whole-task, part-task, and part/open loop adaptive task groups in a transfer of training paradigm. The effect of reducing mental workload at the early stages of learning was examined with respect to the degree that subordinate elements of the complex task could be automated through practice of consistent, learnable stimulus-response relationships. Results revealed trends suggesting the benefit of isolating consistently mapped sub-tasks for part-task training and the presence of a time-sharing skill over and above the skill required for the separate subtasks.

Connelly, James G., Jr.↗