Engineering topics

Cabrall, Christopher

Publications and source records attributed to Cabrall, Christopher.

13 records

NASA NTRS2014

Controller Inhibition of Automated Conflict Resolutions in a Maximum NextGen Condition

With the continued projection of increases in air traffic density, operations in the National Airspace System are expected to exceed human capabilities in the near future. In order to address the bottleneck of human workload capacity, highly automated safety-critical systems are under development to support air traffic controllers. A human-in-the-loop experiment examined controllers transition through four NextGen automation stages: Current-Day, Minimum, Moderate, and Maximum. Maximum NextGen simulated a fully automated environment where the automation was responsible for detecting and resolving conflicts within simulation parameters in high-density airspace. By allocating these tasks to the automation, the controllers task changed. The human moved to primarily a supervisory position- typically only regaining control over separation assurance tasks during conflict situations deferred by the automation. While tasks were allocated a-priori between the controller and automated agent, controllers maintained authority to inhibit the automation from interacting with particular aircraft. Preliminary work is complete, where significant differences were found in inhibition frequency between simulation participants. However, the contexts in which the controllers inhibited the automation, and their reasons for doing so, remain unclear. This analysis attempts to identity factors contributing to human controllers inhibition of the automation in the Maximum NextGen condition.

adaptable automation↗

NASA NTRS2014

Human-Automation Cooperation for Separation Assurance in Future NextGen Environments

A 2012 Human-In-The-Loop air traffic control simulation investigated a gradual paradigm-shift in the allocation of functions between operators and automation. Air traffic controllers staffed five adjacent high-altitude en route sectors, and during the course of a two-week experiment, worked traffic under different function-allocation approaches aligned with four increasingly mature NextGen operational environments. These NextGen time-frames ranged from near current-day operations to nearly fully-automated control, in which the ground systems automation was responsible for detecting conflicts, issuing strategic and tactical resolutions, and alerting the controller to exceptional circumstances. Results indicate that overall performance was best in the most automated NextGen environment. Safe operations were achieved in this environment for twice todays peak airspace capacity, while being rated by the controllers as highly acceptable. However, results show that sector operations were not always safe; separation violations did in fact occur. This paper will describe in detail the simulation conducted, as well discuss important results and their implications.

air traffic control↗

NASA NTRS2014

An Overview of Current Capabilities and Research Activities in the Airspace Operations Laboratory at NASA Ames Research Center

The Airspace Operations Laboratory at NASA Ames conducts research to provide a better understanding of roles, responsibilities, and requirements for human operators and automation in future air traffic management (ATM) systems. The research encompasses developing, evaluating, and integrating operational concepts and technologies for near-, mid-, and far-term air traffic operations. Current research threads include efficient arrival operations, function allocation in separation assurance and efficient airspace and trajectory management. The AOL has developed powerful air traffic simulation capabilities, most notably the Multi Aircraft Control System (MACS) that is used for many air traffic control simulations at NASA and its partners in government, academia and industry. Several additional NASA technologies have been integrated with the AOL's primary simulation capabilities where appropriate. Using this environment, large and small-scale system-level evaluations can be conducted to help make near-term improvements and transition NASA technologies to the FAA, such as the technologies developed under NASA's Air Traffic Management Demonstration-1 (ATD-1). The AOL's rapid prototyping and flexible simulation capabilities have proven a highly effective environment to progress the initiation of trajectory-based operations and support the mid-term implementation of NextGen. Fundamental questions about accuracy requirements have been investigated as well as realworld problems on how to improve operations in some of the most complex airspaces in the US. This includes using advanced trajectory-based operations and prototype tools for coordinating arrivals to converging runways at Newark airport and coordinating departures and arrivals in the San Francisco and the New York metro areas. Looking beyond NextGen, the AOL has started exploring hybrid human/automation control strategies as well as highly autonomous operations in the air traffic control domain. Initial results indicate improved capacity, low operator workload, good situation awareness and acceptability for controllers teaming with autonomous air traffic systems. While much research and development needs to be conducted to make such concepts a reality, these approaches have the potential to truly transform the airspace system towards increased mobility, safe and efficient growth in global operations and enabling many of the new vehicles and operations that are expected over the next decades. This paper describes how the AOL currently contributes to the ongoing air transportation transformation.

simulation↗

NASA NTRS2013

Investigating the Complexity of Transitioning Separation Assurance Tools into NextGen Air Traffic Control

In a study, that introduced ground-based separation assurance automation through a series of envisioned transitional phases of concept maturity, it was found that subjective responses to scales of workload, situation awareness, and acceptability in a post run questionnaire revealed as-predicted results for three of the four study conditions but not for the third, Moderate condition. The trend continued for losses of separation (LOS) where the number of LOS events were far greater than expected in the Moderate condition. To offer an account of why the Moderate condition was perceived to be more difficult to manage than predicted, researchers examined the increase in amount and complexity of traffic, increase in communication load, and increased complexities as a result of the simulation's mix of aircraft equipage. Further analysis compared the tools presented through the phases, finding that controllers took advantage of the informational properties of the tools presented but shied away from using their decision support capabilities. Taking into account similar findings from other studies, it is suggested that the Moderate condition represented the first step into a "shared control" environment, which requires the controller to use the automation as a decision making partner rather than just a provider of information. Viewed in this light, the combination of tools offered in the Moderate condition was reviewed and some tradeoffs that may offset the identified complexities were suggested.

separation assurance↗

NASA NTRS2013

Analysis of Interactive Conflict Resolution Tool Usage in a Mixed Equipage Environment

A human-in-the-loop simulation was conducted that examined separation assurance concepts in varying levels of traffic density with mixtures of aircraft equipage and automation. This paper's analysis focuses on one of the experimental conditions in which traffic levels were approximately fifty percent higher than today, and approximately fifty percent of the traffic within the test area were equipped with data communications (data comm) capabilities. The other fifty percent of the aircraft required control by voice much like today. Within this environment, the air traffic controller participants were provided access to tools and automation designed to support the primary task of separation assurance that are currently unavailable. Two tools were selected for analysis in this paper: 1) a pre-probed altitude fly-out menu that provided instant feedback of conflict probe results for a range of altitudes, and 2) an interactive auto resolver that provided on-demand access to an automation-generated conflict resolution trajectory. Although encouraged, use of the support tools was not required; the participants were free to use the tools as they saw fit, and they were also free to accept, reject, or modify the resolutions offered by the automation. This mode of interaction provided a unique opportunity to examine exactly when and how these tools were used, as well as how acceptable the resolutions were. Results showed that the participants used the pre-probed altitude fly-out menu in 14% of conflict cases and preferred to use it in a strategic timeframe on data comm equipped and level flight aircraft. The interactive auto resolver was also used in a primarily strategic timeframe on 22% of conflicts and that their preference was to use it on conflicts involving data comm equipped aircraft as well. Of the 258 resolutions displayed, 46% were implemented and 54% were not. The auto resolver was rated highly by participants in terms of confidence and preference. Factors such as aircraft equipage, ownership, and location of predicted separation loss appeared to play a role in the decision of controllers to accept or reject the auto resolver's resolutions.

auto resolver↗

NASA NTRS2013

Designing Scenarios for Controller-in-the-Loop Air Traffic Simulations

Well prepared traffic scenarios contribute greatly to the success of controller-in-the-loop simulations. This paper describes each stage in the design process of realistic scenarios based on real-world traffic, to be used in the Airspace Operations Laboratory for simulations within the Air Traffic Management Technology Demonstration 1 effort. The steps from the initial analysis of real-world traffic, to the editing of individual aircraft records in the scenario file, until the final testing of the scenarios before the simulation conduct, are all described. The iterative nature of the design process and the various efforts necessary to reach the required fidelity, as well as the applied design strategies, challenges, and tools used during this process are also discussed.

ATD1↗

NASA NTRS2013

Controller Strategies for Automation Tool Use under Varying Levels of Trajectory Prediction Uncertainty

A human-in-the-loop simulation was conducted to examine the effects of varying levels of trajectory prediction uncertainty on air traffic controller workload and performance, as well as how strategies and the use of decision support tools change in response. This paper focuses on the strategies employed by two controllers from separate teams who worked in parallel but independently under identical conditions (airspace, arrival traffic, tools) with the goal of ensuring schedule conformance and safe separation for a dense arrival flow in en route airspace. Despite differences in strategy and methods, both controllers achieved high levels of schedule conformance and safe separation. Overall, results show that trajectory uncertainties introduced by wind and aircraft performance prediction errors do not affect the controllers' ability to manage traffic. Controller strategies were fairly robust to changes in error, though strategies were affected by the amount of delay to absorb (scheduled time of arrival minus estimated time of arrival). Using the results and observations, this paper proposes an ability to dynamically customize the display of information including delay time based on observed error to better accommodate different strategies and objectives.

Strategy↗

NASA NTRS2013

Pilot and Controller Evaluations of Separation Function Allocation in Air Traffic Management

Two human-in-the-loop simulation experiments were conducted in coordinated fashion to investigate the allocation of separation assurance functions between ground and air and between humans and automation. The experiments modeled a mixed-operations concept in which aircraft receiving ground-based separation services shared the airspace with aircraft providing their own separation service (i.e., self-separation). Ground-based separation was provided by air traffic controllers without automation tools, with tools, or by ground-based automation with controllers in a managing role. Airborne self-separation was provided by airline pilots using self-separation automation enabled by airborne surveillance technology. The two experiments, one pilot-focused and the other controller-focused, addressed selected key issues of mixed operations, assuming the starting point of current-day operations and modeling an emergence of NextGen technologies and procedures. In the controller-focused experiment, the impact of mixed operations on controller performance was assessed at four stages of NextGen implementation. In the pilot-focused experiment, the limits to which pilots with automation tools could take full responsibility for separation from ground-controlled aircraft were tested. Results indicate that the presence of self-separating aircraft had little impact on the controllers' ability to provide separation services for ground-controlled aircraft. Overall performance was best in the most automated environment in which all aircraft were data communications equipped, ground-based separation was highly automated, and self-separating aircraft had access to trajectory intent information for all aircraft. In this environment, safe, efficient, and highly acceptable operations could be achieved for twice today's peak airspace throughput. In less automated environments, reduced trajectory intent exchange and manual air traffic control limited the safely achievable airspace throughput and negatively impacted the maneuver efficiency of self-separating aircraft through high-density airspace. In a test of scripted conflicts with ground-managed aircraft, flight crews of self-separating aircraft prevented separation loss in all conflicts with detection time greater than one minute. In debrief, pilots indicated a preference for at least five minute's alerting notice and trajectory intent information on all aircraft. When intent information on ground-managed aircraft was available, self-separating aircraft benefited from fewer conflict alerts and fewer required deviations from trajectory-based operations.

Wing, David↗

NASA NTRS2012

Investigating the Impact of Off-Nominal Events on High-Density "Green" Arrivals

Trajectory-based controller tools developed to support a schedule-based terminal-area air traffic management (ATM) concept have been shown effective for enabling green arrivals along Area Navigation (RNAV) routes in moderately high-density traffic conditions. A recent human-in-the-loop simulation investigated the robustness of the concept and tools to off-nominal events events that lead to situations in which runway arrival schedules require adjustments and controllers can no longer use speed control alone to impose the necessary delays. Study participants included a terminal-area Traffic Management Supervisor responsible for adjusting the schedules. Sector-controller participants could issue alternate RNAV transition routes to absorb large delays. The study also included real-time winds/wind-forecast changes. The results indicate that arrival spacing accuracy, schedule conformance, and tool usage and usefulness are similar to that observed in simulations of nominal operations. However, the time and effort required to recover from an off-nominal event is highly context-sensitive, and impacted by the required schedule adjustments and control methods available for managing the evolving situation. The research suggests ways to bolster the off-nominal recovery process, and highlights challenges related to using human-in-the-loop simulation to investigate the safety and robustness of advanced ATM concepts.

Callatine, Todd J.↗

NASA NTRS2012

Initial Investigations of Controller Tools and Procedures for Schedule-Based Arrival Operations with Mixed Flight-Deck Interval Management Equipage

NASA's Air Traffic Management Demonstration-1 (ATD-1) is a multi-year effort to demonstrate high-throughput, fuel-efficient arrivals at a major U.S. airport using NASA-developed scheduling automation, controller decision-support tools, and ADS-B-enabled Flight-Deck Interval Management (FIM) avionics. First-year accomplishments include the development of a concept of operations for managing scheduled arrivals flying Optimized Profile Descents with equipped aircraft conducting FIM operations, and the integration of laboratory prototypes of the core ATD-1 technologies. Following each integration phase, a human-in-the-loop simulation was conducted to evaluate and refine controller tools, procedures, and clearance phraseology. From a ground-side perspective, the results indicate the concept is viable and the operations are safe and acceptable. Additional training is required for smooth operations that yield notable benefits, particularly in the areas of FIM operations and clearance phraseology.

Callantine, Todd J.↗

NASA NTRS2012

Air Traffic Controllers' Control Strategies in the Terminal Area Under Off-Nominal Conditions

A human-in-the-loop simulation investigated the robustness of a schedule-based terminal-area air traffic management concept, and its supporting controller tools, to off-nominal events - events that led to situations in which runway arrival schedules required adjustments and controllers could no longer use speed control alone to impose the necessary delays. The main research question was exploratory: to assess whether controllers could safely resolve and control the traffic during off-nominal events. A focus was the role of the supervisor - how he managed the schedules, how he assisted the controllers, what strategies he used, and which combinations of tools he used. Observations and questionnaire responses revealed supervisor strategies for resolving events followed a similar pattern: a standard approach specific to each type of event often resolved to a smooth conclusion. However, due to the range of factors influencing the event (e.g., environmental conditions, aircraft density on the schedule, etc.), sometimes the plan required revision and actions had a wide-ranging effect.

Martin, Lynne↗

NASA NTRS2011

Allocation of Functions in a Far-Term Air Traffic Control Environment

A human-in-the-loop exploration of a ground-based automated separation assurance concept was conducted that involved the allocation of certain functions between humans and automation. This exploration included operations that were sustained for prolonged periods of time with high levels of traffic in the presence of convective weather and scheduling constraints. An investigation into the acceptability of the defined roles and performance of tasks was conducted where it was found that the participants rated the concept and allocation of functions with a high level of acceptability. However, issues were encountered with the automation related to the detection of and response to tactical conflicts. Lower ratings were given on account of these concerns, and it was found that a key contributor to the underlying problems was transitioning aircraft and the uncertainty of their trajectories. Stemming from those results, participants responded that they would rather have direct control over aircraft transitions as well as more control over the tactical conflict resolution automation. In contrast, participants responded that they would rather have the automation place aircraft back on trajectory, and perform weather avoidance and scheduling tasks.

Homola, Jeffrey↗

NASA NTRS2010

Functional Allocation for Ground-Based Automated Separation Assurance in NextGen

As part of an ongoing research effort into functional allocation in a NextGen environment, a controller-in-the-loop study on ground-based automated separation assurance was conducted at NASA Ames' Airspace Operations Laboratory in February 2010. Participants included six FAA front line managers, who are currently certified professional controllers and four recently retired controllers. Traffic scenarios were 15 and 30 minutes long where controllers interacted with advanced technologies for ground-based separation assurance, weather avoidance, and arrival metering. The automation managed the separation by resolving conflicts automatically and involved controllers only by exception, e.g., when the automated resolution would have been outside preset limits. Results from data analyses show that workload was low despite high levels of traffic, Operational Errors did occur but were closely tied to local complexity, and safety acceptability ratings varied with traffic levels. Positive feedback was elicited for the overall concept with discussion on the proper allocation of functions and trust in automation.

Prevot, Thomas↗