Search NASASearch

Engineering topics

Chamberlain, James P.

Publications and source records attributed to Chamberlain, James P..

UAS Air Traffic Controller Acceptability Study-2: Effects of Communications Delays and Winds in Simulation

This study evaluated the effects of Communications Delays and Winds on Air Traffic Controller ratings of acceptability of horizontal miss distances (HMDs) for encounters between UAS and manned aircraft in a simulation of the Dallas-Ft. Worth East-side airspace. Fourteen encounters per hour were staged in the presence of moderate background traffic. Seven recently retired controllers with experience at DFW served as subjects. Guidance provided to the UAS pilots for maintaining a given HMD was provided by information from self-separation algorithms displayed on the Multi-Aircraft Simulation System. Winds tested did not affect the acceptability ratings. Communications delays tested included 0, 400, 1200, and 1800 msec. For longer communications delays, there were changes in strategy and communications flow that were observed and reported by the controllers. The aim of this work is to provide useful information for guiding future rules and regulations applicable to flying UAS in the NAS.

Comstock, James R., Jr.

Unmanned Aircraft Systems Human-in-the-Loop Controller and Pilot Acceptability Study: Collision Avoidance, Self-Separation, and Alerting Times (CASSAT)

The Federal Aviation Administration (FAA) has been mandated by the Congressional funding bill of 2012 to open the National Airspace System (NAS) to Unmanned Aircraft Systems (UAS). With the growing use of unmanned systems, NASA has established a multi-center "UAS Integration in the NAS" Project, in collaboration with the FAA and industry, and is guiding its research efforts to look at and examine crucial safety concerns regarding the integration of UAS into the NAS. Key research efforts are addressing requirements for detect-and-avoid (DAA), self-separation (SS), and collision avoidance (CA) technologies. In one of a series of human-in-the-loop experiments, NASA Langley Research Center set up a study known as Collision Avoidance, Self-Separation, and Alerting Times (CASSAT). The first phase assessed active air traffic controller interactions with DAA systems and the second phase examined reactions to the DAA system and displays by UAS Pilots at a simulated ground control station (GCS). Analyses of the test results from Phase I and Phase II are presented in this paper. Results from the CASSAT study and previous human-in-the-loop experiments will play a crucial role in the FAA's establishment of rules, regulations, and procedures to safely, efficiently, and effectively integrate UAS into the NAS.

Comstock, James R., Jr.

UAS Air Traffic Controller Acceptability Study: Evaluating Detect and Avoid Technology and Communication Delays in Simulation - 2

This study evaluated the effects of communications delays and winds on air traffic controller ratings of acceptability of horizontal miss distances (HMDs) for encounters between Unmanned Aircraft Systems (UAS) and manned aircraft in a simulation of the Dallas-Ft. Worth (DFW) airspace. Fourteen encounters per hour were staged in the presence of moderate background traffic. Seven recently retired controllers with experience at DFW served as subjects. Guidance provided to the UAS pilots for maintaining a given HMD was provided by information from Detect and Avoid (DAA) self-separation algorithms (Stratway+) displayed on the Multi-Aircraft Control System. This guidance consisted of amber "bands" on the heading scale of the UAS navigation display indicating headings that would result in a loss of well clear between the UAS and nearby traffic. Winds tested were successfully handled by the DAA algorithms and did not affect the controller acceptability ratings of the HMDs. Voice communications delays for the UAS were also tested and included one-way delay times of 0, 400, 1200, and 1800 msec. For longer communications delays, there were changes in strategy and communications flow that were observed and reported by the controllers. The aim of this work is to provide useful information for guiding future rules and regulations applicable to flying UAS in the NAS. Information from this study will also be of value to the Radio Technical Commission for Aeronautics (RTCA) Special Committee 228 - Minimum Performance Standards for UAS.

Comstock, James R., Jr.

UAS in the NAS Air Traffic Controller Acceptability Study-1: The Effects of Horizontal Miss Distances on Simulated UAS and Manned Aircraft Encounters

This study examined air traffic controller acceptability ratings based on the effects of differing horizontal miss distances (HMDs) for encounters between UAS and manned aircraft. In a simulation of the Dallas/Fort Worth (DFW) East-side airspace, the CAS-1 experiment at NASA Langley Research Center enlisted fourteen recently retired DFW air traffic controllers to rate well-clear volumes based on differing HMDs that ranged from 0.5 NM to 3.0 NM. The controllers were tasked with rating these HMDs from "too small" to "too excessive" on a defined, 1-5, scale and whether these distances caused any disruptions to the controller and/or to the surrounding traffic flow. Results of the study indicated a clear favoring towards a particular HMD range. Controller workload was also measured. Data from this experiment and subsequent experiments will play a crucial role in the FAA's establishment of rules, regulations, and procedures to safely and efficiently integrate UAS into the NAS.

Ghatas, Rania W.

NASA Controller Acceptability Study 1(CAS-1) Experiment Description and Initial Observations

This paper describes the Controller Acceptability Study 1 (CAS-1) experiment that was conducted by NASA Langley Research Center personnel from January through March 2014 and presents partial CAS-1 results. CAS-1 employed 14 air traffic controller volunteers as research subjects to assess the viability of simulated future unmanned aircraft systems (UAS) operating alongside manned aircraft in moderate-density, moderate-complexity Class E airspace. These simulated UAS were equipped with a prototype pilot-in-the-loop (PITL) Detect and Avoid (DAA) system, specifically the Self-Separation (SS) function of such a system based on Stratway+ software to replace the see-and-avoid capabilities of manned aircraft pilots. A quantitative CAS-1 objective was to determine horizontal miss distance (HMD) values for SS encounters that were most acceptable to air traffic controllers, specifically HMD values that were assessed as neither unsafely small nor disruptively large. HMD values between 0.5 and 3.0 nautical miles (nmi) were assessed for a wide array of encounter geometries between UAS and manned aircraft. The paper includes brief introductory material about DAA systems and their SS functions, followed by descriptions of the CAS-1 simulation environment, prototype PITL SS capability, and experiment design, and concludes with presentation and discussion of partial CAS-1 data and results.

Chamberlain, James P.

Analysis of Well-Clear Boundary Models for the Integration of UAS in the NAS

The FAA-sponsored Sense and Avoid Workshop for Unmanned Aircraft Systems (UAS) defnes the concept of sense and avoid for remote pilots as "the capability of a UAS to remain well clear from and avoid collisions with other airborne traffic." Hence, a rigorous definition of well clear is fundamental to any separation assurance concept for the integration of UAS into civil airspace. This paper presents a family of well-clear boundary models based on the TCAS II Resolution Advisory logic. Analytical techniques are used to study the properties and relationships satisfied by the models. Some of these properties are numerically quantifed using statistical methods.

Upchurch, Jason M.

A Well-Clear Volume Based on Time to Entry Point

A well-clear volume is a key component of NASA's Separation Assurance concept for the integration of UAS in the NAS. This paper proposes a mathematical definition of the well-clear volume that uses, in addition to distance thresholds, a time threshold based on time to entry point (TEP). The mathematical model that results from this definition is more conservative than other candidate definitions of the wellclear volume that are based on range over closure rate and time to closest point of approach.

Narkawicz, Anthony J.

Concepts of Integration for UAS Operations in the NAS

One of the major challenges facing the integration of Unmanned Aircraft Systems (UAS) in the National Airspace System (NAS) is the lack of an onboard pilot that can comply with the legal requirement identified in the US Code of Federal Regulations (CFR) that pilots see and avoid other aircraft. UAS will be expected to demonstrate the means to perform the function of see and avoid while preserving the safety level of the airspace and the efficiency of the air traffic system. This paper introduces a Sense and Avoid (SAA) concept for integration of UAS into the NAS that is currently being developed by the National Aeronautics and Space Administration (NASA) and identifies areas that require additional experimental evaluation to further inform various elements of the concept. The concept design rests on interoperability principles that take into account both the Air Traffic Control (ATC) environment as well as existing systems such as the Traffic Alert and Collision Avoidance System (TCAS). Specifically, the concept addresses the determination of well clear values that are large enough to avoid issuance of TCAS corrective Resolution Advisories, undue concern by pilots of proximate aircraft and issuance of controller traffic alerts. The concept also addresses appropriate declaration times for projected losses of well clear conditions and maneuvers to regain well clear separation.

Consiglio, Maria C.

Integration of Weather Avoidance and Traffic Separation

This paper describes a dynamic convective weather avoidance concept that compensates for weather motion uncertainties; the integration of this weather avoidance concept into a prototype 4-D trajectory-based Airborne Separation Assurance System (ASAS) application; and test results from a batch (non-piloted) simulation of the integrated application with high traffic densities and a dynamic convective weather model. The weather model can simulate a number of pseudo-random hazardous weather patterns, such as slow- or fast-moving cells and opening or closing weather gaps, and also allows for modeling of onboard weather radar limitations in range and azimuth. The weather avoidance concept employs nested "core" and "avoid" polygons around convective weather cells, and the simulations assess the effectiveness of various avoid polygon sizes in the presence of different weather patterns, using traffic scenarios representing approximately two times the current traffic density in en-route airspace. Results from the simulation experiment show that the weather avoidance concept is effective over a wide range of weather patterns and cell speeds. Avoid polygons that are only 2-3 miles larger than their core polygons are sufficient to account for weather uncertainties in almost all cases, and traffic separation performance does not appear to degrade with the addition of weather polygon avoidance. Additional "lessons learned" from the batch simulation study are discussed in the paper, along with insights for improving the weather avoidance concept. Introduction

Consiglio, Maria C.

Functional Allocation with Airborne Self-Separation Evaluated in a Piloted Simulation

A human-in-the-loop simulation experiment was designed and conducted to evaluate an airborne self-separation concept. The activity supports the National Aeronautics and Space Administration s (NASA) research focus on function allocation for separation assurance. The objectives of the experiment were twofold: (1) use experiment design features in common with a companion study of ground-based automated separation assurance to promote comparability, and (2) assess agility of self-separation operations in managing trajectory-changing events in high traffic density, en-route operations with arrival time constraints. This paper describes the experiment and presents initial results associated with subjective workload ratings and group discussion feedback obtained from the experiment s commercial transport pilot participants.

Wing, David J.

Comparison of Ground-Based and Airborne Function Allocation Concepts for NextGen Using Human-In-The-Loop Simulations

Investigation of function allocation for the Next Generation Air Transportation System is being conducted by the National Aeronautics and Space Administration (NASA). To provide insight on comparability of different function allocations for separation assurance, two human-in-the-loop simulation experiments were conducted on homogeneous airborne and ground-based approaches to four-dimensional trajectory-based operations, one referred to as ground-based automated separation assurance (groundbased) and the other as airborne trajectory management with self-separation (airborne). In the coordinated simulations at NASA s Ames and Langley Research Centers, controllers for the ground-based concept at Ames and pilots for the airborne concept at Langley managed the same traffic scenarios using the two different concepts. The common scenarios represented a significant increase in airspace demand over current operations. Using common independent variables, the simulations varied traffic density, scheduling constraints, and the timing of trajectory change events. Common metrics were collected to enable a comparison of relevant results. Where comparisons were possible, no substantial differences in performance or operator acceptability were observed. Mean schedule conformance and flight path deviation were considered adequate for both approaches. Conflict detection warning times and resolution times were mostly adequate, but certain conflict situations were detected too late to be resolved in a timely manner. This led to some situations in which safety was compromised and/or workload was rated as being unacceptable in both experiments. Operators acknowledged these issues in their responses and ratings but gave generally positive assessments of the respective concept and operations they experienced. Future studies will evaluate technical improvements and procedural enhancements to achieve the required level of safety and acceptability and will investigate the integration of airborne and ground-based capabilities within the same airspace to leverage the benefits of each concept.

Wing, David J.

Comparison of Airborne and Ground-Based Function Allocation Concepts for NextGen Using Human-In-The-Loop Simulations

This paper presents an air/ground functional allocation experiment conducted by the National Aeronautics and Space Administration (NASA) using two human-in-the-Loop simulations to compare airborne and ground-based approaches to NextGen separation assurance. The approaches under investigation are two trajectory-based four-dimensional (4D) concepts; one referred to as "airborne trajectory management with self-separation" (airborne) the other as "ground-based automated separation assurance" (ground-based). In coordinated simulations at NASA's Ames and Langley Research Centers, the primary operational participants -controllers for the ground-based concept and pilots for the airborne concept - manage the same traffic scenario using the two different 4D concepts. The common scenarios are anchored in traffic problems that require a significant increase in airspace capacity - on average, double, and in some local areas, close to 250% over current day levels - in order to enable aircraft to safely and efficiently traverse the test airspace. The simulations vary common independent variables such as traffic density, sequencing and scheduling constraints, and timing of trajectory change events. A set of common metrics is collected to enable a direct comparison of relevant results. The simulations will be conducted in spring 2010. If accepted, this paper will be the first publication of the experimental approach and early results. An initial comparison of safety and efficiency as well as operator acceptability under the two concepts is expected.

Wing, David J.

Pilot In-Trail Procedure Validation Simulation Study

A Human-In-The-Loop experiment was conducted at the National Aeronautics and Space Administration (NASA) Langley Research Center (LaRC) to investigate the viability of the In-Trail Procedure (ITP) concept from a flight crew perspective, by placing participating airline pilots in a simulated oceanic flight environment. The test subject pilots used new onboard avionics equipment that provided improved information about nearby traffic and enabled them, when specific criteria were met, to request an ITP flight level change referencing one or two nearby aircraft that might otherwise block the flight level change. The subject pilots subjective assessments of ITP validity and acceptability were measured via questionnaires and discussions, and their objective performance in appropriately selecting, requesting, and performing ITP flight level changes was evaluated for each simulated flight scenario. Objective performance and subjective workload assessment data from the experiment s test conditions were analyzed for statistical and operational significance and are reported in the paper. Based on these results, suggestions are made to further improve the ITP.

Bussink, Frank J. L.

Enhanced Oceanic Operations Human-In-The-Loop In-Trail Procedure Validation Simulation Study

The Enhanced Oceanic Operations Human-In-The-Loop In-Trail Procedure (ITP) Validation Simulation Study investigated the viability of an ITP designed to enable oceanic flight level changes that would not otherwise be possible. Twelve commercial airline pilots with current oceanic experience flew a series of simulated scenarios involving either standard or ITP flight level change maneuvers and provided subjective workload ratings, assessments of ITP validity and acceptability, and objective performance measures associated with the appropriate selection, request, and execution of ITP flight level change maneuvers. In the majority of scenarios, subject pilots correctly assessed the traffic situation, selected an appropriate response (i.e., either a standard flight level change request, an ITP request, or no request), and executed their selected flight level change procedure, if any, without error. Workload ratings for ITP maneuvers were acceptable and not substantially higher than for standard flight level change maneuvers, and, for the majority of scenarios and subject pilots, subjective acceptability ratings and comments for ITP were generally high and positive. Qualitatively, the ITP was found to be valid and acceptable. However, the error rates for ITP maneuvers were higher than for standard flight level changes, and these errors may have design implications for both the ITP and the study's prototype traffic display. These errors and their implications are discussed.

Murdoch, Jennifer L.

Decision-Making in Flight with Different Convective Weather Information Sources: Preliminary Results

This paper reports preliminary and partial results of a flight experiment to address how General Aviation (GA) pilots use weather cues to make flight decisions. This research presents pilots with weather cue conditions typically available to GA pilots in visual meteorological conditions (VMC) and instrument meteorological conditions (IMC) today, as well as in IMC with a Graphical Weather Information System (GWIS). These preliminary data indicate that both VMC and GWIS-augmented IMC conditions result in better confidence, information sufficiency and perceived performance than the current IMC condition. For all these measures, the VMC and GWIS-augmented conditions seemed to provide similar pilot support. These preliminary results are interpreted for their implications on GWIS display design, training, and operational use guidelines. Final experimental results will compare these subjective data with objective data of situation awareness and decision quality.

Latorella, Kara A.

Graphical Weather Information System Evaluation: Usability, Perceived Utility, and Preferences from General Aviation Pilots

Weather is a significant factor in General Aviation (GA) accidents and fatality rates. Graphical Weather Information Systems (GWISs) for the flight deck are appropriate technologies for mitigating the difficulties GA pilots have with current aviation weather information sources. This paper describes usability evaluations of a prototype GWIS by 12 GA pilots after using the system in flights towards convective weather. We provide design guidance for GWISs and discuss further research required to support weather situation awareness and in-flight decision making for GA pilots.

Latorella, Kara A.

Tactical Versus Strategic Behavior: General Aviation Piloting in Convective Weather Scenarios

We commonly describe environments and behavioral responses to environmental conditions as 'tactical' and 'strategic.' However theoretical research defining relevant environmental characteristics is rare, as are empirical investigations that would inform such theory. This paper discusses General Aviation (GA) pilots' descriptions of tactical/strategic conditions with respect to weather flying, and evaluates their ratings along a tactical/strategic scale in response to real convective weather scenarios experienced during a flight experiment with different weather information cues. Perceived risk was significantly associated with ratings for all experimental conditions. In addition, environmental characteristics were found to be predictive of ratings for Traditional IMC (instrument meteorological conditions), i.e., aural weather information only, and Traditional VMC (visual meteorological conditions), i.e., aural information and an external view. The paper also presents subjects' comments regarding use of Graphical Weather Information Systems (GWISs) to support tactical and strategic weather flying decisions and concludes with implications for the design and use of GWISs.

Latorella, Kara A.

Convection Weather Detection by General Aviation Pilots with Convectional and Data-Linked Graphical Weather Information Sources

This study compares how well general aviation (GA) pilots detect convective weather in flight with different weather information sources. A flight test was conducted in which GA pilot test subjects were given different in-flight weather information cues and flown toward convective weather of moderate or greater intensity. The test subjects were not actually flying the aircraft, but were given pilot tasks representative of the workload and position awareness requirements of the en route portion of a cross country GA flight. On each flight, one test subject received weather cues typical of a flight in visual meteorological conditions (VMC), another received cues typical of flight in instrument meteorological conditions (IMC), and a third received cues typical of flight in IMC but augmented with a graphical weather information system (GWIS). The GWIS provided the subject with near real time data-linked weather products, including a weather radar mosaic superimposed on a moving map with a symbol depicting the aircraft's present position and direction of track. At several points during each flight, the test subjects completed short questionnaires which included items addressing their weather situation awareness and flight decisions. In particular, test subjects were asked to identify the location of the nearest convective cells. After the point of nearest approach to convective weather, the test subjects were asked to draw the location of convective weather on an aeronautical chart, along with the aircraft's present position. This paper reports preliminary results on how accurately test subjects provided with these different weather sources could identify the nearest cell of moderate or greater intensity along their route of flight. Additional flight tests are currently being conducted to complete the data set.

Chamberlain, James P.