Search NASA⌕ Search

Engineering topics

Jillian Keeler

Publications and source records attributed to Jillian Keeler.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2024

Evaluation of Initial and Midterm Air Traffic Procedures for Urban Air Mobility Operations

This paper describes a follow-on joint human-in-the loop (HITL) simulation effort by NASA and Joby Aviation that builds on the results of these previous studies. It extends that work by comparing the LOA condition for Initial UAM operations to Midterm operations that includes corridor airspace structures and some other changes to the operating environment. This is the first reported air traffic controller-in-the-loop evaluation of the corridor condition in a high-fidelity simulation environment. The following sections describe the routes, scenarios, and operating conditions along with metrics used to evaluate feasibility from the air traffic controllers’ perspectives. The results section presents the traffic levels that were feasible in each condition and concludes with recommendations for extending the scope and applicability of evaluations like this one in the future.

Savvy Verma↗
NASA NTRS2022

Effects of Unmanned Aircraft Voice Communication Delay on En Route Air Traffic Management Operations

The present study investigated the effects of remotely piloted unmanned aircraft (UA) voice communication delay on air traffic management operations with different background sector traffic-volume levels. Three one-way UA voice delay lengths of 400, 900, and 2,000 milliseconds (ms) were tested, representing the currently estimated transmission delays for terrestrial, satellite communication (SATCOM), and long SATCOM Command and Control Link System, respectively. All delay values exceeded 390 ms, the FAA’s current requirement for the maximum communication latency in the National Airspace System. Eight retired en route air traffic controllers (ATCs) and eight remote pilots (RPs) participated in a human-in-the-loop simulation study, where a simulated UA flight transitioned through an Oakland en route low-altitude sector to a local non-towered airport. The results showed that, when the 2,000-ms voice delay was present, radio transmission step-ons and detect-and-avoid (DAA) alert level elevations increased. In addition, ATC workload, ATC acceptability for the UA, and RP acceptability for the DAA were negatively affected only when the UA had a 2,000-ms voice delay under the high traffic-volume condition, but not in the other conditions.

remotely piloted unmanned aircraft, voice delay, s↗
NASA NTRS2021

Bowtie Analysis of the Effects of Unmanned Aircraft on Air Traffic Control

Within the aviation domain, there is a growing industry demand to develop and integrate remotely piloted operations into the National Airspace System. However, it is not yet well understood how the integration of unmanned aircraft with impact air traffic control, and specifically, the air traffic controllers who are at the sharp end of this safety critical system. This research presented in this paper aimed to begin to address this gap in understanding by identifying and exploring potential hazards associated with introducing Unmanned Aircraft into the national airspace system, and identify possible mitigations to reduce identified risks. A bowtie risk analysis methodology was used to identify and analyze hazards. A focus-group format discussion was conducted with nine subject matter experts as participants. Findings identified five areas of potential risk, each associated with multiple hazards. Mitigations for each hazard are reported. Findings have essential implications for the safe and efficient integration of unmanned aircraft into the national airspace.

unmanned aerial vehicles↗
NASA NTRS2020

A Human-in-theLoop Evaluation of ACAS Xu

As part of the Phase 2 UAS DAA MOPS, a Class 3 DAA system has been under development with the potential to resolve many of the limitations of Class 1 and 2 systems. A Class 3 system would combine the DAA and CA functions into a single, unified system, and would also extend the CA capabilities relative to TCAS II. Class 3 is enabled by the Airborne Collision Avoidance System (ACAS) XU, a next generation CA system developed specifically for UAS operations. Unlike Class 2 systems, ACAS XU provides CA protection against both cooperative and non-cooperative traffic. Class 3 systems also expand the CA logic to allow horizontal RAs in addition to vertical RAs. The purpose of the current study was to evaluate ACAS XU in a real-time, HITL simulation. The latest version of ACAS XU was implemented and pilots were tasked with responding to scripted traffic conflicts over the course of four experimental trials. Variables included the location of the ACAS XU guidance information (standalone vs. integrated) and traffic conflict type (DAA or CA threat). Sixteen active UAS pilots participated in the study, with ATC and ‘pseudo’ pilots acting as airspace confederates. Results showed that pilots were able to maintain DWC with ACAS XU at a rate comparable to previous research (~5%). Compliance rates to initial RAs were high (~90%) but dropped significantly when the target heading value issued during horizontal RAs were updated over the course of an encounter (30-70%). The implications of these findings on the display, alerting, and guidance requirements for Class 3 systems will be discussed.

unmanned aircraft systems↗
NASA NTRS2020

UAS Pilot Performance Comparisons with Different Low Size, Weight and Power Sensor Ranges

The present study evaluated the performance of UAS pilots under four simulated low size, weight, and power (SwaP) sensor ranges: 1.5nmi, 2.0nmi, 2.5nmi, and 3.0nmi. Nine active-duty UAS pilots responded to scripted DAA conflicts against non-cooperative intruders while flying a simulated RQ-7 Shadow at varied speeds along a pre-filed flight path in Class E airspace. Findings revealed a linear effect of sensor range on alerting time and separation performance, with nearly every DAA well clear (DWC) violation and all Near Mid-Air Collision (NMAC) events occurring below 2.5nmi. Response time differences at these reduced ranges were negligible due to the high frequency of warning-level alerts that require an immediate response. Since caution alert duration was truncated to some degree by each tested declaration range, pilots were often unable to coordinate their avoidance maneuvers with ATC prior to their uploads. Nonetheless, the 2.5nmi range allowed minimum alerting times that were sufficient for acceptable pilot performance. These findings will inform DAA system requirements for UAS with alternative surveillance equipment and aircraft performance capabilities. Implications on DAA display and sensor requirements are discussed.

unmanned aircraft systems↗
NASA NTRSDate not supplied

Display and Automation Considerations for the Airborne Collision Avoidance System Xu

In this presentation we examine several display and automation considerations of a collision avoidance system that is currently under development: the Airborne Collision Avoidance System (ACAS) Xu. This study builds on previous work conducted as part of NASA’s Unmanned Aircraft Systems (UAS) Integration into the National Airspace System (NAS) project. ACAS Xu represents the next-generation successor to the Traffic Alert and Collision Avoidance System (TCAS II), wherein the Xu variant is intended for UAS applications. Whereas TCAS II exclusively issues RAs in the vertical dimension, a major distinction between ACAS Xu and previous collision avoidance (CA) systems is the introduction of horizontal and “blended” RAs (i.e., RAs with both horizontal and vertical components). This present work was conducted as an engineering analysis involving two parts. In Part 1, a two-by-two, within-subjects study was performed that manipulated how RAs were presented to a pilot situated at a UAS ground control station. Five participants experienced four experimental trials in which text and aural alerting characteristics were manipulated. In Part 2, another five participants experienced four trials in which the levels of automation were manipulated with regard to the CA and return-to-course (RTC) tasks. The results for Part 1 found no effect of display or alerting configuration on pilot performance. However, it was discovered that pilot response time to RAs greatly depended on the RA type. In particular, pilots were quicker to respond to vertical RAs (M = 4.52 seconds) than horizontal (M = 7.42 seconds) and blended (M = 9.68 seconds) RAs in which both dimensions were issued simultaneously. For Part 2 of the study, pilots found both auto-CA and auto-RTC functions equally useful. Most pilots were comfortable with the automation, however responses were mixed. Three of five participants indicated high levels of comfort with the auto-CA function, while two rated their comfort as low. Pilots’ comfort for the auto-RTC functionality was slightly higher: four out of five pilots gave high ratings, while one pilot gave a low rating. Overall, pilots ordinally ranked their preference for automated functions as auto-CA together with auto-RTC (when an aural alert announces a change between CA and RTC states), auto-CA, and auto-CA and RTC (without the aural state-change announcement). Recommendations for improving the display of automation are also discussed.

collision avoidance↗
NASA NTRSDate not supplied

UAS Pilot Performance Comparisons with Different Low Size, Weight and Power Sensor Ranges

The present study evaluated the performance of UAS pilots under four simulated low size, weight, and power (SwaP) sensor ranges: 1.5nmi, 2.0nmi, 2.5nmi, and 3.0nmi. Nine active-duty UAS pilots responded to scripted DAA conflicts against non-cooperative intruders while flying a simulated RQ-7 Shadow at varied speeds along a pre-filed flight path in Class E airspace. Findings revealed a linear effect of sensor range on alerting time and separation performance, with nearly every DAA well clear (DWC) violation and all Near Mid-Air Collision (NMAC) events occurring below 2.5nmi. Response time differences at these reduced ranges were negligible due to the high frequency of warning-level alerts that require an immediate response. Since caution alert duration was truncated to some degree by each tested declaration range, pilots were often unable to coordinate their avoidance maneuvers with ATC prior to their uploads. Nonetheless, the 2.5nmi range allowed minimum alerting times that were sufficient for acceptable pilot performance. The study findings will inform DAA system requirements for UAS with alternative surveillance equipment and aircraft performance capabilities. Implications on DAA display and sensor requirements are discussed.

unmanned aircraft systems↗
NASA NTRSDate not supplied

A Human-in-the-Loop Evaluation of ACAS Xu

As part of the Phase 2 UAS DAA MOPS, a Class 3 DAA system has been under development with the potential to resolve many of the limitations of Class 1 and 2 systems. A Class 3 system would combine the DAA and CA functions into a single, unified system, and would also extend the CA capabilities relative to TCAS II. Class 3 is enabled by the Airborne Collision Avoidance System (ACAS) XU, a next generation CA system developed specifically for UAS operations. Unlike Class 2 systems, ACAS XU provides CA protection against both cooperative and non-cooperative traffic. Class 3 systems also expand the CA logic to allow horizontal RAs in addition to vertical RAs. The purpose of the current study was to evaluate ACAS XU in a real-time, HITL simulation. The latest version of ACAS XU was implemented and pilots were tasked with responding to scripted traffic conflicts over the course of four experimental trials. Variables included the location of the ACAS XU guidance information (standalone vs. integrated) and traffic conflict type (DAA or CA threat). Sixteen active UAS pilots participated in the study, with ATC and ‘pseudo’ pilots acting as airspace confederates. Results showed that pilots were able to maintain DWC with ACAS XU at a rate comparable to previous research (~5%). Compliance rates to initial RAs were high (~90%) but dropped significantly when the target heading value issued during horizontal RAs were updated over the course of an encounter (30-70%). The implications of these findings on the display, alerting, and guidance requirements for Class 3 systems will be discussed.

unmanned aircraft systems↗
NASA NTRSDate not supplied

A Human-in-the-Loop Evaluation of ACAS Xu

As part of the Phase 2 UAS DAA MOPS, a Class 3 DAA system has been under development with the potential to resolve many of the limitations of Class 1 and 2 systems. A Class 3 system would combine the DAA and CA functions into a single, unified system, and would also extend the CA capabilities relative to TCAS II. Class 3 is enabled by the Airborne Collision Avoidance System (ACAS) XU, a next generation CA system developed specifically for UAS operations. Unlike Class 2 systems, ACAS XU provides CA protection against both cooperative and non-cooperative traffic. Class 3 systems also expand the CA logic to allow horizontal RAs in addition to vertical RAs. The purpose of the current study was to evaluate ACAS XU in a real-time, HITL simulation. The latest version of ACAS XU was implemented and pilots were tasked with responding to scripted traffic conflicts over the course of four experimental trials. Variables included the location of the ACAS XU guidance information (standalone vs. integrated) and traffic conflict type (DAA or CA threat). Sixteen active UAS pilots participated in the study, with ATC and ‘pseudo’ pilots acting as airspace confederates. Results showed that pilots were able to maintain DWC with ACAS XU at a rate comparable to previous research (~5%). Compliance rates to initial RAs were high (~90%) but dropped significantly when the target heading value issued during horizontal RAs were updated over the course of an encounter (30-70%). The implications of these findings on the display, alerting, and guidance requirements for Class 3 systems will be discussed.

unmanned aircraft systems↗
NASA NTRSDate not supplied

UAS Pilot Performance Comparisons with Different Low Size, Weight and Power Sensor Ranges

The present study evaluated the performance of UAS pilots under four simulated low size, weight, and power (SwaP) sensor ranges: 1.5nmi, 2.0nmi, 2.5nmi, and 3.0nmi. Nine active-duty UAS pilots responded to scripted DAA conflicts against non-cooperative intruders while flying a simulated RQ-7 Shadow at varied speeds along a pre-filed flight path in Class E airspace. Findings revealed a linear effect of sensor range on alerting time and separation performance, with nearly every DAA well clear (DWC) violation and all Near Mid-Air Collision (NMAC) events occurring below 2.5nmi. Response time differences at these reduced ranges were negligible due to the high frequency of warning-level alerts that require an immediate response. Since caution alert duration was truncated to some degree by each tested declaration range, pilots were often unable to coordinate their avoidance maneuvers with ATC prior to their uploads. Nonetheless, the 2.5nmi range allowed minimum alerting times that were sufficient for acceptable pilot performance. These findings will inform DAA system requirements for UAS with alternative surveillance equipment and aircraft performance capabilities. Implications on DAA display and sensor requirements are discussed.

unmanned aircraft systems↗
NASA NTRSDate not supplied

UAS Pilot Assessments of Display and Alerting for the Next Generation Airborne Collision Avoidance System Xu

Unmanned aircraft systems (UAS) must comply with specific standards to operate in the National Airspace System (NAS). Among the requirements are the detect and avoid (DAA) capabilities, which include display, alerting, and guidance specifications. Previous studies have queried pilots for their subjective feedback on these display elements on earlier systems; the present study sought pilot evaluations with an initial iteration of the unmanned variant of a Next Generation Airborne Collision Avoidance System (ACAS XU). Sixteen participants piloted simulated aircraft with both standalone and integrated DAA displays. Their opinions were gathered using post-block and post-simulation questionnaires as well as guided debriefs. The data showed pilots had better understanding and comfort with the system when using an integrated display. Pilots also rated ACAS Xu alerting and guidance as generally acceptable and effective. Implications for further development of ACAS XU and DAA displays are discussed.

unmanned aircraft systems↗
NASA NTRSDate not supplied

Bowtie Analysis of the Effects of Unmanned Aircraft on Air Traffic Control

Within the aviation domain, there is a growing industry demand to develop and integrate remotely piloted operations into the National Airspace System. However, it is not yet well understood how the integration of unmanned aircraft with impact air traffic control, and specifically, the air traffic controllers who are at the sharp end of this safety critical system. This research presented in this paper aimed to begin to address this gap in understanding by identifying and exploring potential hazards associated with introducing Unmanned Aircraft into the national airspace system, and identify possible mitigations to reduce identified risks. A bowtie risk analysis methodology was used to identify and analyze hazards. A focus-group format discussion was conducted with nine subject matter experts as participants. Findings identified five areas of potential risk, each associated with multiple hazards. Mitigations for each hazard are reported. Findings have essential implications for the safe and efficient integration of unmanned aircraft into the national airspace.

Tamsyn Edwards↗
NASA NTRSDate not supplied

Effects of Unmanned Aircraft Voice Communication Delay on En Route Air Traffic Management Operations

The present study investigated the effects of remotely piloted unmanned aircraft (UA) voice communication delay on air traffic management operations with different background sector traffic-volume levels. Three one-way UA voice delay lengths of 400, 900, and 2,000 milliseconds (ms) were tested, representing the currently estimated transmission delays for terrestrial, satellite communication (SATCOM), and long SATCOM Command and Control Link System, respectively. All delay values exceeded 390 ms, the FAA’s current requirement for the maximum communication latency in the National Airspace System. Eight retired en route air traffic controllers (ATCs) and eight remote pilots (RPs) participated in a human-inthe-loop simulation study, where a simulated UA flight transitioned through an Oakland en route low-altitude sector to a local non-towered airport. The results showed that, when the 2,000-ms voice delay was present, radio transmission step-ons and detect-and-avoid (DAA) alert level elevations increased. In addition, ATC workload, ATC acceptability for the UA, and RP acceptability for the DAA were negatively affected only when the UA had a 2,000-ms voice delay under the high traffic-volume condition, but not in the other conditions.

remotely piloted unmanned aircraft, voice delay, s↗
NASA NTRSDate not supplied

m:N Handoff Study

Explore the source record for details and available documents.

m:N operations↗
NASA NTRSDate not supplied

Streamlining Tactical Operator Handoffs During Multi-Vehicle Operations

Increased automation has shifted the operator control paradigm from a single operator controlling a single vehicle, to multiple operators collaborating to control multiple vehicles; this paradigm is known as m:N. Many questions remain unanswered in this new operational paradigm about the division of assets as workload for individual operators varies over time. This paper explores the management of workload by enabling operators to temporarily handoff vehicles among each other. A study was conducted to explore both a manual and assisted method for performing handoffs during manipulated contingency scenarios. The assisted handoff method allowed subjects to easily choose and group nominal and/or contingency vehicles. The number of contingencies was also manipulated to determine the effect workload had on how pilots utilized the ability to handoff vehicles. Results show subjects performed handoffs more often when there were more contingencies and when the assisted handoff tool was available. In addition, the assisted tool made subjects feel more comfortable, enabling them to feel like they could take longer to resolve contingency situations. Lastly, even during contingencies, subjects were able to successfully complete secondary tasks.

m:N operations↗
NASA NTRSDate not supplied

sUAS Ground Control Station Capabilities Impact on Fleet Management

Future Small Uncrewed Aerial Systems (sUAS) missions will require multiple operators to collaborate and manage large fleets of highly automated vehicles. It is critical that these operators maintain the necessary situational awareness to modify vehicle missions if/when unexpected situations arise in the operating environment. It has been suggested that highly automated vehicle capabilities can lead to reducing the capabilities given to operators to modify/direct vehicle missions. This paper explores various Ground Control Station (GCS) capabilities configurations and their impact on sUAS fleet management. Results show that a GCS with a combination of manual and automated capabilities allowed participants to make more effective decisions while maintaining workload and response times similar to that of a GCS with only automated capabilities.

sUAS↗