Search NASASearch

Engineering topics

Casey Smith

Publications and source records attributed to Casey Smith.

A Human-in-theLoop Evaluation of ACAS Xu

As part of the Phase 2 UAS DAA MOPS, a Class 3 DAA system has been under development with the potential to resolve many of the limitations of Class 1 and 2 systems. A Class 3 system would combine the DAA and CA functions into a single, unified system, and would also extend the CA capabilities relative to TCAS II. Class 3 is enabled by the Airborne Collision Avoidance System (ACAS) XU, a next generation CA system developed specifically for UAS operations. Unlike Class 2 systems, ACAS XU provides CA protection against both cooperative and non-cooperative traffic. Class 3 systems also expand the CA logic to allow horizontal RAs in addition to vertical RAs. The purpose of the current study was to evaluate ACAS XU in a real-time, HITL simulation. The latest version of ACAS XU was implemented and pilots were tasked with responding to scripted traffic conflicts over the course of four experimental trials. Variables included the location of the ACAS XU guidance information (standalone vs. integrated) and traffic conflict type (DAA or CA threat). Sixteen active UAS pilots participated in the study, with ATC and ‘pseudo’ pilots acting as airspace confederates. Results showed that pilots were able to maintain DWC with ACAS XU at a rate comparable to previous research (~5%). Compliance rates to initial RAs were high (~90%) but dropped significantly when the target heading value issued during horizontal RAs were updated over the course of an encounter (30-70%). The implications of these findings on the display, alerting, and guidance requirements for Class 3 systems will be discussed.

unmanned aircraft systems

UAS Pilot Performance Comparisons with Different Low Size, Weight and Power Sensor Ranges

The present study evaluated the performance of UAS pilots under four simulated low size, weight, and power (SwaP) sensor ranges: 1.5nmi, 2.0nmi, 2.5nmi, and 3.0nmi. Nine active-duty UAS pilots responded to scripted DAA conflicts against non-cooperative intruders while flying a simulated RQ-7 Shadow at varied speeds along a pre-filed flight path in Class E airspace. Findings revealed a linear effect of sensor range on alerting time and separation performance, with nearly every DAA well clear (DWC) violation and all Near Mid-Air Collision (NMAC) events occurring below 2.5nmi. Response time differences at these reduced ranges were negligible due to the high frequency of warning-level alerts that require an immediate response. Since caution alert duration was truncated to some degree by each tested declaration range, pilots were often unable to coordinate their avoidance maneuvers with ATC prior to their uploads. Nonetheless, the 2.5nmi range allowed minimum alerting times that were sufficient for acceptable pilot performance. These findings will inform DAA system requirements for UAS with alternative surveillance equipment and aircraft performance capabilities. Implications on DAA display and sensor requirements are discussed.

unmanned aircraft systems

An Evaluation of UAS Pilot Workload and Acceptability Ratings with Four Simulated Radar Declaration Ranges

Currently, minimum operating standards (MOPS) are being developed for a broader range of UAS types, including smaller UAS that will feature onboard sensors that are low in size, weight, and power (Low SWaP). These sensors will have limited declaration ranges compared to ones typically found on medium-to-large UAS used to detect non-cooperative aircraft. A human-in-the-loop (HITL) study was conducted examining four possible radar declaration ranges (i.e., 1.5 nm, 2 nm, 2.5 nm, and 3 nm) for a potential low SWaP sensor with a DAA system. Participants had lower workload, particularly workload associated with temporal demand and effort. Furthermore, participants reported better ability to remain DAA well clear within the larger declaration range conditions, such as the 2.5 nm and 3 nm.

UAS

Display and Automation Considerations for the Airborne Collision Avoidance System Xu

In this presentation we examine several display and automation considerations of a collision avoidance system that is currently under development: the Airborne Collision Avoidance System (ACAS) Xu. This study builds on previous work conducted as part of NASA’s Unmanned Aircraft Systems (UAS) Integration into the National Airspace System (NAS) project. ACAS Xu represents the next-generation successor to the Traffic Alert and Collision Avoidance System (TCAS II), wherein the Xu variant is intended for UAS applications. Whereas TCAS II exclusively issues RAs in the vertical dimension, a major distinction between ACAS Xu and previous collision avoidance (CA) systems is the introduction of horizontal and “blended” RAs (i.e., RAs with both horizontal and vertical components). This present work was conducted as an engineering analysis involving two parts. In Part 1, a two-by-two, within-subjects study was performed that manipulated how RAs were presented to a pilot situated at a UAS ground control station. Five participants experienced four experimental trials in which text and aural alerting characteristics were manipulated. In Part 2, another five participants experienced four trials in which the levels of automation were manipulated with regard to the CA and return-to-course (RTC) tasks. The results for Part 1 found no effect of display or alerting configuration on pilot performance. However, it was discovered that pilot response time to RAs greatly depended on the RA type. In particular, pilots were quicker to respond to vertical RAs (M = 4.52 seconds) than horizontal (M = 7.42 seconds) and blended (M = 9.68 seconds) RAs in which both dimensions were issued simultaneously. For Part 2 of the study, pilots found both auto-CA and auto-RTC functions equally useful. Most pilots were comfortable with the automation, however responses were mixed. Three of five participants indicated high levels of comfort with the auto-CA function, while two rated their comfort as low. Pilots’ comfort for the auto-RTC functionality was slightly higher: four out of five pilots gave high ratings, while one pilot gave a low rating. Overall, pilots ordinally ranked their preference for automated functions as auto-CA together with auto-RTC (when an aural alert announces a change between CA and RTC states), auto-CA, and auto-CA and RTC (without the aural state-change announcement). Recommendations for improving the display of automation are also discussed.

collision avoidance

UAS Pilot Performance Comparisons with Different Low Size, Weight and Power Sensor Ranges

The present study evaluated the performance of UAS pilots under four simulated low size, weight, and power (SwaP) sensor ranges: 1.5nmi, 2.0nmi, 2.5nmi, and 3.0nmi. Nine active-duty UAS pilots responded to scripted DAA conflicts against non-cooperative intruders while flying a simulated RQ-7 Shadow at varied speeds along a pre-filed flight path in Class E airspace. Findings revealed a linear effect of sensor range on alerting time and separation performance, with nearly every DAA well clear (DWC) violation and all Near Mid-Air Collision (NMAC) events occurring below 2.5nmi. Response time differences at these reduced ranges were negligible due to the high frequency of warning-level alerts that require an immediate response. Since caution alert duration was truncated to some degree by each tested declaration range, pilots were often unable to coordinate their avoidance maneuvers with ATC prior to their uploads. Nonetheless, the 2.5nmi range allowed minimum alerting times that were sufficient for acceptable pilot performance. The study findings will inform DAA system requirements for UAS with alternative surveillance equipment and aircraft performance capabilities. Implications on DAA display and sensor requirements are discussed.

unmanned aircraft systems

A Human-in-the-Loop Evaluation of ACAS Xu

As part of the Phase 2 UAS DAA MOPS, a Class 3 DAA system has been under development with the potential to resolve many of the limitations of Class 1 and 2 systems. A Class 3 system would combine the DAA and CA functions into a single, unified system, and would also extend the CA capabilities relative to TCAS II. Class 3 is enabled by the Airborne Collision Avoidance System (ACAS) XU, a next generation CA system developed specifically for UAS operations. Unlike Class 2 systems, ACAS XU provides CA protection against both cooperative and non-cooperative traffic. Class 3 systems also expand the CA logic to allow horizontal RAs in addition to vertical RAs. The purpose of the current study was to evaluate ACAS XU in a real-time, HITL simulation. The latest version of ACAS XU was implemented and pilots were tasked with responding to scripted traffic conflicts over the course of four experimental trials. Variables included the location of the ACAS XU guidance information (standalone vs. integrated) and traffic conflict type (DAA or CA threat). Sixteen active UAS pilots participated in the study, with ATC and ‘pseudo’ pilots acting as airspace confederates. Results showed that pilots were able to maintain DWC with ACAS XU at a rate comparable to previous research (~5%). Compliance rates to initial RAs were high (~90%) but dropped significantly when the target heading value issued during horizontal RAs were updated over the course of an encounter (30-70%). The implications of these findings on the display, alerting, and guidance requirements for Class 3 systems will be discussed.

unmanned aircraft systems

A Human-in-the-Loop Evaluation of ACAS Xu

As part of the Phase 2 UAS DAA MOPS, a Class 3 DAA system has been under development with the potential to resolve many of the limitations of Class 1 and 2 systems. A Class 3 system would combine the DAA and CA functions into a single, unified system, and would also extend the CA capabilities relative to TCAS II. Class 3 is enabled by the Airborne Collision Avoidance System (ACAS) XU, a next generation CA system developed specifically for UAS operations. Unlike Class 2 systems, ACAS XU provides CA protection against both cooperative and non-cooperative traffic. Class 3 systems also expand the CA logic to allow horizontal RAs in addition to vertical RAs. The purpose of the current study was to evaluate ACAS XU in a real-time, HITL simulation. The latest version of ACAS XU was implemented and pilots were tasked with responding to scripted traffic conflicts over the course of four experimental trials. Variables included the location of the ACAS XU guidance information (standalone vs. integrated) and traffic conflict type (DAA or CA threat). Sixteen active UAS pilots participated in the study, with ATC and ‘pseudo’ pilots acting as airspace confederates. Results showed that pilots were able to maintain DWC with ACAS XU at a rate comparable to previous research (~5%). Compliance rates to initial RAs were high (~90%) but dropped significantly when the target heading value issued during horizontal RAs were updated over the course of an encounter (30-70%). The implications of these findings on the display, alerting, and guidance requirements for Class 3 systems will be discussed.

unmanned aircraft systems

UAS Pilot Performance Comparisons with Different Low Size, Weight and Power Sensor Ranges

The present study evaluated the performance of UAS pilots under four simulated low size, weight, and power (SwaP) sensor ranges: 1.5nmi, 2.0nmi, 2.5nmi, and 3.0nmi. Nine active-duty UAS pilots responded to scripted DAA conflicts against non-cooperative intruders while flying a simulated RQ-7 Shadow at varied speeds along a pre-filed flight path in Class E airspace. Findings revealed a linear effect of sensor range on alerting time and separation performance, with nearly every DAA well clear (DWC) violation and all Near Mid-Air Collision (NMAC) events occurring below 2.5nmi. Response time differences at these reduced ranges were negligible due to the high frequency of warning-level alerts that require an immediate response. Since caution alert duration was truncated to some degree by each tested declaration range, pilots were often unable to coordinate their avoidance maneuvers with ATC prior to their uploads. Nonetheless, the 2.5nmi range allowed minimum alerting times that were sufficient for acceptable pilot performance. These findings will inform DAA system requirements for UAS with alternative surveillance equipment and aircraft performance capabilities. Implications on DAA display and sensor requirements are discussed.

unmanned aircraft systems

m:N Handoff Study

Explore the source record for details and available documents.

m:N operations

Streamlining Tactical Operator Handoffs During Multi-Vehicle Operations

Increased automation has shifted the operator control paradigm from a single operator controlling a single vehicle, to multiple operators collaborating to control multiple vehicles; this paradigm is known as m:N. Many questions remain unanswered in this new operational paradigm about the division of assets as workload for individual operators varies over time. This paper explores the management of workload by enabling operators to temporarily handoff vehicles among each other. A study was conducted to explore both a manual and assisted method for performing handoffs during manipulated contingency scenarios. The assisted handoff method allowed subjects to easily choose and group nominal and/or contingency vehicles. The number of contingencies was also manipulated to determine the effect workload had on how pilots utilized the ability to handoff vehicles. Results show subjects performed handoffs more often when there were more contingencies and when the assisted handoff tool was available. In addition, the assisted tool made subjects feel more comfortable, enabling them to feel like they could take longer to resolve contingency situations. Lastly, even during contingencies, subjects were able to successfully complete secondary tasks.

m:N operations

Interannual to Decadal Variability in Subarctic Atlantic Ocean Primary Productivity Historical Variability, Dynamics, and Response to Warming

Phytoplankton primary productivity in the Subarctic Atlantic Ocean sustains valuable fisheries and exports anthropogenic atmospheric carbon dioxide, but multiple Earth system models show that this productivity declines substantially in 21st century global warming scenarios. Prior studies have investigated the spatial and temporal dynamics of the seasonal cycle of the phytoplankton, which exhibit a prominent but spatially variable spring bloom that is caused by the closely related seasonal cycles in solar radiation and vertical mixing that modulate both phytoplankton growth and loss rates. However, recent work indicates that multi-decade declines in this spring bloom with global warming in multiple Earth system models are driven by reductions in circulation of nutrients from the subtropical and tropical thermocline, rather than local changes in vertical mixing or shortwave radiation in the Subarctic. It is unclear if current models of how phytoplankton productivity varies seasonally or over a century in global warming can be interpolated to explain the interannual to decadal variability. In this poster, I will quantify the interannual to decadal variability of phytoplankton chlorophyll using historical satellite ocean color observations and model simulations with the Community Earth System Model. I will then use the observations and model simulations to elucidate the mechanisms of interannual to decadal variability and how that variability is restructured in 21st century global warming scenarios.

nterannual

Advanced Air Mobility Operations & Automation Part II Technical Lecture

The Airborne Collision Avoidance System X (ACAS X) is a next-generation collision avoidance tool developed to support different aircraft types and operations. The rotorcraft variant – referred to as ACAS XR – is designed to accommodate existing helicopter platforms as well as in-development, electric vertical takeoff and landing concepts, which are critical to the emerging concept of operations referred to as Advanced Air Mobility. The fundamental role of ACAS XR is to provide Detect and Avoid (DAA) and/or Collision Avoidance (CA) protection against airborne traffic. DAA alerting and guidance in the context of ACAS XR is caution-level and “suggestive,” and is to be used by the pilot if, and when, they decide to maneuver against an identified threat to DAA “well clear.” The CA alerting, by contrast, is warning-level and “directive,” with the pilot required to comply with the associated guidance to prevent a predicted Near Midair Collision (NMAC). The CA alerts generated by ACAS XR are referred to as Resolution Advisories (RAs) consistent with previous CA systems. Unlike earlier CA systems, ACAS XR issues RAs in the horizontal and vertical dimensions as well as multi-axis RAs (referred to as “Blended” RAs). According to the Minimal Operational Performance Standards of DAA systems for Unmanned Aircraft Systems, maneuvers to comply with RAs may be automated, whereas maneuvers based on DAA alerting assume a manual response. The current presentation discusses two human-in-the-loop simulations that presented rotorcraft pilots with ACAS XR alerts and guidance in eVTOL simulators with varying levels of automation. It also presents overviews of these studies as well as how they assisted live flight tests, which will occur throughout 2023.

air taxis

Detect and Avoid and Collision Avoidance Flight Test Results with ACAS Xr

In October 2023, the National Aeronautics and Space Administration (NASA) completed its Integration of Automated Systems flight test series, conducted under NASA’s Advanced Air Mobility project and in partnership with Sikorsky and the Defense Advanced Research Projects Agency (DARPA). The flight test effort included two crewed rotorcraft platforms. The first, a modified S-76B helicopter, served as the “ownship” for the duration of the flight test. The second vehicle, a modified S-70, served as the intruder aircraft. One Sikorsky pilot and one NASA test pilot was onboard each aircraft for every test point, with the NASA test pilot responsible for interacting with the research systems under test. Approximately half of the flight test was devoted to assessing the Federal Aviation Administration’s (FAA) next-generation collision avoidance system, the Airborne Collision Avoidance System X for Rotorcraft (ACAS Xr). The two configurations available within ACAS Xr – the Collision Avoidance System (CAS) configuration and the Detect and Avoid (DAA) configuration – were flown with an onboard pilot under Visual Flight Rules in controlled airspace over the Long Island Sound (Connecticut, USA). A total of 33 flight test cards were flown with ACAS Xr active. The ownship was equipped with ACAS Xr and the intruder was equipped with Automatic Dependent Surveillance-Broadcast (ADS-B). The test points were blocked by ACAS Xr configuration, with individual encounters varying the ownship speed (90 knots or 20 knots), the intruder designation (en-route, terminal area, or structured airspace), and method of RA execution (automated or manually executed). Results showed that the ACAS Xr alerting and guidance was largely effective and rated positively by the NASA test pilots, exemplified by zero instances of the pilots overriding an ACAS Xr Resolution Advisory (RA). Key areas of improvement, however, were noted, particularly with regards to the lack of an aural alert indicating a need to accelerate when receiving an RA at low speed and the occurrence of multiple RAs that the pilots found to be unacceptable.

detect and avoid