Search NASA⌕ Search

Engineering topics

Rorie, Conrad

Publications and source records attributed to Rorie, Conrad.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2020

ACAS-Xu Run 5 HITL (June 2019) SC-228 WG 1.3 Results Outbrief

This presentation provides an overview of a recently completed human-in-the-loop simulation, conducted as part of the Unmanned Aircraft Systems (UAS) Integration in the National Airspace System (NAS) Project. This study examined how to present resolution advisories (RAs) issued by Airborne Collision Avoidance System (ACAS) Xu, which can be in the vertical dimension, the horizontal dimension, or both (i.e., “blended”). The study varied the location of the ACAS Xu traffic information - it was either presented within an 'integrated' display or a 'standalone' display, where the traffic information was separated from the vehicle control interfaces and navigational information. Results revealed generally positive feedback on the visual and aural presentation of RAs, with special considerations and performance implications noted throughout.

Monk, Kevin J.↗
NASA NTRS2019

Low Size, Weight, and Power (SWaP) Experiments 1 & 2 Flight Test Series 6 VIP Day

This presentation provides an overview of two recently completed human-in-the-loop simulations, conducted as part of the Unmanned Aircraft Systems (UAS) Integration in the National Airspace System (NAS) Project. These studies investigated the effects of shorter RADAR surveillance ranges on DAA system performance. They were designed to serve as a validation of the fast-time simulation work performed by other groups working on the UAS-NAS project. They were also intended to establish a baseline for the Flight Test 6 Full Mission configuration flights. Low SWaP HITL 1 examined system performance with two candidate non-cooperative DAA well clear (DWC) definitions with a RADAR declaration range of 3.5nm. Low SWaP HITL 2 looked at DAA system performance with four different RADAR declaration ranges (1.5, 2.0, 2.5, & 3.0nm) with a non-cooperative DWC definition of 450ft vertical separation and 2200ft horizontal separation. The results of each study and the implications for FT6 are discussed.

Rorie, Conrad↗
NASA NTRS2019

Unmanned Aircraft Systems (UAS) Integration in the National Airspace System (NAS) Project: ACAS-Xu Run 5 Human-In-The-Loop Sim SC-147 Results Outbrief

This presentation provides an overview of a recently completed human-in-the-loop simulation, conducted as part of the Unmanned Aircraft Systems (UAS) Integration in the National Airspace System (NAS) Project. This study examined how to present resolution advisories (RAs) issued by Airborne Collision Avoidance System (ACAS) Xu, which can be in the vertical dimension, the horizontal dimension, or both (i.e., "blended"). The study varied the location of the ACAS Xu traffic information - it was either presented within an 'integrated' display or a 'standalone' display, where the traffic information was separated from the vehicle control interfaces and navigational information. Results revealed generally positive feedback on the visual and aural presentation of RAs, with special considerations and performance implications noted throughout.

Monk, Kevin J.↗
NASA NTRS2019

Terminal Area Test Vector Development

This presentation provides an overview of work being done to develop test vectors for the terminal area, in coordination with RTCA Special Committee 228, an organization developing the Minimum Operational Performance Standards (MOPS) for Unmanned Aircraft Systems (UAS) Detect and Avoid (DAA) systems. The work leverages existing encounter data to develop a set of encounters to be used to define and refine both performance-based and functionally-based terminal area MOPS requirements. The encounter set would be used across various organizations supporting MOPS terminal area requirements development to provide some level of consistency in terms of terminal area assumptions. The work will investigate other potentially applicable data sets and make any similarly needed adjustments to arrive at a consolidated set of terminal area encounters.

terminal area↗
NASA NTRS2019

Unmanned Aircraft Systems (UAS) Integration in the National Airspace System (NAS) Project: ACAS Xu Engineering Analysis Results

This presentation provides an overview of the results from a two-part engineering analysis conducted as part of the Unmanned Aircraft Systems (UAS) Integration in the National Airspace System (NAS) Project. Part one of this analysis examined how to present resolution advisories (RAs) issued by Airborne Collision Avoidance System (ACAS) Xu, which can be in the vertical dimension, the horizontal dimension, or both (i.e., "blended"). The study varied the appearance of the alerting and the verbiage used in the aural alerts. Results revealed high acceptability ratings for the appearance of the RA guidance. Part two of the analysis assessed pilot acceptability of varying levels of automation in the collision avoidance (CA) task. Pilots experienced conditions in which ACAS Xu RAs were executed either manually or automatically (i.e., auto-Collision Avoidance). In some conditions the return to a previously filed course was also executed automatically (auto-Return to Course). Results indicated that improvements are needed to how the state of the automation is presented. Implications of these findings are also discussed.

Detect and Avoid↗
NASA NTRS2018

Multi-UAS HITL: Primary Results & Automation Workshop Summaries

This presentation covers the primary results from a recently completed human-in-the-loop (HITL) simulation conducted as part of the UAS (Unmanned Aircraft System) integration into the NAS (National Airspace System) project. The HITL examined the impact of multiple (simultaneous) UAS control while performing a demanding mission task and managing scripted conflicts. The scripted conflicts were designed to trigger the detect-and-avoid (DAA) system. This was the first time the DAA system as designed as part of the UAS-NAS project has been applied to multi-UAS control. The second part of the presentation briefly summarizes the takeaways from two workshops held on human-automation interaction considerations for UAS integration. NASA co-hosted and participated in both workshops.

unmanned aircraft systems↗
NASA NTRS2018

An Interoperability Concept for Detect and Avoid and Collision Avoidance Systems: Results from a Human-In-The-Loop Simulation

The integration of Unmanned Aircraft Systems (UAS) into the National Airspace System (NAS) poses a variety of technical challenges to UAS developers and aviation regulators. In response to growing demand for access to civil airspace in the United States, the Federal Aviation Administration (FAA) has produced a roadmap identifying key areas requiring further research and development. One such technical challenge is the development of a "detect and avoid" system (DAA) capable of providing a means of compliance with the "see and avoid" requirement in manned aviation. The purpose of the DAA system is to support the pilot, situated at a ground control station (GCS), in maintaining "DAA well clear" of nearby aircraft through the use of GCS displays and alerts. In addition to its primary function of aiding the pilot in maintaining well clear, the DAA system must also safely interoperate with existing NAS systems and operations, such as the airspace management procedures of air traffic controllers (ATC) and Collision Avoidance (CA) systems currently in use by manned aircraft, namely the Traffic alert and Collision Avoidance System (TCAS) II. It is anticipated that many UAS architectures will integrate both a DAA system and a TCAS II. It is therefore necessary to explicitly study the integration of DAA and TCAS II alerting structures and maneuver guidance formats to ensure that pilots understand the appropriate type and urgency of their response to the various alerts. This paper presents a concept of interoperability for the two systems. The concept was developed with the goal of avoiding any negative impact on the performance level of TCAS II while retaining a DAA system that still effectively enables pilots to maintain DAA well clear.

unmanned aircraft systems↗
NASA NTRS2018

An Exploratory Evaluation of UAS Detect and Avoid Operations in the Terminal Environment

New technical standards for Unmanned Aircraft Systems (UAS) detect and avoid (DAA) systems mark recent progress toward realizing the goal of full integration of UAS into the National Airspace System (NAS). The DAA system is intended to provide a means of compliance with operating regulations that required pilots on board manned aircraft to remain "well clear" of other aircraft which is accomplished through out-the-window visual acquisition of other aircraft and application of a subjective judgment of safe separation. The requirements for the DAA system, including the specification of a DAA well clear threshold as well as functional requirements for detecting, tracking, alerting and guidance processing, and displays, are specified in DO-365, Minimum Operational Performance Standards (MOPS) for DAA Systems developed within RTCA Special Committee 228 (SC-228). Intended as the first in a series of phased versions, these requirements are frequently referred to as the "Phase 1" DAA system. The Phase 1 DAA system is limited for use by aircraft transitioning to and from Class A or special use airspace, through Class D, E, and G airspace. In particular, the Phase 1 DAA MOPS are not intended for terminal airspace operations, a critical gap for enabling a full range of UAS operations. The application of the Phase 1 DAA system and DAA well clear threshold within the terminal area is predicted to result in a high number of unnecessary alerts when the UAS is safely separated from other traffic. The goal of the present study was to examine pilot performance and operational issues related to the operation of the Phase 1 DAA system in a terminal area. This experiment was intended as an exploratory study that would be used to inform the development of a new terminal area-specific DAA well clear definition, and associated alerting and guidance requirements. The two main objectives of this study were to: 1) characterize pilot behavior in the terminal environment with the Phase 1 DAA system, and 2) investigate the effect of modifications to the Phase 1 DAA alerting and guidance structure. In particular, the authors were interested in determining whether the removal of specific alerting and guidance levels, without changing the DAA well clear definition or alerting thresholds, would impact pilot performance while conducting terminal operations. The results indicate that the Phase 1 well clear definition and alerting and guidance resulted in frequent alerting that degraded pilots' ability to discriminate between encounters where another aircraft was safely separated versus when a maneuver was necessary. The resulting impact on pilot performance was slower response times and higher frequency and severity of losses of DAA well clear compared to those observed for experiments examining pilot performance in the en route environment. There was no significant effect of alerting and guidance display configuration on pilot performance.

Rorie, Conrad↗
NASA NTRS2018

UAS Integration in the NAS: Human Systems Integration Overview

This presentation covers the work done by the Unmanned Aircraft Systems (UAS) Integration into the National Airspace System (NAS) project's Human Systems Integration team. It covers the work done in Phase 1 and how it has informed the development of minimum operational performance standards. The presentation then discusses upcoming HIS work in UAS-NAS Phase 2. Finally the presentation covers the work to be done at the current workshop and how it relates to its ongoing work.

human autonomy teaming↗
NASA NTRS2018

Unmanned Aircraft Systems (UAS) Integration in the National Airspace System (NAS) Project: Terminal Operations HITL 1B Primary Results

This presentation provides an overview of the primary results from the Unmanned Aircraft Systems (UAS) Integration in the National Airspace System (NAS) Project's second Terminal Operations human-in-the-loop simulation. This talk covers the background of this follow-on experiment, which includes an overview of the first Terminal Operations HITL performed by the project. The primary results include a look at the number and durations of detect and avoid (DAA) alerts issued by the two DAA systems under test. It also includes response time metrics and metrics on the ability of the pilot-in-command (PIC) to maintain sufficient separation. Additional interoperability metrics are included to illustrate how pilots interact with the tower controller. Implications and conclusions are covered at the end.

unmanned aircraft systems↗
NASA NTRS2017

Unmanned Aircraft Systems (UAS) Integration in the National Airspace System (NAS) Project: Terminal Operations HITL 1: Primary Results

This presentation covers the primary results of the Unmanned Aircraft Systems (UAS) Integration in the National Airspace System (NAS) Project Terminal Operations Foundational Human-in-the-Loop (HITL) simulation. The study tasked 16 pilots (half with manned piloting experience, and the other half with unmanned piloting experience) with maintaining "well clear" from other traffic while performing three different types of approaches into the Santa Rosa airport. A detect and avoid (DAA) system was provided to pilots to assist their ability to manage separation. The DAA system used in this test conformed to the criteria defined by RTCA Special Committee 228 (SC-228) in their Phase 1 Minimum Operational Performance Standards (MOPS) for UAS intending to operate in the NAS. The Phase 1 system was not designed to account for terminal operations, focusing instead on en route operations. To account for this, three different alerting and guidance configurations were presently tested in order to determine their effect on pilots operating the system in the terminal area. Results indicated that pilots with the alerting and guidance condition that provided the least amount of assistance (fewer alert levels and guidance types) experienced slightly increased pilot response times and rates of losses of separation. Additional data is presented on the effects of approach type and descriptive data on pilot maneuver preferences and ATC interoperability.

terminal environmen↗
NASA NTRS2017

Validation of Minimum Display Requirements for a UAS Detect and Avoid System

The full integration of Unmanned Aircraft Systems (UAS) into the National Airspace System (NAS), a prerequisite for enabling a broad range of public and commercial UAS operations, presents several technical challenges to UAS developers, operators and regulators. A primary barrier is the inability for UAS pilots (situated at a ground control station, or GCS) to comply with Title 14 Code of Federal Regulations sections 91.111 and 91.113, which require pilots to see and avoid other aircraft in order to maintain well clear. The present study is the final in a series of human-in-the-loop experiments designed to explore and test the various display and alerting requirements being incorporated into the minimum operational performance standards (MOPS) for a UAS-specific detect and avoid system that would replace the see and avoid function required of manned aircraft. Two display configurations were tested - an integrated display and a standalone display - and their impact on pilot response times and ability to maintain DAA well clear were compared. Results indicated that the current draft of the MOPS result in high-level performance and did not meaningfully differ by display configuration.

unmanned aircraft systems↗
NASA NTRS2016

UAS Integration into the NAS: Detect and Avoid Display Evaluations in Support of SC-228 MOPS Development

At the May 2015 SC-228 meeting, requirements for TCAS II interoperability became elevated in priority. A TCAS interoperability work group was formed to identify and address key issuesquestions. The TCAS work group came up with an initial list of questions and a plan to address those questions. As part of that plan, NASA proposed to run a mini HITL to address display, alerting and guidance issues. A TCAS Interoperability Workshop was held to determine potential displayalertingguidance issues that could be explored in future NASA mini HITLS. Consensus on main functionality of DAA guidance when TCAS II RA occurs. Prioritized list of independent variables for experimental design. Set of use cases to stress TCAS Interoperability.

detect and avoid↗
NASA NTRS2016

UAS Integration in the NAS Project: DAA-TCAS Interoperability "mini" HITL Primary Results

At the May 2015 SC-228 meeting, requirements for TCAS II interoperability became elevated in priority. A TCAS interoperability workgroup was formed to identify and address key issues/questions. The TCAS workgroup came up with an initial list of questions and a plan to address those questions. As part of that plan, NASA proposed to run a mini HITL to address display, alerting and guidance issues. A TCAS Interoperability Workshop was held to determine potential display/alerting/guidance issues that could be explored in future NASA mini HITLS. Consensus on main functionality of DAA guidance when TCAS II RA occurs. Prioritized list of independent variables for experimental design. Set of use cases to stress TCAS Interoperability.

human systems integration↗
NASA NTRS2016

The Impact of Suggestive Maneuver Guidance on UAS Pilots Performing the Detect and Avoid Function

This presentation discusses the results of a recent UAS Integration into the NAS human-in-the-loop simulation. In the study, 16 active UAS pilots flew a UAS through civil airspace and were tasked with maintaining well clear from other aircraft in the area. Pilots performed the task with four different detect and avoid (DAA) traffic displays, each of which varied in the form of guidance it provided to pilots The present findings focus on how the different displays impacted pilots' measured response to scripted conflicts with their aircraft. Measured response is made up of several components, each of which help inform our understanding of the pilots' role in the overall detect and avoid task.

detect and avoid↗
NASA NTRS2015

The Impact of Integrated Maneuver Guidance Information on UAS Pilots Performing the Detect and Avoid Task

The integrated human-in-the-loop (iHITL) simulation examined the effect of four different Detect-and-Avoid (DAA) display concepts on unmanned aircraft system (UAS) pilots' ability to maintain safe separation. The displays varied in the type and amount of guidance they provided to pilots. The study's background and methodology are discussed, followed by the 'measured response' data (i.e., pilots' end-to-end response time in reacting to traffic alerts on their DAA display). Results indicate that display type had a significant impact on how long pilot's spent interacting with the interface (i.e., edit times).

detect and avoid↗
NASA NTRS2015

An Evaluation of Detect and Avoid Displays for UAS: The Effect of Information Level and Display Location on Pilot Performance

The pilot-in-the-loop Detect-and-Avoid (DAA) task requires the pilot to carry out three major functions: 1) detect a potential threat, 2) determine an appropriate resolution maneuver, and 3) execute that resolution maneuver via the GCS control and navigation interface(s). The purpose of the present study was to examine two main questions with respect to DAA display considerations that could impact pilots ability to maintain well clear from other aircraft. First, what is the effect of a minimum (or basic) information display compared to an advanced information display on pilot performance? Second, what is the effect of display location on UAS pilot performance? Two levels of information level (basic, advanced) were compared across two levels of display location (standalone, integrated), for a total of four displays. The results indicate that the advanced displays had faster overall response times compared to the basic displays, however, there were no significant differences between the standalone and integrated displays.

detect and avoid↗