Search NASA⌕ Search

SEARCH · Search NASA

Results for “HITL simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

A Detect and Avoid System in the Context of Multiple-Unmanned Aircraft Systems Operations

NASA's Unmanned Aircraft Systems Integration into the National Airspace System (UAS in the NAS) project examines the technical barriers associated with the operation of UAS in civil airspace. For UAS, the removal of the pilot from onboard the aircraft has eliminated the ability of the ground-based pilot in command (PIC) to use out-the-window visual information to make judgements about a potential threat of a loss of well clear with another aircraft. NASA's Phase 1 research supported the development of a Detect and Avoid (DAA) system that supports the ground-based pilot's ability to detect potential traffic conflicts and determine a resolution maneuver, but existing display/alerting requirements did not account for multiple UAS control (1:N). Demands for increased scalability of UAS in the NAS operations are expected to create a need for simultaneous control of UAs, and thus, a new DAA HMI design will likely be necessary. Previous research, however, has found performance degradations as the number of vehicles under operator control has increased. The purpose of the current human-in-the-loop (HITL) simulation was to examine the viability of 1:N operations with the Phase 1 DAA alerting and guidance. Sixteen UAS pilots flew three scenarios with varying number of UAs under their control (1:1, 1:3, 1:5). In addition to their supervisory and sensor mission responsibilities, pilots were to utilize the DAA system to remain DAA well clear (DWC) during scripted conflicts of mixed severity. Measured response times, separation performance, mission task data, and subjective feedback were collected to assess how the multi-UAS control configuration impacted pilots' ability to maintain DAA well clear and perform the mission tasks. Overall, the DAA system proved surprisingly adaptive to multi-UAS control for preventing losses of DAA well clear (LoDWC). The findings suggest that, while multi-UAS operators are able to maintain safe separation (DWC) from other traffic, their ability to efficiently perform missions drastically decreases with their number of controlled vehicles. Pilot feedback indicated that, for this context, the use of automation support tools for completing and managing mission tasks would be appropriate and desired, especially for ensuring efficient use of assets. Finally, human-machine interface (HMI) design considerations for multi-UAS operations are discussed.

Monk, Kevin J.↗

Challenges Using Linux as a Real-Time Operating System

Human-in-the-loop (HITL) simulation groups at NASA and the Air Force Research Lab have been using Linux as a real-time operating system (RTOS) for over a decade. More recently, SpaceX has revealed that it is using Linux as an RTOS for its Falcon launch vehicles and Dragon capsules. As Linux makes its way from ground facilities to flight critical systems, it is necessary to recognize that the real-time capabilities in Linux are cobbled onto a kernel architecture designed for general purpose computing. The Linux kernel contain numerous design decisions that favor throughput over determinism and latency. These decisions often require workarounds in the application or customization of the kernel to restore a high probability that Linux will achieve deadlines.

Madden, Michael M.↗

Challenges Using the Linux Network Stack for Real-Time Communication

Starting in the early 2000s, human-in-the-loop (HITL) simulation groups at NASA and the Air Force Research Lab began using the Linux network stack for some real-time communication. More recently, SpaceX has adopted Ethernet as the primary bus technology for its Falcon launch vehicles and Dragon capsules. As the Linux network stack makes its way from ground facilities to flight critical systems, it is necessary to recognize that the network stack is optimized for communication over the open Internet, which cannot provide latency guarantees. The Internet protocols and their implementation in the Linux network stack contain numerous design decisions that favor throughput over determinism and latency. These decisions often require workarounds in the application or customization of the stack to maintain a high probability of low latency on closed networks, especially if the network must be fault tolerant to single event upsets.

Madden, Michael M.↗

Demonstrating Early-Adopter Benefits of Submitting Multiple Trajectory Options for Airlines

A workshop at NASA Ames Research Center was held with airline industry stakeholders to demonstrate the impact of using Trajectory Options Sets (TOSs) during a Collaborative Trajectory Options Program (CTOP) for severe weather operations. The demonstration was conducted using apart-task Human-in-the-Loop (HITL) simulation of the Integrated Demand Management (IDM) concept, which is an air traffic management method that uses CTOP to deliver preconditioned traffic to the Time-Based Flow Management (TBFM) region. The demonstration addressed the following research objectives: first, determine who receives a greater benefit, TOS-participating or TOS-excluded airlines? Second, determine which method of trajectory selection yields a better solution, human/manual selection or automation? Finally, obtain feedback from stakeholders on their impression of the concept and recommendations for future work. The results showed that TOS-participating airlines received greater benefit in terms of total ground delay, ground delay savings, number of reroute options, and additional flight time, compared to TOS-excluded airlines. However, this result was dependent on the situational context, such as the number and location of flights. We found that all airlines benefitted when just a subset of airlines submitted TOS, but the greatest benefit went to the TOS-participating airlines. These benefits to the TOS-participating airlines were diminished as the number of TOS-participants in the system increased. Therefore, there was an “early-adopter” effect that suggested airlines could benefit by becoming the first to equip TOS without causing unfair disadvantages to those who do not equip TOS. In addition, we found that manual selection of trajectory options performed similarly to CTOP, but the CTOP solution was more efficient in terms of number of reroutes, additional flight time, and average ground delay for rerouted flights. Feedback from the stakeholders was solicited, and their overall impressions of the demonstrations were positive. They remarked that CTOP could do a better job than current day solutions, and they thought airlines could benefit from continuing to develop TOS capabilities.

Integrated Demand Management↗

A Human-in-the-Loop Evaluation of ACAS Xu

As part of the Phase 2 UAS DAA MOPS, a Class 3 DAA system has been under development with the potential to resolve many of the limitations of Class 1 and 2 systems. A Class 3 system would combine the DAA and CA functions into a single, unified system, and would also extend the CA capabilities relative to TCAS II. Class 3 is enabled by the Airborne Collision Avoidance System (ACAS) XU, a next generation CA system developed specifically for UAS operations. Unlike Class 2 systems, ACAS XU provides CA protection against both cooperative and non-cooperative traffic. Class 3 systems also expand the CA logic to allow horizontal RAs in addition to vertical RAs. The purpose of the current study was to evaluate ACAS XU in a real-time, HITL simulation. The latest version of ACAS XU was implemented and pilots were tasked with responding to scripted traffic conflicts over the course of four experimental trials. Variables included the location of the ACAS XU guidance information (standalone vs. integrated) and traffic conflict type (DAA or CA threat). Sixteen active UAS pilots participated in the study, with ATC and ‘pseudo’ pilots acting as airspace confederates. Results showed that pilots were able to maintain DWC with ACAS XU at a rate comparable to previous research (~5%). Compliance rates to initial RAs were high (~90%) but dropped significantly when the target heading value issued during horizontal RAs were updated over the course of an encounter (30-70%). The implications of these findings on the display, alerting, and guidance requirements for Class 3 systems will be discussed.

unmanned aircraft systems↗

A Human-in-the-Loop Evaluation of ACAS Xu

As part of the Phase 2 UAS DAA MOPS, a Class 3 DAA system has been under development with the potential to resolve many of the limitations of Class 1 and 2 systems. A Class 3 system would combine the DAA and CA functions into a single, unified system, and would also extend the CA capabilities relative to TCAS II. Class 3 is enabled by the Airborne Collision Avoidance System (ACAS) XU, a next generation CA system developed specifically for UAS operations. Unlike Class 2 systems, ACAS XU provides CA protection against both cooperative and non-cooperative traffic. Class 3 systems also expand the CA logic to allow horizontal RAs in addition to vertical RAs. The purpose of the current study was to evaluate ACAS XU in a real-time, HITL simulation. The latest version of ACAS XU was implemented and pilots were tasked with responding to scripted traffic conflicts over the course of four experimental trials. Variables included the location of the ACAS XU guidance information (standalone vs. integrated) and traffic conflict type (DAA or CA threat). Sixteen active UAS pilots participated in the study, with ATC and ‘pseudo’ pilots acting as airspace confederates. Results showed that pilots were able to maintain DWC with ACAS XU at a rate comparable to previous research (~5%). Compliance rates to initial RAs were high (~90%) but dropped significantly when the target heading value issued during horizontal RAs were updated over the course of an encounter (30-70%). The implications of these findings on the display, alerting, and guidance requirements for Class 3 systems will be discussed.

unmanned aircraft systems↗

A Human-in-theLoop Evaluation of ACAS Xu

As part of the Phase 2 UAS DAA MOPS, a Class 3 DAA system has been under development with the potential to resolve many of the limitations of Class 1 and 2 systems. A Class 3 system would combine the DAA and CA functions into a single, unified system, and would also extend the CA capabilities relative to TCAS II. Class 3 is enabled by the Airborne Collision Avoidance System (ACAS) XU, a next generation CA system developed specifically for UAS operations. Unlike Class 2 systems, ACAS XU provides CA protection against both cooperative and non-cooperative traffic. Class 3 systems also expand the CA logic to allow horizontal RAs in addition to vertical RAs. The purpose of the current study was to evaluate ACAS XU in a real-time, HITL simulation. The latest version of ACAS XU was implemented and pilots were tasked with responding to scripted traffic conflicts over the course of four experimental trials. Variables included the location of the ACAS XU guidance information (standalone vs. integrated) and traffic conflict type (DAA or CA threat). Sixteen active UAS pilots participated in the study, with ATC and ‘pseudo’ pilots acting as airspace confederates. Results showed that pilots were able to maintain DWC with ACAS XU at a rate comparable to previous research (~5%). Compliance rates to initial RAs were high (~90%) but dropped significantly when the target heading value issued during horizontal RAs were updated over the course of an encounter (30-70%). The implications of these findings on the display, alerting, and guidance requirements for Class 3 systems will be discussed.

unmanned aircraft systems↗

UAS Integration in the NAS Flight Test 6: Full Mission Results

Recent standards development efforts for the integration of Unmanned Aircraft Systems (UAS) into the National Airspace System (NAS) such as those in RTCA Inc. Special Committee 228 (SC-228) have focused on relatively large UAS transitioning to and from Class A airspace. In an effort to expand the range of vehicle classes that can access the NAS, the NASA UAS Integration in the NAS project has investigated Low Size, Weight, and Power (Low SWaP) technologies that would allow smaller UAS to detect-and-avoid (DAA) traffic. Through batch and human in the loop (HITL) simulation studies, the UAS Integration in the NAS DAA subproject have identified candidate performance standards that would contribute to enabling extended Low SWaP, UAS operations under 10,000 feet. These candidate performance standards include minimum field of regard (FOR) values for Low SWaP air surveillance sensors as well as a DAA well-clear (DWC) definition which can be applied to non-cooperative traffic to reduce the required maneuver initiation range. To test the assumptions of the project’s simulation studies and validate the candidate performance standards, a live flight research event was executed at NASA Armstrong Flight Research Center. The UAS Integration in the NAS Project Flight Test 6 Full Mission sought to characterize UAS pilot responses to traffic conflicts using a representative Low SWAP DAA system in an operational NAS environment. To achieve this, live, virtual and constructive distributed environment (LVC-DE) elements were combined to simulate a sector of Oakland center airspace and induce encounters with a live, manned aircraft. A Navmar Applied Sciences Tigershark XP was used as the UAS ownship and was integrated into the test architecture to enable it to be controlled from a Vigilant Spirit Control Station (VSCS) research ground control station. Qualified UAS pilots were recruited to act as subject pilots under test (SPUT) to control the Tigershark XP in a simulated mission while coordinating with a participating air traffic controller in simulated airspace. The intruder speed, intruder equipage and encounter geometry were varied between six scripted encounters per SPUT. Various metrics were collected including pilot reaction time from the onset of DAA alert, ATC coordination rate, probability and severity of losses of DAA well clear, and subjective ratings of system acceptability. The implications of these results on the development of standards for Low SWAP DAA systems will be discussed.

UAV↗

A Cognitive Walkthrough of Multiple Drone Delivery Operations

Advances of early twenty-first century aviation and transportation technologies provide opportunities for enhanced aerial projects, and the overall integration of unmanned aircraft systems (UAS) into the National Airspace System (NAS) has applications across a wide range of operations. Through these, remote operators have learned to manage several UAS at the same time in a variety of operational environments. The present work details a component piece of an ongoing body of research into multi-UAS operations. Beginning in early 2020, NASA has collaborated with Uber Technologies to design and develop concepts of operations, roles and responsibilities, and ground control station (GCS) concepts to enable food delivery operations via multiple, small UAS (sUAS). A cognitive walkthrough was chosen as the method for data collection. This allowed information to be gathered from UAS subject matter experts (SMEs) that could further mature designs for future human-in-the-loop (HITL) simulations; in addition, it allowed information to be collected remotely during the stringent restrictions of the COVID-19 pandemic. Consequently, the described cognitive walkthrough activity utilized remote data collection protocols mediated through the usage of programs designed for presentation and telecommunications. Scenarios were designed, complete with airspace, contingencies, and remedial actions, to be presented to the SMEs. Information was collected using a combination of rating scales and open-ended questions. Results received from the SMEs revealed expected hazards, workloads, and information concerns inherent in the contingency scenarios. SMEs also provided insight into the design of GCS tools and displays as well as the duties and relationships of human operators (i.e., monitors) and automation (i.e., informers and flight managers). Implications of these findings are discussed.

unmanned aircraft systems↗

A Cognitive Walkthrough of Multiple Drone Delivery Operations

Advances of early twenty-first century aviation and transportation technologies provide opportunities for enhanced aerial projects, and the overall integration of unmanned aircraft systems (UAS) into the National Airspace System (NAS) has applications across a wide range of operations. Through these, remote operators have learned to manage several UAS at the same time in a variety of operational environments. The present work details a component piece of an ongoing body of research into multi-UAS operations. Beginning in early 2020, NASA has collaborated with Uber Technologies to design and develop concepts of operations, roles and responsibilities, and ground control station (GCS) concepts to enable food delivery operations via multiple, small UAS (sUAS). A cognitive walkthrough was chosen as the method for data collection. This allowed information to be gathered from UAS subject matter experts (SMEs) that could further mature designs for future human-in-the-loop (HITL) simulations; in addition, it allowed information to be collected remotely during the stringent restrictions of the COVID-19 pandemic. Consequently, the described cognitive walkthrough activity utilized remote data collection protocols mediated through the usage of programs designed for presentation and telecommunications. Scenarios were designed, complete with airspace, contingencies, and remedial actions, to be presented to the SMEs. Information was collected using a combination of rating scales and open-ended questions. Results received from the SMEs revealed expected hazards, workloads, and information concerns inherent in the contingency scenarios. SMEs also provided insight into the design of GCS tools and displays as well as the duties and relationships of human operators (i.e., monitors) and automation (i.e., informers and flight managers). Implications of these findings are discussed.

unmanned aircraft systems↗

HAT m:N Activity Overview

Since 2020, researchers from the Human Autonomy Teaming (HAT) Laboratory at NASA Ames Research Center have conducted human-in-the-loop (HITL) simulation research to study a new control paradigm for operations involving multiple remotely piloted aircraft systems (RPAS). Colloquially referred to as "m:N," this paradigm is characterized by multiple operators collaboratively controlling multiple vehicles between them. The m:N name expresses a ratio whereby m is the number of operators and N is the number of vehicles shared between them. In this presentation, HAT Lab researchers provide a high-level overview of the m:N studies that have been performed to-date. These include a study of the m:N concept of operations (CONOPS) and the attending roles and responsibilities ("ConOps/R&R Sim"), a study focused on contingency management involving dynamic, inter-operator transfers of vehicles ("Handoff Sim"), and a study examining the effects of pilot-ATC communication systems on workload ("UAM Comms Sim"). A selection of key results are provided. The presentation concludes with a brief discussion of planned research into m:N operations.

m:N↗

Evaluation of Initial and Midterm Air Traffic Procedures for Urban Air Mobility Operations

This paper describes a follow-on joint human-in-the loop (HITL) simulation effort by NASA and Joby Aviation that builds on the results of these previous studies. It extends that work by comparing the LOA condition for Initial UAM operations to Midterm operations that includes corridor airspace structures and some other changes to the operating environment. This is the first reported air traffic controller-in-the-loop evaluation of the corridor condition in a high-fidelity simulation environment. The following sections describe the routes, scenarios, and operating conditions along with metrics used to evaluate feasibility from the air traffic controllers’ perspectives. The results section presents the traffic levels that were feasible in each condition and concludes with recommendations for extending the scope and applicability of evaluations like this one in the future.

Savvy Verma↗

Constructive Engineering of Simulations

Joint experimentation that investigates sensor optimization, re-tasking and management has far reaching implications for Department of Defense, Interagency and multinational partners. An adaption of traditional human in the loop (HITL) Modeling and Simulation (M&S) was one approach used to generate the findings necessary to derive and support these implications. Here an entity-based simulation was re-engineered to run on USJFCOM's High Performance Computer (HPC). The HPC was used to support the vast number of constructive runs necessary to produce statistically significant data in a timely manner. Then from the resulting sensitivity analysis, event designers blended the necessary visualization and decision making components into a synthetic environment for the HITL simulations trials. These trials focused on areas where human decision making had the greatest impact on the sensor investigations. Thus, this paper discusses how re-engineering existing M&S for constructive applications can positively influence the design of an associated HITL experiment.

Snyder, Daniel R.↗

Evaluation of the Terminal Area Precision Scheduling and Spacing System for Performance-Based Navigation Arrivals

The growth of global demand for air transportation has put increasing strain on the nation's air traffic management system. To relieve this strain, the International Civil Aviation Organization has urged all nations to adopt Performance-Based Navigation (PBN), which can help to reduce air traffic congestion, decrease aviation fuel consumption, and protect the environment. NASA has developed a Terminal Area Precision Scheduling and Spacing (TAPSS) system that can support increased use of PBN during periods of high traffic, while supporting fuel-efficient, continuous descent approaches. In the original development of this system, arrival aircraft are assigned fuel-efficient Area Navigation (RNAV) Standard Terminal Arrival Routes before their initial descent from cruise, with routing defined to a specific runway. The system also determines precise schedules for these aircraft that facilitate continuous descent through the assigned routes. To meet these schedules, controllers are given a set of advisory tools to precisely control aircraft. The TAPSS system has been evaluated in a series of human-in-the-loop (HITL) air traffic simulations during 2010 and 2011. Results indicated increased airport arrival throughput up to 10 over current operations, and maintained fuel-efficient aircraft decent profiles from the initial descent to landing with reduced controller workload. This paper focuses on results from a joint NASA and FAA HITL simulation conducted in 2012. Due to the FAA rollout of the advance terminal area PBN procedures at mid-sized airports first, the TAPSS system was modified to manage arrival aircraft as they entered Terminal Radar Approach Control (TRACON). Dallas-Love Field airport (DAL) was selected by the FAA as a representative mid-sized airport within a constrained TRACON airspace due to the close proximity of a major airport, in this case Dallas-Ft Worth International Airport, one of the busiest in the world. To address this constraint, RNAV routes and Required Navigation Performance with the particular capability known as Radius-to-Fix (RNP-RF) approaches to a short final were used. The purpose of this simulation was to get feedback on how current operations could benefit with the TAPSS system and also to evaluate the efficacy of the advisory tools to support the broader use of PBN in the US National Airspace System. For this NASA-FAA joint experiment, an Air Traffic Control laboratory at NASA Ames was arranged to simulate arrivals into DAL in Instrument Meteorological Conditions utilizing parallel dependent approaches, with two feeder positions that handed off traffic to one final position. Four FAA controllers participated, alternately covering these three positions. All participants were Full-Performance Level terminal controllers and members of the National Air Traffic Controllers Association. During the simulation, PBN arrival operations were compared and contrasted in three conditions. They were the Baseline, where none of the TAPSS systems TRACON controller decision support advisories were provided, the Limited Advisories, reflecting the existing but dormant capabilities of the current terminal automation equipment with providing a subset of the TAPSS systems advisories; numerical delay, landing sequence, and runway assignment information, and the Full Advisories, with providing the following in addition to the ones in the Limited condition; trajectory slot markers, timelines of estimated times of arrivals and sched

Performance based navigation↗

Airspace Technology Demonstration 2 (ATD-2) Integrated Surface and Airspace Simulation - Experiment Plan

This presentation describes the overview of the ATD-2 project and the integrated simulation of surface and airspace to evaluate the procedures of IADS system and evaluate surface metering capabilities via a high-fidelity human-in-the-loop simulation. Two HITL facilities, Future Flight Central (FFC) and Airspace Operations Laboratory (AOL), are integrated for simulating surface operations of the Charlotte-Douglas International Airport (CLT) and airspace in CLT TRACON and Washington Center.

ATD-2↗

Development and Validation of an Automated Simulation Capability in Support of Integrated Demand Management

Integrated Demand Management (IDM) is a near- to mid-term NASA concept that proposes to address mismatches in air traffic system demand and capacity by using strategic flow management capabilities to pre-condition demand into the more tactical Time-Based Flow Management System (TBFM). This paper describes an automated simulation capability to support IDM concept development. The capability closely mimics existing human-in-the-loop (HITL) capabilities, automating both the human components and collaboration between operational systems, and speeding up the real-time aircraft simulations. Such a capability allows for parametric studies that will inform the HITL simulations, identifying breaking points and parameter values at which significant changes in system behavior occur. This paper also describes the initial validation of individual components of the automated simulation capability, and an example application comparing the performance of the IDM concept under two TBFM scheduling paradigms. The results and conclusions from this simulation compare closely to those from previous HITL simulations using similar scenarios, providing an initial validation of the automated simulation capability.

Integrated Demand Management↗

Investigation of Communications Involved in Near-Term UAM Operations

The present research explored whether the implementation of a letter of agreement (LOA), or pre-established written terms of engagement, would reduce controller communication associated workload in a HITL study simulating a near-term UAM infrastructure with varying traffic levels. Current helicopter routes, including modified versions, and communication procedures were outlined in the LOA. Time spent communicating was reduced under both conditions featuring a LOA, for current and modified routes, compared to present day procedures without a LOA. Results suggest that utilizing current-day helicopter routes and implementing a LOA may prove beneficial for near-term low-density and low-tempo UAM operations.

Keeler, Jillian N.↗