A Remote, Human-in-the-Loop Evaluation of a Multiple-Drone Delivery Operation
Explore the source record for details and available documents.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Since 2020, researchers from the Human Autonomy Teaming (HAT) Laboratory at NASA Ames Research Center have conducted human-in-the-loop (HITL) simulation research to study a new control paradigm for operations involving multiple remotely piloted aircraft systems (RPAS). Colloquially referred to as "m:N," this paradigm is characterized by multiple operators collaboratively controlling multiple vehicles between them. The m:N name expresses a ratio whereby m is the number of operators and N is the number of vehicles shared between them. In this presentation, HAT Lab researchers provide a high-level overview of the m:N studies that have been performed to-date. These include a study of the m:N concept of operations (CONOPS) and the attending roles and responsibilities ("ConOps/R&R Sim"), a study focused on contingency management involving dynamic, inter-operator transfers of vehicles ("Handoff Sim"), and a study examining the effects of pilot-ATC communication systems on workload ("UAM Comms Sim"). A selection of key results are provided. The presentation concludes with a brief discussion of planned research into m:N operations.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
The use of Assistive Detect and Avoid (Assistive DAA or ADAA) technology in Urban Air Mobility (UAM) environments poses potential benefits as well as challenges. Assistive DAA refers to the leveraged use of DAA technology, originally developed to replace see-and-avoid capabilities for remotely piloted aircraft, in onboard-piloted aircraft to augment (rather than replace) pilots’ see-and-avoid abilities and thus enhance the safety and efficiency of visual flight operations. ADAA is anticipated to be especially safety-enhancing in airspace where traffic density is high or traditional air traffic services are limited, such as in future UAM environments. ADAA may also enable higher-tempo UAM operations than with only see-and-avoid capabilities, while still maintaining acceptable levels of safety. UAM concepts under development by the FAA, NASA, and industry focus on operations moving people and cargo in urban and suburban areas using innovative technologies, operations, and aircraft, including electric vertical takeoff and landing (eVTOL) aircraft. Researchers at NASA Langley Research Center, in collaboration with FAA researchers at the William J. Hughes Technical Center in Atlantic City, NJ, have conducted a series of medium-fidelity, human-in-the-loop research simulations of potential future UAM operations and concepts in both Class C and Class B airspace environments. These simulations have included use of a Langley-developed ADAA research tool called DANTi, which enables configurable ADAA displays to be presented to pilots of simulated eVTOL aircraft participating in higher-density and higher-tempo UAM operations. Experience and observations made during testing of the NASA-developed DANTi ADAA capability in the UAM NFLITE simulation environment will be reported in this paper together with a discussion of airspace integration and regulatory topics.
The use of Assistive Detect and Avoid (Assistive DAA or ADAA) technology in Urban Air Mobility (UAM) environments poses potential benefits as well as challenges. Assistive DAA refers to the leveraged use of DAA technology, originally developed to replace see-and-avoid capabilities for remotely piloted aircraft, in onboard-piloted aircraft to augment (rather than replace) pilots’ see-and-avoid abilities and thus enhance the safety and efficiency of visual flight operations. ADAA is anticipated to be especially safety-enhancing in airspace where traffic density is high or traditional air traffic services are limited, such as in future UAM environments. ADAA may also enable higher-tempo UAM operations than with only see-and-avoid capabilities, while still maintaining acceptable levels of safety. UAM concepts under development by the FAA, NASA, and industry focus on operations moving people and cargo in urban and suburban areas using innovative technologies, operations, and aircraft, including electric vertical takeoff and landing (eVTOL) aircraft. Researchers at NASA Langley Research Center, in collaboration with FAA researchers at the William J. Hughes Technical Center in Atlantic City, NJ, have conducted a series of medium-fidelity, human-in-the-loop research simulations of potential future UAM operations and concepts in both Class C and Class B airspace environments. These simulations have included use of a Langley-developed ADAA research tool called DANTi, which enables configurable ADAA displays to be presented to pilots of simulated eVTOL aircraft participating in higher-density and higher-tempo UAM operations. Experience and observations made during testing of the NASA-developed DANTi ADAA capability in the UAM NFLITE simulation environment will be reported in this paper together with a discussion of airspace integration and regulatory topics.
Explore the source record for details and available documents.
This presentation provides an overview of an upcoming human-in-the-loop simulation planned by the Pathfinding for Airspace with Autonomous Vehicles (PAAV) subproject, as part of the Air Traffic Management eXploration project. The study will investigate Detect and Avoid (DAA) concepts in and around the DAA terminal area (DTA). The DTA has received little investigation in real-time, pilot-in-the-loop simulation. This study proposes to use current remotely piloted aircraft system (RPAS) pilots to investigate the effectiveness of current DTA requirements using the FAA's Airborne Collision Avoidance System X for Rotorcraft (ACAS Xr) as the DAA system under test. The findings of this stufy will be used to inform DTA and ACAS Xr standards development. This presentation will be provided to RTCA Special Committee 228 as an overview and as an opportunity to collect feedback from the larger RPAS/DAA community on the study design and key scenarios and metrics. The presentation provides a brief overview of open areas of research with ACAS Xr, the experimental design, the simulation environment and the simulation schedule.
The Dryden Flight Research Center Facility of NASA Ames Research Center (Ames-Dryden) and the FAA conducted the controlled impact demonstration (CID) program using a large, four-engine, remotely piloted jet transport airplane. Closed-loop primary flight was controlled through the existing onboard PB-20D autopilot which had been modified for the CID program. Uplink commands were sent from a ground-based cockpit and digital computer in conjunction with an up-down telemetry link. These uplink commands were received aboard the airplane and transferred through uplink interface systems to the modified PB-20D autopilot. Both proportional and discrete commands were produced by the ground system. Prior to flight tests, extensive simulation was conducted during the development of ground-based digital control laws. The control laws included primary control, secondary control, and racetrack and final approach guidance. Extensive ground checks were performed on all remotely piloted systems; however, piloted flight tests were the primary method and validation of control law concepts developed from simulation. The design, development, and flight testing of control laws and systems required to accomplish the remotely piloted mission are discussed.
This paper describes how a 3 stage turbocharged gasoline engine was selected to power NASA's atmospheric science unmanned aircraft now under development. The airplane, whose purpose is to fly sampling instruments through targeted regions of the upper atmosphere at the exact location and time (season, time of day) where the most interesting chemistry is taking place, must have a round trip range exceeding 1000 km, carry a payload of about 500 lb to altitudes exceeding 80 kft over the site, and be able to remain above that altitude for at least 30 minutes before returning to base. This is a subsonic aircraft (the aerodynamic heating and shock associated with supersonic flight could easily destroy the chemical species that are being sampled) and it must be constructed so it will operate out of small airfields at primitive remote sites worldwide, under varying climate and weather conditions. Finally it must be low cost, since less than $50 M is available for its development. These requirements put severe constraints on the aircraft design (for example, wing loading in the vicinity of 10 psf) and have in turn limited the propulsion choices to already-existing hardware, or limited adaptations of existing hardware. The only candidate that could emerge under these circumstances was a propeller driven aircraft powered by spark ignited (SI) gasoline engines, whose intake pressurization is accomplished by multiple stages of turbo-charging and intercooling. Fortunately the turbocharged SI powerplant, owing to its rich automotive heritage and earlier intensive aero powerplant development during WWII, enjoys in addition to its potentially low development costs some subtle physical advantages (arising from its near-stochiometric combustion) that may make it smaller and lighter than either a turbine engine or a diesel for these altitudes. Just as fortunately, the NASA/industry team developing this aircraft includes the same people who built multi-stage turbocharged SI powerplants for unmanned military spyplanes in the early 1980's. Now adapting hardware developed for reconaissance at 65-70 kft to the interests of atmospheric science at 80-90 kft, their efforts should yield an aero powerplant that pushes the altitude limits of subsonic air breathing propulsion.
There is much interest in autonomous systems and their operations. When it comes to autonomous systems, it is critical to understand various levels of proposed autonomy, reasons for selecting autonomous capabilities, certification approaches and various challenges or research needs associated with the integration of autonomous systems in the National Airspace System (NAS). Furthermore, there are levels of autonomous systems proposed for different types of aircraft including: single pilot operations, remotely piloted operations, fully autonomous operations, and multiple aircraft managed by a single, remote pilot. This preliminary article aims to provide a broad overview rather than concentrate on a specific element of autonomous flight. Hence, the focus of this article is on enabling various types of increasingly autonomous aircraft and their operations routinely within the next five to ten years, consistent with the FAA’s Info-Centric NAS (ICN) vision. Under ICN, a fully integrated information environment supports collaboration across diverse traffic management services and shifts decision-making to the most appropriate actor supported by automation. However, the roles and responsibilities of Air Traffic Services (ATS) personnel providing traditional services are likely to be very similar to today in that humans will still be responsible for majority of decision making. There is another NASA research effort beyond ICN is underway called Sky For All which is not covered in this article as it is in the planning stages.
The use of remotely piloted unmanned aircraft systems/vehicles (UAS/UAV or drones) increases dramatically in recent years. This paper discusses the use of multiple-input and multiple-output (MIMO) technologies in cellular (i.e., LTE) based small UAS (sUAS) communications. More specifically, we will first provide background information about this work, followed by a review of state-of-the-art. Then, we will discuss the benefits of MIMO technologies and propose practical MIMO configurations (e.g., the type, size and number of antennas) that are suitable for NASA's sUAS research and operations. Finally, the design tradeoff among multiplexing, diversity, and interference/jamming cancellation will also be discussed.
Over time, advances in unmanned aircraft systems (UAS) have enabled a shift in the operational paradigm from one operator managing one aircraft to that of multiple operators working together to manage multiple aircraft. This shift has highlighted the need for effective human-autonomy teaming methods to maintain manageable workload levels for operators as well as high standards of system performance and safety. This paper presents a study aimed at evaluating whether automation can help operators manage workload during small UAS (sUAS) package delivery scenarios featuring contingency situations. These contingency situations, resulting from unplanned UAS Volume Reservations (UVRs), required flight path reroutes for multiple aircraft simultaneously. The study manipulated the number of aircraft affected by the UVRs and the level of automation support. The presence of terrain conflicts was also controlled within each scenario. Due to the COVID-19 pandemic, subjects were not able to gain direct access to the Ground Control System (GCS). Therefore, the study was conducted using a subject-surrogate paradigm that required subjects to relay commands through a verbal protocol from remote locations outside of the lab to a researcher surrogate who had direct control of the GCS interfaces at the lab location. Results show that the automated support condition was associated with faster reroute response times, more efficient reroute maneuvers, and significantly lower levels of perceived workload than the manual reroute condition. However, the automation support level did not significantly impact pilots’ ability to avoid the UVR successfully; pilots were overwhelmingly capable of avoiding the UVR in all conditions. The presence of terrain conflicts primarily impacted pilot performance by leading to multiple uploads per vehicle, which was not typically required when pilots only needed to maneuver laterally. Although subjects did not have direct control over the GCS, subjective ratings indicate that the displays under test provided them with sufficient information to manage their aircraft and promptly respond to the unplanned UVRs. Overall, the objective and subjective data strongly suggest that the verbal protocol and subject-surrogate paradigm were effective methods for collecting data remotely amid the COVID-19 pandemic.
The use of remotely piloted unmanned aircraft systems/vehicles (UAS/UAV or drones) increases dramatically in recent years. This paper discusses the use of multiple-input and multiple-output (MIMO) technologies in cellular (i.e., LTE) based small UAS (sUAS) communications. More specifically, we will first provide background information about this work, followed by a review of state-of-the-art. Then, we will discuss the benefits of MIMO technologies and propose practical MIMO configurations (e.g., the type, size and number of antennas) that are suitable for NASA's sUAS research and operations. Finally, the design tradeoff among multiplexing, diversity, and interference/jamming cancellation will also be discussed.
The present study investigated the effects of remotely piloted unmanned aircraft (UA) voice communication delay on air traffic management operations with different background sector traffic-volume levels. Three one-way UA voice delay lengths of 400, 900, and 2,000 milliseconds (ms) were tested, representing the currently estimated transmission delays for terrestrial, satellite communication (SATCOM), and long SATCOM Command and Control Link System, respectively. All delay values exceeded 390 ms, the FAA’s current requirement for the maximum communication latency in the National Airspace System. Eight retired en route air traffic controllers (ATCs) and eight remote pilots (RPs) participated in a human-inthe-loop simulation study, where a simulated UA flight transitioned through an Oakland en route low-altitude sector to a local non-towered airport. The results showed that, when the 2,000-ms voice delay was present, radio transmission step-ons and detect-and-avoid (DAA) alert level elevations increased. In addition, ATC workload, ATC acceptability for the UA, and RP acceptability for the DAA were negatively affected only when the UA had a 2,000-ms voice delay under the high traffic-volume condition, but not in the other conditions.
The present study investigated the effects of remotely piloted unmanned aircraft (UA) voice communication delay on air traffic management operations with different background sector traffic-volume levels. Three one-way UA voice delay lengths of 400, 900, and 2,000 milliseconds (ms) were tested, representing the currently estimated transmission delays for terrestrial, satellite communication (SATCOM), and long SATCOM Command and Control Link System, respectively. All delay values exceeded 390 ms, the FAA’s current requirement for the maximum communication latency in the National Airspace System. Eight retired en route air traffic controllers (ATCs) and eight remote pilots (RPs) participated in a human-in-the-loop simulation study, where a simulated UA flight transitioned through an Oakland en route low-altitude sector to a local non-towered airport. The results showed that, when the 2,000-ms voice delay was present, radio transmission step-ons and detect-and-avoid (DAA) alert level elevations increased. In addition, ATC workload, ATC acceptability for the UA, and RP acceptability for the DAA were negatively affected only when the UA had a 2,000-ms voice delay under the high traffic-volume condition, but not in the other conditions.
Air cargo companies and aircraft manufacturers are making significant investments to enable the movement of cargo via various levels of automated aircraft, such as aircraft with simplified operations requiring a pilot, remotely monitored or piloted aircraft, and fully autonomous aircraft. These investments will enable greater utilization of aircraft while unlocking new air markets traditionally served by ground transportation only. Many cargo companies and aerospace experts envision an operating environment where a single pilot can remotely pilot numerous aircraft for significant increases in aircraft utilization. The future operating environment is also expected to include air cargo companies flying smaller aircraft from airports and distribution centers outside of major U.S. cities directly to city centers, avoiding congested roads and increasing the velocity of cargo shipments, particularly those that are high-value, time-sensitive, and security sensitive (e.g., pharmaceuticals). These are just a few benefits and use cases cargo companies and aerospace experts see with the advancement of automated aircraft. To better understand industry’s direction, NASA asked the LMI team to research the forecasted market, timeline, risks, and opportunities for integrating unmanned air cargo vehicles into the National Airspace System (NAS) for the development and prioritization of the NASA Air Traffic Management Exploration’s research portfolio. To begin the market assessment, we gathered data via numerous interviews with key stakeholders and subject matter experts and literature reviews. We then incorporated the data into a custom-developed systems dynamics model and visualization dashboard. The systems dynamics model classifies the size of the market (e.g., overall fleet size of automated aircraft) for four distinct use cases over the next 20 years. The model projects the year in which various types of automated aircraft will enter the commercial cargo market based on our team’s collective research on when the aircraft will become viable due to manufacturing and certification timelines and the lifespan of current, traditional aircraft in service, to name a few factors. While this report defines our team’s estimated timeline of entry and growth, the model is dynamic—it enables NASA users to change variables based on future-year events. If the necessary technology does not mature in accordance with our assumptions, then NASA can change the entry of service point to a future year to evaluate the changes in market size in the out years. This flexibility will be key to deciding when and how NASA should invest in various areas.