Engineering topics

Shively, R. Jay

Publications and source records attributed to Shively, R. Jay.

At least 19 records

NASA NTRS2018

Detect and Avoid: Efforts from NASA's UAS Integration into the NAS Project

NASA's Unmanned Aerial Systems (UAS) integration into the National Air Space (NAS) project has been working closely with the FAA and RTCA Special Committee 228 to identify and break down barriers to UAS integration. A focus of this work is on detect and avoid (DAA) technologies. A pilot has responsibility to see and avoid other aircraft and to remain "well clear," using their best judgment (Federal Aviation Regulations (FAR) Sec. 91.113). For UAS to perform this function, the see function is replaced by sensors to detect the other aircraft. Secondly, the pilot judgment of well clear has to be replaced by a mathematical expression. For Phase 1 of this effort, a well clear violation was defined if all three of these conditions are true: a) the horizontal clearance is less than 4000 ft., and b) the vertical clearance is less than 450 ft., and c) the time to loss of well clear is less than 35 seconds. This definition was developed with a great deal of community input and testing to ensure interoperability with Air Traffic Control (ATC) and pilots of manned aircraft. Appropriate guidance, alerting and displays were developed to allow UAS, with the appropriate sensors, to effectively maintain well clear. This work contributed to FAA Technical Standard Orders: TSO-C211, Detect and Avoid and TSO-C212, ATAR for Traffic Surveillance. Phase 2 of this work extends the operational environment to include the terminal area and lesser capable aircraft that might not have the payload capability to carry the RADAR defined in Phase 1. This session reports on work from Phase 1 and initial work in Phase 2.

Detect and Avoid (DAA)↗

NASA NTRS2017

A Human-Autonomy Teaming Approach for a Flight-Following Task

Human involvement with increasingly autonomous systems must adjust to allow for a more dynamic relationship involving cooperation and teamwork. As part of an ongoing project to develop a framework for human autonomy teaming (HAT) in aviation, a study was conducted to evaluate proposed tenets of HAT. Participants performed a flight-following task at a ground station both with and without HAT features enabled. Overall, participants preferred the ground station with HAT features enabled over the station without the HAT features. Participants reported that the HAT displays and automation were preferred for keeping up with operationally important issues. Additionally, participants reported that the HAT displays and automation provided enough situation awareness to complete the task, reduced the necessary workload and were efficient. Overall, there was general agreement that HAT features supported teaming with the automation. These results will be used to refine and expand our proposed framework for human-autonomy teaming.

Human-Autonomy Teaming (HAT)↗

NASA NTRS2017

Beyond Point Design: General Pattern to Specific Implementations

Elsewhere we have discussed a number of problems typical of highly automated systems and proposed tenets for addressing these problems based on Human-Autonomy Teaming (HAT)[1]. We have examined these principles in the context of aviation [2,3]. Here we discuss the generality of these tenets by examining how they might be applied to photography and automotive navigation. While these domains are very different, we find application of our HAT tenets provides a number of opportunities for improving interaction between human operators and automation. We then illustrate how the generalities found across aviation, photography and navigation can be captured in a design pattern.

Lachter, Joel Benjamin↗

NASA NTRS2017

Validation of Minimum Display Requirements for a UAS Detect and Avoid System

The full integration of Unmanned Aircraft Systems (UAS) into the National Airspace System (NAS), a prerequisite for enabling a broad range of public and commercial UAS operations, presents several technical challenges to UAS developers, operators and regulators. A primary barrier is the inability for UAS pilots (situated at a ground control station, or GCS) to comply with Title 14 Code of Federal Regulations sections 91.111 and 91.113, which require pilots to “see and avoid” other aircraft in order to maintain well clear. UAS pilots’ removal from the flight deck of the aircraft necessitates the development of a UAS-specific system for detecting nearby traffic and displaying traffic information to the pilot to support their ability to maintain an objectively defined “DAA well clear” threshold from other aircraft. This new UAS-specific function of remaining DAA well clear is called traffic avoidance. The resulting Detect and Avoid (DAA) system, however, will be subject to a collection of requirements that manufacturers will be obligated to meet in order to certify their equipment. RTCA Special Committee 228 (SC-228), a consortium of representatives from government, industry and academia, is responsible for developing and documenting the Minimum Operational Performance Standards (MOPS) for UAS DAA systems. The present study is the final in a series of human-in-the-loop (HITL) experiments designed to explore and test the various display and alerting requirements being incorporated into the DAA MOPS. Whereas the prior DAA HITLs examined a wide variety of DAA display features and concepts, the current experiment aims to validate the latest minimum display requirements for Phase 1 of the DAA MOPS. Rather than test different display concepts, this study tests two configurations of a MOPS-compatible DAA display: a version that is integrated into the primary navigation and control display of the GCS and a version that is physically separated from the primary display. This manipulation tests the draft minimum requirement that allows the DAA traffic display to be a separate, or standalone, configuration. This type of configuration is a more achievable near-term technology solution since it does not stipulate additional certification or integration requirements on UAS manufacturers. However, a standalone display configuration has the potential to result in pilot performance issues resulting from the cognitive costs of switching between the primary DAA display and the primary navigation and control display. This configuration is also particularly susceptible to errors if the displays are in different orientations (e.g., north-up versus track-up). Both the integrated and standalone display configurations were presented to 16 active UAS pilots in a medium-fidelity simulation, which included confederate air traffic controllers and pseudo pilots operating simulated manned traffic. Pilots were tasked with navigating two different mission routes while maintaining DAA well clear with scripted conflicts. Pilot response times (i.e., measured response) and ability to remain DAA well clear are reported. Primary results indicate that both display configurations resulted in favorable response times and well clear rates. While there were clear trends of pilots objectively performing better in the integrated display condition, with several measured response metrics reaching statistical significance, the differences between the two displays were typically moderate. While the primary variable of DAA display location did not have an especially large impact on pilot performance on its own, when examined alongside the type of DAA threat the pilot was facing (a caution-level versus a warning-level alert), the response time benefits associated with the integrated display were amplified. The implications of these American Institute of Aeronautics and Astronautics 2 results on the Phase 1 DAA MOPS and the connection of this data to previous studies is also discussed.

detect and avoid↗

NASA NTRS2016

Application of Human-Autonomy Teaming (HAT) Patterns to Reduced Crew Operations (RCO)

As part of the Air Force - NASA Bi-Annual Research Council Meeting, slides will be presented on recent Reduced Crew Operations (RCO) work. Unmanned aerial systems, robotics, advanced cockpits, and air traffic management are all examples of domains that are seeing dramatic increases in automation. While automation may take on some tasks previously performed by humans, humans will still be required, for the foreseeable future, to remain in the system. The collaboration with humans and these increasingly autonomous systems will begin to resemble cooperation between teammates, rather than simple task allocation. It is critical to understand this human-autonomy teaming (HAT) to optimize these systems in the future. One methodology to understand HAT is by identifying recurring patterns of HAT that have similar characteristics and solutions. A methodology for identifying HAT patterns to an advanced cockpit project is discussed.

Human-Autonomy Teaming (HAT)↗

NASA NTRS2016

Application of Human-Autonomy Teaming (HAT) Patterns to Reduce Crew Operations (RCO)

Unmanned aerial systems, robotics, advanced cockpits, and air traffic management are all examples of domains that are seeing dramatic increases in automation. While automation may take on some tasks previously performed by humans, humans will still be required, for the foreseeable future, to remain in the system. The collaboration with humans and these increasingly autonomous systems will begin to resemble cooperation between teammates, rather than simple task allocation. It is critical to understand this human-autonomy teaming (HAT) to optimize these systems in the future. One methodology to understand HAT is by identifying recurring patterns of HAT that have similar characteristics and solutions. This paper applies a methodology for identifying HAT patterns to an advanced cockpit project.

design patterns↗

NASA NTRS2015

An Evaluation of Detect and Avoid (DAA) Displays for Unmanned Aircraft Systems: The Effect of Information Level and Display Location on Pilot Performance

A consortium of government, industry and academia is currently working to establish minimum operational performance standards for Detect and Avoid (DAA) and Control and Communications (C2) systems in order to enable broader integration of Unmanned Aircraft Systems (UAS) into the National Airspace System (NAS). One subset of these performance standards will need to address the DAA display requirements that support an acceptable level of pilot performance. From a pilot's perspective, the DAA task is the maintenance of self separation and collision avoidance from other aircraft, utilizing the available information and controls within the Ground Control Station (GCS), including the DAA display. The pilot-in-the-loop DAA task requires the pilot to carry out three major functions: 1) detect a potential threat, 2) determine an appropriate resolution maneuver, and 3) execute that resolution maneuver via the GCS control and navigation interface(s). The purpose of the present study was to examine two main questions with respect to DAA display considerations that could impact pilots' ability to maintain well clear from other aircraft. First, what is the effect of a minimum (or basic) information display compared to an advanced information display on pilot performance? Second, what is the effect of display location on UAS pilot performance? Two levels of information level (basic, advanced) were compared across two levels of display location (standalone, integrated), for a total of four displays. The authors propose an eight-stage pilot-DAA interaction timeline from which several pilot response time metrics can be extracted. These metrics were compared across the four display conditions. The results indicate that the advanced displays had faster overall response times compared to the basic displays, however, there were no significant differences between the standalone and integrated displays. Implications of the findings on understanding pilot performance on the DAA task, the development of DAA display performance standards, as well as the need for future research are discussed.

detect and avoid↗

NASA NTRS2015

Human Performance Considerations for Remotely Piloted Aircraft Systems (RPAS)

Successful integration of Remotely Piloted Aircraft Systems (RPAS) into civil airspace will not only require solutions to technical challenges, but will also require that the design and operation of RPAS take into account human limitations and capabilities. Human factors can affect overall system performance whenever the system relies on people to interact with another element of the system. Four types of broad interactions can be described. These are (1) interactions between people and hardware, such as controls and displays; (2) human use of procedures and documentation; (3) impact of the task environment, including lighting, noise and monotony; and lastly, (4) interactions between operational personnel, including communication and coordination. In addition to the human factors that have been identified for conventional aviation, RPAS operations introduce a set of unique human challenges. The purpose of document is to raise human factors issues for consideration by workgroups of the ICAO RPAS panel as they work to develop guidance material and additions to ICAO annexes. It is anticipated that the content of this document will be revised and updated as the work of the panel progresses.

ICAO↗

NASA NTRS2014

NASA's UAS Integration into the NAS: A Report on the Human Systems Integration Phase 1 Simulation Activities

In 2011 the National Aeronautics and Space Administration (NASA) began a five-year Project to address the technical barriers related to routine access of Unmanned Aerial Systems (UAS) in the National Airspace System (NAS). Planned in two phases, the goal of the first phase was to lay the foundations for the Project by identifying those barriers and key issues to be addressed to achieve integration. Phase 1 activities were completed two years into the five-year Project. The purpose of this paper is to review activities within the Human Systems Integration (HSI) subproject in Phase 1 toward its two objectives: 1) develop GCS guidelines for routine UAS access to the NAS, and 2) develop a prototype display suite within an existing Ground Control Station (GCS). The first objective directly addresses a critical barrier for UAS integration into the NAS - a lack of GCS design standards or requirements. First, the paper describes the initial development of a prototype GCS display suite and supporting simulation software capabilities. Then, three simulation experiments utilizing this simulation architecture are summarized. The first experiment sought to determine a baseline performance of UAS pilots operating in civil airspace under current instrument flight rules for manned aircraft. The second experiment examined the effect of currently employed UAS contingency procedures on Air Traffic Control (ATC) participants. The third experiment compared three GCS command and control interfaces on UAS pilot response times in compliance with ATC clearances. The authors discuss how the results of these and future simulation and flight-testing activities contribute to the development of GCS guidelines to support the safe integration of UAS into the NAS. Finally, the planned activities for Phase 2, including an integrated human-in-the-loop simulation and two flight tests are briefly described.

National Airspace System↗

NASA NTRS2014

Human Factor Challenges of Remotely Piloted Aircraft

The control stations of many unmanned systems have been characterized by inadequate human-system interfaces. Some of the interface problems may have been prevented had an existing regulation or cockpit design principle been applied. In other cases, the design problems may indicate a lack of suitable guidance material. The human factors of unmanned operations will be reviewed, and a NASA program to develop human-factor guidelines for control stations will be described. To be effective, guidelines must be relevant to a wide range of systems, must not be overly prescriptive, and must not impose premature standardization on evolving technologies. Several types of guidelines are described. These relate to required capabilities, information requirements, properties of the human machine interface, and general cognitive engineering principles.

Hobbs, Alan↗

NASA NTRS2013

Human Factors Guidelines for UAS in the National Airspace System

The ground control stations (GCS) of some UAS have been characterized by less-than-adequate human-system interfaces. In some cases this may reflect a failure to apply an existing regulation or human factors standard. In other cases, the problem may indicate a lack of suitable guidance material. NASA is leading a community effort to develop recommendations for human factors guidelines for GCS to support routine beyond-line-of-sight UAS operations in the national airspace system (NAS). In contrast to regulations, guidelines are not mandatory requirements. However, by encapsulating solutions to identified problems or areas of risk, guidelines can provide assistance to system developers, users and regulatory agencies. To be effective, guidelines must be relevant to a wide range of systems, must not be overly prescriptive, and must not impose premature standardization on evolving technologies. By assuming that a pilot will be responsible for each UAS operating in the NAS, and that the aircraft will be required to operate in a manner comparable to conventionally piloted aircraft, it is possible to identify a generic set of pilot tasks and the information, control and communication requirements needed to support these tasks. Areas where guidelines will be useful can then be identified, utilizing information from simulations, operational experience and the human factors literature. In developing guidelines, we recognize that existing regulatory and guidance material will, at times, provide adequate coverage of an area. In other cases suitable guidelines may be found in existing military or industry human factors standards. In cases where appropriate existing standards cannot be identified, original guidelines will be proposed.

Guidelines↗

NASA NTRS2011

Application of Human-Autonomy Teaming (HAT) Patterns to Reduce Crew Operations (RCO)

Unmanned aerial systems, advanced cockpits, and air traffic management are all seeing dramatic increases in automation. However, while automation may take on some tasks previously performed by humans, humans will still be required to remain in the system for the foreseeable future. The collaboration between humans and these increasingly autonomous systems will begin to resemble cooperation between teammates, rather than simple task allocation. It is critical to understand this human-autonomy teaming (HAT) to optimize these systems in the future. One methodology to understand HAT is by identifying recurring patterns of HAT that have similar characteristics and solutions. This paper applies a methodology for identifying HAT patterns to an advanced cockpit project.

design patterns↗

NASA NTRS2004

Comanche Helmet-Mounted Display Symbology Evaluation

This study assessed pilot-vehicle performance and workload associated with flying the Comanche Contact Analog, world-referenced primary flight symbology when compared with a conventional, screen-fixed, Compressed symbology. Previous investigation had revealed benefits when utilizing Compressed symbology in constrained flight maneuvers. The current evaluation further evaluated the effects of symbology by testing pilots in a high-fidelity simulator, executing more operational tasks. Flight performance and subjective ratings from six experimental test pilots were collected. Results replicated previous findings, and no performance differences were found in operational tasks. Pilot comments revealed significant preference for Compressed symbology, while some aspects of Contact Analog symbology raised objections. Performance, preference, and safety of flight issues perceived by test pilots merit a review of Contact Analog symbology design.

Dowell, Susan R.↗

NASA NTRS2002

Contact Analog/Compressed Symbology Heading Tape Assessment

A simulation assessed the performance, handling qualities and workload associated with a contact-analog, world-referenced heading tape as implemented on the Comanche Helmet Integrated Display Sight System (HIDSS) when compared with a screen-fixed, compressed heading tape. Six pilots, four active duty Army Aviators and two civilians flew three ADS-33 maneuvers and a traffic pattern in the Ames Vertical Motion Simulation facility. Small, but statistically significant advantages were found for the compressed symbology for handling qualities, workload, and some of the performance measures. It should be noted however that the level of performance and handling qualities for both symbology sets fell within the acceptable tolerance levels. Both symbology sets yield satisfactory handling qualities and performance in velocity stabilization mode and adequate handling qualities in the automatic flight control mode. Pilot comments about the contact analog symbology highlighted the lack of useful rate of change information in the heading tape and "blurring" due to the rapid movement of the heading tape. These issues warrant further study. Care must be taken in interpreting the operational significance of these results. The symbology sets yielded categorically similar data, i.e., acceptable handling qualities and adequate performance, so while the results point to the need for further study, their operational significance has yet to be determined.

Shively, R. Jay↗

NASA NTRS2000

Evaluation of a Computational Model of Situational Awareness

Although the use of the psychological construct of situational awareness (SA) assists researchers in creating a flight environment that is safer and more predictable, its true potential remains untapped until a valid means of predicting SA a priori becomes available. Previous work proposed a computational model of SA (CSA) that sought to Fill that void. The current line of research is aimed at validating that model. The results show that the model accurately predicted SA in a piloted simulation.

Burdick, Mark D.↗

NASA NTRS1999

Re-Design and Beat Testing of the Man-Machine Integration Design and Analysis System: MIDAS

The Man-machine Design and Analysis System (MIDAS) is a human factors design and analysis system that combines human cognitive models with 3D CAD models and rapid prototyping and simulation techniques. MIDAS allows designers to ask 'what if' types of questions early in concept exploration and development prior to actual hardware development. The system outputs predictions of operator workload, situational awareness and system performance as well as graphical visualization of the cockpit designs interacting with models of the human in a mission scenario. Recently, MIDAS was re-designed to enhance functionality and usability. The goals driving the redesign include more efficient processing, GUI interface, advances in the memory structures, implementation of external vision models and audition. These changes were detailed in an earlier paper. Two Beta test sites with diverse applications have been chosen. One Beta test site is investigating the development of a new airframe and its interaction with the air traffic management system. The second Beta test effort will investigate 3D auditory cueing in conjunction with traditional visual cueing strategies including panel-mounted and heads-up displays. The progress and lessons learned on each of these projects will be discussed.

Shively, R. Jay↗

NASA NTRS1994

Effects of Perceptual Augmentation Of Visual Displays: Dissociation of Performance and Situational Awareness

It is intuitive that good performance is associated with, if not caused by, good situational awareness. There are, however, some situations in which these two concepts diverge. There are some trivial examples that have been identified, such as auto-pilots. However, it is also possible that these concepts diverge in a much more subtle manner. This research is focused on investigating those more subtle situations. Specifically, this research addresses the effects of perceptual display enhancement based upon Ecological Task Analysis (ETA) on performance and situational awareness. A perceptually augmented display was designed based upon ETA. Globally, performance advantages were found for the group with the enhanced display. Further, the findings demonstrate a dissociation of sub-task performance and operators' knowledge of the system subtask. The mechanisms involved in this dissociation are related to the characteristics of the display augmentation that led to the increased performance. The level of processing, and presence of feedback seem to play an important mediating role. These findings have important implications for both designers and researchers.

Shively, R. Jay↗

NASA NTRS1993

Emergency medical service (EMS): A unique flight environment

The EMS flight environment is unique in today's aviation. The pilots must respond quickly to emergency events and often fly to landing zones where they have never been before . The time from initially receiving a call to being airborne can be as little as two to three minutes. Often the EMS pilot is the only aviation professional on site, they have no operations people or other pilots to aid them in making decisons. Further, since they are often flying to accident scenes, not airports, there is often complete weather and condition information. Therefore, the initial decision that the pilot must make, accepting or declining a flight, can become very difficult. The accident rate of EMS helicopters has been relatively high over the past years. NASA-Ames research center has taken several steps in an attempt to aid EMS pilots in their decision making and situational awareness. A preflight risk assessment system (SAFE) was developed to aid pilots in their decision making, and was tested at an EMS service. The resutls of the study were promising and a second version incorporating the lessons learned is under development. A second line of research was the development of a low cost electronic chart display (ECD). This is a digital map display to help pilots maintain geographical orientation. Another thrust was undertaken in conjunction with the Aviation Safety Reporting System (ASRS). This involved publicizing the ASRS to EMS pilots and personnel, and calling each of the reporters back to gather additional information. This paper will discuss these efforts and how they may positively impact the safety of EMS operations.

Shively, R. Jay↗