Search NASA⌕ Search

SEARCH · Search NASA

Results for “human-automation interaction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Multiple Views on Safety-Critical Automation: Aircraft, Autonomous Vehicles, Air Traffic Management and Satellite Ground Segments Perspectives

This SIG focuses on the engineering of automation in interactive critical systems. Automation has already been studied in a number of (sub-) disciplines and application fields: design, human factors, psychology, (software) engineering, aviation, health care, games. One distinguishing feature of the area we are focusing on is that in the field of interactive critical systems properties such as reliability, dependability, fault-tolerance are as important as usability, user experience or overall acceptance issues. The SIG targets at two problem areas: first the engineering of the user interaction with (partly-) autonomous systems: how to design, build and assess autonomous behavior, especially in cases where there is a need to represent on the user interface both autonomous and interactive objects. An example of such integration is the representation of an unmanned aerial vehicle (UAV) (where no direct interaction is possible), together with aircrafts (that have to be instructed by an air traffic controller to avoid the UAV). Second the design and engineering of user interaction in general for autonomous objects systems (for example a cruise control in a car or an autopilot in an aircraft). The goal of the SIG is to raise interest in the CHI community on the general aspects of automation and to identify a community of researchers and practitioners interested in those increasingly prominent issues of interfaces towards (semi)-autonomous systems. The expected audience should be interested in addressing the issues of integration of mainly unconnected research domains to formulate a new joint research agenda.

safety-critical automation↗

A First Look at the Evolution of Flight Crew Requirements for Emerging Market Aircraft

This is an exciting time for aviation. New vehicle and airspace technologies promise large increases in the number of aircraft in operation. One critical technology for these emerging markets is the increased use of automated systems to reduce pilot skill, training, and proficiency requirements. While the use of these systems promises to reduce or eliminate pilot functions in the long-term, the technology development for the required functions will necessitate a phased transition. The transition to, and adoption of automated systems will generate new safety challenges. This paper is a first look at a model to help frame flight crew functions for evaluation of future operational requirements. The model is intended to provide required flight crew functions regardless of whether the functions are performed by human or artificial agent. It is hoped that the model will be useful in identifying safety challenges and enabling a safe transition for the new aviation markets. The paper presents some background for a model for framing the flight crew function model and some thoughts about next steps.

safety-critical automation↗

A Closer Look at Automation Behavior During a Human-in-the-Loop Simulation

A 2012 Human-In-The-Loop air traffic control simulation investigated a gradual paradigm-shift in the allocation of functions between operators and automation. Air traffic controllers staffed five adjacent high-altitude en route sectors, and during the course of a two-week experiment, worked traffic under four different function allocation concepts aligned with increasingly mature NextGen operational environments. These NextGen time-frames ranged from near current-day operations to nearly fully-automated control, in which the ground systems automation was responsible for detecting conflicts, issuing strategic and tactical resolutions, and alerting controllers to exceptional circumstances. This paper continues the investigations reported in previous publications. Analyses of data surrounding the conflict-resolution task serve as the context in which we investigate the interactions between controllers and the automation.

Human-Automation Interaction↗

Humans, Autonomy, and eVTOLs

Electric Vertical Takeoff and Landing (eVTOL) vehicle and airspace technologies promise large increases in the number of aircraft in operation. One critical technology for these emerging markets is the increased use of automated systems to reduce pilot skill, training, and proficiency requirements. While the use of these systems promises to reduce or eliminate pilot functions in the long-term, the technology development for the required functions will necessitate a phased transition. The transition to, and adoption of automated systems will generate new safety challenges. This presentation discusses current safety challenges, new challenges for eVTOLs, and some research focused on addressing these challenges.

Human-Automation Interaction↗

Deep Space Human-Systems Research Recommendations for Future Human-Automation/Robotic Integration

Appropriate integration between automation and robotics systems and their human operators is essential for future space exploration. The Human Factors and Behavioral Performance Element of NASA’s Human Research Program requires a systematic understanding of the critical human-automation/robotic (HAR) integration, or HARI, design challenges for future space exploration. This document reports the results of a systematic assessment of the spaceflight-relevant HARI technologies and research topics addressing critical gaps in spaceflight-relevant HARI knowledge, and prioritizes research required for successful human performance and HAR integration. We reviewed relevant literature across the past ten years and interviewed ten subject matter experts to investigate the current state of HARI technology, challenges facing development, the state of HARI research across a wide range of fields, and opportunities for advancing the state of the art through directed research. This information was used to identify relevant HARI technologies and research topics, as well as factors to assess relative priority of HARI technologies. We worked with NASA stakeholders to weight the factors relevant to assessing HARI specific technologies. A multi-dimensional trade analysis was performed to objectively score HARI research topics and specific technologies to recommended investment priorities for NASA.

human-automation interaction↗

Towards a Characterization of Scheduling Task Complexity

Future long-duration missions will require astronauts to act more autonomously, manage their schedules, and replan timelines as anomalies and discoveries occur. Astronauts are not professional planners, however, and the complexity of schedules that novice planners can complete successfully is not fully understood. To identify the primary factors which contribute to scheduling task complexity, we conducted a human-in-the-loop study and developed planning algorithms to investigate how the type and amount of constraints affect the difficulty of scheduling and rescheduling. We created rankings of difficulty using a combination of human performance metrics from experimental planning tasks and metrics describing the final plans that participants scheduled. Using the results of our scheduling and rescheduling algorithm algorithms, we created a similar ranking with which to compare. We created rankings which compared well between the experimental and algorithm results for the scheduling task, but the rescheduling task proved more difficult to estimate.

scheduling↗

Attentional Considerations in Advanced Air Mobility Operations: Control, Manage, or Assist?

The implementation of automation will enable Advanced Air Mobility (AAM), which could alter the hu-man’s responsibilities from those of an active controller to a passive monitor of vehicles. Mature AAM operations will likely rely on both experienced and novice operators to supervise multiple aircraft. As AAM constitutes a complex and increasingly autonomous system, the human operator’s set of responsibilities will transition from those of a controller, to a manager, and eventually to an assistant to highly automated systems. The development of AAM will require system designers to characterize these three sets of human responsibilities. The present work proposes different human responsibilities across various roles (i.e., pilot in command, system operator, system assistant) in the context of AAM along with pertinent attention-related constructs that could contribute to each of the three identified roles of AAM operators including situation awareness, workload, complacency, and vigilance.

Advanced Air Mobility↗

Multifactor Interactions and the Air Traffic Controller: The Interaction of Situation Awareness and Workload in Association with Automation

Air traffic controllers (ATCOs) must maintain a consistently high level of human performance in order to maintain flight safety and efficiency. In current control environments, performance-influencing factors such as workload, fatigue and situation awareness (SA) can co-occur, and interact, to affect performance. However, multifactor influences and the association with performance are under-researched. This study utilized a high fidelity human in the loop enroute air traffic control simulation to investigate the relationship between workload, situation awareness and ATCO performance. The study aimed to replicate and extend Edwards, Sharples, Wilson and Kirwan's (2012) previous study and confirm multifactor interactions with a participant sample of ex-controllers. The study also aimed to extend Edwards et al.'s previous research by comparing multifactor relationships across 4 automation conditions. Results suggest that workload and SA may interact to produce a cumulative impact on controller performance, although the effect of the interaction on performance may be dependent on the context and amount of automation present. Findings have implications for human-automation teaming in air traffic control, and the potential prediction and support of ATCO performance.

Workload↗

Human-in-the-Loop Evaluation of Dynamic Multi-Flight Common Route Advisories

Flights often experience large delays when they are routed around weather. Multi-flight common route advisories provide delay recovery by suggesting time-saving re-routes for groups of flights whose current weather-avoidance routes have become outdated because the weather has dissipated and/or moved away. A laboratory evaluation of these advisories was conducted by four subject matter experts having extensive experience in traffic flow management operations. These experts provided a total of 120 data points in the airspace of Houston Center. The multi-flight common route tool provides time-saving route change advisories taking into account flight plans, wind fields, and the spatio-temporal evolution of predicted convective weather. It is not designed to account for complex operational factors such as non-standard sector traversal and interactions with local traffic management initiatives; hence a relatively low percentage (37%) of advisories generated by the tool were rated as acceptable. However, a high percentage (81%) of advisories were rated as acceptable after the subject matter experts used the tool's user interface to make route modifications that accounted for relevant operational factors not considered by the tool. The workload associated with using the tool, as measured by the NASA Task Load Index, was quite low (1.1 on a scale of 0 to 10). The results of this evaluation make a good case for human-automation teaming to design operationally valid weather re-routes for delay recovery.

Traffic Flow Management↗

Human-in-the-Loop Evaluation of Dynamic Multi-Flight Common Route Advisories

Flights often experience large delays when they are routed around weather. Multi-flight common route advisories provide delay recovery by suggesting time-saving re-routes for groups of flights whose current weather-avoidance routes have become outdated because the weather has dissipated and/or moved away. A laboratory evaluation of these advisories was conducted by four subject matter experts having extensive experience in traffic flow management operations. These experts provided a total of 120 data points in the airspace of Houston Center. The multi-flight common route tool provides time-saving route change advisories taking into account flight plans, wind fields, and the spatio-temporal evolution of predicted convective weather. It is not designed to account for complex operational factors such as non-standard sector traversal and interactions with local traffic management initiatives; hence a relatively low percentage (37%) of advisories generated by the tool were rated as acceptable. However, a high percentage (81%) of advisories were rated as acceptable after the subject matter experts used the tool's user interface to make route modifications that accounted for relevant operational factors not considered by the tool. The workload associated with using the tool, as measured by the NASA Task Load Index, was quite low (1.1 on a scale of 0 to 10). The results of this evaluation make a good case for human-automation teaming to design operationally valid weather re-routes for delay recovery.

Traffic Flow Management↗

Measuring the Effectiveness of Human Autonomy Teaming

Human-Automation Teaming (HAT), is now recognized as a promising solution to the problems of humans managing increasingly complex work systems. A human-automation team can be defined as the interdependent coupling between one or more human operators and one or more autonomous systems requiring collaboration and coordination to accomplish system and task goals (e.g., Langan-Fox et al., 2009). In this conception, automated agents are considered team members that can operate at various levels of automation, be focused on one or more human-information-processing stages, and the interactions with human operators may be adaptable, adjustable or mixed initiative. We investigated some metrics for assessing HAT effectiveness in a demonstration of a HAT tool used by ground station operators in a Reduced Crew Operations project that was conducted at NASA Ames Human Automation Teaming Laboratory. In this paper, we focus on operator metrics of HAT effectiveness, specifically workload and operator behaviors.

measurements↗

Team play with a powerful and independent agent: operational experiences and automation surprises on the Airbus A-320

Research and operational experience have shown that one of the major problems with pilot-automation interaction is a lack of mode awareness (i.e., the current and future status and behavior of the automation). As a result, pilots sometimes experience so-called automation surprises when the automation takes an unexpected action or fails to behave as anticipated. A lack of mode awareness and automation surprises can he viewed as symptoms of a mismatch between human and machine properties and capabilities. Changes in automation design can therefore he expected to affect the likelihood and nature of problems encountered by pilots. Previous studies have focused exclusively on early generation "glass cockpit" aircraft that were designed based on a similar automation philosophy. To find out whether similar difficulties with maintaining mode awareness are encountered on more advanced aircraft, a corpus of automation surprises was gathered from pilots of the Airbus A-320, an aircraft characterized by high levels of autonomy, authority, and complexity. To understand the underlying reasons for reported breakdowns in human-automation coordination, we also asked pilots about their monitoring strategies and their experiences with and attitude toward the unique design of flight controls on this aircraft.

NASA Discipline Space Human Factors↗

Work Practice Simulation of Complex Human-Automation Systems in Safety Critical Situations: The Brahms Generalized berlingen Model

The transition from the current air traffic system to the next generation air traffic system will require the introduction of new automated systems, including transferring some functions from air traffic controllers to on­-board automation. This report describes a new design verification and validation (V&V) methodology for assessing aviation safety. The approach involves a detailed computer simulation of work practices that includes people interacting with flight-critical systems. The research is part of an effort to develop new modeling and verification methodologies that can assess the safety of flight-critical systems, system configurations, and operational concepts. The 2002 Ueberlingen mid-air collision was chosen for analysis and modeling because one of the main causes of the accident was one crew's response to a conflict between the instructions of the air traffic controller and the instructions of TCAS, an automated Traffic Alert and Collision Avoidance System on-board warning system. It thus furnishes an example of the problem of authority versus autonomy. It provides a starting point for exploring authority/autonomy conflict in the larger system of organization, tools, and practices in which the participants' moment-by-moment actions take place. We have developed a general air traffic system model (not a specific simulation of Überlingen events), called the Brahms Generalized Ueberlingen Model (Brahms-GUeM). Brahms is a multi-agent simulation system that models people, tools, facilities/vehicles, and geography to simulate the current air transportation system as a collection of distributed, interactive subsystems (e.g., airports, air-traffic control towers and personnel, aircraft, automated flight systems and air-traffic tools, instruments, crew). Brahms-GUeM can be configured in different ways, called scenarios, such that anomalous events that contributed to the Überlingen accident can be modeled as functioning according to requirements or in an anomalous condition, as occurred during the accident. Brahms-GUeM thus implicitly defines a class of scenarios, which include as an instance what occurred at Überlingen. Brahms-GUeM is a modeling framework enabling "what if" analysis of alternative work system configurations and thus facilitating design of alternative operations concepts. It enables subsequent adaption (reusing simulation components) for modeling and simulating NextGen scenarios. This project demonstrates that BRAHMS provides the capacity to model the complexity of air transportation systems, going beyond idealized and simple flights to include for example the interaction of pilots and ATCOs. The research shows clearly that verification and validation must include the entire work system, on the one hand to check that mechanisms exist to handle failures of communication and alerting subsystems and/or failures of people to notice, comprehend, or communicate problematic (unsafe) situations; but also to understand how people must use their own judgment in relating fallible systems like TCAS to other sources of information and thus to evaluate how the unreliability of automation affects system safety. The simulation shows in particular that distributed agents (people and automated systems) acting without knowledge of each others' actions can create a complex, dynamic system whose interactive behavior is unexpected and is changing too quickly to comprehend and control.

complex systems↗

The Human Performance Envelope: Past Research, Present Activities and Future Directions

Air traffic controllers (ATCOs) must maintain a consistently high level of human performance in order to maintain flight safety and efficiency. In current control environments, performance-influencing factors such as workload, fatigue and situation awareness can co-occur, and interact, to effect performance. However, multifactor influences and the association with performance are under-researched. This study utilized a high fidelity human in the loop enroute air traffic control simulation to investigate the relationship between workload, situation awareness and ATCO performance. The study aimed to replicate and extend Edwards, Sharples, Wilson and Kirwans (2012) previous study and confirm multifactor interactions with a participant sample of ex-controllers. The study also aimed to extend Edwards et als previous research by comparing multifactor relationships across 4 automation conditions. Results suggest that workload and SA may interact to produce a cumulative impact on controller performance, although the effect of the interaction on performance may be dependent on the context and amount of automation present. Findings have implications for human-automation teaming in air traffic control, and the potential prediction and support of ATCO performance.

human performance envelope↗

Human-Automation Cooperation for Separation Assurance in Future NextGen Environments

A 2012 Human-In-The-Loop air traffic control simulation investigated a gradual paradigm-shift in the allocation of functions between operators and automation. Air traffic controllers staffed five adjacent high-altitude en route sectors, and during the course of a two-week experiment, worked traffic under different function-allocation approaches aligned with four increasingly mature NextGen operational environments. These NextGen time-frames ranged from near current-day operations to nearly fully-automated control, in which the ground systems automation was responsible for detecting conflicts, issuing strategic and tactical resolutions, and alerting the controller to exceptional circumstances. Results indicate that overall performance was best in the most automated NextGen environment. Safe operations were achieved in this environment for twice todays peak airspace capacity, while being rated by the controllers as highly acceptable. However, results show that sector operations were not always safe; separation violations did in fact occur. This paper will describe in detail the simulation conducted, as well discuss important results and their implications.

air traffic control↗

Biocybernetic Closed-Loop System for Mitigating Hazardous States of Awareness

The past century of passenger flight has seen continuous improvement in aviation safety by the aerospace industry. However, while commercial aviation accident rates have continued to decline, human error-related incident and accident rates remain remarkably constant across all types of aviation (Shappell, et al., 2007). Unfortunately, this level of human error is unacceptable when considering projections for increased traffic volume (FAA, 2009), and is likely to yield more incidents and accidents unless a more complete understanding of operator error is achieved and remediations are implemented. One area of interest highlighted by researchers is Hazardous States of Awareness (HSAs) that can result from deficiencies in the design and inappropriate use of human-machine interfaces. Identifying and mitigating HSAs is critical for reducing operator errors. One promising approach uses psychophysiological measures which enable automated systems to adapt to the operator?s state and modify modes of operation to support optimal human performance (Scerbo, 2007). This paper will survey previous research and describe future directions for the application of psychophysiological measures of operators derived from cortical and autonomic assessment to perform real-time adaptive modulation of human-automation task mode mixes. The authors will present a summary of previous work done at NASA LaRC and Old Dominion University using a Psychophysiologically Adaptive System (PAS) in which the level of automation of the NASA Multi-Attribute Task Battery was modulated based on Engagement Indices derived from the users? electroencephalogram (Pope, Bogart, & Bartolome, 1995; for review see, Scerbo, Freeman, & Mikulka, 2003). Future theoretical and methodological directions for this type of closed-loop research will be discussed. Specifically, the capacity for this type of PAS to maintain effective operator state and to enable validation of candidate physiological indices will be described. Consideration will also be given to critical system characteristics (e.g., engagement indices, methods for invoking changes among system states, individual differences among users, etc.) that have been or still need to be studied. The potential of the PAS approach for interactive system design and prototyping will also be described. Examples of adaptive automation flight deck concepts in recent experiments will be highlighted and discussed.

Chad L Stephens↗