Search NASA⌕ Search

Engineering topics

Shafto, Michael G.

Publications and source records attributed to Shafto, Michael G..

At least 19 records

NASA's OCA Mirroring System: An Application of Multiagent Systems in Mission Control

Orbital Communications Adaptor (OCA) Flight Controllers, in NASA's International Space Station Mission Control Center, use different computer systems to uplink, downlink, mirror, archive, and deliver files to and from the International Space Station (ISS) in real time. The OCA Mirroring System (OCAMS) is a multiagent software system (MAS) that is operational in NASA's Mission Control Center. This paper presents OCAMS and its workings in an operational setting where flight controllers rely on the system 24x7. We also discuss the return on investment, based on a simulation baseline, six months of 24x7 operations at NASA Johnson Space Center in Houston, Texas, and a projection of future capabilities. This paper ends with a discussion of the value of MAS and future planned functionality and capabilities.

Sierhuis, Maarten↗

What Happened, and Why: Toward an Understanding of Human Error Based on Automated Analyses of Incident Reports

The objective of the Aviation System Monitoring and Modeling (ASMM) project of NASA s Aviation Safety and Security Program was to develop technologies that will enable proactive management of safety risk, which entails identifying the precursor events and conditions that foreshadow most accidents. This presents a particular challenge in the aviation system where people are key components and human error is frequently cited as a major contributing factor or cause of incidents and accidents. In the aviation "world", information about what happened can be extracted from quantitative data sources, but the experiential account of the incident reporter is the best available source of information about why an incident happened. This report describes a conceptual model and an approach to automated analyses of textual data sources for the subjective perspective of the reporter of the incident to aid in understanding why an incident occurred. It explores a first-generation process for routinely searching large databases of textual reports of aviation incident or accidents, and reliably analyzing them for causal factors of human behavior (the why of an incident). We have defined a generic structure of information that is postulated to be a sound basis for defining similarities between aviation incidents. Based on this structure, we have introduced the simplifying structure, which we call the Scenario as a pragmatic guide for identifying similarities of what happened based on the objective parameters that define the Context and the Outcome of a Scenario. We believe that it will be possible to design an automated analysis process guided by the structure of the Scenario that will aid aviation-safety experts to understand the systemic issues that are conducive to human error.

Maille, Nicolas P.↗

Human-Interaction Challenges in UAV-Based Autonomous Surveillance

Autonomous UAVs provide a platform for intelligent surveillance in application domains ranging from security and military operations to scientific information gathering and land management. Surveillance tasks are often long duration, requiring that any approach be adaptive to changes in the environment or user needs. We describe a decision- theoretic model of surveillance, appropriate for use on our autonomous helicopter, that provides a basis for optimizing the value of information returned by the UAV. From this approach arise a range of challenges in making this framework practical for use by human operators lacking specialized knowledge of autonomy and mathematics. This paper describes our platform and approach, then describes human-interaction challenges arising from this approach that we have identified and begun to address.

Freed, Michael↗

Employing Simulation to Evaluate Designs: The APEX Approach

The key innovations of APEX are its integrated approaches to task analysis, procedure definition, and intelligent, resource-constrained multi-tasking. This paper presents a step-by-step description of how APEX is used, from scenario development through trace analysis.

Freed, Michael A.↗

Differences Training for the Glass Cockpit

This study followed two groups of pilots from a major US air carrier as they went through a transition to advanced technology aircraft. Specifically, these were pilots were no previous automation experience undergoing Differences training from the 737-100/200 aircraft to the 737-300/500 aircraft. Each were given a different curriculum and data were collected on the efficacy of each training model and the pilots' attitudes toward automation. Results of the analyses performed and guidelines for training are included.

Wiener, Earl L.↗

Free Flight and Self-Separation from the Flight Deck Perspective

The concept of "free flight", while still being developed, is intended to emphasize more, flexibility for operators in the National Airspace System (NAS) by providing more separation responsibility to pilots, New technologies, procedures, and concepts have been suggested by the aviation community to enable this task; however, much work needs to be accomplished to help define and evaluate the concept feasibility. The purpose of this simulation was to begin examining some of the communication and procedural issues associated with self-separation in the enroute environment. A simulation demonstration was conducted in the Boeing 747-400 simulator at NASA Ames Research Center. Commercial pilots (from a U.S. domestic carrier) current on the B747-400 aircraft were the participants. Ten flight crews (10 captains, 10 first officers) flew in the Denver enroute airspace environment. A new alerting logic designed to allow for airborne self-separation was created for this demonstration. This logic assumes automatic dependent surveillance broadcast (ADS-B) capability and represented aircraft up to 120 nautical miles on the display. The new flight deck display features were designed and incorporated on the existing navigational display in the simulator to allow for increased traffic and maneuvering information to the flight crew. New tools were also provided to allow the crews to assess conflicts and potential maneuvers before implementing them. Each of the flight crews flew eight different scenarios in the Denver enroute airspace. The scenarios included eight to ten other aircraft, and each scenario was created with the intent of having one of the other aircraft become an operational conflict for our simulator aircraft. Different types of conflict geometries were represented across the eight scenarios. Also, some scenarios allowed for more time to detect a potential clearance, while others allowed for less time for'detection. Additionally, the crews were asked to a ply the Visual Flight Rules (VFR) right of way rules when determining who should maneuver in a conflict situation; therefore, the scenarios were designed to test different applications of those recommendations, Data analyses include an evaluation of crew procedures and communication. The application of the VFR right-of-way rules are being explored. Timing variables are being examined to determine potential efficiency differences between scenarios and conflict types. Proximity of aircraft will be assessed as one indication of the operational safety. The intent of these evaluations is to help provide definitions and guidelines of negotiation procedures in a self-separation environment assuming automated data link technology (ADS-B). Also, definitions of likely flight crew maneuvers and application to current VFR right-of-way rules may be obtained, along with guidelines for negotiation procedures between flight crews.

Lozito, Sandra↗

Word Frequency Effects in Dual-Task Studies Using Lexical Decision and Naming as Task 2

Word frequency effects in dual-task lexical decision are variously reported to be additive or underadditive across SOA. We replicate and extend earlier lexical decision studies and find word frequency to be additive across SOA. To more directly capture lexical processing, we examine dual-task naming. Once again, we find word frequency to be additive across SOA. Lexical processing appears to be constrained by central processing limitations.

Remington, Roger W.↗

A Framework for Modeling Human-Machine Interactions

Modern automated flight-control systems employ a variety of different behaviors, or modes, for managing the flight. While developments in cockpit automation have resulted in workload reduction and economical advantages, they have also given rise to an ill-defined class of human-machine problems, sometimes referred to as 'automation surprises'. Our interest in applying formal methods for describing human-computer interaction stems from our ongoing research on cockpit automation. In this area of aeronautical human factors, there is much concern about how flight crews interact with automated flight-control systems, so that the likelihood of making errors, in particular mode-errors, is minimized and the consequences of such errors are contained. The goal of the ongoing research on formal methods in this context is: (1) to develop a framework for describing human interaction with control systems; (2) to formally categorize such automation surprises; and (3) to develop tests for identification of these categories early in the specification phase of a new human-machine system.

Shafto, Michael G.↗

Modes in Supervisory Control Systems: Structure and Transitions

Mode confusion is becoming a major drawback in operator interaction with systems that allow for multiple levels of automation. This drawback has manifested itself in several mode related accidents and incidents in commercial aviation, military control systems, as well as high technology medical systems. In the domain of commercial aviation, there have been four recent airline accidents, all involving highly automated aircraft, in which mode related problems were present. Mode problems, we argue, stem from three principal factors: (1) mis-identification of the current mode, (2) difficulty in apprehending current mode behavior; and (3) difficulty in predicting the consequences of the next mode transition. This combination of factors may lead to mode confusion and possibly unwanted results. We define in this paper a mode as the system's manner of behavior. Any given system or machine, may have several ways of behaving. A controller, either human or machine, provides the input that triggers the transition from one mode of behavior to another. At any point in time, a machine may be in one mode or another modes are mutually exclusive. Complex systems are typically comprised of several subsystems, or components, each one with its own set of modes. Therefore, the status of the system at any point in time can be described as a vector of all the active modes.

Degani, Asaf↗

Decision Making in the Airplane

The Importance of decision-making to safety in complex, dynamic environments like mission control centers, aviation, and offshore installations has been well established. NASA-ARC has a program of research dedicated to fostering safe and effective decision-making in the manned spaceflight environment. Because access to spaceflight is limited, environments with similar characteristics, including aviation and nuclear power plants, serve as analogs from which space-relevant data can be gathered and theories developed. Analyses of aviation accidents cite crew judgement and decision making as causes or contributing factors in over half of all accidents. Yet laboratory research on decision making has not proven especially helpful In improving the quality of decisions in these kinds of environments. One reason is that the traditional, analytic decision models are inappropriate to multi-dimensional, high-risk environments, and do not accurately describe what expert human decision makers do when they make decisions that have consequences. A new model of dynamic, naturalistic decision making is offered that may prove useful for improving decision making in complex, isolated, confined and high-risk environments. Based on analyses of crew performance in full-mission simulators and accident reports, features that define effective decision strategies in abnormal or emergency situations have been identified. These include accurate situation assessment (including time and risk assessment), appreciation of the complexity of the problem, sensitivity to constraints on the decision, timeliness of the response, and use of adequate information. More effective crews also manage their workload to provide themselves with time and resources to make good decisions. In brief, good decisions are appropriate to the demands of the situation. Effective crew decision making and overall performance are mediated by crew communication. Communication contributes to performance because it assures that all crew members have essential information, but it also regulates and coordinates crew actions and is the medium of collective thinking In response to a problem, This presentation will examine the relations between leadership, communication, decision making and overall crew performance. Implications of these findings for training will be discussed.

Orasanu, Judith↗

Cross-Cultural Barriers to Effective Communication in Aviation

Recent research on communication and performance in airline flight crews has led to a concept of shared mental models that is associated with effective, efficient team coordination in problem solving and decision making situations. Elements that characterize efficient communication have been identified. This research, however, was based strictly on US crews. More recent studies supported by NASA have identified cultural factors that influence communication among team members who vary in their status and roles. Research is just beginning to identify commonalities and culturally distinct strategies for accomplishing joint tasks. ASRS incident reports have been analyzed to identify language barriers in flight that have safety consequences. Implications of these concepts and findings for multi-cultural command and control will be explored.

Orasanu, Judith↗

Identifying Human Factors Issues in Aircraft Maintenance Operations

Maintenance operations incidents submitted to the Aviation Safety Reporting System (ASRS) between 1986-1992 were systematically analyzed in order to identify issues relevant to human factors and crew coordination. This exploratory analysis involved 95 ASRS reports which represented a wide range of maintenance incidents. The reports were coded and analyzed according to the type of error (e.g, wrong part, procedural error, non-procedural error), contributing factors (e.g., individual, within-team, cross-team, procedure, tools), result of the error (e.g., aircraft damage or not) as well as the operational impact (e.g., aircraft flown to destination, air return, delay at gate). The main findings indicate that procedural errors were most common (48.4%) and that individual and team actions contributed to the errors in more than 50% of the cases. As for operational results, most errors were either corrected after landing at the destination (51.6%) or required the flight crew to stop enroute (29.5%). Interactions among these variables are also discussed. This analysis is a first step toward developing a taxonomy of crew coordination problems in maintenance. By understanding what variables are important and how they are interrelated, we may develop intervention strategies that are better tailored to the human factor issues involved.

Veinott, Elizabeth S.↗

Capturing the Value: Earth Applications of Space Human Factors Research

This paper details how the Space Human Factors/Life Sciences program at Ames Research Center (ARC) has provided, and continues to provide, a variety of Earth-based benefits. These benefits will be considered under five categories: aeronautics, space-like environments, general applications, human/automation interaction, and methodology. The human factors work at ARC includes a range of activities whose products serve the aerospace community. Some areas of research focus specifically on aeronautical requirements; others are driven by space needs. However, the symbiosis between these two domains allows a sharing of resources, and the insights and experimental results gathered in one domain can often be applied in the other. Aeronautics is an industry whose survival is generally viewed as critical to American competitiveness, and where benefits can result in a very high payoff. The ability to apply space-initiated research to aeronautical requirements represents one example of bringing space benefits down to Earth. The second-order value of space human factors research goes well beyond the aerospace community. Spaceflight shares with a number of other activities certain environmental characteristics that drive human factors engineering design and procedural specification. Spaceflight is an isolated activity, conducted under severely confined conditions, with a high level of risk, and where provisions are restricted and opportunities for outside help are limited. A number of Earth-based activities including submarines and other naval vessels, oil rigs, remote weather stations, and scientific and polar expeditions, share many of these characteristics. These activities serve as testbeds for space-related research and, in turn, space-related research provides beneficial insight to the conduct of these activities.

Connors, Mary M.↗

Flight Schedule and the Circadian Clock Influence on Sleep Loss During Overnight Cargo Operations

Thirty-four flight crew members were monitored before, during, and after two 8-day overnight cargo duty patterns which involved multiple flights at night crossing no more than one time zone per 24 h. Rectal temperature, heart rate, and wrist activity were recorded every 2 min. Sleep quantity and quality, and nap timing, were noted in a logbook. To reduce the masking effects of physical activity on temperature, 0.28 C was added to each subject's raw temperature data whenever he reported being asleep. For both masked and unmasked data, daily temperature minima were estimated from the multiple complex demodulated waveform. The temperature minima did not show a progressive adaptation to night duty, which was interrupted by a night off after 5 nights on one trip pattern and after 3 nights on the other. On duty days, the average temperature minimum delayed by about 3 h, occurring near the end of the duty period. Daytime sleep episodes averaged 2.9 h shorter than nighttime sleep episodes, and were rated as lighter, less restorative, and poorer overall. Fifty-three percent of subjects slept more than once per 24 h while they were on night duty, compared to 17% when able to sleep at night. The total sleep per 24 h on duty days averaged 1.2 h less than pretrip. Twenty-nine percent of subjects lost more than 2 h of sleep per 24 h across the 8-day duty patterns. After night duty, subjects awoke around 1400 local time, even when they had slept 2-3 h less than a normal nocturnal sleep episode. Consequently, the duration of morning sleep episodes was correlated with the off-duty time (multiple r(sup 2)=0.44, F=37.23, p less than 0.0001). Anecdotally, crew members complained of being unable to sleep longer and not feeling well-rested. These wakeups were clustered 6 h after the temperature minimum, which suggests that they may have been a response to the circadian wakeup signal. Daytime layovers in which crew members were able to sleep again in the evening ended later (0200-0300) and were longer (average 19.2 h versus 14.8 h) than those in which they slept only once in the morning. Overnight cargo crew members are working around the time of the circadian nadir with an accumulating sleep debt. Two scheduling factors affect sleep loss during these operations: how long before the circadian wakeup signal crew members come off duty, and whether the layover lasts long enough to permit a second sleep episode in the early evening.

Gander, Philippa H.↗

A Laboratory Glass-Cockpit Flight Simulator for Automation and Communications Research

A laboratory glass-cockpit flight simulator supporting research on advanced commercial flight deck and Air Traffic Control (ATC) automation and communication interfaces has been developed at the Aviation Operations Branch at the NASA Ames Research Center. This system provides independent and integrated flight and ATC simulator stations, party line voice and datalink communications, along with video and audio monitoring and recording capabilities. Over the last several years, it has been used to support the investigation of flight human factors research issues involving: communication modality; message content and length; graphical versus textual presentation of information, and human accountability for automation. This paper updates the status of this simulator, describing new functionality in the areas of flight management system, EICAS display, and electronic checklist integration. It also provides an overview of several experiments performed using this simulator, including their application areas and results. Finally future enhancements to its ATC (integration of CTAS software) and flight deck (full crew operations) functionality are described.

Pisanich, Gregory M.↗

The Nature of Procedural Interrupts in Ground Operations in Aerospace Systems

This study proposes a methodology for characterizing the causal context and consequences of procedural interrupts in ground operations tasks. Behavioral science researchers observed 26 tasks at NASA's Kennedy Space Center. From these tasks, 81 procedural interrupts were identified and coded for the following information: source of the interrupt, circumstances surrounding the interrupt, and consequences of the interrupt. We found that more interrupts were equipment or personnel-related than procedure-related. More interrupts were due to unavailable resources or resources being incorrect than resources being inaccessible, and most interrupts resulted in some action being taken. Variation in duration of procedural interrupts across causal categories was also examined. The characterization process helps to identify those interrupts that are disruptive, those that cannot be avoided, and those that may have been prevented through better planning or scheduling of resources. Implications for the use of the methodology and suggestions for further research are discussed.

Irwin, Cheryl M.↗

Aircrew Discourse: Exploring Strategies of Information and Action Management

This paper explores methodology issues encountered in the analysis of flightcrew communications in aviation simulation research. Examples are provided by two recent studies which are compared on three issues: level of analysis, data definition, and interpretation of the results. The data discussed were collected in a study comparing two levels of aircraft automation. The first example is an investigation of how pilots' information transfer strategies differed as a function of automation during low and high-workload flight phases. The second study focuses on how crews managed actions in the two aircraft during a ten minute, high-workload flight segment. Results indicated that crews in the two aircraft differed in their strategies of information and action management. The differences are discussed in terms of their operational and research significance.

Irwin, Cheryl M.↗

"Oops, It didn't arm." - A Case Study of Two Automation Assisted Altitude Deviations

Altitude deviations are the most common pilot error reported to the Aviation Safety Reporting System. Last year, altitude deviations were reported to the ASRS at the rate of about one per hour. The reporting pilot's narrative is usually our only source of information about what happened in these incidents. In a recent line-oriented, simulator study, twenty-two airline crews flew a realistic, two-hour mission in a DC-9 and an MD-88 aircraft. This paper will describe and analyze two of the five altitude deviations that were observed during this study. The paper focuses on the flight crews' use (or misuse) of the autopilot and autothrottle during these incidents.

Plamer, Everett↗