Search NASA⌕ Search

Engineering topics

Dismukes, R. Key

Publications and source records attributed to Dismukes, R. Key.

Effects of Acute Stress on Aircrew Performance: Literature Review and Analysis of Operational Aspects

Situational stress can adversely affect the cognition and skilled performance of pilots, as well as experts in other domains. Emergencies and other threatening situations require pilots to execute infrequently practiced procedures correctly and to use their skills and judgment to select an appropriate course of action, often under high workload, time pressure, and ambiguous indications, all of which can be stressful. Our current study, consited of three parts, starting with a critical review of the research literature on the effects of stress on skilled performance, going back to World War II and continuing to recent and more sophisticated studies of the cognitive effects of anxiety. In the second part we analyzed the specific ways stress may have impaired the performance of airline crews in twelve major accidents, selected for diversity of the situations the crews encountered. The third part examined the operational significance and practical implications of the findings from the first two parts, suggested specific ways to reduce the harmful effects of stress on flight crews, and identified aspects requiring further research. Even thought this study focused on flight crews, the findings apply to the effects of stress on the skilled performance of experts in almost any domain.

stress↗

Remembrance of Things Future: Prospective Memory in Laboratory, Workplace, and Everyday Settings

In this review, oriented to the human factors community, I will summarize and provide a perspective on recent research and theory on prospective memory. This will not be an exhaustive review of literature, which is already available in two excellent recent books that provide a wealth of detail on the current state of experimental research (Kliegel, McCaniel, & Einstein, 2008; McDaniel & Einstein, 2007; also see Brandimonte, Einstein, & McDaniel, 1996, for a still relevant overview of the field as it was emerging). Rather, I will explore the limits of existing experimental paradigms and theory, Vvilich, in my opinion, fail to capture some critical aspects of performance outside the laboratory. I will also review the relatively few studies in workplace and everyday settings and will discuss several studies that attempt to bridge between the bulk of experimental studies and these few naturalistic studies. Finally, I will describe countermeasures that can reduce vulnerability to forgetting to perform intended tasks, and I will propose a research agenda that would extend existing experimental and theoretical approaches and would support human factors practitioners by generating information on a wide range of issues relevant to prospective memory performance in natural settings.

Dismukes, R. Key↗

Checklists and Monitoring in the Cockpit: Why Crucial Defenses Sometimes Fail

Checklists and monitoring are two essential defenses against equipment failures and pilot errors. Problems with checklist use and pilots failures to monitor adequately have a long history in aviation accidents. This study was conducted to explore why checklists and monitoring sometimes fail to catch errors and equipment malfunctions as intended. Flight crew procedures were observed from the cockpit jumpseat during normal airline operations in order to: 1) collect data on monitoring and checklist use in cockpit operations in typical flight conditions; 2) provide a plausible cognitive account of why deviations from formal checklist and monitoring procedures sometimes occur; 3) lay a foundation for identifying ways to reduce vulnerability to inadvertent checklist and monitoring errors; 4) compare checklist and monitoring execution in normal flights with performance issues uncovered in accident investigations; and 5) suggest ways to improve the effectiveness of checklists and monitoring. Cognitive explanations for deviations from prescribed procedures are provided, along with suggestions for countermeasures for vulnerability to error.

Dismukes, R. Key↗

Pressing the Approach: A NASA Study of 19 Recent Accidents Yields a New Perspective on Pilot Error

This article begins with a review of two sample airplane accidents that were caused by pilot error. The analysis of these and 17 other accidents suggested that almost all experienced pilot operating in the same environment in which the accident crews were operating and knowing only what the accident crews knew at each moment of the flight, would be vulnerable to making a similar decision and similar errors. Whether a particular crew in a given situation makes errors depends on somewhat random interaction of factors. Two themes that seem to be prevalent in these cases are: Plan Continuation Bias, and Snowballing Workload.

Berman, Benjamin A.↗

A Gold Standards Approach to Training Instructors to Evaluate Crew Performance

The Advanced Qualification Program requires that airlines evaluate crew performance in Line Oriented Simulation. For this evaluation to be meaningful, instructors must observe relevant crew behaviors and evaluate those behaviors consistently and accurately against standards established by the airline. The airline industry has largely settled on an approach in which instructors evaluate crew performance on a series of event sets, using standardized grade sheets on which behaviors specific to event set are listed. Typically, new instructors are given a class in which they learn to use the grade sheets and practice evaluating crew performance observed on videotapes. These classes emphasize reliability, providing detailed instruction and practice in scoring so that all instructors within a given class will give similar scores to similar performance. This approach has value but also has important limitations; (1) ratings within one class of new instructors may differ from those of other classes; (2) ratings may not be driven primarily by the specific behaviors on which the company wanted the crews to be scored; and (3) ratings may not be calibrated to company standards for level of performance skill required. In this paper we provide a method to extend the existing method of training instructors to address these three limitations. We call this method the "gold standards" approach because it uses ratings from the company's most experienced instructors as the basis for training rater accuracy. This approach ties the training to the specific behaviors on which the experienced instructors based their ratings.

Baker, David P.↗

LOFT Debriefings: An Analysis of Instructor Techniques and Crew Participation

This study analyzes techniques instructors use to facilitate crew analysis and evaluation of their Line-Oriented Flight Training (LOFT) performance. A rating instrument called the Debriefing Assessment Battery (DAB) was developed which enables raters to reliably assess instructor facilitation techniques and characterize crew participation. Thirty-six debriefing sessions conducted at five U.S. airlines were analyzed to determine the nature of instructor facilitation and crew participation. Ratings obtained using the DAB corresponded closely with descriptive measures of instructor and crew performance. The data provide empirical evidence that facilitation can be an effective tool for increasing the depth of crew participation and self-analysis of CRM performance. Instructor facilitation skill varied dramatically, suggesting a need for more concrete hands-on training in facilitation techniques. Crews were responsive but fell short of actively leading their own debriefings. Ways to improve debriefing effectiveness are suggested.

Dismukes, R. Key↗

Facilitating LOS Debriefings: A Training Manual

This manual is a practical guide to help airline instructors effectively facilitate debriefings of Line Oriented Simulations (LOS). It is based on a recently completed study of Line Oriented Flight Training (LOFT) debriefings at several U.S. airlines. This manual presents specific facilitation tools instructors can use to achieve debriefing objectives. The approach of the manual is to be flexible so it can be tailored to the individual needs of each airline. Part One clarifies the purpose and objectives of facilitation in the LOS setting. Part Two provides recommendations for clarifying roles and expectations and presents a model for organizing discussion. Part Tree suggests techniques for eliciting active crew participation and in-depth analysis and evaluation. Finally, in Part Four, these techniques are organized according to the facilitation model. Examples of how to effectively use the techniques are provided throughout, including strategies to try when the debriefing objectives are not being fully achieved.

McDonnell, Lori K.↗

Translating Research Into Airline Practice: Case Studies In Collaboration

Airline training departments are avid customers for research that will help them enhance the effectiveness of training and the safety of flight operations. However, various factors often make it difficult for training department managers to draw upon the large body of human factors research, e.g.: research may not address the specific questions facing the training departments, the research literature may not be in a form that training managers can readily interpret, researchers' recommendations may be too expensive or impractical to implement, etc. This panel will discuss ways in which researchers can work with training departments to design research and translate findings into products that airlines can use readily. This collaboration is most effective when it is an integral part of the study from its inception. To illustrate the process of collaboration we will use as a case study the recently completed LOFT (Line Oriented Flight Training) Debriefing research project. We will summarize the findings from that study and discuss how we translated those findings into two training tools: a manual on how to facilitate LOFT debriefings and a video that illustrates facilitation techniques in a realistically enacted debriefing. In some cases, instead of starting a new research project, training department needs can be addressed by reviewing the existing research literature and using expert opinion to develop products that specifically address those needs. To illustrate this approach we will discuss a recent informal working group of scientists and airline personnel that met to develop training material to enhance situation awareness. This group reviewed scientific literature and ASRS (Aviation Safety Reporting System) reports, analyzed contributing factors, and produced a model for managing situation awareness.

Dismukes, R. Key↗

Aviation human factors research in US universities: Potential contributions to national needs

Universities can and should make vital contributions to national needs in aviation human factors. However, to guide and utilize university research effectively we must understand what types of expertise and facilities universities can bring to bear on aviation problems. We should be aware of where relevant research is already underway and where untapped potential exists. How does the character of research in universities differ from and complement research in government and industry laboratories? What conditions would encourage universities to focus on national priorities and would promote high quality, relevant research? This paper attempts to address these issues. It is based on a survey conducted by the author, which included site visits to several universities, telephone interviews with faculty members at other universities, and a search of the aviation human factors research literature.

Dismukes, R. Key↗