Search NASA⌕ Search

SEARCH · Search NASA

Results for “human error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Intervention strategies for the management of human error

This report examines the management of human error in the cockpit. The principles probably apply as well to other applications in the aviation realm (e.g. air traffic control, dispatch, weather, etc.) as well as other high-risk systems outside of aviation (e.g. shipping, high-technology medical procedures, military operations, nuclear power production). Management of human error is distinguished from error prevention. It is a more encompassing term, which includes not only the prevention of error, but also a means of disallowing an error, once made, from adversely affecting system output. Such techniques include: traditional human factors engineering, improvement of feedback and feedforward of information from system to crew, 'error-evident' displays which make erroneous input more obvious to the crew, trapping of errors within a system, goal-sharing between humans and machines (also called 'intent-driven' systems), paperwork management, and behaviorally based approaches, including procedures, standardization, checklist design, training, cockpit resource management, etc. Fifteen guidelines for the design and implementation of intervention strategies are included.

Wiener, Earl L.↗

Human error in aviation operations

The role of human error in commercial and general aviation accidents and the techniques used to evaluate it are reviewed from a human-factors perspective. Topics addressed include the general decline in accidents per million departures since the 1960s, the increase in the proportion of accidents due to human error, methods for studying error, theoretical error models, and the design of error-resistant systems. Consideration is given to information acquisition and processing errors, visually guided flight, disorientation, instrument-assisted guidance, communication errors, decision errors, debiasing, and action errors.

Nagel, David C.↗

Management of human error by design

Design-induced errors and error prevention as well as the concept of lines of defense against human error are discussed. The concept of human error prevention, whose main focus has been on hardware, is extended to other features of the human-machine interface vulnerable to design-induced errors. In particular, it is pointed out that human factors and human error prevention should be part of the process of transport certification. Also, the concept of error tolerant systems is considered as a last line of defense against error.

Wiener, Earl↗

Determination of a Generic Human Error Probability Distribution, Part 1: A Dynamic Formulation of SPAR-H

In almost all major nuclear power plants (NPP) events include a significant human error component. As an example, in Fukushima Daiichi (2011) nuclear meltdown, the human actions related to the high-pressure injection cooling strongly affected accident evolution. Furthermore, in the Three Mile Island accident (1979) (which was initiated by a stuck open valve and thus was triggered a loss of coolant accident) the unit operators made decisions based upon false assumptions that contributed negatively to the accident. Given these premises, the ability to accurately model human interactions with plant evolution and, in particular, dynamically calculate human error probability (HEP) plays a major role in a probabilistic risk analysis (PRA). Human reliability analysis (HRA) identifies and models the causes of human errors, and quantifies HEP by applying different methodologies. HRA methods identify errors and reflect on the understanding of error-prone people and systems. There are a number of HRA methods available that assist in identifying the vulnerabilities in the system and provide guidance in determining the HEP. HEP is the probability of a human failure event (HFE), and quantification of HEPs under various situations is utilized in PRA of large complex systems. One of the more prominent HRA methods is the Standardized Plant Analysis Risk-Human Reliability Analysis (SPAR-H) method that was developed to estimate HEPs for the use in the Standardized Plant Analysis Risk (SPAR) PRA models employed in U.S. NPPs. SPAR-H is implemented in U.S. NPPs by regulators at the U.S. Nuclear Regulatory Commission (NRC) to determine the HEP based on expert estimation through the use of calculation worksheets. In SPAR-H, the nominal HEPs (NHEPs) are multiplied by performance shaping factors (PSF) multiplier values to obtain the overall error probability. PSFs encompass the human components, individual characteristics, their environment, and aspects of the task. With PSFs, the goal is to capture all factors that can affect human performance. In SPAR-H there are eight PSFs used, each having respective levels corresponding to multipliers: Available Time, Stress/Stressors, Complexity, Experience/Training, Procedures, Ergonomics/Human Machine Interface, Fitness for Duty, and Work Processes. The PSF multipliers indicate enhanced, nominal, or degraded human performance. The SPAR-H method estimates the HEP through multiplying a NHEP with PSFs. Hence, SPAR-H is a traditional HRA method that assesses human performance at a fixed, or static, point in time. In a dynamic HRA framework, human performance is assessed on a continuous time basis. SPAR-H can be used within a dynamic PRA framework through the use of simulation and stochastic models. The goal of dynamic HRA is to build a more realistic model of the human-system interaction to enhance calculation of reliability, risk and safety analysis. The progression of events in dynamic SPAR-H considers that some PSFs may experience gradual change, while other change can be sudden due to individualistic differences or rapid plant status changes. The PSF changes are caused by contextual changes in the scenario. For example, as more time passes, the realization that a task should be completed sooner may cause the operator more stress. In another example, a sudden relay of information about sickness of a family member may alter the operator's general stress level and fitness for duty. Each PSF has a different dynamic nature; PSFs like stress and complexity change more quickly over the course of a task than experience and training. While the experience of an operator changes over the course of attaining the objective, the amount that this added experience changes the HEP is very minimal. In contrast, the stress, complexity, and procedures PSFs may change quite a bit over the course of task completion.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

SPIDARman: System-Level Physics-Informed Detection of Anomalies in Reactor Collected Data Considering Human Errors

In nuclear power plants (NPPs), anomalies arising from sensors or human errors (HEs) can undermine the performance and reliability of plant operations. Anomaly detection models can be employed to detect sensor errors and HEs. Additionally, physics-informed machine learning models can utilize the known physics of the system, as described by mathematical equations, to ensure that sensor values are consistent with physical laws. Hence, we propose SPIDARman: System-level Physics-Informed Detection of Anomalies in Reactor Collected Data Considering Human Errors, a holistic physics-informed anomaly detection approach based on generative adversarial networks (GANs) to detect anomalies in both automatically collected sensor data and manually collected surveillance data. Here we test our approach on data collected from a flow loop testbed, showcasing its potential to detect anomalies. Results demonstrate that the proposed model performs better than the baseline GAN-based models in detecting sensor and surveillance anomalies, suggesting the potential of physics-informed anomaly detection GAN models in NPPs.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Application of the epidemiological model in studying human error in aviation

An epidemiological model is described in conjunction with the analytical process through which aviation occurrence reports are composed into the events and factors pertinent to it. The model represents a process in which disease, emanating from environmental conditions, manifests itself in symptoms that may lead to fatal illness, recoverable illness, or no illness depending on individual circumstances of patient vulnerability, preventive actions, and intervention. In the aviation system the analogy of the disease process is the predilection for error of human participants. This arises from factors in the operating or physical environment and results in errors of commission or omission that, again depending on the individual circumstances, may lead to accidents, system perturbations, or harmless corrections. A discussion of the previous investigations, each of which manifests the application of the epidemiological method, exemplifies its use and effectiveness.

Cheaney, E. S.↗

Using APEX to Model Anticipated Human Error: Analysis of a GPS Navigational Aid

The interface development process can be dramatically improved by predicting design facilitated human error at an early stage in the design process. The approach we advocate is to SIMULATE the behavior of a human agent carrying out tasks with a well-specified user interface, ANALYZE the simulation for instances of human error, and then REFINE the interface or protocol to minimize predicted error. This approach, incorporated into the APEX modeling architecture, differs from past approaches to human simulation in Its emphasis on error rather than e.g. learning rate or speed of response. The APEX model consists of two major components: (1) a powerful action selection component capable of simulating behavior in complex, multiple-task environments; and (2) a resource architecture which constrains cognitive, perceptual, and motor capabilities to within empirically demonstrated limits. The model mimics human errors arising from interactions between limited human resources and elements of the computer interface whose design falls to anticipate those limits. We analyze the design of a hand-held Global Positioning System (GPS) device used for radical and navigational decisions in small yacht recalls. The analysis demonstrates how human system modeling can be an effective design aid, helping to accelerate the process of refining a product (or procedure).

VanSelst, Mark↗

Determination of a Generic Human Error Probability Distribution, Part 2: A Dynamic SPAR-H Example Application

Humans are an integral part of a nuclear power plant (NPP) from its construction, to its everyday maintenance and operation. In the nuclear industry there are many approaches to quantifying component reliability, which is called probability risk assessment (PRA). In PRA there are two considerations given to the quantification, static and dynamic. Static is quantified before or after an operation; and dynamic is time dependent, in that the probability changes as real time data are provided. In PRA, the importance of the components is calculated, but what of the importance of the human component? There are several methods for human reliability analysis (HRA), which include but are not limited to: THERP, ATHEANA, CREAM, SPAR-H, ASEP, and SLIM. Each of these methods aims to provide a more accurate and objective human error probability (HEP) quantification. Of the methods listed above, ASEP, THERP, and SPAR-H are all inextricably linked. The Standardized Plant Analysis Risk-Human Reliability Analysis (SPAR-H) method was generated to better generalize the Technique for Human Error Rate Prediction (THERP) and Accident Sequence Precursor (ASEP). THERP is mapped to specific scenario templates, and ASEP is a simplified screening method, while SPAR-H employs generalizations to describe the spectrum of human behavior while maintaining the same theoretical underpinnings. SPAR-H is a well-known and accepted HRA method that uses performance shaping factors (PSFs) to classify inputs to the human component. PSFs capture a wide variety of input data, including plant status, crew dynamics, task description, and psychological aspects of the human operator. Current efforts have been focused to further generalize SPAR-H in to a dynamic framework. These methods can fit into dynamic NPP simulations such as RAVEN / RELAP-7. In order to do this, a dynamic methodology is applied to model the human as would be applied to the components. This method is applied in part one in the accompanying paper.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Automation of Commanding at NASA: Reducing Human Error in Space Flight

Automation has been implemented in many different industries to improve efficiency and reduce human error. Reducing or eliminating the human interaction in tasks has been proven to increase productivity in manufacturing and lessen the risk of mistakes by humans in the airline industry. Human space flight requires the flight controllers to monitor multiple systems and react quickly when failures occur so NASA is interested in implementing techniques that can assist in these tasks. Using automation to control some of these responsibilities could reduce the number of errors the flight controllers encounter due to standard human error characteristics. This paper will investigate the possibility of reducing human error in the critical area of manned space flight at NASA.

Dorn, Sarah J.↗

The Unintended Consequences of Focusing on Human Error (And How You Can Help)

The literature on human performance is rich with findings of cognitive failures and methods to identify, label, and measure them. In many real-world contexts, however, outcomes are driven far more by successful than failed cognition. Designers of systems intended for human use, in an effort to be “data driven,” rely upon findings from the cognitive performance literature to inform their system designs. When most available data are about human error, data-driven designs focus on the human primarily as a source of failure. Designs intended to support or replace humans often fail to acknowledge or understand the capabilities that humans routinely contribute to successful performance. Consequently, designs intended to “protect” the system from “error-prone” humans can design-out the capability for the human to effectively intervene or adapt. The development of paradigms to study successful human performance represents a significant and largely untapped opportunity for research in cognition.

Jon Holbrook↗

An experimental approach to validating a theory of human error in complex systems

The problem of 'human error' is pervasive in engineering systems in which the human is involved. In contrast to the common engineering approach of dealing with error probabilistically, the present research seeks to alleviate problems associated with error by gaining a greater understanding of causes and contributing factors from a human information processing perspective. The general approach involves identifying conditions which are hypothesized to contribute to errors, and experimentally creating the conditions in order to verify the hypotheses. The conceptual framework which serves as the basis for this research is discussed briefly, followed by a description of upcoming research. Finally, the potential relevance of this research to design, training, and aiding issues is discussed.

Morris, N. M.↗

Defining the Relationship Between Human Error Classes and Technology Intervention Strategies

One of the main factors in all aviation accidents is human error. The NASA Aviation Safety Program (AvSP), therefore, has identified several human-factors safety technologies to address this issue. Some technologies directly address human error either by attempting to reduce the occurrence of errors or by mitigating the negative consequences of errors. However, new technologies and system changes may also introduce new error opportunities or even induce different types of errors. Consequently, a thorough understanding of the relationship between error classes and technology "fixes" is crucial for the evaluation of intervention strategies outlined in the AvSP, so that resources can be effectively directed to maximize the benefit to flight safety. The purpose of the present project, therefore, was to examine the repositories of human factors data to identify the possible relationship between different error class and technology intervention strategies. The first phase of the project, which is summarized here, involved the development of prototype data structures or matrices that map errors onto "fixes" (and vice versa), with the hope of facilitating the development of standards for evaluating safety products. Possible follow-on phases of this project are also discussed. These additional efforts include a thorough and detailed review of the literature to fill in the data matrix and the construction of a complete database and standards checklists.

Wiegmann, Douglas A.↗

The role of AI in detecting and mitigating human errors in safety-critical industries: A review

For safety-critical industries, human error (HE) presents continual risks to system productivity, reliability and safety. Artificial intelligence (AI) and machine learning (ML) methods have emerged as promising approaches to understand, categorize and mitigate the risk of HE in safety-critical industries. Furthermore, this review offers an examination of the current landscape regarding the utilization of AI/ML with regards to HE in safety-critical industries, categorizing literature into descriptive modeling, predictive modeling, prescriptive modeling, and generative modeling techniques. Additionally, the review aims to provide insights regarding themes in literature, challenges, and future research directions. Findings of the review suggest that AI/ML methods can prove useful in addressing the HE problem across safety-critical industries.

42 ENGINEERING↗

Using artificial intelligence to detect human errors in nuclear power plants: A case in operation and maintenance

Human error (HE) is an important concern in safety-critical systems such as nuclear power plants (NPPs). HE has played a role in many accidents and outage incidents in NPPs. Despite the increased automation in NPPs, HE remains unavoidable. Hence, the need for HE detection is as important as HE prevention efforts. In NPPs, HE is rather rare. Hence, anomaly detection, a widely used machine learning technique for detecting rare anomalous instances, can be repurposed to detect potential HE. In this study, we develop an unsupervised anomaly detection technique based on generative adversarial networks (GANs) to detect anomalies in manually collected surveillance data in NPPs. More specifically, our GAN is trained to detect mismatches between automatically recorded sensor data and manually collected surveillance data, and hence, identify anomalous instances that can be attributed to HE. We test our GAN on both a real-world dataset and an external dataset obtained from a testbed, and we benchmark our results against state-of-the-art unsupervised anomaly detection algorithms, including one-class support vector machine and isolation forest. Our results show that the proposed GAN provides improved anomaly detection performance. Our study is promising for the future development of artificial intelligence based HE detection systems.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

HUMAN ERROR QUANTIFICATION USING PERFORMANCE SHAPING FACTORS IN THE SPAR-H METHOD

This paper describes a cognitively based human reliability analysis (HRA) quantification technique for estimating the human error probabilities (HEPs) associated with operator and crew actions at nuclear power plants. The method described here, Standardized Plant Analysis Risk-Human Reliability Analysis (SPAR-H) method, was developed to aid in characterizing and quantifying human performance at nuclear power plants. The intent was to develop a defensible method that would consider all factors that may influence performance. In the SPAR-H approach, calculation of HEP rates is especially straightforward, starting with pre-defined nominal error rates for cognitive vs. action-oriented tasks, and incorporating performance shaping factor multipliers upon those nominal error rates.

99 GENERAL AND MISCELLANEOUS↗

Human Error In Complex Systems

Report presents results of research aimed at understanding causes of human error in such complex systems as aircraft, nuclear powerplants, and chemical processing plants. Research considered both slips (errors of action) and mistakes (errors of intention), and influence of workload on them. Results indicated that: humans respond to conditions in which errors expected by attempting to reduce incidence of errors; and adaptation to conditions potent influence on human behavior in discretionary situations.

Morris, Nancy M.↗

Uncertainty-Aware and Explainable Human Error Detection in the Operation of Nuclear Power Plants

The timely and accurate identification of incidents, such as human factor error, is important to restore nuclear power plants (NPPs) to a stable state. However, the identification of abnormal operating conditions is difficult because of the existence of multiple scenarios. In addition, to implement mitigation actions rapidly after an incident occurs, operators must accurately identify an incident by monitoring the trends of many variables. The mental burden posed by this can increase human error and cause failure in identifying incidents. Failure to identify incidents directly results in erroneous mitigation measures, which are detrimental to NPPs. In this study, we leverage uncertainty-aware models to identify such errors and thereby increase the chances of mitigating them. We use the data collected from a physical test bed. The goal is to identify both certain and accurate models. For this, the two main aspects of focus in this study are explainable artificial intelligence (XAI) and uncertainty quantification (UQ). While XAI elucidates the decision pathway, UQ evaluates decision reliability. Their integration paints a comprehensive picture, signifying that understanding decisions and their confidence should be interlinked. Thus, in this study we leverage UQ measures (e.g. entropy and mutual information) along with Shapley additive explanations to gain insights into the features contributing to both accuracy and uncertainty in error identification. Furthermore, our results show that uncertainty-aware models combined with XAI tools can explain the artificial intelligence–prescribed decisions, with the potential of better explaining errors for the operators.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗