Search NASA⌕ Search

SEARCH · Search NASA

Results for “human error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

A Bayesian method for using simulator data to enhance human error probabilities assigned by existing HRA methods

In the past several years, several international organizations have begun to collect data on human performance in nuclear power plant simulators. The data collected provide a valuable opportunity to improve human reliability analysis (HRA), but these improvements will not be realized without implementation of Bayesian methods. Bayesian methods are widely used to incorporate sparse data into models in many parts of probabilistic risk assessment (PRA), but Bayesian methods have not been adopted by the HRA community. In this paper, we provide a Bayesian methodology to formally use simulator data to refine the human error probabilities (HEPs) assigned by existing HRA methods. We demonstrate the methodology with a case study, wherein we use simulator data from the Halden Reactor Project to update the probability assignments from the SPAR-H method. The case study demonstrates the ability to use performance data, even sparse data, to improve existing HRA methods. Furthermore, this paper also serves as a demonstration of the value of Bayesian methods to improve the technical basis of HRA.

99 GENERAL AND MISCELLANEOUS↗

Estimating the Contributions to Human Error Probability from the Convolution of the Distribution of Time Available and Time Required

As part of their duties, Human Reliability Analysis must often evaluate if crews in nuclear power plants (NPPs) can complete tasks associated with a human-failure event within time limits. For example, the time required in NPP scenarios is determined by systematic and structured walkthroughs, feasibility studies, recorded times from training exercises, and interviews with experienced operators and experts. Typically, a point estimate is derived for the estimate (mean, maximum, or 95th percentile of time required). Using point-estimate values can mask the risk associated with variability among crews, plant conditions and set-up, environmental conditions, and other impact factors under which these actions are executed. While point estimates for time required and time available have served the industry well, without considering the uncertainty they could lead to biased understanding about the risk. The Integrated Human Event Analysis System - General Methodology (IDHEAS-G) model (developed by the US Nuclear Regulatory Commission, NRC) for human error probability calculates human error probability by summing two probabilities: insufficient time and cognitive error. As such, the model takes a more holistic approach by considering the full distributions for time required and time available to calculate the human error probability because the time available to complete the task is insufficient. In this study, we expand on the work of the NRC and discuss methods for estimating these time considerations. For example, for the time required, the impact of Performance Influencing Factors (PIFs) on the distribution was divided into impacts that are aleatory in nature, such as crew-to-crew variability, and those that are epistemic (i.e., the PIFs). Starting with the factors that introduce aleatory uncertainty, a first-order distribution was developed from a large set of time required (i.e., NPP task completion times) data for the range of operator actions that occur in the NPP control room under simulated accident conditions. The first-order distribution can then be adjusted to account for epistemic uncertainty using research associated with the impact of applicable PIFs on the time required. We also develop guidance for analysts to address the probability distributions for the time available. The guidance we developed on how to estimate time required and time available distributions is based on the identification of pertinent research and data, data analyses, and expert knowledge elicitation.

human error probability, human performance, time e↗

SIMULATED HUMAN ERROR PROBABILITY AND ITS APPLICATION TO DYNAMIC HUMAN FAILURE EVENTS

Abstract Objectives: Human reliability analysis (HRA) methods typically analyze human failure events (HFEs) at the overall task level. For dynamic HRA, it is important to model human activities at the subtask level. There exists a disconnect between dynamic subtask level and static task level that presents issues when modeling dynamic scenarios. For example, the SPAR-H method is typically used to calculate the human error probability (HEP) at the task level. As demonstrated in this paper, quantification in SPAR-H does not translate to the subtask level. Methods: Two different discrete distributions were generated for each SPAR-H Performance Shaping Factor (PSF) to define the frequency of PSF levels. The first distribution was a uniform, or uninformed distribution that assumed the frequency of each PSF level was equally likely. The second non-continuous distribution took the frequency of PSF level as identified from an assessment of the HERA database. These two different approaches were created to identify the resulting distribution of the HEP. The resulting HEP that appears closer to the known distribution, a log-normal centered on 1E-3, is the more desirable. Each approach then has median, average and maximum HFE calculations applied. To calculate these three values, three events, A, B and C are generated from the PSF level frequencies comprised of subtasks. The median HFE selects the median PSF level from each PSF and calculates HEP. The average HFE takes the mean PSF level, and the maximum takes the maximum PSF level. The same data set of subtask HEPs yields starkly different HEPs when aggregated to the HFE level in SPAR-H. Results: Assuming that each PSF level in each HFE is equally likely creates an unrealistic distribution of the HEP that is centered at 1. Next the observed frequency of PSF levels was applied with the resulting HEP behaving log-normally with a majority of the values under 2.5% HEP. The median, average and maximum HFE calculations did yield different answers for the HFE. The HFE maximum grossly over estimates the HFE, while the HFE distribution occurs less than HFE median, and greater than HFE average. Conclusions: Dynamic task modeling can be perused through the framework of SPAR-H. Identification of distributions associated with each PSF needs to be defined, and may change depending upon the scenario. However it is very unlikely that each PSF level is equally likely as the resulting HEP distribution is strongly centered at 100%, which is unrealistic. Other distributions may need to be identified for PSFs, to facilitate the transition to dynamic task modeling. Additionally discrete distributions need to be exchanged for continuous so that simulations for the HFE can further advance. This paper provides a method to explore dynamic subtask to task translation and provides examples of the process using the SPAR-H method.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Determination of a Generic Human Error Probability Distribution, Part 1: A Dynamic Formulation of SPAR-H

In almost all major nuclear power plants (NPP) events include a significant human error component. As an example, in Fukushima Daiichi (2011) nuclear meltdown, the human actions related to the high-pressure injection cooling strongly affected accident evolution. Furthermore, in the Three Mile Island accident (1979) (which was initiated by a stuck open valve and thus was triggered a loss of coolant accident) the unit operators made decisions based upon false assumptions that contributed negatively to the accident. Given these premises, the ability to accurately model human interactions with plant evolution and, in particular, dynamically calculate human error probability (HEP) plays a major role in a probabilistic risk analysis (PRA). Human reliability analysis (HRA) identifies and models the causes of human errors, and quantifies HEP by applying different methodologies. HRA methods identify errors and reflect on the understanding of error-prone people and systems. There are a number of HRA methods available that assist in identifying the vulnerabilities in the system and provide guidance in determining the HEP. HEP is the probability of a human failure event (HFE), and quantification of HEPs under various situations is utilized in PRA of large complex systems. One of the more prominent HRA methods is the Standardized Plant Analysis Risk-Human Reliability Analysis (SPAR-H) method that was developed to estimate HEPs for the use in the Standardized Plant Analysis Risk (SPAR) PRA models employed in U.S. NPPs. SPAR-H is implemented in U.S. NPPs by regulators at the U.S. Nuclear Regulatory Commission (NRC) to determine the HEP based on expert estimation through the use of calculation worksheets. In SPAR-H, the nominal HEPs (NHEPs) are multiplied by performance shaping factors (PSF) multiplier values to obtain the overall error probability. PSFs encompass the human components, individual characteristics, their environment, and aspects of the task. With PSFs, the goal is to capture all factors that can affect human performance. In SPAR-H there are eight PSFs used, each having respective levels corresponding to multipliers: Available Time, Stress/Stressors, Complexity, Experience/Training, Procedures, Ergonomics/Human Machine Interface, Fitness for Duty, and Work Processes. The PSF multipliers indicate enhanced, nominal, or degraded human performance. The SPAR-H method estimates the HEP through multiplying a NHEP with PSFs. Hence, SPAR-H is a traditional HRA method that assesses human performance at a fixed, or static, point in time. In a dynamic HRA framework, human performance is assessed on a continuous time basis. SPAR-H can be used within a dynamic PRA framework through the use of simulation and stochastic models. The goal of dynamic HRA is to build a more realistic model of the human-system interaction to enhance calculation of reliability, risk and safety analysis. The progression of events in dynamic SPAR-H considers that some PSFs may experience gradual change, while other change can be sudden due to individualistic differences or rapid plant status changes. The PSF changes are caused by contextual changes in the scenario. For example, as more time passes, the realization that a task should be completed sooner may cause the operator more stress. In another example, a sudden relay of information about sickness of a family member may alter the operator's general stress level and fitness for duty. Each PSF has a different dynamic nature; PSFs like stress and complexity change more quickly over the course of a task than experience and training. While the experience of an operator changes over the course of attaining the objective, the amount that this added experience changes the HEP is very minimal. In contrast, the stress, complexity, and procedures PSFs may change quite a bit over the course of task completion.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

SPIDARman: System-Level Physics-Informed Detection of Anomalies in Reactor Collected Data Considering Human Errors

In nuclear power plants (NPPs), anomalies arising from sensors or human errors (HEs) can undermine the performance and reliability of plant operations. Anomaly detection models can be employed to detect sensor errors and HEs. Additionally, physics-informed machine learning models can utilize the known physics of the system, as described by mathematical equations, to ensure that sensor values are consistent with physical laws. Hence, we propose SPIDARman: System-level Physics-Informed Detection of Anomalies in Reactor Collected Data Considering Human Errors, a holistic physics-informed anomaly detection approach based on generative adversarial networks (GANs) to detect anomalies in both automatically collected sensor data and manually collected surveillance data. Here we test our approach on data collected from a flow loop testbed, showcasing its potential to detect anomalies. Results demonstrate that the proposed model performs better than the baseline GAN-based models in detecting sensor and surveillance anomalies, suggesting the potential of physics-informed anomaly detection GAN models in NPPs.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Determination of a Generic Human Error Probability Distribution, Part 2: A Dynamic SPAR-H Example Application

Humans are an integral part of a nuclear power plant (NPP) from its construction, to its everyday maintenance and operation. In the nuclear industry there are many approaches to quantifying component reliability, which is called probability risk assessment (PRA). In PRA there are two considerations given to the quantification, static and dynamic. Static is quantified before or after an operation; and dynamic is time dependent, in that the probability changes as real time data are provided. In PRA, the importance of the components is calculated, but what of the importance of the human component? There are several methods for human reliability analysis (HRA), which include but are not limited to: THERP, ATHEANA, CREAM, SPAR-H, ASEP, and SLIM. Each of these methods aims to provide a more accurate and objective human error probability (HEP) quantification. Of the methods listed above, ASEP, THERP, and SPAR-H are all inextricably linked. The Standardized Plant Analysis Risk-Human Reliability Analysis (SPAR-H) method was generated to better generalize the Technique for Human Error Rate Prediction (THERP) and Accident Sequence Precursor (ASEP). THERP is mapped to specific scenario templates, and ASEP is a simplified screening method, while SPAR-H employs generalizations to describe the spectrum of human behavior while maintaining the same theoretical underpinnings. SPAR-H is a well-known and accepted HRA method that uses performance shaping factors (PSFs) to classify inputs to the human component. PSFs capture a wide variety of input data, including plant status, crew dynamics, task description, and psychological aspects of the human operator. Current efforts have been focused to further generalize SPAR-H in to a dynamic framework. These methods can fit into dynamic NPP simulations such as RAVEN / RELAP-7. In order to do this, a dynamic methodology is applied to model the human as would be applied to the components. This method is applied in part one in the accompanying paper.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

The role of AI in detecting and mitigating human errors in safety-critical industries: A review

For safety-critical industries, human error (HE) presents continual risks to system productivity, reliability and safety. Artificial intelligence (AI) and machine learning (ML) methods have emerged as promising approaches to understand, categorize and mitigate the risk of HE in safety-critical industries. Furthermore, this review offers an examination of the current landscape regarding the utilization of AI/ML with regards to HE in safety-critical industries, categorizing literature into descriptive modeling, predictive modeling, prescriptive modeling, and generative modeling techniques. Additionally, the review aims to provide insights regarding themes in literature, challenges, and future research directions. Findings of the review suggest that AI/ML methods can prove useful in addressing the HE problem across safety-critical industries.

42 ENGINEERING↗

Using artificial intelligence to detect human errors in nuclear power plants: A case in operation and maintenance

Human error (HE) is an important concern in safety-critical systems such as nuclear power plants (NPPs). HE has played a role in many accidents and outage incidents in NPPs. Despite the increased automation in NPPs, HE remains unavoidable. Hence, the need for HE detection is as important as HE prevention efforts. In NPPs, HE is rather rare. Hence, anomaly detection, a widely used machine learning technique for detecting rare anomalous instances, can be repurposed to detect potential HE. In this study, we develop an unsupervised anomaly detection technique based on generative adversarial networks (GANs) to detect anomalies in manually collected surveillance data in NPPs. More specifically, our GAN is trained to detect mismatches between automatically recorded sensor data and manually collected surveillance data, and hence, identify anomalous instances that can be attributed to HE. We test our GAN on both a real-world dataset and an external dataset obtained from a testbed, and we benchmark our results against state-of-the-art unsupervised anomaly detection algorithms, including one-class support vector machine and isolation forest. Our results show that the proposed GAN provides improved anomaly detection performance. Our study is promising for the future development of artificial intelligence based HE detection systems.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

HUMAN ERROR QUANTIFICATION USING PERFORMANCE SHAPING FACTORS IN THE SPAR-H METHOD

This paper describes a cognitively based human reliability analysis (HRA) quantification technique for estimating the human error probabilities (HEPs) associated with operator and crew actions at nuclear power plants. The method described here, Standardized Plant Analysis Risk-Human Reliability Analysis (SPAR-H) method, was developed to aid in characterizing and quantifying human performance at nuclear power plants. The intent was to develop a defensible method that would consider all factors that may influence performance. In the SPAR-H approach, calculation of HEP rates is especially straightforward, starting with pre-defined nominal error rates for cognitive vs. action-oriented tasks, and incorporating performance shaping factor multipliers upon those nominal error rates.

99 GENERAL AND MISCELLANEOUS↗

Uncertainty-Aware and Explainable Human Error Detection in the Operation of Nuclear Power Plants

The timely and accurate identification of incidents, such as human factor error, is important to restore nuclear power plants (NPPs) to a stable state. However, the identification of abnormal operating conditions is difficult because of the existence of multiple scenarios. In addition, to implement mitigation actions rapidly after an incident occurs, operators must accurately identify an incident by monitoring the trends of many variables. The mental burden posed by this can increase human error and cause failure in identifying incidents. Failure to identify incidents directly results in erroneous mitigation measures, which are detrimental to NPPs. In this study, we leverage uncertainty-aware models to identify such errors and thereby increase the chances of mitigating them. We use the data collected from a physical test bed. The goal is to identify both certain and accurate models. For this, the two main aspects of focus in this study are explainable artificial intelligence (XAI) and uncertainty quantification (UQ). While XAI elucidates the decision pathway, UQ evaluates decision reliability. Their integration paints a comprehensive picture, signifying that understanding decisions and their confidence should be interlinked. Thus, in this study we leverage UQ measures (e.g. entropy and mutual information) along with Shapley additive explanations to gain insights into the features contributing to both accuracy and uncertainty in error identification. Furthermore, our results show that uncertainty-aware models combined with XAI tools can explain the artificial intelligence–prescribed decisions, with the potential of better explaining errors for the operators.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Study on the assessment method of human error probabilities in the digitalized main control room - 170

Recently, nuclear power plants (NPPs) in Republic of Korea have been constructed with the new type of main control room (MCR) which is called as digitalized MCR. In digitalized MCR, as digital technologies are being adopted, the environment of MCR has been considerably changed. The operators may obtain the plant data via digitalized human system interfaces (HSIs), large display panel (LDP), computerized procedure system (CPS), soft controls and other system features. Accordingly, the necessity to consider the new environment of MCR has been raised when performing human reliability analysis (HRA) methods. However, none of HRA methods consider the newly installed MCRs. The goal of this paper is to propose new frameworks to assess the human error probabilities (HEPs) in digitalized MCR. Generally, the HEPs are obtained by summing the probabilities of diagnosis errors and the probabilities of execution errors and those probabilities are modified by performance shaping factors (PSFs). In this paper, two parts are included; (1) Assessing the probabilities of diagnosis errors, and (2) Assessing the probabilities of execution errors. In this paper, the process to develop the frameworks are introduced and we expect that the HEPs affecting the features of digitalized MCR can be calculated by using the proposed frameworks. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A Comparison of Human Error Probabilities Collected from HuREX and SHEEP Frameworks

This paper discusses how different are the HEPs collected from HuREX and SHEEP frameworks. This study is a preceding research to infer full-scope HRA data based on the data collected from the SHEEP framework. For the comparison, we used HEPs in the HuREX database published in KAERI-TR-6649 [6]. The HEPs have been collected from actual licensed operators when manipulating MCR simulators of Westinghouse type and Optimized Power Reactor (OPR1000) type in South Korea. For the HEPs based on the SHEEP framework, these have been collected from actual licensed operators and students when using a simplified simulator, i.e., Rancor Microworld.

99 GENERAL AND MISCELLANEOUS↗

Application of Artificial Intelligence in Detection and Mitigation of Human Factor Errors in Nuclear Power Plants: A Review

Human factors and ergonomics have played an essential role in increasing the safety and performance of operators in the nuclear energy industry. In this critical review, we examine how artificial intelligence (AI) technologies can be leveraged to mitigate human errors, thereby improving the safety and performance of operators in nuclear power plants (NPPs). First, we discuss the various causes of human errors in NPPs. Next, we examine the ways in which AI has been introduced to and incorporated into different types of operator support systems to mitigate these human errors. We specifically examine (1) operator support systems, including decision support systems, (2) sensor fault detection systems, (3) operation validation systems, (4) operator monitoring systems, (5) autonomous control systems, (6) predictive maintenance systems, (7) automated text analysis systems, and (8) safety assessment systems. Finally, we provide some of the shortcomings of the existing AI technologies and discuss the challenges still ahead for their further adoption and implementation to provide future research directions.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Design Guidance for Computer-Based Procedures for Field Workers

Nearly all activities that involve human interaction with nuclear power plant systems are guided by procedures, instructions, or checklists. Paper-based procedures (PBPs) currently used by most utilities have a demonstrated history of ensuring safety; however, improving procedure use could yield significant savings in increased efficiency, as well as improved safety through human performance gains. The nuclear industry is constantly trying to find ways to decrease human error rates, especially human error rates associated with procedure use. As a step toward the goal of improving field workers’ procedure use and adherence and hence improve human performance and overall system reliability, the U.S. Department of Energy Light Water Reactor Sustainability (LWRS) Program researchers, together with the nuclear industry, have been investigating the possibility and feasibility of replacing current paper-based procedures with computer-based procedures (CBPs). PBPs have ensured safe operation of plants for decades, but limitations in paper-based systems do not allow them to reach the full potential for procedures to prevent human errors. The environment in a nuclear power plant is constantly changing, depending on current plant status and operating mode. PBPs, which are static by nature, are being applied to a constantly changing context. This constraint often results in PBPs that are written in a manner that is intended to cover many potential operating scenarios. Hence, the procedure layout forces the operator to search through a large amount of irrelevant information to locate the pieces of information relevant for the task and situation at hand, which has potential consequences of taking up valuable time when operators must be responding to the situation, and potentially leading operators down an incorrect response path. Other challenges related to use of PBPs are management of multiple procedures, place-keeping, finding the correct procedure for a task, and relying on other sources of additional information to ensure a functional and accurate understanding of the current plant status (Converse, 1995; Fink, Killian, Hanes, and Naser, 2009; Le Blanc, Oxstrand, and Waicosky, 2012). This report provides design guidance to be used when designing the human-system interaction and the design of the graphical user interface for a CBP system. The guidance is based on human factors research related to the design and usability of CBPs conducted by Idaho National Laboratory, 2012 - 2016.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Human Performance Analysis Depending on Operator Expertise (Student vs. Operator) and Simulator Complexity (Rancor Microworld vs. Compact Nuclear Simulator)

Human reliability analysis (HRA) evaluates human errors and provides human error probabilities (HEPs) for application in probabilistic safety assessment (PSA), which is a comprehensive safety assessment method for nuclear power plants (NPPs). Generally, HRA methods estimate HEPs based on human reliability data collected from actual historical measurement, simulator experiments, or expert judgement. Most recent HRA data collection studies focus on collecting data via full-scope main control room (MCR) simulators with actual licensed reactor operators. Contrary to this, Idaho National Laboratory (INL) has adopted a different approach, which attempts to collect HRA data based on experiment using simplified simulators and student participants by following the Simplified Human Error Experimental Program (SHEEP). This approach has a couple of advantages compared to full-scope data collection. Representatively, it has relatively low entry point for collecting HRA data, and secures large sample sizes with reasonable cost and labor. In the previous studies, we developed the SHEEP framework, then verified whether the data collected through the framework could support a representative full-scope data collection study, i.e., the Human Reliability Data Extraction (HuREX) study. Also, we analyzed human performance measurements depending on participant type (i.e., student vs. operator). In this paper, we analyze human performance data collected from an experiment comparing operator expertise and simulator complexity when using the more simplified simulator developed by INL, i.e., Rancor Microworld and the less simplified simulator, i.e., Compact Nuclear Simulator (CNS) developed by Korea Atomic Energy Research Institute (KAERI). Analysis of variance (ANOVA) tests and correlation analysis are used for analyzing the experimental data.

99 GENERAL AND MISCELLANEOUS↗