SEARCH · Search NASA

Results for “Human Errors”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

All sources NASA NTRS DOE OSTI

DOE OSTI2020

An Approach to Dependence Assessment in Human Reliability Analysis: Application of Lag and Linger Effects

Dependence assessment refers to an approach used in human reliability analysis (HRA) to adjust a human error probability (HEP) for the following action by considering the impact of the preceding action. It has been known to significantly affect the overall results of probabilistic safety assessment (PSA). If the dependence assessment is not adequate, the result could be unconvincing for explaining the operator failures in the context of PSA. To date, several methods and some recent research have identified suggestions for treating dependence issues in HRA; however, these are still exclusively based on the intrinsic approach of the Technique for Human Error Rate Prediction (THERP), an HRA method. THERP inevitably has a challenge with the subjectivity of expert evaluation as well as the requirement for PSA and HRA expertise with resource-intensive and time-consuming processes. This paper suggests an approach to dependence assessment that could not only minimize the influence of expert judgment, but also saves time to perform the analysis with reasonable manpower. It modifies existing HRA methods with considering lag and linger effects to apply dependence effects for them. Based on a representative HRA method, i.e., Standardized Plant Analysis Risk - HRA (SPAR-H), guidance for how to apply lag and linger effects for the HRA method is suggested. Then, an investigation is carried out to compare quantification results of the revised HRA method with that of the original approach based on experimental data.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2024

Simulator Data Analysis to Inform Digitalized Environment Impacts on Human Reliability

The U.S. Nuclear Regulatory Commission (NRC) has developed a human reliability analysis (HRA) method, termed the Integrated Human Event Analysis System for Event and Condition Assessment (IDHEAS-ECA), in order to estimate human error probabilities (HEPs) in risk-informed regulatory applications. To update the quantification part of IDHEAS-ECA, the NRC required human performance and error data from fully digitalized main control rooms (MCRs); therefore, it requested that Idaho National Laboratory (INL) revisit previous data collection studies and investigate how the following three factors impact human reliability: self-checking, peer-checking, and automation. The HRA data collection studies revisited were the Human Reliability Data Extraction (HuREX) project, developed by the Korea Atomic Energy Research Institute (KAERI), and the Simplified Human Error Experimental Program (SHEEP), developed by INL. HuREX is a representative HRA data collection study that collects human reliability data from full-scope simulators staffed by licensed operators. SHEEP, on the other hand, has been proposed to complement such full-scope studies by collecting data via simplified simulators staffed by non-licensed student operators. In the HuREX study, KAERI collected HRA data from fully digitalized MCRs for the Advanced Power Reactor (APR)–1400. The SHEEP data were obtained from simplified simulators that partially mimicked the features of digitalized MCRs. The present report mainly discusses how the impacts of the aforementioned three factors on human errors were derived from these two data collection studies.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2024

Rancor-HUNTER: A Virtual Plant and Operator Environment for Predicting Human Performance

Advances in simulation capabilities to model physical systems have outpaced the development of simulations for humans using those physical systems. There is an argument that the infinite span of potential human behaviors inherently render human modeling more challenging than physical systems. Despite this challenge, the need for modeling humans interacting with these complex systems is paramount. As technologies have improved, many of the failure modes originating from the physical systems have been solved. This means the overall proportion of human errors has increased, such that it is not uncommon to be the primary driver of system failure in modern complex systems. Moreover, technologies such as automated systems may introduce emerging contexts that can cause new, unanticipated modes of human error. Therefore, it is now more important than ever to develop models of human behavior to realize overall system error reductions and achieve established safety margins. To support new and novel concepts of operations for the anticipated wave of advanced nuclear reactor deployments, human factors and human reliability analysis researchers need to develop advanced simulation-based approaches. This talk presents a simulation environment suitable to both collect data and then perform Monte Carlo simulations to evaluate human performance and develop better models of human behavior. Specifically, the Rancor Microworld Simulator models a complex energy production system in a simplified manner. Rancor includes computer-based procedures, which serve as a framework to automatically classify human behaviors without manual, subjective experimenter coding during scenarios. This method supports a detailed level of analysis at the task level. It is feasible for collecting large sample sizes required to develop quantitative modelling elements that have historically challenged traditional full-scope simulator study approaches. Additionally, the other portion of this experimental platform, the Human Unimodel for Nuclear Technology to Enhance Reliability (HUNTER), is presented to show how the collected data can be used to evaluate novel scenarios based on the contextual factors, or performance shaping factors, derived from Rancor simulations. Rancor-HUNTER is being used to predict operator performance with new procedures, such as results from control room modernization or new-build situations. Rancor-HUNTER is also proving a useful surrogate platform to model human performance for other complex systems.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2024

SNL Human Reliability Analysis (Capstone Final Report)

Sandia National Laboratories (SNL) requested a measure of possible human error for each state verification method for a safety mechanism performed at partnering production agencies. A team of three human factors individuals were tasked with conducting observations during site visits of both production agencies in order to complete a Human Reliability Analysis (HRA). A HRA will be used because it provides both qualitative and quantitative reports of human error. This report is the first phase of that effort, which will describe the methods which occur at one of the production agencies.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2021

Experimental Analysis of the Effects of Simulator Complexity on Human Performance

Human Reliability Analysis predicts accidents caused by human errors and is an important factor in Probabilistic Safety Assessment that comprehensively evaluates the safety of nuclear power plants. This study compares and analyzes the human performance of nuclear power plant operators according to the simulator complexity as part of the HRA data collection support method development project conducted by Idaho National Laboratory. This experiment was conducted by setting two types of simulators and scenarios as independent variables. The data collected by conducting the experiments in two different simulators were analyzed using an analysis of variance test and a correlation analysis, and four human performance charts were derived.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2023

An Experimental Investigation of Students’ Learning Effects When Using a Simplified Nuclear Simulator

Securing enough data has been a main challenge in human reliability analysis (HRA). Many researchers and institutes have made a lot of efforts for collecting HRA data to produce reasonable human error probabilities (HEPs) as well as reduce the uncertainty of HRA quantification. Representatively, U.S. Nuclear Regulatory Commission (U.S. NRC), Korea Atomic Energy Research Institute (KAERI) and Idaho National Laboratory (INL) have led lots of empirical research regarding the HRA data collection. The U.S. NRC and KAERI have mainly carried out full-scope simulator research collecting HRA data through experiments using full-scope simulators with actual operators. In contrast, INL has experimentally collected the data using simplified simulators and student operators. INL has proposed the Simplified Human Error Experimental Program (SHEEP) framework to complement full-scope data collection efforts by suggesting a way to infer full-scope data based on experimental data collected from students operating simplified simulators, specifically the Rancor Microworld Simulator (Rancor) and the Compact Nuclear Simulator (CNS). The aim of the SHEEP framework is to lower the entry point for collecting useful HRA data by securing large sample sizes at a reasonable amount of cost and labor while also guaranteeing a high degree of freedom when designing experiments. The authors’ previous research investigated whether data collected from the SHEEP framework could support a representative full-scope study. Besides, human performance differences between professional and student operators when using Rancor and CNS have been analyzed to understand the lack of fidelity of the simplified simulators and student operators within the SHEEP study. As a follow up research, this study experimentally investigates students’ learning effects and the performance trends over a certain period when using Rancor. This study aims to find out 1) how much training or education is required to collect HRA data from non-experts (i.e., students) when using Rancor and 2) how much differences there are in human performance measures between students and professional operators. In this study, a longitudinal experiment is developed. The four experiment trials with two weeks interval are carried out for sixteen undergraduate students majoring nuclear engineering at Chosun University. Totally four scenarios randomly selected from ten Rancor scenarios are used in each experiment trial. Four human performance measurements (i.e., workload, situation awareness, time and error) are considered in the experiment. Lastly, the trend of students’ performance is compared with operator data having been collected from the previous experiment.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2022

The HUNTER Dynamic Human Reliability Analysis Tool: Development of a Module for Performance Shaping Factors

The Human Unimodel for Nuclear Technology to Enhance Reliability (HUNTER) is a framework to support dynamic human reliability analysis (HRA) in communication with a variety of methods and tools. This paper explores how we developed one of the HUNTER modules: namely, the Individual module for evaluating performance shaping factors (PSFs). A PSF is any factor that influences human performance (e.g., workload or complexity). In the existing HRA, they are used to highlight human errors and adjust error probabilities. We consider the eight PSFs suggested in the Standardized Plant Analysis Risk-HRA (SPAR-H) method, a representative HRA method widely used in the nuclear field. To support our dynamic modeling using the eight SPAR-H PSFs, we reviewed the human performance literature and developed data-based mathematical models to rate and quantify PSFs in the context of dynamic HRA. We also designed the Individual module to consist of two functions: (1) the PSF qualification function for automatically or manually evaluating PSF levels, and (2) the PSF quantification function for dynamically or statically determining PSF multiplier values and integrating them to adjust human error probabilities (HEPs). How each function works in regard to the SPAR-H PSFs, and how the PSFs serve to adjust the HEPs, were investigated via literature review and are discussed in this paper.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2023

INVESTIGATION OF HUMAN RELIABILITY ANALYSIS METHODS FOR ANALYZING PRE-INITIATORS

As a type of human actions defined in human reliability analysis (HRA), pre-initiator refers to the human actions that may lead to the unavailability of systems, typically committed during maintenance, test, or calibration. This paper investigates representative HRA methods used for analyzing pre-initiators. The HRA methods are Technique for Human Error Rate Prediction (THERP), Korean Standard HRA (K-HRA) and Standard Plant Risk HRA (SPAR-H). In this paper, characteristics of each HRA method are compared for qualitative and quantification aspects. Two pre-initiators, i.e., a calibration task and a valve restoration task, are analyzed using the HRA methods to compare human error probabilities. Then, insights from the analysis and additional research requirements are discussed in this paper.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2021

An Experimental Investigation of Human Performance Differences Depending on Simulator Complexity

As a different approach to collect human reliability analysis (HRA) data compared to the full-scope simulator studies, Idaho National Laboratory (INL) has attempted to collect HRA data based on Simplified Human Error Experimental Program (SHEEP), which uses a simplified simulator and student participants. To date, INL has considered the SHEEP approach using simplified simulators such as Rancor Microworld and Compact Nuclear Simulator to complement – not replace – full-scope studies as well as to mainly collect HRA data for estimating nominal/basic human error probabilities (HEPs) needed in the HRA quantification process. This study is a part of the project aiming to suggest how to support full-scope data collection studies based on SHEEP. This paper first introduces major tasks within the SHEEP framework. Then, as one of the major tasks, why and how we have planned to experimentally investigate human performance differences depending on simulator complexity are mainly introduced in this paper.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2022

The HUNTER Dynamic Human Reliability Analysis Tool: Development of a Module for Performance Shaping Factors

Human Unimodel for Nuclear Technology to Enhance Reliability (HUNTER) is a framework to support dynamic human reliability analysis (HRA) in communication with a variety of methods and tools. In this paper, how we have developed one of the HUNTER modules, the individual module for evaluating performance shaping factors (PSFs), is introduced. The PSF refers to any factor that influences human performance such as workload or complexity. It has been used for highlighting human errors and adjusting the error probabilities in the existing HRA. We consider the eight PSFs suggested in the Standardized Plant Analysis Risk-HRA (SPAR-H) method, which is the representative HRA method widely used in the nuclear field. To support our dynamic modeling using the eight SPAR-H PSFs, we reviewed human performance literature and developed data-based mathematical models to rate and quantify PSFs in the context of dynamic HRA. We also design the individual module composed of the two functions: 1) the PSF qualification function that automatically or manually evaluates a PSF level, and 2) the PSF quantification function that dynamically or statically determines the PSF multiplier values and integrate them to adjust human error probabilities (HEPs). How each function works with the SPAR-H PSFs and how the PSFs adjust the HEPs are investigated through literature and discussed in this paper.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2023

INVESTIGATION OF HUMAN RELIABILITY ANALYSIS METHODS FOR ANALYZING PRE-INITIATORS

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2022

Dynamic Approach to Dependency Analysis in Human Reliability Analysis: Application in a Stream Generator Tube Rupture Scenario

Dependency analysis in human reliability analysis (HRA) is a method of adjusting the failure probability of a given action by considering the impact of the action preceding it. It plays a role in reasonably accounting for human actions in the context of probabilistic safety assessments (PSAs), preventing PSA results from being estimated too optimistically based on the HRA results. Nevertheless, the existing dependency methods present a couple of challenges in that the quantification approaches rarely explain the adjustment of human error probabilities (HEPs). For this reason, the authors’ previous research has pointed out challenges of the existing dependency approaches and conceptually, theoretically proposed a performance shaping factor (PSF)-based dynamic dependency analysis method for HRA in order to complement the existing dependency methods. The current paper explores the latest version of the method and guidance for applying it to a steam generator tube rupture (SGTR) scenario.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2025

EVALUATION OF HRA METHODOLOGIES FOR APPLICATION IN SDP WORK

This study critically evaluates human reliability analysis (HRA) methodologies applicable to regulatory probabilistic safety assessment (PSA) model, with a particular focus on their role in supporting the significance determination process (SDP) in nuclear safety assessment. Firstly, three widely utilized HRA methods – IDHEAS-ECA, SPAR-H, and ASEP/THERP – were qualitatively and quantitatively assessed. Qualitative assessments were conducted using attributes from the NEA/CSNI/R(2015)1 report, while quantitative evaluations employed regression and correlation analyses to compare predicted human error probabilities (HEPs) against empirical data. Results reveal distinct strengths, for example, IDHEAS-ECA’s robust predictive accuracy and K-HRA’s alignment with operational practices. In addition, dependency analysis and recovery analysis were critically evaluated. For dependency analysis, the methods’ handling of inter-task dependencies and their impact on HEPs were examined, while recovery analysis highlighted strategies for mitigating failure events. Furthermore, strategies were proposed to evaluate performance-shaping factors under conditions of reduced human performance, such as stress, fatigue, or cognitive overload, addressing specific challenges faced in SDP evaluations. Human errors from KINS’s operational performance information system event reports were evaluated as a case study. This study identifies gaps and provides actionable insights to ensure their validity and applicability in SDP HRA applications. This paper is a part of research conducted by KINS, and it should be noted that this result does not represent the regulatory position of KINS.

99 - GENERAL AND MISCELLANEOUS↗

DOE OSTI2025

Reinforcement Learning for Anomaly Detection in Nuclear Power Plant Operation and Maintenance

In nuclear power plants (NPPs), timely identification of sensor and human errors is critical to ensure safe and efficient plant operations. Anomaly detection models can be employed for this task. However, traditional anomaly detection approaches may have high dependency on labeled datasets and struggle with adaptability in complex, dynamic environments. Reinforcement learning (RL) has demonstrated significant potential in fault diagnosis and anomaly detection; however, its application to anomaly detection in NPPs remains a relatively underexplored research direction. Hence, to address this gap, in this study, we present a novel physics-informed reinforcement learning model, PIRL-AD: Physics-Informed Reinforcement Learning for Anomaly Detection, that integrates domain knowledge from calorimetric equations into the RL framework for enhanced sensor and human error anomaly detection. We evaluate the performance of PIRL-AD against a non-physics informed RL benchmark and a support vector machine (SVM) on data collected from a forced flow loop testbed. Experimental results suggest that PIRL-AD outperforms other baselines on a range of anomalous datasets that include both sensor and human-induced anomalies across key performance metrics, statistically outperforming the RL and SVM benchmarks with respect to geometric mean (respectively, 92.96% vs. 91.06% vs. 83.01%) and F1-score (respectively, 89.23% vs. 86.98% vs. 77.01%). Furthermore, the findings suggest the potential of physics-integrated reinforcement learning models for enhanced anomaly detection performance in NPPs.

Reinforcement learning↗

DOE OSTI2020

Quantifying Human Behavior and Decision Errors in Security Screening Operations

The potential for human errors in conducting security related screening operations can lead to inadvertent and adverse decision outcomes. This paper overviews an initial mathematical framework designed to model and quantify the various human factors and decision outcomes that may occur in conducting security screening operations, such as U.S. port of entry radiological and nuclear (rad/nuc) security screening. This framework is based on the Human Error Assessment and Reduction (HEART) technique. As applied here, the framework incorporates a set of rules for human engagement, including a prescribed concept of operations (CONOPS) and deviations that may occur from this established CONOPS due to inadvertent personnel decision errors. We also review some of the various factors that may adversely influence such decisions by security screening personnel. Some of these factors include current workload, environmental conditions, training, and various other intangible factors. Using the HEART methodology, we translate each of these factors into error producing conditions, their effects on error, an assessed proportion of effects, and finally the overall probability of human error at each stage of the screening process. We then include a small scale example to demonstrate the methodology and results based on an assumed set of input conditions at a notional port of entry.

Brigantic, Robert T.↗

DOE OSTI2022

A framework to collect human reliability analysis data for nuclear power plants using a simplified simulator and student operators

Data scarcity in human reliability analysis (HRA) has been a major challenge in the quantification process. Many institutes have collected HRA data through experiments using full-scope simulators with actual operators. Nevertheless, there are still some limitations to relying solely on full-scope studies. This paper aims to propose how full-scope data collection studies can be supported through the Simplified Human Error Experimental Program (SHEEP). The SHEEP framework was developed by Idaho National Laboratory (INL) to collect HRA data through a simplified simulator and student operators. This paper introduces the major tasks in the SHEEP framework, with a particular focus on differences that arise due to participant type (i.e., student vs. actual operator), based on experiments using a simplified simulator (i.e., the Rancor Microworld). This paper also describes whether the data collected via this approach could support a representative full-scope data collection study (i.e., the HuREX study) based on the experimental data.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2022

Analysis of human performance differences between students and operators when using the Rancor Microworld simulator

Here, from within the umbrella of the Simplified Human Error Experimental Program (SHEEP) framework, this paper analyzes human performance differences between professional and student operators when using a simplified simulator (i.e., Rancor Microworld). This paper represents a crucial step in understanding the fidelity of the simplified simulators and student operators within the SHEEP study. This paper explores a randomized factorial experimental design that features two independent variables: participant type and event class. Six human performance measurements are considered in the experiment. The experiment is conducted using 20 professional reactor operators employed at actual nuclear power plants (NPPs), along with 20 trained students. The experimental data are analyzed via statistical analysis methods. Finally, this paper examines the differences in human performance between actual operators and students when using Rancor Microworld.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2023

Development of a hybrid neural network and transfer learning model for optimized ICP-MS/MS operation

Correct function and calibration of instrumentation is a crucial assumption for any scientific experiment. One such instrument, tandem inductively coupled plasma mass spectrometer (ICP-MS/MS), has in-depth calibration settings that range across 30+ different parameters, making it difficult to determine optimal conditions without expertise and some degree of trial and error. Often, these settings are hand-tuned, a time-intensive process prone to local maxima and human error. While some automation is available, the automation also may favor local optimizations over a global optimum. In addition to these difficulties, day to day instrument variability can further complicate the calibration process. We propose a solution to this problem as a machine learning (ML) algorithm that learns how each parameter helps determine the calibration sensitivity across several elements, and re-weights parameters over time as instrument variability changes (e.g., a global neural network (NN) with a time-dependent transfer learning (TL) component). This model would be able to generate a surface of predicted calibration sensitivities and their respective parameters, and a simple multivariate algorithm would be able to pull out the optimum results with the settings associated with them. Here-in, we describe our initial findings in working towards this goal, including data extraction from historical files, exploratory data analysis, and some initial model building to better describe the data and the feasibility of our goal.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗