Engineering topics

Kim, Jonghyun

Publications and source records attributed to Kim, Jonghyun.

17 records

DOE OSTI2024

Approach for Inferring Full-Scope Human Reliability Data Based on Simplified Simulator Data

This paper proposes a method for inferring full-scope human reliability data based on the Simplified Human Error Experimental Program (SHEEP) data. It mainly focuses on the human errors observed when using simulators with different complexity levels. In the proposed method, the manner in which human error probabilities (HEPs) change as a result of increasing simulator complexity and how simulator complexity levels are quantified represent key information for inferring full-scope data. In the present study, SHEEP error data pertaining to actual professional operators using Rancor Microworld (Rancor) (i.e., a more simplified simulator) and Compact Nuclear Simulator (CNS) (i.e., a less simplified simulator) were compared with the HuREX error data. An approach to quantifying simulator complexity levels was then proposed based on information theory and acquired eye-tracker data.

99 - GENERAL AND MISCELLANEOUS↗

DOE OSTI2023

An Investigation of Time Distributions for Task Primitives to Support the HUNTER Dynamic Human Reliability Analysis

As an effort to support data collection for dynamic human reliability analysis (HRA), this study investigates time distributions for task primitives defined in the Goals, Operators, Methods, and Selection rules (GOMS)–Human Reliability Analysis (HRA) method. GOMS-HRA was developed to provide cognition-based time and human error probability information for dynamic HRA calculation in the Human Unimodel for Nuclear Technology to Enhance Reliability (HUNTER) framework. HUNTER is a framework to support the dynamic modelling of human error in conjunction with other modelling tools. In this paper, we investigate time distributions using experimental data collected from the Simplified Human Error Experimental Program (SHEEP) study, which suggests an HRA data collection framework to complement full-scope simulator research as well as collect input data for dynamic HRA using simplified simulators such as the Rancor Microworld Simulator. In this study, time required for GOMS-HRA task primitives to satisfy thirteen statistical distributions is investigated. Then, the time distributions from student operators and professional operators are compared and discussed. As a result, this study identified several time distributions on five GOMS-HRA task primitives at a statistically significant level. According to analyses to date, a greater number of significant time distributions was found in abnormal or emergency operating procedures rather than standard operating procedures. In the future, it is expected that the result of this study can provide objective reference on elapsed time data for task primitives as well as help to realistically simulate scenarios within dynamic HRA.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2023

An Experimental Investigation of Students? Learning Effects When Using a Simplified Nuclear Simulator

This study focuses on investigating students' learning effects and performance trends over a certain period using the Rancor Microworld Simulator. Specifically, it aims to determine the training required to collect HRA data from non-experts (i.e., students) using Rancor Microworld and the differences in human performance measures between students and professional operators. A longitudinal experiment is conducted with sixteen undergraduate students, using four Rancor Microworld scenarios in each of the four experiment trials. The study considers four human performance measurements workload, situation awareness, time, and error. Finally, the trend of students' performance is compared with operator data collected from the previous experiment. Overall, this research complements previous studies by providing insights into how much training is required to collect HRA data from non-experts and the differences in human performance measures between students and professional operators.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2023

Comparison of Error Rate Depending on Operator Expertise and Simulator Complexity

This paper analyzes operator's error rate from experiments, depending on the expertise and simulator complexity. This study uses the Rancor Microworld, a simplified simulator developed by INL, and the Compact Nuclear Simulator (CNS), a less simplified simulator developed by the Korea Atomic Energy Research Institute (KAERI). The error rates were measured from simulation data of a total of 72 participants, and the collected error rate data were analyzed using analysis of variance (ANOVA) test.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2022

Analysis of human performance differences between students and operators when using the Rancor Microworld simulator

Here, from within the umbrella of the Simplified Human Error Experimental Program (SHEEP) framework, this paper analyzes human performance differences between professional and student operators when using a simplified simulator (i.e., Rancor Microworld). This paper represents a crucial step in understanding the fidelity of the simplified simulators and student operators within the SHEEP study. This paper explores a randomized factorial experimental design that features two independent variables: participant type and event class. Six human performance measurements are considered in the experiment. The experiment is conducted using 20 professional reactor operators employed at actual nuclear power plants (NPPs), along with 20 trained students. The experimental data are analyzed via statistical analysis methods. Finally, this paper examines the differences in human performance between actual operators and students when using Rancor Microworld.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2022

Human Performance Analysis Depending on Operator Expertise (Student vs. Operator) and Simulator Complexity (Rancor Microworld vs. Compact Nuclear Simulator)

Human reliability analysis (HRA) evaluates human errors and provides human error probabilities (HEPs) for application in probabilistic safety assessment (PSA), which is a comprehensive safety assessment method for nuclear power plants (NPPs). Generally, HRA methods estimate HEPs based on human reliability data collected from actual historical measurement, simulator experiments, or expert judgement. Most recent HRA data collection studies focus on collecting data via full-scope main control room (MCR) simulators with actual licensed reactor operators. Contrary to this, Idaho National Laboratory (INL) has adopted a different approach, which attempts to collect HRA data based on experiment using simplified simulators and student participants by following the Simplified Human Error Experimental Program (SHEEP). This approach has a couple of advantages compared to full-scope data collection. Representatively, it has relatively low entry point for collecting HRA data, and secures large sample sizes with reasonable cost and labor. In the previous studies, we developed the SHEEP framework, then verified whether the data collected through the framework could support a representative full-scope data collection study, i.e., the Human Reliability Data Extraction (HuREX) study. Also, we analyzed human performance measurements depending on participant type (i.e., student vs. operator). In this paper, we analyze human performance data collected from an experiment comparing operator expertise and simulator complexity when using the more simplified simulator developed by INL, i.e., Rancor Microworld and the less simplified simulator, i.e., Compact Nuclear Simulator (CNS) developed by Korea Atomic Energy Research Institute (KAERI). Analysis of variance (ANOVA) tests and correlation analysis are used for analyzing the experimental data.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2022

A framework to collect human reliability analysis data for nuclear power plants using a simplified simulator and student operators

Data scarcity in human reliability analysis (HRA) has been a major challenge in the quantification process. Many institutes have collected HRA data through experiments using full-scope simulators with actual operators. Nevertheless, there are still some limitations to relying solely on full-scope studies. This paper aims to propose how full-scope data collection studies can be supported through the Simplified Human Error Experimental Program (SHEEP). The SHEEP framework was developed by Idaho National Laboratory (INL) to collect HRA data through a simplified simulator and student operators. This paper introduces the major tasks in the SHEEP framework, with a particular focus on differences that arise due to participant type (i.e., student vs. actual operator), based on experiments using a simplified simulator (i.e., the Rancor Microworld). This paper also describes whether the data collected via this approach could support a representative full-scope data collection study (i.e., the HuREX study) based on the experimental data.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2021

A Comparison of Human Error Probabilities Collected from HuREX and SHEEP Frameworks

This paper discusses how different are the HEPs collected from HuREX and SHEEP frameworks. This study is a preceding research to infer full-scope HRA data based on the data collected from the SHEEP framework. For the comparison, we used HEPs in the HuREX database published in KAERI-TR-6649 [6]. The HEPs have been collected from actual licensed operators when manipulating MCR simulators of Westinghouse type and Optimized Power Reactor (OPR1000) type in South Korea. For the HEPs based on the SHEEP framework, these have been collected from actual licensed operators and students when using a simplified simulator, i.e., Rancor Microworld.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2021

Experimental Analysis of the Effects of Simulator Complexity on Human Performance

Human Reliability Analysis predicts accidents caused by human errors and is an important factor in Probabilistic Safety Assessment that comprehensively evaluates the safety of nuclear power plants. This study compares and analyzes the human performance of nuclear power plant operators according to the simulator complexity as part of the HRA data collection support method development project conducted by Idaho National Laboratory. This experiment was conducted by setting two types of simulators and scenarios as independent variables. The data collected by conducting the experiments in two different simulators were analyzed using an analysis of variance test and a correlation analysis, and four human performance charts were derived.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2021

An Experimental Analysis on the CNS Simulator Comparing Human Performance between Operators and Students

This study, as a previous study of the SHEEP project, aims to identify differences in human performance data through experiments with students and operators using CNS (Compact Nuclear Simulator). To achieve this goal, this experiment seeks to analyze the correlation of measured human performance between students and operators through a randomized factorial experiment design. Five human performances are measured. In addition, several scenarios and related procedures have been developed for the CNS experiments.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2021

An Experimental Investigation of Human Performance Differences Depending on Simulator Complexity

As a different approach to collect human reliability analysis (HRA) data compared to the full-scope simulator studies, Idaho National Laboratory (INL) has attempted to collect HRA data based on Simplified Human Error Experimental Program (SHEEP), which uses a simplified simulator and student participants. To date, INL has considered the SHEEP approach using simplified simulators such as Rancor Microworld and Compact Nuclear Simulator to complement – not replace – full-scope studies as well as to mainly collect HRA data for estimating nominal/basic human error probabilities (HEPs) needed in the HRA quantification process. This study is a part of the project aiming to suggest how to support full-scope data collection studies based on SHEEP. This paper first introduces major tasks within the SHEEP framework. Then, as one of the major tasks, why and how we have planned to experimentally investigate human performance differences depending on simulator complexity are mainly introduced in this paper.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2021

Quantitative resilience evaluation on recovery from emergency situations in nuclear power plants

Here, this paper mainly introduces how to develop a resilience evaluation model by quantifying the relationship between resilience and resilience components in regard to recovering from emergency situations in nuclear power plants (NPPs). It is an extension of the author’s previous researches. To develop the model, the first step was to analyze event reports published in Republic of Korea in terms of resilience factors from different safety perspectives. Second, statistical methods such as factor analysis, principal component analysis, and multivariate regression analysis were applied to the dataset to identify relations among resilience factors and develop a quantitative resilience evaluation model for recovery from emergency situations in NPPs. Third, the model was validated using the recent event report data released in Korea. Lastly, we present a discussion on how to apply the quantitative resilience evaluation model to results from stress tests performed in Korea.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2020

An Empirical Study on the Use of the Rancor Microworld Simulator to Support Full-scope Data Collection

A lack of data has been identified as a major challenge in human reliability analysis (HRA). Accordingly, several institutes and researchers have tried to collect HRA data from different data sources such as actual historical measurements, expert judgements, or simulator studies. While the most recent studies predominantly focus on collecting data using full-scope simulators with actual operators, Idaho National Laboratory (INL) has begun to collect HRA data using a simplified simulator, i.e., the Rancor Microworld simulator, with student participants. Full-scope studies have been known to have several intrinsic challenges to securing enough quantity of the data due to many reasons like the high cost for performing experiments or requiring actual operators’ cooperation. The ultimate goal of INL’s effort aims to infer actual operators’ data collected from a full-scope simulator on the basis of microworld data with student subjects as well as collect additional data that could be missed in the full-scope research. As a first step to achieve this goal, this paper projects an experimental plan for investigating the differences in human performance between individuals in two groups: 1) an actual operator and 2) a student when using the Rancor Microworld simulator. A randomized factorial experiment design has been developed with two independent variables, i.e., type of scenario and type of subject. Six human performance measures, i.e., 1) time, 2) error, 3) workload, 4) situation awareness, 5) patterns of attention and 6) the number of manipulations were selected. A couple of scenarios and their procedures available to the Rancor Microworld simulator have been developed.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2020

Identification of Collectible Items in the Rancor Microworld Simulator Compared to Full-scope Studies

Most studies collecting reliability data in human reliability analysis (HRA) have concentrated on research using full-scope simulators and actual operators. However, several researchers have found that there are challenges to collecting the variety of items as well as the amount of data needed to support HRA. As an opposite and complementing approach to the full-scope study, Idaho National Laboratory (INL) has developed a simplified simulator, i.e., Rancor Microworld, for generating HRA data based on student subjects. This paper aims to identify collectible items in Rancor Microworld versus full-scope simulators. In this paper, collectible items and their different analysis levels in Rancor Microworld are identified in comparison with full-scope simulators. Then, how to treat the items is suggested with experiment directions that will be treated in the future.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2019

Identification of Performance Shaping Factor Lag and Linger Effects for Dynamic Human Reliability Analysis: Application of Experimental Data

Many researchers have emphasized the importance of dynamic probabilistic safety assessment (PSA), which highlights the necessity of studies for dynamic human reliability analysis (HRA). Dynamic HRA concentrates on a dynamic account of human actions or how performance shaping factors (PSFs) can dynamically modify the human error probability (HEP) over time. In contrast, existing static HRA does not consider human actions as changes over time or event progressions. Accordingly, previous research on dynamic HRA conceptually suggested PSF lag and linger effects to treat dependence between operator actions in dynamic HRA versus existing approaches. As follow-up research, this study attempted to identify PSF lag and linger effects for dynamic HRA on the basis of experimental data. Firstly, mathematical models for PSF lag and linger effects were developed based on a literature survey in the field of biology. Secondly, we analyzed experimental scenarios from a control room study to identify operator actions considered in PSA. Lastly, based on the experimental data, the effect of the stress PSF with lag and linger effects was compared to that without PSF lag and linger effects. This paper concludes with an overall discussion of PSF lag and linger effects based on the relation between the stress PSF and error occurrence.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2017

Development of cyber security test scenario for non-safety display system - 226

In order to test the cyber security of NPP related to safety, the results of probabilistic safety assessment were used. The fault tree (FT) is used to reflect the impact of the cyber-attack on the operator. The cyber security test should be performed focusing on the scenario derived from the FT. The concept of a security case has been introduced. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2016

Modeling the Resilience of Nuclear Power Plant for Unexpected Reactor Trip

Resilience can be defined as the intrinsic ability of a system to adjust to its functioning prior to, during, or following changes and disturbances, so that it can sustain required operations under both expected and unexpected conditions. Resilience engineering is a relatively new paradigm for safety management that focuses on how to cope with complexity under pressure or disturbance to achieve success. A resilient system combines inherent human abilities with engineered safety features and organizational features in a controlled and flexible manner both in expected and in unexpected situations. The concept of resilience has been suggested to complement conventional safety analyses. Conventional safety analysis methods such as PSA have several limitations: 1) they primarily focus on technical dimension, 2) the analysis are linear and sequential, 3) they are dominated by static models, 4) they do not take a systemic view into account, and 5) they focus primarily on why accidents happen and not how success is achieved. The concept of resilience provides a more integrated view for the safety analysis in safety-critical systems, e.g., nuclear power plants. The concept of resilience in the organization of NPPs has been highlighted since the Fukushima Daiichi Nuclear Power Plant accident. An IAEA report addresses that a resilient organization is one that quickly realizes deviation from normal operations and has the ability to make even the toughest and least popular decisions and to manage the margins in which it can maneuver. While traditional strategy to safety in NPPs is to identify what could go or has gone wrong, the concept of resilience is focused on what the organization does well and what it does to maintain its successful operation and to capitalize on those processes in the event of an unexpected situation. This study attempts to model the resilience of NPP dynamically, based on the operating experiences in Korean NPPs. First, this study revised the characterization of NPP. Then, a survey on the literature was conducted to identify the influences between the elements in the model of resilience in NPPs. These works provide a qualitative model for the resilience in NPPs. Then, this study reviewed 168 licensee events reports submitted to the Korean regulatory body since 2004 and quantified the relation between the attributes in the model by performing a Pearson correlation analysis. Finally, a few simulations using the System Dynamics were conducted to discuss which factors are most influencing the resilience. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗