Search NASA⌕ Search

SEARCH · Search NASA

Results for “Operator-in-the-Loop Study”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

Operator-in-the-Loop Study for a Computerized Operator Support System (COSS) – Cross-System and System-Independent Evaluations

The Computerized Operator Support System (COSS) is an operator assistive technology funded by the U.S. Department of Energy Office of Nuclear Energy and developed at Idaho National Laboratory. The project works in collaboration with an advanced prognostics system called PRO-AID developed at Argonne National Laboratory. The COSS provides a human-machine interface to help operators maintain situation awareness and detect faults earlier than would be possible using conventional control room technologies at nuclear power plants. This report represents a status report outlining third-year efforts to develop and validate the COSS. The COSS has now been implemented as a prototype system, with multiple interaction design concepts on multiple plant systems in the simulator from a commercial nuclear power plant. Two studies involving three licensed reactor crews were conducted to evaluate the COSS. This report captures insights into the development of COSS as well as operator feedback and future development guidance derived from the operator-in-the-loop simulator studies.

99 GENERAL AND MISCELLANEOUS↗

Analog, Digital, or Enhanced Human-System Interfaces? Results of an Operator-in-the-Loop Study on Main Control Room Modernization for a Nuclear Power Plant

The second Operator Study of System Overviews (OSSO-2) was conducted with a three-person reactor operator crew in the Human Systems Simulation Laboratory (HSSL) at Idaho National Laboratory (INL) in August, 2017. The study supported control room modernization at a nuclear power plant and featured a benchmark comparison of three variants of a turbine control system (TCS): the existing analog TCS, a proposed standalone digital TCS with two displays, and the digital TCS with the addition of a third display consisting of a system overview screen. TCS prototypes were developed at INL to allow evaluation of operator performance and preferences during realistic turbine scenarios in the full-scope simulator. The study revealed that completion of turbine startup was several minutes faster with the digital TCS variants than with the conventional analog TCS. Eye tracking scan paths were more widely distributed in the overview vs. standalone TCS condition, suggesting the overview screen was cueing reactor operators to verify values across the boards. There was no significant difference in workload or situation awareness across the three interfaces. Reviewing key plant parameters showed smoother transitions during load following for the digital vs. analog TCS. Despite some performance advantages for the digital TCS variants, operators preferred the existing analog TCS. Open-ended responses suggested this finding may be more an artifact of familiarity than a reflection of dissatisfaction with the new TCS. OSSO-2 provides compelling evidence that the new digital TCS was used successfully by the operators without extensive training of rewriting of the operating procedures, suggesting high usability for the digital TCS design. Further advantages were realized through the addition of the system overview screen to provide crews with at-a-glance indicators of key turbine parameters.

99 GENERAL AND MISCELLANEOUS↗

Exploring the Psychometrics of Common Post-Scenario Human Factors Questionnaires of Workload, Situation Awareness, and Perceived Difficulty

Abstract: The United States (U.S.) Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) program has the primary mission of sustaining operation of the existing commercial nuclear power plants (NPPs) through a multi-pathway approach in conducting research and development (R&D). In this effort, the role of human factors engineering (HFE) has been an integral in ensuring new digital upgrades that are part of the overall main control room modernization strategy for various U.S. NPPs optimize human-system performance and do not introduce new human failure modes. In this process, testing and evaluation of concept (i.e., prototype) human machine interfaces (HMIs) are done in operator-in-the-loop studies at various stages of the HFE modification process, such as during design and verification and validation (V&V) [1]. During these studies, licensed operators go through select scenarios using a testbed, such as a full-scale simulator or at a NPP’s training simulator, to identify potential usability issues and provide general design feedback regarding the new digital HMIs. Human-system performance is measured and evaluated through a range of objective and self-report measures that capture aspects of plant performance, task performance, workload, situation awareness, and anthropometric and ergonomic concerns [2]. The use of post-scenario questionnaires is an acceptable method for gathering measures of workload and situation awareness. To this end, the NASA-Task Load Index (TLX) [e.g., 3, 4, & 5] and Situation Awareness Rating Technique (SART) [e.g., 6 & 7] are common standardized questionnaires used for evaluating workload and situation awareness, respectively. When combined, these questionnaires consist of a total of 15 questions, each using a different rating scale. Debriefs are also done through interviews with operators to gather design insight after each scenario. Since operator- and training simulator-time is limited, a concern during this post-scenario period of operator-in-the-loop studies is the limited time available to run scenarios, administer post-scenario questionnaires, and debrief within the allotted simulator time. To address this potential problem, this paper explores the psychometric characteristics of NASA-TLX, SART, and a common one-question post-scenario usability questionnaire (i.e., the single ease question – SEQ [8]) in effort to inform future development of a condensed questionnaire that captures aspects of workload and situation awareness. This exploratory work uses data from four different operator-in-the-loop studies completed under prior LWRS operator-in-the-loop studies. Findings from this paper should support future development of a consolidated questionnaire that may be used in operator-in-the-loop studies, when time is compressed, that conforms to the HFE scientific and regulatory requirements set for NPP control room modernization.

99 GENERAL AND MISCELLANEOUS↗

Computerized operator support system and human performance in the control room - 262

An operator aid technology to assist nuclear plant operators maintain situation awareness and detect faults earlier than would be possible using conventional control room technologies is described. Coined the Computerized Operator Support System (COSS), this technology is aimed at the human-machine interface. The COSS has been implemented as a prototype system operating in the control room environment of a full-scale simulator for a commercial nuclear power plant. A human factors assessment that involved two licensed reactor crews was performed to evaluate crew performance. This paper describes the development of the COSS, the underlying fault-detection architecture, and feedback received based on operator-in-the-loop studies. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

An Integrated Energy Systems Prototype Human-System Interface for a Steam Extraction Loop System to Support Joint Electricity-Hydrogen Flexible Operations

Due to increasing economic competition from renewables and combined-cycle natural gas plants, nuclear power plants are looking toward flexible operations to enhance their cost competitiveness. The Integrated Energy Systems project under the Light Water Reactor Sustainability program of the U.S. Department of Energy focuses on joint electricity-hydrogen flexible operations. Joint electricity-hydrogen flexible operations entail the nuclear power plant diverting thermal energy via main steam to a hydrogen production plant located nearby. The steam serves to enhance the efficiency of the hydrogen production. Furthermore, high temperature electrolysis requires a large amount of electricity, which the plant can also provide. The plant provides steam and electricity to the hydrogen plant throughout the day, but during peak demand hours the nuclear power plant returns to solely providing electricity to meet the high demand. Through this flexible concept of operations, the plant can optimize the thermal energy it produces without having to maneuver the power of the plant. This report documents the human factors process to design and develop a prototype human-system interface for the steam extraction loop that serves as the conduit between the nuclear power plant and the adjacent hydrogen plant. The design process followed the human factors guidelines set by NUREG-0711, Human Factors Engineering Program Review Model (O’Hara, Higgins, & Fleger, 2012), and expanded upon by the Guideline for Operational Nuclear Usability and Knowledge Elicitation (GONUKE; Boring, Ulrich, Joe, & Lew, 2015; Boring, Lew, & Ulrich, 2016). The design process entailed operator interviews to determine the concept of operations for the steam extraction loop, a review and adaptation of digital interface design concepts developed by the team in prior projects, an iterative design process, and reviews conducted by both operators and human factors experts. Several versions of the prototype human-system interface were developed. Operators were interviewed to determine what design features they found useful and would like to see in the interface. The design underwent a review by human factors experts against NUREG-0700, Human Interface Design Review Guidelines (U.S. Nuclear Regulatory Commission, 2019), to ensure compliance with the latest human factors standards for digital interfaces in nuclear applications. The design was then prototyped as a functional windows-based application integrated with the Generic Pressurized Water Reactor simulator modified to include the steam extraction loop. The simulation is supported by the Human Systems Simulation Laboratory at Idaho National Laboratory, which supports operator-in-the-loop testing. This is an ongoing project and the next phase of the project entails performing an operator-in-the-loop usability study to evaluate the interface and examine the proposed concept of operations to extraction steam from the nuclear power plant for delivery to the coupled hydrogen production plant.

99 GENERAL AND MISCELLANEOUS↗

EXTRACTING HUMAN RELIABILITY FINDINGS FROM HUMAN FACTORS STUDIES IN THE HUMAN SYSTEMS SIMULATION LABORATORY

Modernization of U.S. nuclear power plants (NPPs) is widespread, with most plants currently replacing and transitioning equipment, control systems, and human system interfaces (HSI)s from analog to digital displays. This conversion remedies the obsolescence of analog parts along with needs for increased intuitiveness of design, safety, and capabilities. The Human Factors and Reliability team at Idaho National Laboratory (INL) carried out twelve control room modernization studies in the newly designed Human Systems Simulation Laboratory (HSSL) over nine years. The HSSL was constructed as a testbed for evaluating human factors techniques and performance measures, HSI frameworks, and cutting-edge operational concepts in NPPs. Installing a full-scope training simulator enabled direct design and evaluation work on the same instrumentation and control (I&C) and HSIs located at U.S. plants. The subsequent addition of glass top bays afforded crews opportunities to implement operations via the simulator using full-scale representations of their home NPP. Additionally, functional HSI prototypes were created, providing an environment for operator-in-the-loop benchmark studies. The HSSL has assisted in upgrades of six commercial NPP control rooms and served as an invaluable proving ground for new NPP operations technology. Human reliability analysis (HRA) was not originally the focus of the studies; however, data relating to HRA such as type and frequency of human errors can be extracted from the studies. INL is currently extracting data from the HSSL study reports to apprise how information gathered from simulation, HSI, and other related studies can create a broad look across different data sources to help inform HRA methods.

99 GENERAL AND MISCELLANEOUS↗

Reactor operator-in-the-loop dynamic modelling - 122

The description of human operator dynamic characteristics in mathematical terms compatible with control engineering practice is an essential prerequisite to the analytical treatment of manual reactor control systems. Safe reactor operation requires effective operator control through interaction with plant dynamics, manipulators and displays. Traditional static analysis methods consider only specific situations; they fail to adequately explain the mutual interactions between the operator and the reactor plant characteristics. In this paper we investigate the theory for describing operator-reactor characteristics based on the methods of conventional control engineering techniques. The primary purpose of the experiments reported is the validation of the quasi-linear operator model. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗