Search NASA⌕ Search

SEARCH · Search NASA

Results for “human systems performance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

A Framework for Evaluating the Effects of Degraded Digital I and C Systems on Human Performance

New and advanced reactors will use integrated digital instrumentation and control (I&C) systems to support operators in their monitoring and control functions. Even though digital systems are typically highly reliable, their potential for degradation or failure could significantly affect operator situation awareness and performance and, consequently, impact plant safety. The U.S. Nuclear Regulatory Commission has initiated a research project to investigate the effects of degraded I&C systems on human performance and plant operations. The ultimate objective of this project is to develop the technical basis for human factors review guidance for conditions of degraded I&C, including complete failure. Based on the results of this effort, NRC will determine the need for developing new guidance or revising NUREG-0800, NUREG-0711, NUREG-0700 and other pertinent NRC review guidance. This paper reports on the first phase of the research, the development of a framework for linking degraded I&C system conditions to human performance. The framework consists of three levels: I&C subsystems, human-system interfaces, and human performance. Each level is composed of a number of discrete elements. This paper will describe the elements at each level and their integration. In the next phase of the research, the framework will be used to systematically investigate the human performance consequences of various classes of failures.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A Human Factors Evaluation of an Advanced Human System Interface for the Generic Pressurized Water Reactor Simulator

Researchers at Idaho National Laboratory (INL), funded by the United States (U.S.) Department of Energy’s Light Water Reactor Sustainability (LWRS) Program, conducted a human factors evaluation of an Advanced Human System Interface (HSI) that colleagues at the Institute for Energy Technology developed for the generic Pressurized Water Reactor (gPWR) simulator. The gPWR simulator is based on an existing, currently operating, U.S. commercial nuclear power plant (NPP). Furthermore, INL has a relationship with this NPP that allows them to recruit operators to participate in their studies. INL also has a full-scope, full-scale simulator facility, called the Human Systems Simulation Laboratory, that hosts the gPWR simulator and allowed these researchers to compare human-system performance when operators used the existing/current gPWR HSI and the new Advanced HSI. As such, one goal of this work was to collect a baseline measure of human-system performance for the Advanced HSI and to identify areas to further improve the design of the Advanced HSI to optimize overall system usability. This paper summarizes the methodology used to perform this evaluation, which emphasized measuring key aspects of human-system performance and getting operator feedback on the design, aesthetics, and functionality of the Advanced HSI, and presents the key findings and insights gained.

99 GENERAL AND MISCELLANEOUS↗

Exploring the Psychometrics of Common Post-Scenario Human Factors Questionnaires of Workload, Situation Awareness, and Perceived Difficulty

Abstract: The United States (U.S.) Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) program has the primary mission of sustaining operation of the existing commercial nuclear power plants (NPPs) through a multi-pathway approach in conducting research and development (R&D). In this effort, the role of human factors engineering (HFE) has been an integral in ensuring new digital upgrades that are part of the overall main control room modernization strategy for various U.S. NPPs optimize human-system performance and do not introduce new human failure modes. In this process, testing and evaluation of concept (i.e., prototype) human machine interfaces (HMIs) are done in operator-in-the-loop studies at various stages of the HFE modification process, such as during design and verification and validation (V&V) [1]. During these studies, licensed operators go through select scenarios using a testbed, such as a full-scale simulator or at a NPP’s training simulator, to identify potential usability issues and provide general design feedback regarding the new digital HMIs. Human-system performance is measured and evaluated through a range of objective and self-report measures that capture aspects of plant performance, task performance, workload, situation awareness, and anthropometric and ergonomic concerns [2]. The use of post-scenario questionnaires is an acceptable method for gathering measures of workload and situation awareness. To this end, the NASA-Task Load Index (TLX) [e.g., 3, 4, & 5] and Situation Awareness Rating Technique (SART) [e.g., 6 & 7] are common standardized questionnaires used for evaluating workload and situation awareness, respectively. When combined, these questionnaires consist of a total of 15 questions, each using a different rating scale. Debriefs are also done through interviews with operators to gather design insight after each scenario. Since operator- and training simulator-time is limited, a concern during this post-scenario period of operator-in-the-loop studies is the limited time available to run scenarios, administer post-scenario questionnaires, and debrief within the allotted simulator time. To address this potential problem, this paper explores the psychometric characteristics of NASA-TLX, SART, and a common one-question post-scenario usability questionnaire (i.e., the single ease question – SEQ [8]) in effort to inform future development of a condensed questionnaire that captures aspects of workload and situation awareness. This exploratory work uses data from four different operator-in-the-loop studies completed under prior LWRS operator-in-the-loop studies. Findings from this paper should support future development of a consolidated questionnaire that may be used in operator-in-the-loop studies, when time is compressed, that conforms to the HFE scientific and regulatory requirements set for NPP control room modernization.

99 GENERAL AND MISCELLANEOUS↗

Computerized operator support system and human performance in the control room - 262

An operator aid technology to assist nuclear plant operators maintain situation awareness and detect faults earlier than would be possible using conventional control room technologies is described. Coined the Computerized Operator Support System (COSS), this technology is aimed at the human-machine interface. The COSS has been implemented as a prototype system operating in the control room environment of a full-scale simulator for a commercial nuclear power plant. A human factors assessment that involved two licensed reactor crews was performed to evaluate crew performance. This paper describes the development of the COSS, the underlying fault-detection architecture, and feedback received based on operator-in-the-loop studies. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Application of eye tracking for measurement and evaluation in human factors studies in control room modernization - 309

An important element of human factors engineering (HFE) pertains to measurement and evaluation (M and E). The role of HFE-M and E should be integrated throughout the entire control room modernization (CRM) process and be used for human-system performance evaluation and diagnostic purposes with resolving potential human engineering deficiencies (HEDs) and other human machine interface (HMI) design issues. NUREG-0711 describes how HFE in CRM should employ a hierarchical set of measures, particularly during integrated system validation (ISV), including plant performance, personnel task performance, situation awareness, cognitive workload, and anthropometric/ physiological factors. Historically, subjective measures have been primarily used since they are easier to collect and do not require specialized equipment. However, there are pitfalls with relying solely on subjective measures in M and E such that negatively impact reliability, sensitivity, and objectivity. As part of comprehensively capturing a diverse set of measures that strengthen findings and inferences made of the benefits from emerging technologies like advanced displays, this paper discusses the value of using eye tracking as an objective method that can be used in M and E. A brief description of eye tracking technology and relevant eye tracking measures is provided. Additionally, technical considerations and the unique challenges with using eye tracking in full-scaled simulations are addressed. Finally, this paper shares preliminary findings regarding the use of a wearable eye tracking system in a full-scale simulator study. These findings should help guide future full-scale simulator studies using eye tracking as a methodology to evaluate human-system performance. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

APPLICATION OF EYE TRACKING FOR MEASUREMENT AND EVALUATION IN HUMAN FACTORS STUDIES IN CONTROL ROOM MODERNIZATION

An important element of human factors engineering (HFE) pertains to measurement and evaluation (M&E). The role of HFE-M&E should be integrated throughout the entire control room modernization (CRM) process and be used for human-system performance evaluation and diagnostic purposes with resolving potential human engineering deficiencies (HEDs) and other human machine interface (HMI) design issues. NUREG-0711 describes how HFE in CRM should employ a hierarchical set of measures, particularly during integrated system validation (ISV), including plant performance, personnel task performance, situation awareness, cognitive workload, and anthropometric/ physiological factors. Historically, subjective measures have been primarily used since they are easier to collect and do not require specialized equipment. However, there are pitfalls with relying solely on subjective measures in M&E such that negatively impact reliability, sensitivity, and objectivity. As part of comprehensively capturing a diverse set of measures that strengthen findings and inferences made of the benefits from emerging technologies like advanced displays, this paper discusses the value of using eye tracking as an objective method that can be used in M&E. A brief description of eye tracking technology and relevant eye tracking measures is provided. Additionally, technical considerations and the unique challenges with using eye tracking in full-scaled simulations are addressed. Finally, this paper shares preliminary findings regarding the use of a wearable eye tracking system in a full-scale simulator study. These findings should help guide future full-scale simulator studies using eye tracking as a methodology to evaluate human-system performance.

99 GENERAL AND MISCELLANEOUS↗

Application of Eye Tracking for Measurement and Evaluation in Human Factors Studies in Control Room Modernization

An important element of human factors engineering (HFE) pertains to measurement and evaluation (M&E). The role of HFE-M&E should be integrated throughout the entire control room modernization (CRM) process and be used for human-system performance evaluation and diagnostic purposes with resolving potential human engineering deficiencies (HEDs) and other human machine interface (HMI) design issues. NUREG-0711 describes how HFE in CRM should employ a hierarchical set of measures, particularly during integrated system validation (ISV), including plant performance, personnel task performance, situation awareness, cognitive workload, and anthropometric/ physiological factors. Historically, subjective measures have been primarily used since they are easier to collect and do not require specialized equipment. However, there are pitfalls with relying solely on subjective measures in M&E such that negatively impact reliability, sensitivity, and objectivity. Furthermore, as part of comprehensively capturing a diverse set of measures that strengthen findings and inferences made of the benefits from emerging technologies like advanced displays, this paper discusses the value of using eye tracking as an objective method that can be used in M&E. A brief description of eye tracking technology and relevant eye tracking measures is provided. Additionally, technical considerations and the unique challenges with using eye tracking in full-scaled simulations are addressed. Finally, this paper shares preliminary findings regarding the use of a wearable eye tracking system in a full-scale simulator study. These findings should help guide future full-scale simulator studies using eye tracking as a methodology to evaluate human-system performance.

99 GENERAL AND MISCELLANEOUS↗

The Effects of Degraded Digital Instrumentation and Control Systems on Human-system Interfaces and Operator Performance: HFE Review Guidance and Technical Basis

New and advanced reactors will use integrated digital instrumentation and control (I&C) systems to support operators in their monitoring and control functions. Even though digital systems are typically highly reliable, their potential for degradation or failure could significantly affect operator performance and, consequently, impact plant safety. The U.S. Nuclear Regulatory Commission (NRC) supported this research project to investigate the effects of degraded I&C systems on human performance and plant operations. The objective was to develop human factors engineering (HFE) review guidance addressing the detection and management of degraded digital I&C conditions by plant operators. We reviewed pertinent standards and guidelines, empirical studies, and plant operating experience. In addition, we conducted an evaluation of the potential effects of selected failure modes of the digital feedwater system on human-system interfaces (HSIs) and operator performance. The results indicated that I&C degradations are prevalent in plants employing digital systems and the overall effects on plant behavior can be significant, such as causing a reactor trip or causing equipment to operate unexpectedly. I&C degradations can impact the HSIs used by operators to monitor and control the plant. For example, sensor degradations can make displays difficult to interpret and can sometimes mislead operators by making it appear that a process disturbance has occurred. We used the information obtained as the technical basis upon which to develop HFE review guidance. The guidance addresses the treatment of degraded I&C conditions as part of the design process and the HSI features and functions that support operators to monitor I&C performance and manage I&C degradations when they occur. In addition, we identified topics for future research.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

The Effect of Degraded Digital Instrumentation and Control systems on Human-system Interfaces and Operator Performance

Integrated digital instrumentation and control (I&C) systems in new and advanced nuclear power plants (NPPs) will support operators in monitoring and controlling the plants. Even though digital systems typically are expected to be reliable, their potential for degradation or failure significantly could affect the operators performance and, consequently, jeopardize plant safety. This U.S. Nuclear Regulatory Commission (NRC) research investigated the effects of degraded I&C systems on human performance and on plant operations. The objective was to develop technical basis and guidance for human factors engineering (HFE) reviews addressing the operator's ability to detect and manage degraded digital I&C conditions. We reviewed pertinent standards and guidelines, empirical studies, and plant operating experience. In addition, we evaluated the potential effects of selected failure modes of the digital feedwater control system of a currently operating pressurized water reactor (PWR) on human-system interfaces (HSIs) and the operators performance. Our findings indicated that I&C degradations are prevalent in plants employing digital systems, and the overall effects on the plant's behavior can be significant, such as causing a reactor trip or equipment to operate unexpectedly. I&C degradations may affect the HSIs used by operators to monitor and control the plant. For example, deterioration of the sensors can complicate the operators interpretation of displays, and sometimes may mislead them by making it appear that a process disturbance has occurred. We used the findings as the technical basis upon which to develop HFE review guidance.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Human performance modeling for system of systems analytics.

A Laboratory-Directed Research and Development project was initiated in 2005 to investigate Human Performance Modeling in a System of Systems analytic environment. SAND2006-6569 and SAND2006-7911 document interim results from this effort; this report documents the final results. The problem is difficult because of the number of humans involved in a System of Systems environment and the generally poorly defined nature of the tasks that each human must perform. A two-pronged strategy was followed: one prong was to develop human models using a probability-based method similar to that first developed for relatively well-understood probability based performance modeling; another prong was to investigate more state-of-art human cognition models. The probability-based modeling resulted in a comprehensive addition of human-modeling capability to the existing SoSAT computer program. The cognitive modeling resulted in an increased understanding of what is necessary to incorporate cognition-based models to a System of Systems analytic environment.

99 GENERAL AND MISCELLANEOUS↗

INITIATORS AND TRIGGERING CONDITIONS FOR ADAPTIVE AUTOMATION IN ADVANCED SMALL MODULAR REACTORS

It is anticipated that Advanced Small Modular Reactors (AdvSMRs) will employ high degrees of automation. High levels of automation can enhance system performance, but often at the cost of reduced human performance. Automation can lead to human out-of the loop issues, unbalanced workload, complacency, and other problems if it is not designed properly. Researchers have proposed adaptive automation (defined as dynamic or flexible allocation of functions) as a way to get the benefits of higher levels of automation without the human performance costs. Adaptive automation has the potential to balance operator workload and enhance operator situation awareness by allocating functions to the operators in a way that is sensitive to overall workload and capabilities at the time of operation. However, there still a number of questions regarding how to effectively design adaptive automation to achieve that potential. One of those questions is related to how to initiate (or trigger) a shift in automation in order to provide maximal sensitivity to operator needs without introducing undesirable consequences (such as unpredictable mode changes). Several triggering mechanisms for shifts in adaptive automation have been proposed including: operator initiated, critical events, performance-based, physiological measurement, model-based, and hybrid methods. As part of a larger project to develop design guidance for human-automation collaboration in AdvSMRs, researchers at Idaho National Laboratory have investigated the effectiveness and applicability of each of these triggering mechanisms in the context of AdvSMR. Researchers reviewed the empirical literature on adaptive automation and assessed each triggering mechanism based on the human-system performance consequences of employing that mechanism. Researchers also assessed the practicality and feasibility of using the mechanism in the context of an AdvSMR control room. Results indicate that there are tradeoffs associated with each mechanism, but that some are more applicable to the AdvSMR domain. The two mechanisms that consistently improve performance in laboratory studies are operator initiated adaptive automation based on hierarchical task delegation and the Electroencephalogram(EEG) –based measure of engagement. Current EEG methods are intrusive and require intensive analysis; therefore it is not recommended for an AdvSMR control rooms at this time. Researchers also discuss limitations in the existing empirical literature and make recommendations for further research.

99 GENERAL AND MISCELLANEOUS↗

EXPLORING THE USE OF COGNITIVE MODELS FOR NUCLEAR POWER PLANT HUMAN-SYSTEM INTERFACE EVALUATION

Much of the United States commercial nuclear power plant fleet is approaching the end of their operating licenses. To extend the life of these plants, advanced human-system interface (HSI) technologies are being researched to address aging and reliability concerns with the existing legacy instrumentation and controls. Human factors engineering (HFE) has a crucial role in ensuring these technologies are designed in a way that does not introduce new failure modes and promote optimal human-system performance. An important focus of HFE in NPP modernization is the early involvement to inform the design of the HSI. Here, traditional formative evaluations are done to collect design feedback. While these evaluations are absolutely useful, they are limited in providing convincing quantitative data for efficiency of use. This paper discusses the use of cognitive models to provide such quantitative data early in the HSI design process. A comparison of three open-source and readily accessible cognitive modeling tools are discussed.

99 GENERAL AND MISCELLANEOUS↗

Human-Centered Technology Design for Energy Efficiency and Conservation

Human-centered design (HCD) is the practice of designing systems for human use. This paper describes the discipline of human factors engineering, which has traditionally been applied to energy intensive complex systems such as automobiles and aircraft, and will look ahead to applications in sustainable systems design. The focus of HCD has been ensuring efficient and effective human-system performance, through application of design principles such as understanding the user, providing feedback, and minimizing cognitive load. These principles also apply to the design of sustainable socio-technical systems, both through specific device user interfaces and broader developments such as transportation systems and urban design. HCD design principles need to be embedded within a social-systems engineering model that considers the overall constraints of physical and institutional processes, the cultural aspects of designs and interventions, various comfort and convenience factors at the level of individual users, and the cognitive impacts of designs – the 5C model. Application of HCD will involve a more holistic view of human-systems than is traditionally adopted by government and industry, to encompass the embedded nature of energy services in lifestyle and work. HCD methods can be useful in disaggregating the energy intensive aspects of lifestyle and work, as well as applying design principles to address the 5 C’s.

energy efficiency, conservation, behavior, human-c↗

Physiological Characterization of Language Comprehension

In this project, our goal was to develop methods that would allow us to make accurate predictions about individual differences in human cognition. Understanding such differences is important for maximizing human and human-system performance. There is a large body of research on individual differences in the academic literature. Unfortunately, it is often difficult to connect this literature to applied problems, where we must predict how specific people will perform or process information. In an effort to bridge this gap, we set out to answer the question: can we train a model to make predictions about which people understand which languages? We chose language processing as our domain of interest because of the well- characterized differences in neural processing that occur when people are presented with linguistic stimuli that they do or do not understand. Although our original plan to conduct several electroencephalography (EEG) studies was disrupted by the COVID-19 pandemic, we were able to collect data from one EEG study and a series of behavioral experiments in which data were collected online. The results of this project indicate that machine learning tools can make reasonably accurate predictions about an individual?s proficiency in different languages, using EEG data or behavioral data alone.

42 ENGINEERING↗

Computational Human Performance Modeling For Alarm System Design

The introduction of new technologies like adaptive automation systems and advanced alarms processing and presentation techniques in nuclear power plants is already having an impact on the safety and effectiveness of plant operations and also the role of the control room operator. This impact is expected to escalate dramatically as more and more nuclear power utilities embark on upgrade projects in order to extend the lifetime of their plants. One of the most visible impacts in control rooms will be the need to replace aging alarm systems. Because most of these alarm systems use obsolete technologies, the methods, techniques and tools that were used to design the previous generation of alarm system designs are no longer effective and need to be updated. The same applies to the need to analyze and redefine operators’ alarm handling tasks. In the past, methods for analyzing human tasks and workload have relied on crude, paper-based methods that often lacked traceability. New approaches are needed to allow analysts to model and represent the new concepts of alarm operation and human-system interaction. State-of-the-art task simulation tools are now available that offer a cost-effective and efficient method for examining the effect of operator performance in different conditions and operational scenarios. A discrete event simulation system was used by human factors researchers at the Idaho National Laboratory to develop a generic alarm handling model to examine the effect of operator performance with simulated modern alarm system. It allowed analysts to evaluate alarm generation patterns as well as critical task times and human workload predicted by the system.

99 GENERAL AND MISCELLANEOUS↗