Search NASA⌕ Search

SEARCH · Search NASA

Results for “human systems performance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

A new method to evaluate human-robot system performance

One of the key issues in space exploration is that of deciding what space tasks are best done with humans, with robots, or a suitable combination of each. In general, human and robot skills are complementary. Humans provide as yet unmatched capabilities to perceive, think, and act when faced with anomalies and unforeseen events, but there can be huge potential risks to human safety in getting these benefits. Robots provide complementary skills in being able to work in extremely risky environments, but their ability to perceive, think, and act by themselves is currently not error-free, although these capabilities are continually improving with the emergence of new technologies. Substantial past experience validates these generally qualitative notions. However, there is a need for more rigorously systematic evaluation of human and robot roles, in order to optimize the design and performance of human-robot system architectures using well-defined performance evaluation metrics. This article summarizes a new analytical method to conduct such quantitative evaluations. While the article focuses on evaluating human-robot systems, the method is generally applicable to a much broader class of systems whose performance needs to be evaluated.

Space Flight/instrumentation↗

Relating Standardized Visual Perception Measures to Simulator Visual System Performance

Human vision is quantified through the use of standardized clinical vision measurements. These measurements typically include visual acuity (near and far), contrast sensitivity, color vision, stereopsis (a.k.a. stereo acuity), and visual field periphery. Simulator visual system performance is specified in terms such as brightness, contrast, color depth, color gamut, gamma, resolution, and field-of-view. How do these simulator performance characteristics relate to the perceptual experience of the pilot in the simulator? In this paper, visual acuity and contrast sensitivity will be related to simulator visual system resolution, contrast, and dynamic range; similarly, color vision will be related to color depth/color gamut. Finally, we will consider how some characteristics of human vision not typically included in current clinical assessments could be used to better inform simulator requirements (e.g., relating dynamic characteristics of human vision to update rate and other temporal display characteristics).

Kaiser, Mary K.↗

Strategies for Quantifying Human Space Flight Performance in the Crew Health and Performance System

The Crew Health and Performance-Probabilistic Risk Assessment (CHP-PRA) team at NASA Glenn Research Center is planning a customized approach to quantify human spaceflight performance changes with respect to changes to the CHP system functions and capabilities. Using the Directed Acyclic Graphs (DAG) initiated by NASA’s Human Systems Risk Board (HSRB) [1], the team is surveying potential candidate models and novel strategies that generate metrics suitable for supporting decision making related to how the CHP system may influence human system performance risk. One such investigation includes classic Human Reliability Analysis (HRA) models. Traditionally, HRA methods estimate the occurrence of human errors and their impact on the success of an activity when designing and operating a system. While humans perceive, interpret, decide on, and carry out a course of action, the factors affecting performance and error likelihood are commonly referred to as performance shaping factors (PSFs). Originally developed to alleviate safety concerns related to nuclear power plant operations, HRA methods such as THERP [2] and CREAM [3] dismantle an activity into tasks, requiring elemental steps to be executed, and assess their failure due to predefined PSFs. In this study, we compare generic HRA methods and those that incorporate some human spaceflight aspects, such as sleep conditions (SCREAM [4]), with respect to how they may be adopted to capture performance with an intention to mitigate detrimental outcomes elucidated by the HSRB DAGs. We suggest strategies to quantify astronaut performance specific to spaceflight activities and illustrate how such concepts may help in optimizing the CHP system capabilities with respect to Artemis missions.

dag↗

A Framework for Evaluating the Effects of Degraded Digital I and C Systems on Human Performance

New and advanced reactors will use integrated digital instrumentation and control (I&C) systems to support operators in their monitoring and control functions. Even though digital systems are typically highly reliable, their potential for degradation or failure could significantly affect operator situation awareness and performance and, consequently, impact plant safety. The U.S. Nuclear Regulatory Commission has initiated a research project to investigate the effects of degraded I&C systems on human performance and plant operations. The ultimate objective of this project is to develop the technical basis for human factors review guidance for conditions of degraded I&C, including complete failure. Based on the results of this effort, NRC will determine the need for developing new guidance or revising NUREG-0800, NUREG-0711, NUREG-0700 and other pertinent NRC review guidance. This paper reports on the first phase of the research, the development of a framework for linking degraded I&C system conditions to human performance. The framework consists of three levels: I&C subsystems, human-system interfaces, and human performance. Each level is composed of a number of discrete elements. This paper will describe the elements at each level and their integration. In the next phase of the research, the framework will be used to systematically investigate the human performance consequences of various classes of failures.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A Human Factors Evaluation of an Advanced Human System Interface for the Generic Pressurized Water Reactor Simulator

Researchers at Idaho National Laboratory (INL), funded by the United States (U.S.) Department of Energy’s Light Water Reactor Sustainability (LWRS) Program, conducted a human factors evaluation of an Advanced Human System Interface (HSI) that colleagues at the Institute for Energy Technology developed for the generic Pressurized Water Reactor (gPWR) simulator. The gPWR simulator is based on an existing, currently operating, U.S. commercial nuclear power plant (NPP). Furthermore, INL has a relationship with this NPP that allows them to recruit operators to participate in their studies. INL also has a full-scope, full-scale simulator facility, called the Human Systems Simulation Laboratory, that hosts the gPWR simulator and allowed these researchers to compare human-system performance when operators used the existing/current gPWR HSI and the new Advanced HSI. As such, one goal of this work was to collect a baseline measure of human-system performance for the Advanced HSI and to identify areas to further improve the design of the Advanced HSI to optimize overall system usability. This paper summarizes the methodology used to perform this evaluation, which emphasized measuring key aspects of human-system performance and getting operator feedback on the design, aesthetics, and functionality of the Advanced HSI, and presents the key findings and insights gained.

99 GENERAL AND MISCELLANEOUS↗

Exploring the Psychometrics of Common Post-Scenario Human Factors Questionnaires of Workload, Situation Awareness, and Perceived Difficulty

Abstract: The United States (U.S.) Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) program has the primary mission of sustaining operation of the existing commercial nuclear power plants (NPPs) through a multi-pathway approach in conducting research and development (R&D). In this effort, the role of human factors engineering (HFE) has been an integral in ensuring new digital upgrades that are part of the overall main control room modernization strategy for various U.S. NPPs optimize human-system performance and do not introduce new human failure modes. In this process, testing and evaluation of concept (i.e., prototype) human machine interfaces (HMIs) are done in operator-in-the-loop studies at various stages of the HFE modification process, such as during design and verification and validation (V&V) [1]. During these studies, licensed operators go through select scenarios using a testbed, such as a full-scale simulator or at a NPP’s training simulator, to identify potential usability issues and provide general design feedback regarding the new digital HMIs. Human-system performance is measured and evaluated through a range of objective and self-report measures that capture aspects of plant performance, task performance, workload, situation awareness, and anthropometric and ergonomic concerns [2]. The use of post-scenario questionnaires is an acceptable method for gathering measures of workload and situation awareness. To this end, the NASA-Task Load Index (TLX) [e.g., 3, 4, & 5] and Situation Awareness Rating Technique (SART) [e.g., 6 & 7] are common standardized questionnaires used for evaluating workload and situation awareness, respectively. When combined, these questionnaires consist of a total of 15 questions, each using a different rating scale. Debriefs are also done through interviews with operators to gather design insight after each scenario. Since operator- and training simulator-time is limited, a concern during this post-scenario period of operator-in-the-loop studies is the limited time available to run scenarios, administer post-scenario questionnaires, and debrief within the allotted simulator time. To address this potential problem, this paper explores the psychometric characteristics of NASA-TLX, SART, and a common one-question post-scenario usability questionnaire (i.e., the single ease question – SEQ [8]) in effort to inform future development of a condensed questionnaire that captures aspects of workload and situation awareness. This exploratory work uses data from four different operator-in-the-loop studies completed under prior LWRS operator-in-the-loop studies. Findings from this paper should support future development of a consolidated questionnaire that may be used in operator-in-the-loop studies, when time is compressed, that conforms to the HFE scientific and regulatory requirements set for NPP control room modernization.

99 GENERAL AND MISCELLANEOUS↗

Computerized operator support system and human performance in the control room - 262

An operator aid technology to assist nuclear plant operators maintain situation awareness and detect faults earlier than would be possible using conventional control room technologies is described. Coined the Computerized Operator Support System (COSS), this technology is aimed at the human-machine interface. The COSS has been implemented as a prototype system operating in the control room environment of a full-scale simulator for a commercial nuclear power plant. A human factors assessment that involved two licensed reactor crews was performed to evaluate crew performance. This paper describes the development of the COSS, the underlying fault-detection architecture, and feedback received based on operator-in-the-loop studies. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Application of eye tracking for measurement and evaluation in human factors studies in control room modernization - 309

An important element of human factors engineering (HFE) pertains to measurement and evaluation (M and E). The role of HFE-M and E should be integrated throughout the entire control room modernization (CRM) process and be used for human-system performance evaluation and diagnostic purposes with resolving potential human engineering deficiencies (HEDs) and other human machine interface (HMI) design issues. NUREG-0711 describes how HFE in CRM should employ a hierarchical set of measures, particularly during integrated system validation (ISV), including plant performance, personnel task performance, situation awareness, cognitive workload, and anthropometric/ physiological factors. Historically, subjective measures have been primarily used since they are easier to collect and do not require specialized equipment. However, there are pitfalls with relying solely on subjective measures in M and E such that negatively impact reliability, sensitivity, and objectivity. As part of comprehensively capturing a diverse set of measures that strengthen findings and inferences made of the benefits from emerging technologies like advanced displays, this paper discusses the value of using eye tracking as an objective method that can be used in M and E. A brief description of eye tracking technology and relevant eye tracking measures is provided. Additionally, technical considerations and the unique challenges with using eye tracking in full-scaled simulations are addressed. Finally, this paper shares preliminary findings regarding the use of a wearable eye tracking system in a full-scale simulator study. These findings should help guide future full-scale simulator studies using eye tracking as a methodology to evaluate human-system performance. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

APPLICATION OF EYE TRACKING FOR MEASUREMENT AND EVALUATION IN HUMAN FACTORS STUDIES IN CONTROL ROOM MODERNIZATION

An important element of human factors engineering (HFE) pertains to measurement and evaluation (M&E). The role of HFE-M&E should be integrated throughout the entire control room modernization (CRM) process and be used for human-system performance evaluation and diagnostic purposes with resolving potential human engineering deficiencies (HEDs) and other human machine interface (HMI) design issues. NUREG-0711 describes how HFE in CRM should employ a hierarchical set of measures, particularly during integrated system validation (ISV), including plant performance, personnel task performance, situation awareness, cognitive workload, and anthropometric/ physiological factors. Historically, subjective measures have been primarily used since they are easier to collect and do not require specialized equipment. However, there are pitfalls with relying solely on subjective measures in M&E such that negatively impact reliability, sensitivity, and objectivity. As part of comprehensively capturing a diverse set of measures that strengthen findings and inferences made of the benefits from emerging technologies like advanced displays, this paper discusses the value of using eye tracking as an objective method that can be used in M&E. A brief description of eye tracking technology and relevant eye tracking measures is provided. Additionally, technical considerations and the unique challenges with using eye tracking in full-scaled simulations are addressed. Finally, this paper shares preliminary findings regarding the use of a wearable eye tracking system in a full-scale simulator study. These findings should help guide future full-scale simulator studies using eye tracking as a methodology to evaluate human-system performance.

99 GENERAL AND MISCELLANEOUS↗

Application of Eye Tracking for Measurement and Evaluation in Human Factors Studies in Control Room Modernization

An important element of human factors engineering (HFE) pertains to measurement and evaluation (M&E). The role of HFE-M&E should be integrated throughout the entire control room modernization (CRM) process and be used for human-system performance evaluation and diagnostic purposes with resolving potential human engineering deficiencies (HEDs) and other human machine interface (HMI) design issues. NUREG-0711 describes how HFE in CRM should employ a hierarchical set of measures, particularly during integrated system validation (ISV), including plant performance, personnel task performance, situation awareness, cognitive workload, and anthropometric/ physiological factors. Historically, subjective measures have been primarily used since they are easier to collect and do not require specialized equipment. However, there are pitfalls with relying solely on subjective measures in M&E such that negatively impact reliability, sensitivity, and objectivity. Furthermore, as part of comprehensively capturing a diverse set of measures that strengthen findings and inferences made of the benefits from emerging technologies like advanced displays, this paper discusses the value of using eye tracking as an objective method that can be used in M&E. A brief description of eye tracking technology and relevant eye tracking measures is provided. Additionally, technical considerations and the unique challenges with using eye tracking in full-scaled simulations are addressed. Finally, this paper shares preliminary findings regarding the use of a wearable eye tracking system in a full-scale simulator study. These findings should help guide future full-scale simulator studies using eye tracking as a methodology to evaluate human-system performance.

99 GENERAL AND MISCELLANEOUS↗

The Effects of Degraded Digital Instrumentation and Control Systems on Human-system Interfaces and Operator Performance: HFE Review Guidance and Technical Basis

New and advanced reactors will use integrated digital instrumentation and control (I&C) systems to support operators in their monitoring and control functions. Even though digital systems are typically highly reliable, their potential for degradation or failure could significantly affect operator performance and, consequently, impact plant safety. The U.S. Nuclear Regulatory Commission (NRC) supported this research project to investigate the effects of degraded I&C systems on human performance and plant operations. The objective was to develop human factors engineering (HFE) review guidance addressing the detection and management of degraded digital I&C conditions by plant operators. We reviewed pertinent standards and guidelines, empirical studies, and plant operating experience. In addition, we conducted an evaluation of the potential effects of selected failure modes of the digital feedwater system on human-system interfaces (HSIs) and operator performance. The results indicated that I&C degradations are prevalent in plants employing digital systems and the overall effects on plant behavior can be significant, such as causing a reactor trip or causing equipment to operate unexpectedly. I&C degradations can impact the HSIs used by operators to monitor and control the plant. For example, sensor degradations can make displays difficult to interpret and can sometimes mislead operators by making it appear that a process disturbance has occurred. We used the information obtained as the technical basis upon which to develop HFE review guidance. The guidance addresses the treatment of degraded I&C conditions as part of the design process and the HSI features and functions that support operators to monitor I&C performance and manage I&C degradations when they occur. In addition, we identified topics for future research.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Study to design and develop remote manipulator system

Human performance measurement techniques for remote manipulation tasks and remote sensing techniques for manipulators are described for common manipulation tasks, performance is monitored by means of an on-line computer capable of measuring the joint angles of both master and slave arms as a function of time. The computer programs allow measurements of the operator's strategy and physical quantities such as task time and power consumed. The results are printed out after a test run to compare different experimental conditions. For tracking tasks, we describe a method of displaying errors in three dimensions and measuring the end-effector position in three dimensions.

Hill, J. W.↗