Multi-source information fusion to assess control room operator performance
Not provided.
Engineering↗
SEARCH · Search NASA
Results for “operator performance”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Biocybernetic Adaptation Strategies: Machine Awareness of Human Engagement for Improved Operational Performance
Human operators interacting with machines or computers continually adapt to the needs of the system ideally resulting in optimal performance. In some cases, however, deteriorated performance is an outcome. Adaptation to the situation is a strength expected of the human operator which is often accomplished by the human through self-regulation of mental state. Adaptation is at the core of the human operator's activity, and research has demonstrated that the implementation of a feedback loop can enhance this natural skill to improve training and human/machine interaction. Biocybernetic adaptation involves a “loop upon a loop,” which may be visualized as a superimposed loop which senses a physiological signal and influences the operator’s task at some point. Biocybernetic adaptation in, for example, physiologically adaptive automation employs the “steering” sense of “cybernetic,” and serves a transitory adaptive purpose – to better serve the human operator by more fully representing their responses to the sys- tem. The adaptation process usually makes use of an assessment of transient cog- nitive state to steer a functional aspect of a system that is external to the operator’s physiology from which the state assessment is derived. Therefore, the objective of this paper is to detail the structure of biocybernetic systems regarding the level of engagement of interest for adaptive systems, their processing pipeline, and the adaptation strategies employed for training purposes, in an effort to pave the way towards machine awareness of human state for self-regulation and improved operational performance.
Stephens, Chad↗
Neo – Mars Adaptive Training Integrative Knowledge System (MATRIKS) to Improve Operational Performance and its Neural Basis for Spaceflight
With prolonged mission durations, spaceflight crews will become increasingly dependent on onboard technologies for knowledge acquisition and maintenance. It is expected that not all skills and knowledge required for these missions can be retained and retrieved based on pre-mission training alone. Limited and delayed communication will significantly constrain support from Mission Control and crews will increasingly rely on autonomous onboard technologies to successfully perform post-landing operations. With the present project we will target NASA’s particular interest in developing and assessing an adaptive, just-in-time countermeasure that will consolidate and improve skills that are most relevant to space flight operations. To achieve this aim, NASA established a Virtual NASA Specialized Center of Research (VNSCOR)referred to as “Mars Adaptive Training Integrative Knowledge System (MATRIKS)”, comprising the following three projects: (1) “Trinity–Multi-Environment Virtual Training for Long Duration Exploration Missions”, PI: A. Anderson (UC Boulder); (2) “Morpheus–A Haptic Sensory Supplement to Optimize In-Flight Adaptive Training for Human Control of Spacecraft Robotic Arms”, PI: S. Robinson, UC Davis); and the present project “Neo–Adaptive Training integrative knowledge System to Improve Operational Performance and its Neural Basis for Spaceflight” (UPenn, PI: A.C. Stahn). Neo leverages a validated workstation called 6DF that simulates a rendezvous and docking maneuver using real spacecraft flight dynamics. It is designed to (1) train and improve sensorimotor skills relevant for inflight and post-landing operational tasks; (2) feature an autonomous and adaptive training approach that does not rely on feedback from flight operations on the ground; (3) maximize the transfer of mission-relevant motor skills; (4) allow the assessment of the neural circuitry underlying the task; and (5) deliver the training in a motivating and meaningful way to astronauts. Neocomprises two overarching aims: First, we will identify the neural circuitry underlying spaceflight relevant tasks by performing a subset of the 6DFtaskduring functional magnetic resonance imaging (MRI)in a total of up to N=30 subjects with varying levels of 6DF training experience. Second, as part of the above-mentioned VNSCOR MATRIKS the proposed 6DF autonomous intelligent tutor system will be integrated in an additive manner with a haptic feedback intervention (Morpheus), and a multi-environment virtual trainer(Trinity).It is expected that Neo, Morpheus and Trinity mutually complement each other to facilitate an effective countermeasure tool to acquire and retain operational skills that are critical for exploration class missions. To assess the efficacy of this combined effort, the VNSCOR MATRIKS will collect data inN=16 crew members in one HERA campaign of 45 days duration with N=16 crew members(four missions with N=4 crew member seach).The primary goal is to identify changes in operational performance as assessed by NASA’s simulator of Canadarm2 operations, i.e., Robotic On-board Trainer (ROBoT-r) in response to MATRIKS. As part of Neo we will also identify if, and to what extent MATRIKS will promote transfer to general cognitive performance (Cognition battery), distinctive visuo-spatial tasks critical for telerobotic tasks (Spatial Cognition battery), and affect brain structural changes and the neural circuitry of key brain networks expected to be relevant for spaceflight-related performance. At the conclusion of the research, we will have defined and demonstrated the use of a neuroscience-based, adaptive training integrative knowledge system to potentially mitigate visuo-spatial and sensorimotor brain changes associated with prolonged isolation and confinement to reduce the likelihood or impact of potential decrements in human performance capabilities during long-duration space missions. The expected significance of this 4-year project relates to its relevance for facilitating effective countermeasure tools to acquire and retain operational skills that are critical for exploration class missions. This will support the development of necessary countermeasures and technologies in support of human space exploration, focusing on mitigating operational performance risks.
A C Stahn↗
Operator Performance Support System (OPSS)
In the complex and fast reaction world of military operations, present technologies, combined with tactical situations, have flooded the operator with assorted information that he is expected to process instantly. As technologies progress, this flow of data and information have both guided and overwhelmed the operator. However, the technologies that have confounded many operators today can be used to assist him -- thus the Operator Performance Support Team. In this paper we propose an operator support station that incorporates the elements of Video and Image Databases, productivity Software, Interactive Computer Based Training, Hypertext/Hypermedia Databases, Expert Programs, and Human Factors Engineering. The Operator Performance Support System will provide the operator with an integrating on-line information/knowledge system that will guide expert or novice to correct systems operations. Although the OPSS is being developed for the Navy, the performance of the workforce in today's competitive industry is of major concern. The concepts presented in this paper which address ASW systems software design issues are also directly applicable to industry. the OPSS will propose practical applications in how to more closely align the relationships between technical knowledge and equipment operator performance.
Conklin, Marlen Z.↗
The Effect of Degraded Digital Instrumentation and Control systems on Human-system Interfaces and Operator Performance
Integrated digital instrumentation and control (I&C) systems in new and advanced nuclear power plants (NPPs) will support operators in monitoring and controlling the plants. Even though digital systems typically are expected to be reliable, their potential for degradation or failure significantly could affect the operators performance and, consequently, jeopardize plant safety. This U.S. Nuclear Regulatory Commission (NRC) research investigated the effects of degraded I&C systems on human performance and on plant operations. The objective was to develop technical basis and guidance for human factors engineering (HFE) reviews addressing the operator's ability to detect and manage degraded digital I&C conditions. We reviewed pertinent standards and guidelines, empirical studies, and plant operating experience. In addition, we evaluated the potential effects of selected failure modes of the digital feedwater control system of a currently operating pressurized water reactor (PWR) on human-system interfaces (HSIs) and the operators performance. Our findings indicated that I&C degradations are prevalent in plants employing digital systems, and the overall effects on the plant's behavior can be significant, such as causing a reactor trip or equipment to operate unexpectedly. I&C degradations may affect the HSIs used by operators to monitor and control the plant. For example, deterioration of the sensors can complicate the operators interpretation of displays, and sometimes may mislead them by making it appear that a process disturbance has occurred. We used the findings as the technical basis upon which to develop HFE review guidance.
21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
Effects of shifts in the level of automation on operator performance
The results of two experiments examining the effects of shifts in the type and level of automation on operator performance are presented. The first examines the costs and benefits of adaptive-automation shifts on operator performance, while the second experiment examines the effects of variations in automation reliability on operator detection of automation failures. Performance consequences of complacency in system monitoring are shown to be related to characteristics of the monitoring task automation, i.e., automation reliability and consistency.
Parasuraman, Raja↗
Proprioceptive cues and their influence on operator performance in manual control
Proprioceptor influence on operator performance in manual control situations
Herzog, J. H.↗
A study of human operator performance using regression analysis
Aspects of human operator performance in low order compensatory control tasks studied with regression analysis
Burgett, A. L.↗
Enhancing Global Competitiveness: Benchmarking Airline Operational Performance in Highly Regulated Environments
Enhancing competitiveness in the global airline industry is at the forefront of attention with airlines, government, and the flying public. The seemingly unchecked growth of major airline alliances is heralded as an enhancement to global competition. However, like many mega-conglomerates, mega-airlines will face complications driven by size regardless of the many recitations of enhanced efficiency. Outlined herein is a conceptual model to serve as a decision tool for policy-makers, managers, and consumers of airline services. This model is developed using public data for the United States (U.S.) major airline industry available from the U/S. Department of Transportation, Federal Aviation Administration, the National Aeronautics and Space Administration, the National Transportation Safety Board, and other public and private sector sources. Data points include number of accidents, pilot deviations, operational performance indicators, flight problems, and other factors. Data from these sources provide opportunity to develop a model based on a complex dot product equation of two vectors. A row vector is weighted for importance by a key informant panel of government, industry, and consumer experts, while a column vector is established with the factor value. The resulting equation, known as the national Airline Quality Rating (AQR), where Q is quality, C is weight, and V is the value of the variables, is stated Q=C[i1-19] x V[i1-19]. Looking at historical patterns of AQR results provides the basis for establishment of an industry benchmark for the purpose of enhancing airline operational performance. A 7 year average of overall operational performance provides the resulting benchmark indicator. Applications from this example can be applied to the many competitive environments of the global industry and assist policy-makers faced with rapidly changing regulatory challenges.
Bowen, Brent D.↗
Meta-Level Design Guidance and Operator Performance Measures for Hybrid Control Rooms
The purpose of this grant was to refine and test methods to evaluate digital human system interfaces (HSI) for existing largely analog nuclear power plant (NPP) control rooms (CRs). We hypothesized that CR operator performance (CROP) in hybrid NPP CRs will be improved if future digital HSI is designed based on: 1) more robust design guidelines for operator situation awareness (SA) and decision-making (DM); 2) enhanced CROP metrics during HSI evaluation; 3) an ontology for selecting simulation scenarios to evaluate digital HSI; and 4) a model to predict optimal HSI design attributes given CROP objectives. The team conducted numerous nuclear power plant site visits (e.g., to Brown’s Ferry, Palo Verde, Sequoyah and Vogtle) to study control room operations and crisis management and 3 visits to the NRC Chattanooga Training Center. We observed research studies at DC Cook and NRC Chattanooga in collaboration with the Halden Reactor Project. We collected operator performance and workload data in one NPP simulator. A comprehensive human (i.e., CROP) performance literature review was published in Applied Ergonomics. We obtained operator team performance data from CAER to produce our data fusion model and a paper delineating the results have been accepted (revision submitted) in Resilience Engineering and System Safety. We analyzed interview data related to scenario ontology development; a manuscript is still in preparation.
21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
Pulse models of human operators performing compensatory tracking with coordinated multiple inputs
Human performance and eye movements of operator performing compensatory tracking with coordinated multiple inputs
COMPENSATORY TRACKING↗
Command and Telemetry Latency Effects on Operator Performance during International Space Station Robotics Operations
International Space Station (ISS) operations will require the on-board crew to perform numerous robotic-assisted assembly, maintenance, and inspection activities. Current estimates for some robotically performed maintenance timelines are disproportionate and potentially exceed crew availability and duty times. Ground-based control of the ISS robotic manipulators, specifically the Special Purpose Dexterous Manipulator (SPDM), is being examined as one potential solution to alleviate the excessive amounts of crew time required for extravehicular robotic maintenance and inspection tasks.
Currie, Nancy J.↗
Evaluation of Heliostat Standby Aiming Strategies to Reduce Avian Flux Hazards and Impacts on Operational Performance
This paper presents a study of alternative heliostat standby aiming strategies and their impact on avian flux hazards and operational performance of a concentrating solar power plant. A mathematical model was developed that predicts the bird-feather temperature as a function of solar irradiance, thermal emittance, convection, and thermal properties of the feather. The irradiance distribution in the airspace above the Ivanpah Unit 2 heliostat field was simulated using a ray-trace model for two different times of the day, four days of the year, and nine different standby aiming strategies. The impact of the alternative aiming strategies on operational performance was assessed by comparing the heliostat slew times from standby position to the receiver for the different aiming strategies. Increased slew times increased a proxy start-up time that reduced the simulated annual energy production. Results showed that spreading the radial aim points around the receiver to a distance of ~150 m or greater reduced the hazardous exposure times that the feather temperature exceeded the hazard metric of 160 degrees C. The hazardous exposure times were reduced by ~23% and 90% at a radial spread of aim points extending to 150 m and 250 m, respectively, but the simulated annual energy production decreased as a result of increased slew times. Single point-focus aiming strategies were also evaluated, but these strategies increased the exposure hazard relative to other aiming strategies.
14 SOLAR ENERGY↗
The use of full scale mission simulation for the assessment of complex operator performance.
Full scale mission simulation for assessment of complex operator performance
Grodsky, M. A.↗
Performance Evaluation of Data-Enhanced Hierarchical Control for Grid Operations
This paper presents a hardware-in-the-loop (HIL) simulation to evaluate the performance of voltage regulation of Data-Enhanced Hierarchical Control (DEHC). This DEHC uses an advanced distribution management system (ADMS) for grid operations to control legacy and grid-edge devices and coordinate with distributed energy management systems (DERMS) to manage high penetrations of photovoltaics (PV) on a utility distribution system. The HIL platform provides realistic laboratory testing, including accurate modeling (legacy devices, grid-edge devices, and PV) of the real-world distribution system from a utility partner, a real controller (ADMS), software controller DERMS, hardware grid-edge devices, and standard communications protocols. The test results demonstrate functionalities of the integrated platform and the performance of voltage regulation of the coordinated control systems. Based on laboratory testing, the utility can set up the same grid-automation system to manage DERs, legacy devices, and grid-edge devices to achieve their system-level control and operation objectives (e.g., voltage regulation), thus de-risking potential issues such as instability for field deployment.
41 EE - Solar Energy Technologies Office (EE-4S)↗
On scaling performance operating characteristics - Caveat emptor
Problems associated with scaling and normalizing empirical performance operating characteristics (POCs) are examined. Normalization methods proposed by Wickens (1980) and by Mountford and North (1980) are critically evaluated. Computer simulations are used to generate raw-score and normalized POCs. The interpretation of transformed empirical POCs (Wickens, Mountford, and Schreiner, 1981) is shown to contain inconsistencies. The normalization techniques reviewed fail to resolve POC scaling problems. Caution must be exercised when interpreting transformed POCs.
Kantowitz, B. H.↗
Science-based HRA: experimental comparison of operator performance to IDAC (Information-Decision-Action Crew) simulations
Information-Decision-Action Crew (IDAC) operator model simulations of a Steam Generator Tube Rupture are compared to student operator performance in studies conducted in the Ohio State University’s Nuclear Power Plant Simulator Facility. This study is presented as a prototype for conducting simulator studies to validate key aspects of Human Reliability Analysis (HRA) methods. Seven student operator crews are compared to simulation results for crews designed to demonstrate three different decision-making strategies. The IDAC model used in the simulations is modified slightly to capture novice behavior rather that expert operators. Operator actions and scenario pacing are compared. A preliminary review of available performance shaping factors (PSFs) is presented. After the scenario in the NPP Simulator Facility, student operators review a video of the scenario and evaluate six PSFs at pre-determined points in the scenario. This provides a dynamic record of the PSFs experienced by the OSU student operators. In this preliminary analysis, Time Constraint Load (TCL) calculated in the IDAC simulations is compared to TCL reported by student operators. We identify potential modifications to the IDAC model to develop an “IDAC Student Operator Model.” This analysis provides insights into how similar experiments could be conducted using expert operators to improve the fidelity of IDAC simulations.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
Characterization of Operational Performance of Ka-Band Links in Deep Space Network
This paper presents a characterization of performance of 32-GHz Ka-band link in an operational environment. The data come from tracking of Kepler spacecraft by the NASA Deep Space Network (DSN) in the past few years. Ka-band link offers a significant signal-to-noise advantage compared to the more common X- or S-band; however, it is subject to more signal fluctuation caused by the weather. Kepler is the first mission supported by the DSN that solely rely on the higher deep space Ka-band communications link to return its high-rate science data. A well characterization of the operational performance of Kepler would benefit future Ka-band missions, especially for those operating with smaller link margin. The study examines how weather conditions at the DSN facilities (e.g., winds, clouds, rains) affect the received signal, particularly on telemetry data. It addresses questions such as how often the weather affects the link and how much degradation the link could suffer. Among the 22 Ka-band passes in 2012, heavy clouds affected one pass and two passes were impacted by high winds. The adverse weather caused at time as much as 3-dB instantaneous change in the signal to noise ratio (SNR). Estimates of degradation to the SNR as a function of wind speeds are captured based on observations. This study also quantifies the probability distribution of the variation of received signal power. With such information, future missions can better plan their link design. An optimal link design aims for just having enough margin to realize the data return with a targeted probability, with neither having too much margin that it reduces the downlink data rate nor insufficient reserve that causes frequent data outages. The study tries to provide some answers to the questions such as how much does SNR vary from one tracking pass to the next, and what is the cumulative distribution of signal fluctuation. Regarding the signal variation over many tracking passes, we found that the averaged symbol SNR (SSNR) for each pass changed by as much as 4 dB. Some variations were due to geometry such as the changing distance between spacecraft and Earth and different antenna pointing elevations. Other variations seem to be random in nature, reflecting the randomness of operational environments. Some passes were found to be quite stable, with a standard deviation of symbol SNR around 0.25 dB while others had greater variation, up to 1.4 dB. Overall, the cumulative distribution of the symbol SNR reflects that 50% of the fluctuations was less than 0.6 dB, 90% of fluctuation was within 1.6 dB and 95% within 2.2 dB. Some of the challenges in data processing, validation and modeling were captured in this paper. We observed some inconsistent measurements where operational data significantly deviate from a normal expectation. These inconsistent measurements made it hard to develop an accurate and consistent performance model, such as the degradation of signal SNR as a function of high wind. The difficulty was compounded by the fact that there were only a few Ka-band passes observed in high winds.
Pham, Timothy↗