Search NASA⌕ Search

SEARCH · Search NASA

Results for “Human Reliability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

A Bayesian and HRA-Aided Method for the Novel Reliability Analysis of Software

Technological advancements and nuclear power plant modernization has inspired considerable research in the areas of safety and reliability, yet there remains a lack of consensus for the reliability assessment of digital instrumentation and control (I&C) systems. Motivated by the lack of consensus for reliability analysis methods, this work employs a novel framework that incorporates Bayesian, human reliability, and common-cause failure (CCF) modeling techniques. The novel framework allows the use of state-of-the-art or classical modeling techniques when accounting for human and CCF effects on system reliability. The Bayesian and HRA-Aided Method for the Reliability Analysis of Software (BAHAMAS) is demonstrated by a case study for the quantification of software hazards found in a previous analysis of a digital reactor trip system. The results demonstrate the ability of BAHAMAS to account for human activities during the software development life cycle and their influence on software reliability. BAHAMAS is a flexible tool for extending the coverage of conventional probabilistic risk assessments to include modernized digital I&C systems.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

An Experimental Investigation of Students’ Learning Effects When Using a Simplified Nuclear Simulator

Securing enough data has been a main challenge in human reliability analysis (HRA). Many researchers and institutes have made a lot of efforts for collecting HRA data to produce reasonable human error probabilities (HEPs) as well as reduce the uncertainty of HRA quantification. Representatively, U.S. Nuclear Regulatory Commission (U.S. NRC), Korea Atomic Energy Research Institute (KAERI) and Idaho National Laboratory (INL) have led lots of empirical research regarding the HRA data collection. The U.S. NRC and KAERI have mainly carried out full-scope simulator research collecting HRA data through experiments using full-scope simulators with actual operators. In contrast, INL has experimentally collected the data using simplified simulators and student operators. INL has proposed the Simplified Human Error Experimental Program (SHEEP) framework to complement full-scope data collection efforts by suggesting a way to infer full-scope data based on experimental data collected from students operating simplified simulators, specifically the Rancor Microworld Simulator (Rancor) and the Compact Nuclear Simulator (CNS). The aim of the SHEEP framework is to lower the entry point for collecting useful HRA data by securing large sample sizes at a reasonable amount of cost and labor while also guaranteeing a high degree of freedom when designing experiments. The authors’ previous research investigated whether data collected from the SHEEP framework could support a representative full-scope study. Besides, human performance differences between professional and student operators when using Rancor and CNS have been analyzed to understand the lack of fidelity of the simplified simulators and student operators within the SHEEP study. As a follow up research, this study experimentally investigates students’ learning effects and the performance trends over a certain period when using Rancor. This study aims to find out 1) how much training or education is required to collect HRA data from non-experts (i.e., students) when using Rancor and 2) how much differences there are in human performance measures between students and professional operators. In this study, a longitudinal experiment is developed. The four experiment trials with two weeks interval are carried out for sixteen undergraduate students majoring nuclear engineering at Chosun University. Totally four scenarios randomly selected from ten Rancor scenarios are used in each experiment trial. Four human performance measurements (i.e., workload, situation awareness, time and error) are considered in the experiment. Lastly, the trend of students’ performance is compared with operator data having been collected from the previous experiment.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2021

Experimental Analysis of the Effects of Simulator Complexity on Human Performance

Human Reliability Analysis predicts accidents caused by human errors and is an important factor in Probabilistic Safety Assessment that comprehensively evaluates the safety of nuclear power plants. This study compares and analyzes the human performance of nuclear power plant operators according to the simulator complexity as part of the HRA data collection support method development project conducted by Idaho National Laboratory. This experiment was conducted by setting two types of simulators and scenarios as independent variables. The data collected by conducting the experiments in two different simulators were analyzed using an analysis of variance test and a correlation analysis, and four human performance charts were derived.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2024

Assessment of Electric Grid Transmission System Simulator for Human Factors Research

Over the past decades, various technologies have been developed for electric grid operations to support clean energy, meet rising electricity demands, and address infrastructure concerns. However, the human factors aspect is often overlooked during rapid integration. Questions persist about how these technologies impact human performance. Simulators play a critical role in supporting investigation of human factors design concepts and conducting comprehensive usability testing to evaluate human performance and assess human reliability. This paper aims to address human factors research simulator requirements and conduct a comparative study of six different simulators. A detailed evaluation reveals that the evaluated simulators lack the ability to customize user interfaces. Additionally, their user interface designs do not fulfill the basic human factors design principles, potentially leading to increased response variability and reduced statistical power when conducting controlled experimental research. In the future, it is essential to develop scripting tools to integrate customizable user interfaces and simulation models, ensuring meeting research requirements.

Li, Ruixuan↗
DOE OSTI2021

An Experimental Investigation of Human Performance Differences Depending on Simulator Complexity

As a different approach to collect human reliability analysis (HRA) data compared to the full-scope simulator studies, Idaho National Laboratory (INL) has attempted to collect HRA data based on Simplified Human Error Experimental Program (SHEEP), which uses a simplified simulator and student participants. To date, INL has considered the SHEEP approach using simplified simulators such as Rancor Microworld and Compact Nuclear Simulator to complement – not replace – full-scope studies as well as to mainly collect HRA data for estimating nominal/basic human error probabilities (HEPs) needed in the HRA quantification process. This study is a part of the project aiming to suggest how to support full-scope data collection studies based on SHEEP. This paper first introduces major tasks within the SHEEP framework. Then, as one of the major tasks, why and how we have planned to experimentally investigate human performance differences depending on simulator complexity are mainly introduced in this paper.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2020

Risk-Informed ATF and FLEX Analysis for an Enhanced Resilient BWR Under Design-Basis and Beyond-Design-Basis Accidents

This report documents the activities performed by the Idaho National Laboratory (INL) during fiscal year (FY) 2020 for the U.S. Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) Program, Risk-Informed System Analysis (RISA) Pathway, Enhanced Resilient Plant (ERP) Systems research. The purpose of the RISA Pathway research and development is to support plant owner-operator decisions with the aim to improve the economics, reliability, and maintain the high levels of safety of current nuclear power plants over periods of extended plant operations. The concept of ERP refers to the combinations of accident-tolerant fuel (ATF), optimal use of diverse and flexible coping strategy (FLEX), enhancements to plant components and systems, and the incorporation of augmented or new passive cooling systems, as well as improved fuel cycle efficiency. The objective of the ERP research effort is to use the RISA methods and toolkit in industry applications, including methods development and early demonstration of technologies, in order to enhance existing reactors’ safety features (both active and passive) and to substantially reduce operating costs through risk-informed approaches to plant design modifications to the plant and their characterization. One main focus of the FY 2020 efforts documented in this report was to extend the analyses conducted in FYs 2018 and 2019 for a pressurized water reactor (PWR) to a boiling water reactor (BWR). The same analysis process, risk analysis approaches, and analysis tools as in the previous work for PWR were used for a generic BWR with near-term ATF cladding (i.e., Iron-Chromium-Aluminum [FeCrAl] cladding and Chromium [Cr]-coated cladding) designs under the postulated station blackout (SBO) and medium loss-of-coolant (MLOCA) accident scenarios. In addition, a FLEX model was developed and incorporated into a generic BWR probabilistic risk assessment (PRA) model using the INL-developed software tool, Systems Analysis Programs for Hands-on Integrated Reliability Evaluations (SAPHIRE), to assess the risk impact from FLEX. The other main focus of the FY 2020 efforts was to advance analysis methods, including developing dynamic approach for FLEX human reliability analysis (HRA) using the INL-developed software tool, Event Modeling Risk Assessment using Linked Diagrams (EMRALD), as well as developing a multicriterion benefit evaluation (MCBE) method for evaluating costs and benefits of safety enhancements in nuclear power plants (NPPs). As a case study, the MCBE method was applied to evaluate the costs and benefits brought by FLEX implementation.

99 GENERAL AND MISCELLANEOUS↗
NASA NTRS2010

The Importance of HRA in Human Space Flight: Understanding the Risks

Human performance is critical to crew safety during space missions. Humans interact with hardware and software during ground processing, normal flight, and in response to events. Human interactions with hardware and software can cause Loss of Crew and/or Vehicle (LOCV) through improper actions, or may prevent LOCV through recovery and control actions. Humans have the ability to deal with complex situations and system interactions beyond the capability of machines. Human Reliability Analysis (HRA) is a method used to qualitatively and quantitatively assess the occurrence of human failures that affect availability and reliability of complex systems. Modeling human actions with their corresponding failure probabilities in a Probabilistic Risk Assessment (PRA) provides a more complete picture of system risks and risk contributions. A high-quality HRA can provide valuable information on potential areas for improvement, including training, procedures, human interfaces design, and the need for automation. Modeling human error has always been a challenge in part because performance data is not always readily available. For spaceflight, the challenge is amplified not only because of the small number of participants and limited amount of performance data available, but also due to the lack of definition of the unique factors influencing human performance in space. These factors, called performance shaping factors in HRA terminology, are used in HRA techniques to modify basic human error probabilities in order to capture the context of an analyzed task. Many of the human error modeling techniques were developed within the context of nuclear power plants and therefore the methodologies do not address spaceflight factors such as the effects of microgravity and longer duration missions. This presentation will describe the types of human error risks which have shown up as risk drivers in the Shuttle PRA which may be applicable to commercial space flight. As with other large PRAs of complex machines, human error in the Shuttle PRA proved to be an important contributor (~12 percent) to LOCV. An existing HRA technique was adapted for use in the Shuttle PRA, but additional guidance and improvements are needed to make the HRA task in space-related PRAs easier and more accurate. Therefore, this presentation will also outline plans for expanding current HRA methodology to more explicitly cover spaceflight performance shaping factors.

Hamlin, Teri↗
DOE OSTI2025

EVALUATION OF HRA METHODOLOGIES FOR APPLICATION IN SDP WORK

This study critically evaluates human reliability analysis (HRA) methodologies applicable to regulatory probabilistic safety assessment (PSA) model, with a particular focus on their role in supporting the significance determination process (SDP) in nuclear safety assessment. Firstly, three widely utilized HRA methods – IDHEAS-ECA, SPAR-H, and ASEP/THERP – were qualitatively and quantitatively assessed. Qualitative assessments were conducted using attributes from the NEA/CSNI/R(2015)1 report, while quantitative evaluations employed regression and correlation analyses to compare predicted human error probabilities (HEPs) against empirical data. Results reveal distinct strengths, for example, IDHEAS-ECA’s robust predictive accuracy and K-HRA’s alignment with operational practices. In addition, dependency analysis and recovery analysis were critically evaluated. For dependency analysis, the methods’ handling of inter-task dependencies and their impact on HEPs were examined, while recovery analysis highlighted strategies for mitigating failure events. Furthermore, strategies were proposed to evaluate performance-shaping factors under conditions of reduced human performance, such as stress, fatigue, or cognitive overload, addressing specific challenges faced in SDP evaluations. Human errors from KINS’s operational performance information system event reports were evaluated as a case study. This study identifies gaps and provides actionable insights to ensure their validity and applicability in SDP HRA applications. This paper is a part of research conducted by KINS, and it should be noted that this result does not represent the regulatory position of KINS.

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2022

The evolution of the Human Systems and Simulation Laboratory in nuclear power research

The events at Three Mile Island in the United States brought about fundamental changes in the ways that simulation would be used in nuclear operations. The need for research simulators was identified to scientifically study human-centered risk and make recommendations for process control system designs. This paper documents the human factors research conducted at the Human Systems and Simulation Laboratory (HSSL) since its inception in 2010 at Idaho National Laboratory. The facility’s primary purposes are to provide support to utilities for system upgrades and to validate modernized control room concepts. In the last decade, however, as nuclear industry needs have evolved, so too have the purposes of the HSSL. Thus, beyond control room modernization, human factors researchers have evaluated the security of nuclear infrastructure from cyber adversaries and evaluated human-in-the-loop simulations for joint operations with an integrated hydrogen generation plant. Lastly, our review presents research using human reliability analysis techniques with data collected from HSSL-based studies and concludes with potential future directions for the HSSL, including severe accident management and advanced control room technologies.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2024

Rancor-HUNTER: A Virtual Plant and Operator Environment for Predicting Human Performance

Advances in simulation capabilities to model physical systems have outpaced the development of simulations for humans using those physical systems. There is an argument that the infinite span of potential human behaviors inherently render human modeling more challenging than physical systems. Despite this challenge, the need for modeling humans interacting with these complex systems is paramount. As technologies have improved, many of the failure modes originating from the physical systems have been solved. This means the overall proportion of human errors has increased, such that it is not uncommon to be the primary driver of system failure in modern complex systems. Moreover, technologies such as automated systems may introduce emerging contexts that can cause new, unanticipated modes of human error. Therefore, it is now more important than ever to develop models of human behavior to realize overall system error reductions and achieve established safety margins. To support new and novel concepts of operations for the anticipated wave of advanced nuclear reactor deployments, human factors and human reliability analysis researchers need to develop advanced simulation-based approaches. This talk presents a simulation environment suitable to both collect data and then perform Monte Carlo simulations to evaluate human performance and develop better models of human behavior. Specifically, the Rancor Microworld Simulator models a complex energy production system in a simplified manner. Rancor includes computer-based procedures, which serve as a framework to automatically classify human behaviors without manual, subjective experimenter coding during scenarios. This method supports a detailed level of analysis at the task level. It is feasible for collecting large sample sizes required to develop quantitative modelling elements that have historically challenged traditional full-scope simulator study approaches. Additionally, the other portion of this experimental platform, the Human Unimodel for Nuclear Technology to Enhance Reliability (HUNTER), is presented to show how the collected data can be used to evaluate novel scenarios based on the contextual factors, or performance shaping factors, derived from Rancor simulations. Rancor-HUNTER is being used to predict operator performance with new procedures, such as results from control room modernization or new-build situations. Rancor-HUNTER is also proving a useful surrogate platform to model human performance for other complex systems.

99 GENERAL AND MISCELLANEOUS↗
NASA NTRS1997

Reduction of Maintenance Error Through Focused Interventions

It is well known that a significant proportion of aviation accidents and incidents are tied to human error. In flight operations, research of operational errors has shown that so-called "pilot error" often involves a variety of human factors issues and not a simple lack of individual technical skills. In aircraft maintenance operations, there is similar concern that maintenance errors which may lead to incidents and accidents are related to a large variety of human factors issues. Although maintenance error data and research are limited, industry initiatives involving human factors training in maintenance have become increasingly accepted as one type of maintenance error intervention. Conscientious efforts have been made in re-inventing the "team" concept for maintenance operations and in tailoring programs to fit the needs of technical operations. Nevertheless, there remains a dual challenge: to develop human factors interventions which are directly supported by reliable human error data, and to integrate human factors concepts into the procedures and practices of everyday technical tasks. In this paper, we describe several varieties of human factors interventions and focus on two specific alternatives which target problems related to procedures and practices; namely, 1) structured on-the-job training and 2) procedure re-design. We hope to demonstrate that the key to leveraging the impact of these solutions comes from focused interventions; that is, interventions which are derived from a clear understanding of specific maintenance errors, their operational context and human factors components.

Kanki, Barbara G.↗
NASA NTRS1997

Operational Interventions to Maintenance Error

A significant proportion of aviation accidents and incidents are known to be tied to human error. However, research of flight operational errors has shown that so-called pilot error often involves a variety of human factors issues and not a simple lack of individual technical skills. In aircraft maintenance operations, there is similar concern that maintenance errors which may lead to incidents and accidents are related to a large variety of human factors issues. Although maintenance error data and research are limited, industry initiatives involving human factors training in maintenance have become increasingly accepted as one type of maintenance error intervention. Conscientious efforts have been made in re-inventing the team7 concept for maintenance operations and in tailoring programs to fit the needs of technical opeRAtions. Nevertheless, there remains a dual challenge: 1) to develop human factors interventions which are directly supported by reliable human error data, and 2) to integrate human factors concepts into the procedures and practices of everyday technical tasks. In this paper, we describe several varieties of human factors interventions and focus on two specific alternatives which target problems related to procedures and practices; namely, 1) structured on-the-job training and 2) procedure re-design. We hope to demonstrate that the key to leveraging the impact of these solutions comes from focused interventions; that is, interventions which are derived from a clear understanding of specific maintenance errors, their operational context and human factors components.

Kanki, Barbara G.↗
NASA NTRS2019

SCREAM: Space-based Cognitive Reliability Error Analysis Method

Given both ground-based performance shaping factors (PSFs) collected by the U.S. Nuclear Regulatory Commission (USNRC) and potential space-based PSFs collected by JSC's HH&P, this year's task is to determine how to combine them for future human reliability analysis (HRA) of space missions. All HRA to date for space missions have been based on ground data (i.e. 1-G environment). There is no space-based HRA approach. The target of this project to produce a "first of its kind" HRA approach for space missions. As humans go beyond Earth orbit and missions become longer, human performance and reliability is expected to degrade. The questions become by how much, when, and what, leading to defining the overall effect on crew risk. Knowing this information earlier rather than later will help us mitigate this risk by vehicle design, crew training, and operational workarounds.

Boyer, Roger L.↗
NASA NTRS2017

And the Human Saves the Day or Maybe They Ruin It, The Importance of Humans in the Loop

Flying a mission in space requires a massive commitment of resources, and without the talent and commitment of the people involved in this effort we would never leave the atmosphere of Earth as safely as we have. When we use the phrase "humans in the loop", it could apply to almost any endeavor since everything starts with humans developing a concept, completing the design process, building or implementing a product and using the product to achieve a goal or purpose. Narrowing the focus to spaceflight, there are a variety of individuals involved throughout the preparations for flight and the flight itself. All of the humans involved add value and support for program success. The paper discusses the concepts of human involvement in technological programs, how a Probabilistic Risk Assessment (PRA) accounts for the human in the loop for potential missions using a technique called Human Reliability Analysis (HRA) and the tradeoffs between having a human in the loop or not. Human actions can increase or decrease the overall risk via initiating events or mitigating them, thus removing the human from the loop doesn't always lowers the risk.

DeMott, Diana L.↗
NASA NTRSDate not supplied

Managing Maintenance Error: Six Lessons From Aviation Maintenance

There are clear parallels between the ground processing of spacecraft and the maintenance of airline aircraft. In both cases, reliable human performance is critical to safe outcomes. Examples of human factors in airline maintenance and spacecraft ground processing illustrate the similarities between these two domains. The worldwide aviation industry began to pay close attention to human factors in maintenance after several maintenance-related disasters in the 1970s and 80s. Rather than simply applying solutions that had been developed for flight crew and air traffic controllers, the aviation industry developed human factors interventions specifically tailored for maintenance personnel. These interventions have led to safety improvements, greater reliability, and significant cost savings. Six human factors approaches from airline maintenance that can be usefully applied to enhance the quality and safety of ground processing are outlined. These are 1) Design for assembly, test, and maintenance, 2) Non technical skills training, 3) Improved design of documentation, 4) Reduction of iatrogenic quality lapses, 5) Barrier and control analysis, and 6) Continuous improvement based on learning from quality lapses.

maintenance human factors↗
NASA NTRS2003

Development of an Integrated Human Factors Toolkit

An effective integration of human abilities and limitations is crucial to the success of all NASA missions. The Integrated Human Factors Toolkit facilitates this integration by assisting system designers and analysts to select the human factors tools that are most appropriate for the needs of each project. The HF Toolkit contains information about a broad variety of human factors tools addressing human requirements in the physical, information processing and human reliability domains. Analysis of each tool includes consideration of the most appropriate design stage, the amount of expertise in human factors that is required, the amount of experience with the tool and the target job tasks that are needed, and other factors that are critical for successful use of the tool. The benefits of the Toolkit include improved safety, reliability and effectiveness of NASA systems throughout the agency. This report outlines the initial stages of development for the Integrated Human Factors Toolkit.

Resnick, Marc L.↗
NASA NTRS2012

A Systems Modeling Approach for Risk Management of Command File Errors

The main cause of commanding errors is often (but not always) due to procedures. Either lack of maturity in the processes, incompleteness of requirements or lack of compliance to these procedures. Other causes of commanding errors include lack of understanding of system states, inadequate communication, and making hasty changes in standard procedures in response to an unexpected event. In general, it's important to look at the big picture prior to making corrective actions. In the case of errors traced back to procedures, considering the reliability of the process as a metric during its' design may help to reduce risk. This metric is obtained by using data from Nuclear Industry regarding human reliability. A structured method for the collection of anomaly data will help the operator think systematically about the anomaly and facilitate risk management. Formal models can be used for risk based design and risk management. A generic set of models can be customized for a broad range of missions.

probabilistic risk↗