INL’s Human Reliability Analysis Data Collection Based on the SHEEP Framework
This presentation introduces INL's human reliability analysis data collection studies.
99 GENERAL AND MISCELLANEOUS↗
SEARCH · Search NASA
Results for “Reliability Analysis”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Reliability analysis of the influence of seepage on levee stability
Reliability analysis is used to evaluate the probability of failure of a flood defence embankment subject to a blanket layer foundation condition, where high seepage forces increase the likelihood of internal erosion and slope failure. The stochastic effect of hydraulic conductivity and blanket layer thickness, in addition to soil shear strength properties, is considered for the underseepage and slope stability failure modes using the first-order reliability method. The blanket layer thickness controls the factor of safety (F) and reliability, followed by the unit weight of the blanket layer. Despite variation over orders of magnitude, hydraulic conductivity is less important than and comparable to the effect of soil shear strength parameters. Aleatory uncertainty is evaluated using fragility curves and a confidence interval on the expected value of F (stochastic F). Uncertainty in probability distribution parameters allows quantification of a subset of epistemic uncertainty and is used to construct confidence intervals for fragility.
58 GEOSCIENCES↗
INVESTIGATION OF HUMAN RELIABILITY ANALYSIS METHODS FOR ANALYZING PRE-INITIATORS
As a type of human actions defined in human reliability analysis (HRA), pre-initiator refers to the human actions that may lead to the unavailability of systems, typically committed during maintenance, test, or calibration. This paper investigates representative HRA methods used for analyzing pre-initiators. The HRA methods are Technique for Human Error Rate Prediction (THERP), Korean Standard HRA (K-HRA) and Standard Plant Risk HRA (SPAR-H). In this paper, characteristics of each HRA method are compared for qualitative and quantification aspects. Two pre-initiators, i.e., a calibration task and a valve restoration task, are analyzed using the HRA methods to compare human error probabilities. Then, insights from the analysis and additional research requirements are discussed in this paper.
99 GENERAL AND MISCELLANEOUS↗
INVESTIGATION OF HUMAN RELIABILITY ANALYSIS METHODS FOR ANALYZING PRE-INITIATORS
As a type of human actions defined in human reliability analysis (HRA), pre-initiator refers to the human actions that may lead to the unavailability of systems, typically committed during maintenance, test, or calibration. This paper investigates representative HRA methods used for analyzing pre-initiators. The HRA methods are Technique for Human Error Rate Prediction (THERP), Korean Standard HRA (K-HRA) and Standard Plant Risk HRA (SPAR-H). In this paper, characteristics of each HRA method are compared for qualitative and quantification aspects. Two pre-initiators, i.e., a calibration task and a valve restoration task, are analyzed using the HRA methods to compare human error probabilities. Then, insights from the analysis and additional research requirements are discussed in this paper.
99 GENERAL AND MISCELLANEOUS↗
An Approach to Dependence Assessment in Human Reliability Analysis: Application of Lag and Linger Effects
Dependence assessment refers to an approach used in human reliability analysis (HRA) to adjust a human error probability (HEP) for the following action by considering the impact of the preceding action. It has been known to significantly affect the overall results of probabilistic safety assessment (PSA). If the dependence assessment is not adequate, the result could be unconvincing for explaining the operator failures in the context of PSA. To date, several methods and some recent research have identified suggestions for treating dependence issues in HRA; however, these are still exclusively based on the intrinsic approach of the Technique for Human Error Rate Prediction (THERP), an HRA method. THERP inevitably has a challenge with the subjectivity of expert evaluation as well as the requirement for PSA and HRA expertise with resource-intensive and time-consuming processes. This paper suggests an approach to dependence assessment that could not only minimize the influence of expert judgment, but also saves time to perform the analysis with reasonable manpower. It modifies existing HRA methods with considering lag and linger effects to apply dependence effects for them. Based on a representative HRA method, i.e., Standardized Plant Analysis Risk - HRA (SPAR-H), guidance for how to apply lag and linger effects for the HRA method is suggested. Then, an investigation is carried out to compare quantification results of the revised HRA method with that of the original approach based on experimental data.
99 GENERAL AND MISCELLANEOUS↗
The HUNTER Dynamic Human Reliability Analysis Tool: Development of a Module for Performance Shaping Factors
Human Unimodel for Nuclear Technology to Enhance Reliability (HUNTER) is a framework to support dynamic human reliability analysis (HRA) in communication with a variety of methods and tools. In this paper, how we have developed one of the HUNTER modules, the individual module for evaluating performance shaping factors (PSFs), is introduced. The PSF refers to any factor that influences human performance such as workload or complexity. It has been used for highlighting human errors and adjusting the error probabilities in the existing HRA. We consider the eight PSFs suggested in the Standardized Plant Analysis Risk-HRA (SPAR-H) method, which is the representative HRA method widely used in the nuclear field. To support our dynamic modeling using the eight SPAR-H PSFs, we reviewed human performance literature and developed data-based mathematical models to rate and quantify PSFs in the context of dynamic HRA. We also design the individual module composed of the two functions: 1) the PSF qualification function that automatically or manually evaluates a PSF level, and 2) the PSF quantification function that dynamically or statically determines the PSF multiplier values and integrate them to adjust human error probabilities (HEPs). How each function works with the SPAR-H PSFs and how the PSFs adjust the HEPs are investigated through literature and discussed in this paper.
99 GENERAL AND MISCELLANEOUS↗
A framework to collect human reliability analysis data for nuclear power plants using a simplified simulator and student operators
Data scarcity in human reliability analysis (HRA) has been a major challenge in the quantification process. Many institutes have collected HRA data through experiments using full-scope simulators with actual operators. Nevertheless, there are still some limitations to relying solely on full-scope studies. This paper aims to propose how full-scope data collection studies can be supported through the Simplified Human Error Experimental Program (SHEEP). The SHEEP framework was developed by Idaho National Laboratory (INL) to collect HRA data through a simplified simulator and student operators. This paper introduces the major tasks in the SHEEP framework, with a particular focus on differences that arise due to participant type (i.e., student vs. actual operator), based on experiments using a simplified simulator (i.e., the Rancor Microworld). This paper also describes whether the data collected via this approach could support a representative full-scope data collection study (i.e., the HuREX study) based on the experimental data.
21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
The HUNTER Dynamic Human Reliability Analysis Tool: Development of a Module for Performance Shaping Factors
The Human Unimodel for Nuclear Technology to Enhance Reliability (HUNTER) is a framework to support dynamic human reliability analysis (HRA) in communication with a variety of methods and tools. This paper explores how we developed one of the HUNTER modules: namely, the Individual module for evaluating performance shaping factors (PSFs). A PSF is any factor that influences human performance (e.g., workload or complexity). In the existing HRA, they are used to highlight human errors and adjust error probabilities. We consider the eight PSFs suggested in the Standardized Plant Analysis Risk-HRA (SPAR-H) method, a representative HRA method widely used in the nuclear field. To support our dynamic modeling using the eight SPAR-H PSFs, we reviewed the human performance literature and developed data-based mathematical models to rate and quantify PSFs in the context of dynamic HRA. We also designed the Individual module to consist of two functions: (1) the PSF qualification function for automatically or manually evaluating PSF levels, and (2) the PSF quantification function for dynamically or statically determining PSF multiplier values and integrating them to adjust human error probabilities (HEPs). How each function works in regard to the SPAR-H PSFs, and how the PSFs serve to adjust the HEPs, were investigated via literature review and are discussed in this paper.
99 GENERAL AND MISCELLANEOUS↗
Probabilistic Grid Reliability Analysis with Energy Storage Systems
SAND2025-12025O The Probabilistic Grid Reliability Analysis with Energy Storage Systems (ProGRESS) software tool is an open-source tool for assessing the resource adequacy of the evolving electric power grid integrated with energy storage systems (ESS). This tool uses a simulation engine to create diverse scenarios that test the limits of the modern power grid consisting of a high-volume ESS and variable energy resources (VER). Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.
Nguyen, Tu↗
Identification of Performance Shaping Factor Lag and Linger Effects for Dynamic Human Reliability Analysis: Application of Experimental Data
Many researchers have emphasized the importance of dynamic probabilistic safety assessment (PSA), which highlights the necessity of studies for dynamic human reliability analysis (HRA). Dynamic HRA concentrates on a dynamic account of human actions or how performance shaping factors (PSFs) can dynamically modify the human error probability (HEP) over time. In contrast, existing static HRA does not consider human actions as changes over time or event progressions. Accordingly, previous research on dynamic HRA conceptually suggested PSF lag and linger effects to treat dependence between operator actions in dynamic HRA versus existing approaches. As follow-up research, this study attempted to identify PSF lag and linger effects for dynamic HRA on the basis of experimental data. Firstly, mathematical models for PSF lag and linger effects were developed based on a literature survey in the field of biology. Secondly, we analyzed experimental scenarios from a control room study to identify operator actions considered in PSA. Lastly, based on the experimental data, the effect of the stress PSF with lag and linger effects was compared to that without PSF lag and linger effects. This paper concludes with an overall discussion of PSF lag and linger effects based on the relation between the stress PSF and error occurrence.
99 GENERAL AND MISCELLANEOUS↗
The HUNTER Dynamic Human Reliability Analysis Tool: Coupling an External Plant Code
The Human Unimodel for Nuclear Technology to Enhance Reliability (HUNTER) is a framework to support dynamic human reliability analysis (HRA) with the aim to develop standalone software to perform the dynamic HRA calculations. Within the HRA, human actions in nuclear power plants (NPPs) are predicated by plant states, and human actions influence the plant. In other words, plant operations are necessarily recursive, and it becomes challenging to model complex human-plant interactions. Consequently, we have linked two software simulations that complement those shortcomings. RELAP5-3D—the Reactor Excursion and Leak Analysis Program (RELAP; Aumiller, Tomlinson, and Bauer 2001) is the foundational thermal-hydraulic software used to model nuclear systems. Using RELAP5-3D, we have simulated the plant operations proceeding according to procedures developed to address emergent situations in NPPs. Plant operations include various actions such as the operator checking plant parameters, as well as actions that are continuously performed over time until a specific parameter reaches certain criteria. That means that HUNTER and RELAP5-3D exchange information with each other and should be carried out simultaneously over time. To simulate plant operations, which represent the actual operator checks of plant parameters and corresponding manual control actions, changes in plant status are identified through simulation and performed according to the criteria and order of the procedure. Thus, the goal of coupling HUNTER with RELAP5-3D is to facilitate synchronous coupling, where human and plant models provide iterative feedback loops that drive the course of actions. The advantage of coupling with RELAP5-3D to serve as the external environment module in HUNTER is the ability to customize the plant model and streamline for particular model applications. In this paper, we will address the key features of the coupling and the coupling structure built to perform the feedback loops.
99 GENERAL AND MISCELLANEOUS↗
Reliability Analysis for Unreliable FSM Computations
Finite State Machines (FSMs) are fundamental in both hardware design and software development. However, the reliability of FSM computations remains poorly understood. This becomes increasingly critical as the technology scaling becomes more aggressive. Existing reliability analyses are mainly designed for generic computations and are unaware of the special error tolerance characteristics in FSM computations. In this work, we introduce RelyFSM – a state-level reliability analysis framework for FSM computations. By qualitatively reasoning about the transition structures in FSM computations, RelyFSM can precisely capture their inherent error tolerance. Basically, RelyFSM takes an FSM specification as input and analyzes its reliability for a specific execution. At the core of the analysis is a set of mathematical models that accurately define the behaviors of unreliable FSM executions. Our evaluation with a spectrum of FSM benchmarks confirms the accuracy and efficiency of RelyFSM in analyzing the reliability of real-world FSM computations.
97 MATHEMATICS AND COMPUTING↗
Time-Dependent Reliability Analysis of Nuclear Hybrid Energy Systems
This paper focuses on developing a framework for comprehensive time-dependent reliability analysis of a nuclear hybrid energy system (NHES) design. Subsystem interactions of this complex integrated system under stochastic electricity demand and load-following operation capabilities requires dynamic reliability assessment of the NHES in component, subsystem and system level. In order to capture the dynamic operational behavior of critical systems and components, a detailed thermal hydraulic model of the NHES is generated using Modelica and tested under different electricity demand histories generated using RAVEN. The physical data (e.g., valve position, flow rates, inlet outlet water temperatures) gathered from Modelica used to calculate time-dependent failure rates through fitting data into the piecewise Weibull distribution. Optimum maintenance interval is calculated, and maintenance cost estimates based on the calculated reliability metric is presented for the selected component. Component time-dependent failure rates fed into the subsystem reliability model built with non-Markovian Stochastic Petri Nets. The component and subsystem failure rates are calculated and updated in every hour to characterize the system behavior appropriately and to understand operational reliability of the NHES design in a given time.
Guler Yigitoglu, Askin↗
Reliability Analysis of Field-aged Glass/Glass PV Modules: Influence of Different Encapsulant Types
This paper presents a preliminary reliability analysis of field-aged glass/glass (G/G) PV modules. Several characterization tests were performed on more than 60 modules with two different encapsulant types (EVA and ionomer) exposed in hot-dry Arizona (AZ) climate over 10-35 years. The common degradation mode observed in both encapsulant types was the delamination of encapsulant along with encapsulant browning (EVA only), glass cracking (EVA only), and metallic corrosion over junction box area (ionomer only). The EVA encapsulated G/G modules showed the higher median power degradation rate at 0.91-1.99%/yr whereas modules with ionomer showed the lower at 0.21%/yr.
photovoltaic, failures, field exposed, glass/glass↗
Qualitative and Quantitative Evaluation for Representative Human Reliability Analysis Methods
The Korea Institute of Nuclear Safety (KINS) is the regulatory expert organization established by the Korean government to strengthen the nation’s technical capabilities relating to nuclear safety regulation. KINS oversees the technical aspects of nuclear safety regulation, including safety reviews, inspections, education, and safety research—all conducted based on technical knowledge and accumulated regulatory experience. In 2023, KINS requested that Idaho National Laboratory (INL) validates representative human reliability analysis (HRA) methods used throughout the world, thus affording KINS with a basis for determining an HRA method adequate for its domestic regulatory purposes. The present paper mainly examines INL’s efforts in this regard. The resulting INL study covered four representative HRA methods widely used by nuclear utilities and regulatory institutes. These methods were qualitatively evaluated by applying specific evaluation criteria and determining how well each method reflected critical HRA issues. For this assessment, INL benchmarked the Halden International HRA Empirical Study. Using the Halden empirical data, along with information on human failure events (HFEs), the present study employed the selected HRA methods to estimate human error probabilities (HEPs) for the HFEs. It also performed statistical analyses to compare the HEPs predicted via the HRA methods against those from the Halden empirical data.
99 - GENERAL AND MISCELLANEOUS↗
Covariance-Free Bifidelity Control Variates Importance Sampling for Rare Event Reliability Analysis
Multifidelity modeling has been steadily gaining attention as a tool to address the problem of exorbitant model evaluation costs that makes the estimation of failure probabilities a significant computational challenge for complex real-world problems, particularly when failure is a rare event. To implement multifidelity modeling, estimators that efficiently combine information from multiple models/sources are necessary. In past works, the variance reduction techniques of control variates (CV) and importance sampling (IS) have been leveraged for this task. In this paper, we present the CVIS framework—a creative take on a coupled CV and IS estimator for bifidelity reliability analysis. The framework addresses some of the practical challenges of the CV method by using an estimator for the control variate mean and sidestepping the need to estimate the covariance between the original estimator and the control variate through a clever choice for the tuning constant. Furthermore, the task of selecting an efficient IS distribution is also considered, with a view towards maximally leveraging the bifidelity structure and maintaining expressivity. Additionally, a diagnostic is provided that indicates both the efficiency of the algorithm as well as the relative predictive quality of the models utilized. Finally, the behavior and performance of the framework is explored through analytical and numerical examples.
Markov chain Monte Carlo↗
CAMERA: A method for cost-aware, adaptive, multifidelity, efficient reliability analysis
Estimating probability of failure in aerospace systems is a critical requirement for flight certification and qualification. Failure probability estimation involves resolving tails of probability distributions, and Monte Carlo sampling methods are intractable when expensive high-fidelity simulations have to be queried. Here, we propose a method to use models of multiple fidelities that trade accuracy for computational efficiency. Specifically, we propose the use of multifidelity Gaussian process models to efficiently fuse models at multiple fidelity, thereby offering a cheap surrogate model that emulates the original model at all fidelities. Furthermore, we propose a novel sequential acquisition function based experiment design framework that can automatically select samples from appropriate fidelity models to make predictions about quantities of interest at the highest fidelity. We use our proposed approach in an importance sampling setting and demonstrate our method on the failure level set and probability estimation on synthetic test functions and two real-world applications, namely, the reliability analysis of a gas turbine engine blade using a finite element method and a transonic aerodynamic wing test case using Reynolds-averaged Navier-Stokes equations. We show that our method predicts the failure boundary and probability more accurately and at a fraction of the computational cost compared with using just a single expensive high-fidelity model. Finally, we show that our sequential approach is guaranteed to asymptotically converge to the true failure boundary with high probability.
97 MATHEMATICS AND COMPUTING↗
Human reliability analysis studies from simulator experiments using Bayesian inference
Probabilistic Safety Assessment (PSA) of complex facilities is performed to arrive at the risk posed by them. PSA also accounts for the contribution of the human errors towards the overall risk through Human Reliability Analysis (HRA) in terms of Human Error Probability (HEP). Human operators are part of the system and do not work in isolation. Their performance is influenced by the context in which the actions are performed. As a result, quantification of HEP requires operator performance data under the given context. Some good sources of operator performance data are plant‘s operation data, simulator data and expert judgement. The plant operation data pertaining to HRA is generally sparse. In this situation, a full scope plant simulator provides a good alternative for operator performance data generation. Many of the currently practiced HRA methods have been developed by combining the empirical evidence with expert judgement and contain a lot of uncertainty in their estimates. Bayesian inference is suitable for updating the prior HRA estimates with the simulator evidence to obtain the posterior HEP. Here, posterior HEP has been calculated for postulated accident scenarios in advanced reactor (first of its kind) at design stage, using plant simulator.
97 MATHEMATICS AND COMPUTING↗