Search NASA⌕ Search

SEARCH · Search NASA

Results for “Error Rate Predictions”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Effects of Stopping Ions and LET Fluctuations on Soft Error Rate Prediction.

Variability in energy deposition from stopping ions and LET fluctuations is quantified for specific radiation environments. When compared to predictions using average LET via CREME96, LET fluctuations lead to an order-of-magnitude difference in effective flux and a nearly 4x decrease in predicted soft error rate (SER) in an example calculation performed on a commercial 65 nm SRAM. The large LET fluctuations reported here will be even greater for the smaller sensitive volumes that are characteristic of highly scaled technologies. End-of-range effects of stopping ions do not lead to significant inaccuracies in radiation environments with low solar activity unless the sensitivevolume thickness is 100 μm or greater. In contrast, end-of-range effects for stopping ions lead to significant inaccuracies for sensitive- volume thicknesses less than 10 μm in radiation environments with high solar activity.

42 ENGINEERING↗

The contribution of low-energy protons to the total on-orbit SEU rate

Low- and high-energy proton experimental data and error rate predictions are presented for many bulk Si and SOI circuits from the 20-90 nm technology nodes to quantify how much low-energy protons (LEPs) can contribute to the total on-orbit single-event upset (SEU) rate. Every effort was made to predict LEP error rates that are conservatively high; even secondary protons generated in the spacecraft shielding have been included in the analysis. Across all the environments and circuits investigated, and when operating within 10% of the nominal operating voltage, LEPs were found to increase the total SEU rate to up to 4.3 times as high as it would have been in the absence of LEPs. Therefore, the best approach to account for LEP effects may be to calculate the total error rate from high-energy protons and heavy ions, and then multiply it by a safety margin of 5. If that error rate can be tolerated then our findings suggest that it is justified to waive LEP tests in certain situations. Trends were observed in the LEP angular responses of the circuits tested. As a result, grazing angles were the worst case for the SOI circuits, whereas the worst-case angle was at or near normal incidence for the bulk circuits.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Performance and power modeling and prediction using MuMMI and 10 machine learning methods

Energy-efficient scientific applications require insight into how high performance computing system features impact the applications' power and performance. This insight can result from the development of performance and power models. Here, in this article, we use the modeling and prediction tool MuMMI (Multiple Metrics Modeling Infrastructure) and 10 machine learning methods to model and predict performance and power consumption and compare their prediction error rates. We use an algorithm-based fault-tolerant linear algebra code and a multilevel checkpointing fault-tolerant heat distribution code to conduct our modeling and prediction study on the Cray XC40 Theta and IBM BG/Q Mira at Argonne National Laboratory and the Intel Haswell cluster Shepard at Sandia National Laboratories. Our experimental results show that the prediction error rates in performance and power using MuMMI are less than 10% for most cases. By utilizing the models for runtime, node power, CPU power, and memory power, we identify the most significant performance counters for potential application optimizations, and we predict theoretical outcomes of the optimizations. Based on two collected datasets, we analyze and compare the prediction accuracy in performance and power consumption using MuMMI and 10 machine learning methods.

97 MATHEMATICS AND COMPUTING↗

Formative vs. Summative Dependence in Human Reliability Analysis

Dependence in human reliability analysis (HRA) is the concept that once an initial human error has occurred, subsequent human errors are more likely. The approach almost universally adopted in HRA was first introduced in the Technique for Human Error Rate Prediction (THERP). In THERP, calculated human error probabilities (HEPs) are adjusted for dependence in the final step of quantification. This final adjustment for dependence involves anchoring the HEP to a set of values corresponding to low through complete dependence. The effect is to increase the HEP. In this paper, we propose formative dependence, which occurs at the onset of quantification. We demonstrate that dependence should be considered earlier in the calculation process, because it is not actually necessary to calculate the HEP when it is subsequently overridden by the dependence anchors. By applying dependence first in the calculation, processing steps can be eliminated, making for more efficient analysis.

99 GENERAL AND MISCELLANEOUS↗

Fifty Years of THERP and Human Reliability Analysis

In 1962 at a Human Factors Society symposium, Alan Swain presented a paper introducing a Technique for Human Error Rate Prediction (THERP). This was followed in 1963 by a Sandia Laboratories monograph outlining basic human error quantification using THERP and, in 1964, by a special journal edition of Human Factors on quantification of human performance. Throughout the 1960s, Swain and his colleagues focused on collecting human performance data for the Sandia Human Error Rate Bank (SHERB), primarily in connection with supporting the reliability of nuclear weapons assembly in the US. In 1969, Swain met with Jens Rasmussen of Risø National Laboratory and discussed the applicability of THERP to nuclear power applications. By 1975, in WASH-1400, Swain had articulated the use of THERP for nuclear power applications, and the approach was finalized in the watershed publication of the NUREG/CR-1278 in 1983. THERP is now 50 years old, and remains the most well known and most widely used HRA method. In this paper, the author discusses the history of THERP, based on published reports and personal communication and interviews with Swain. The author also outlines the significance of THERP. The foundations of human reliability analysis are found in THERP: human failure events, task analysis, performance shaping factors, human error probabilities, dependence, event trees, recovery, and pre- and post-initiating events were all introduced in THERP. While THERP is not without its detractors, and it is showing signs of its age in the face of newer technological applications, the longevity of THERP is a testament of its tremendous significance. THERP started the field of human reliability analysis. This paper concludes with a discussion of THERP in the context of newer methods, which can be seen as extensions of or departures from Swain’s pioneering work.

99 GENERAL AND MISCELLANEOUS↗

Addressing Angular Single-Event Effects in the Estimation of On-Orbit Error Rates

Our study describes complications introduced by angular direct ionization events on space error rate predictions. In particular, prevalence of multiple-cell upsets and a breakdown in the application of effective linear energy transfer in modern-scale devices can skew error rates approximated from currently available estimation models. Moreover, this paper highlights the importance of angular testing and proposes a methodology to extend existing error estimation tools to properly consider angular strikes in modern-scale devices. Finally, these techniques are illustrated with test data provided from a modern 28 nm SRAM-based device.

42 ENGINEERING↗

INVESTIGATION OF HUMAN RELIABILITY ANALYSIS METHODS FOR ANALYZING PRE-INITIATORS

As a type of human actions defined in human reliability analysis (HRA), pre-initiator refers to the human actions that may lead to the unavailability of systems, typically committed during maintenance, test, or calibration. This paper investigates representative HRA methods used for analyzing pre-initiators. The HRA methods are Technique for Human Error Rate Prediction (THERP), Korean Standard HRA (K-HRA) and Standard Plant Risk HRA (SPAR-H). In this paper, characteristics of each HRA method are compared for qualitative and quantification aspects. Two pre-initiators, i.e., a calibration task and a valve restoration task, are analyzed using the HRA methods to compare human error probabilities. Then, insights from the analysis and additional research requirements are discussed in this paper.

99 GENERAL AND MISCELLANEOUS↗

INVESTIGATION OF HUMAN RELIABILITY ANALYSIS METHODS FOR ANALYZING PRE-INITIATORS

As a type of human actions defined in human reliability analysis (HRA), pre-initiator refers to the human actions that may lead to the unavailability of systems, typically committed during maintenance, test, or calibration. This paper investigates representative HRA methods used for analyzing pre-initiators. The HRA methods are Technique for Human Error Rate Prediction (THERP), Korean Standard HRA (K-HRA) and Standard Plant Risk HRA (SPAR-H). In this paper, characteristics of each HRA method are compared for qualitative and quantification aspects. Two pre-initiators, i.e., a calibration task and a valve restoration task, are analyzed using the HRA methods to compare human error probabilities. Then, insights from the analysis and additional research requirements are discussed in this paper.

99 GENERAL AND MISCELLANEOUS↗

HUMAN FAILURE EVENT DEPENDENCE: WHAT ARE THE LIMITS

Abstract Objectives: This paper discusses the differences between classical human reliability analysis (HRA) dependence and the full spectrum of probabilistic dependence. Positive influence suggests an error increases the likelihood of subsequent errors or success increases the likelihood of subsequent success. Currently the typical method for dependence in HRA implements the Technique for Human Error Rate Prediction (THERP) positive dependence equations. This assumes that the dependence between two human failure events varies at discrete levels between zero and complete dependence (as defined by THERP). Dependence in THERP does not consistently span dependence values between 0 and 1. In contrast, probabilistic dependence employs Bayes Law, and addresses a continuous range of dependence. Methods: Using the laws of probability, complete dependence and maximum positive dependence do not always agree. Maximum dependence is when two events overlap to their fullest amount. Maximum negative dependence is the smallest amount that two events can overlap. When the minimum probability of two events overlapping is less than independence, negative dependence occurs. For example, negative dependence is when an operator fails to actuate Pump A, thereby increasing his or her chance of actuating Pump B. The initial error actually increases the chance of subsequent success. Results: Comparing THERP and probability theory yields different results in certain scenarios; with the latter addressing negative dependence. Given that most human failure events are rare, the minimum overlap is typically 0. And when the second event is smaller than the first event the max dependence is less than 1, as defined by Bayes Law. As such alternative dependence equations are provided along with a look-up table defining the maximum and maximum negative dependence given the probability of two events. Conclusions: THERP dependence has been used ubiquitously for decades, and has provided approximations of the dependencies between two events. Since its inception, computational abilities have increased exponentially, and alternative approaches that follow the laws of probability dependence need to be implemented. These new approaches need to consider negative dependence and identify when THERP output is not appropriate.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

An Approach to Dependence Assessment in Human Reliability Analysis: Application of Lag and Linger Effects

Dependence assessment refers to an approach used in human reliability analysis (HRA) to adjust a human error probability (HEP) for the following action by considering the impact of the preceding action. It has been known to significantly affect the overall results of probabilistic safety assessment (PSA). If the dependence assessment is not adequate, the result could be unconvincing for explaining the operator failures in the context of PSA. To date, several methods and some recent research have identified suggestions for treating dependence issues in HRA; however, these are still exclusively based on the intrinsic approach of the Technique for Human Error Rate Prediction (THERP), an HRA method. THERP inevitably has a challenge with the subjectivity of expert evaluation as well as the requirement for PSA and HRA expertise with resource-intensive and time-consuming processes. This paper suggests an approach to dependence assessment that could not only minimize the influence of expert judgment, but also saves time to perform the analysis with reasonable manpower. It modifies existing HRA methods with considering lag and linger effects to apply dependence effects for them. Based on a representative HRA method, i.e., Standardized Plant Analysis Risk - HRA (SPAR-H), guidance for how to apply lag and linger effects for the HRA method is suggested. Then, an investigation is carried out to compare quantification results of the revised HRA method with that of the original approach based on experimental data.

99 GENERAL AND MISCELLANEOUS↗

Determination of a Generic Human Error Probability Distribution, Part 2: A Dynamic SPAR-H Example Application

Humans are an integral part of a nuclear power plant (NPP) from its construction, to its everyday maintenance and operation. In the nuclear industry there are many approaches to quantifying component reliability, which is called probability risk assessment (PRA). In PRA there are two considerations given to the quantification, static and dynamic. Static is quantified before or after an operation; and dynamic is time dependent, in that the probability changes as real time data are provided. In PRA, the importance of the components is calculated, but what of the importance of the human component? There are several methods for human reliability analysis (HRA), which include but are not limited to: THERP, ATHEANA, CREAM, SPAR-H, ASEP, and SLIM. Each of these methods aims to provide a more accurate and objective human error probability (HEP) quantification. Of the methods listed above, ASEP, THERP, and SPAR-H are all inextricably linked. The Standardized Plant Analysis Risk-Human Reliability Analysis (SPAR-H) method was generated to better generalize the Technique for Human Error Rate Prediction (THERP) and Accident Sequence Precursor (ASEP). THERP is mapped to specific scenario templates, and ASEP is a simplified screening method, while SPAR-H employs generalizations to describe the spectrum of human behavior while maintaining the same theoretical underpinnings. SPAR-H is a well-known and accepted HRA method that uses performance shaping factors (PSFs) to classify inputs to the human component. PSFs capture a wide variety of input data, including plant status, crew dynamics, task description, and psychological aspects of the human operator. Current efforts have been focused to further generalize SPAR-H in to a dynamic framework. These methods can fit into dynamic NPP simulations such as RAVEN / RELAP-7. In order to do this, a dynamic methodology is applied to model the human as would be applied to the components. This method is applied in part one in the accompanying paper.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Simulation-Based Recovery Action Analysis Using the EMRALD Dynamic Risk Assessment Tool

Recovery human action is defined as the action that prevents deviant conditions from producing unwanted effects. Analyzing recovery actions has been a critical part in human reliability analysis (HRA). However, there are a couple of limitations to treating recovery actions using only the current HRA methods available. Representatively, the existing recovery analysis does not specifically consider recovery actions as they have occurred in actual nuclear power plants (NPPs). To handle the challenges in the existing recovery analyses, this study suggests a way to analyze recovery actions under a dynamic HRA method, the Procedure-based Risk Investigation MEthod-Human Reliability Analysis (PRIME-HRA) method. The PRIME-HRA method suggests a way on how to develop dynamic simulation models using dynamic risk assessment tools such as the Event Modeling Risk Assessment Using Linked Diagram (EMRALD) [1] and the Human Unimodel for Nuclear Technology to Enhance Reliability (HUNTER) [2]. EMRALD and HUNTER are the dynamic probabilistic risk assessment and HRA tools developed at Idaho National Laboratory. In this paper, differences on analyzing recovery actions in the Technique for Human Error-Rate Prediction (THERP), the Cause-Based Decision Tree (CBDT) and the Korean Standard HRA (K-HRA) and challenges of these approaches are introduced. How we have developed the PRIME-HRA is also introduced in this paper. Then, the proposed approach to analyzing recovery human actions in dynamic context is partially discussed with an example.

99 GENERAL AND MISCELLANEOUS↗

Simulation-Based Recovery Action Analysis Using the EMRALD Dynamic Risk Assessment Tool

A recovery action is defined as the action that prevents deviant conditions from producing unwanted effects. It generally indicates a kind of countermeasure performed in response to a failure of human action. The recovery actions especially play an important role in complex systems like nuclear power plants (NPPs), which consist of highly sophisticated controllers to ensure that desired performance and safety must be achieved and maintained. This is because a combination of human error and its recovery failure may be able to cause a catastrophic effect on a system. Analyzing recovery actions has been a critical part of HRA, which is a technique to evaluate human errors and provide human error probabilities (HEPs) for application in probabilistic safety assessment (PSA). If recovery actions are not adequately analyzed and applied to PSA models, the PSA results may be under-estimated or be not able to reasonably account for the failure of human actions in the context of PSA. For this reason, some regulatory documents such as ASME/ANS RA-Sb-2013 by the American Society for Mechanical Engineers and the American Nuclear Society and NUREG-1792 by U.S. Nuclear Regulatory Commission have emphasized the importance of recovery analysis within the HRA. A couple of existing HRA methods, such as the Technique for Human Error-Rate Prediction (THERP), the Cause-Based Decision Tree (CBDT), and the Korean Standard HRA (K-HRA), have respectively suggested their own approaches to the HRA recovery analysis. However, there are a couple of limitations to treating recovery actions using only the current HRA methods available. The biggest limitation is that the existing recovery analysis does not explicitly consider a variety of recovery action types and recovery sequences as they occur in actual NPPs. To handle the limitations of existing recovery analysis, this study proposes a simulation-based recovery analysis method using the Event Modeling Risk Assessment Using Linked Diagram (EMRALD) software. The EMRALD software is a dynamic simulation tool for PSA. It supports realistic and dynamic modeling of human actions as they would be performed at NPPs. It is also favorable to simultaneously model the specific moment at which an action is performed, the time it takes to perform the action, and the failure probability of that action. In this paper, a detailed methodology for modeling recovery actions in the simulation platform is proposed with a couple of examples. Then, outputs from the simulation are discussed as reviewing if this novel approach can complement the challenges of existing recovery analyses.

99 GENERAL AND MISCELLANEOUS↗

ScaleML: Machine Learning based Heap Memory Object Scaling Prediction

Memory subsystem contributes 28-40% of total energy consumption. Several studies investigated energy prediction and consumption via profiling memory object access patterns. However, such profiling leads to higher energy consumption due to intense memory object-level profiling to achieve high prediction accuracy. Further, memory object access pattern prediction has been considered through analyzing the variation between memory object access patterns, referred to as scaling rate. The existing techniques for scaling rate prediction, such as Linear Scaling Rate (LSR), suffer from a high error rate in prediction with changes in access patterns, which leads to a high error rate of energy consumption prediction. In this paper, we compare and evaluate several memory object access pattern prediction models including LSR and machine learning (ML) models. Further, we propose SCALEML, a heap memory object scaling rate prediction mechanism that employs an ML model to achieve high access pattern prediction accuracy with variations in memory object access patterns. We evaluate SCALEML using various application benchmarks. The experimental results show that SCALEML achieves about 20% higher accuracy than the LSR model for predicting the scaling rate of object access patterns and energy estimation.

Park, Joongeon↗

$\mathrm{PPT}$-Multicore: performance prediction of Open$\mathrm{MP}$ applications using reuse profiles and analytical modeling

In this report we present PPT-Multicore, an analytical model embedded in the Performance Prediction Toolkit (PPT) to predict parallel applications’ performance running on a multicore processor. PPT-Multicore builds upon our previous work towards a multicore cache model. We extract LLVM basic block labeled memory trace using an architecture-independent LLVM-based instrumentation tool only once in an application’s lifetime. The model uses the memory trace and other parameters from an instrumented sequentially executed binary. We use probabilistic and computationally efficient reuse profiles to predict the cache hit rates and runtimes of OpenMP programs’ parallel sections. We model Intel’s Broadwell, Haswell, and AMD’s Zen2 architectures and validate our framework using different applications from PolyBench and PARSEC benchmark suites. The results show that PPT-Multicore can predict cache hit rates with an overall average error rate of 1.23% while predicting the runtime with an error rate of 9.08%.

97 MATHEMATICS AND COMPUTING↗

Per-beam, planar IMRT QA passing rates do not predict clinically relevant patient dose errors

Purpose: The purpose of this work is to determine the statistical correlation between per-beam, planar IMRT QA passing rates and several clinically relevant, anatomy-based dose errors for per-patient IMRT QA. The intent is to assess the predictive power of a common conventional IMRT QA performance metric, the Gamma passing rate per beam. Methods: Ninety-six unique data sets were created by inducing four types of dose errors in 24 clinical head and neck IMRT plans, each planned with 6 MV Varian 120-leaf MLC linear accelerators using a commercial treatment planning system and step-and-shoot delivery. The error-free beams/plans were used as ''simulated measurements'' (for generating the IMRT QA dose planes and the anatomy dose metrics) to compare to the corresponding data calculated by the error-induced plans. The degree of the induced errors was tuned to mimic IMRT QA passing rates that are commonly achieved using conventional methods. Results: Analysis of clinical metrics (parotid mean doses, spinal cord max and D1cc, CTV D95, and larynx mean) vs IMRT QA Gamma analysis (3%/3 mm, 2/2, 1/1) showed that in all cases, there were only weak to moderate correlations (range of Pearson's r-values: -0.295 to 0.653). Moreover, the moderate correlations actually had positive Pearson's r-values (i.e., clinically relevant metric differences increased with increasing IMRT QA passing rate), indicating that some of the largest anatomy-based dose differences occurred in the cases of high IMRT QA passing rates, which may be called ''false negatives.'' The results also show numerous instances of false positives or cases where low IMRT QA passing rates do not imply large errors in anatomy dose metrics. In none of the cases was there correlation consistent with high predictive power of planar IMRT passing rates, i.e., in none of the cases did high IMRT QA Gamma passing rates predict low errors in anatomy dose metrics or vice versa. Conclusions: There is a lack of correlation between conventional IMRT QA performance metrics (Gamma passing rates) and dose errors in anatomic regions-of-interest. The most common acceptance criteria and published actions levels therefore have insufficient, or at least unproven, predictive power for per-patient IMRT QA.

60 APPLIED LIFE SCIENCES↗

Hardness assurance for proton direct ionization-induced SEEs using a high-energy proton beam

The low-energy proton energy spectra of all shielded space environments have the same shape. This shape is easily reproduced in the laboratory by degrading a high-energy proton beam, producing a high-fidelity test environment. We use this test environment to dramatically simplify rate prediction for proton direct ionization effects, allowing the work to be done at high-energy proton facilities, on encapsulated parts, without knowledge of the IC design, and with little or no computer simulations required. Proton direct ionization (PDI) is predicted to significantly contribute to the total error rate under the conditions investigated. Scaling effects are discussed using data from 65-nm, 45-nm, and 32-nm SOI SRAMs. These data also show that grazing-angle protons will dominate the PDI-induced error rate due to their higher effective LET, so PDI hardness assurance methods must account for angular effects to be conservative. As a result, we show that this angular dependence can be exploited to quickly assess whether an IC is susceptible to PDI.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗