Search NASA⌕ Search

SEARCH · Search NASA

Results for “Error Rate Predictions”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Data Analysis & Statistical Methods for Command File Errors

This paper explains current work on modeling for managing the risk of command file errors. It is focused on analyzing actual data from a JPL spaceflight mission to build models for evaluating and predicting error rates as a function of several key variables. We constructed a rich dataset by considering the number of errors, the number of files radiated, including the number commands and blocks in each file, as well as subjective estimates of workload and operational novelty. We have assessed these data using different curve fitting and distribution fitting techniques, such as multiple regression analysis, and maximum likelihood estimation to see how much of the variability in the error rates can be explained with these. We have also used goodness of fit testing strategies and principal component analysis to further assess our data. Finally, we constructed a model of expected error rates based on the what these statistics bore out as critical drivers to the error rate. This model allows project management to evaluate the error rate against a theoretically expected rate as well as anticipate future error rates.

Correlation Analysis↗

Simulation-Based Recovery Action Analysis Using the EMRALD Dynamic Risk Assessment Tool

Recovery human action is defined as the action that prevents deviant conditions from producing unwanted effects. Analyzing recovery actions has been a critical part in human reliability analysis (HRA). However, there are a couple of limitations to treating recovery actions using only the current HRA methods available. Representatively, the existing recovery analysis does not specifically consider recovery actions as they have occurred in actual nuclear power plants (NPPs). To handle the challenges in the existing recovery analyses, this study suggests a way to analyze recovery actions under a dynamic HRA method, the Procedure-based Risk Investigation MEthod-Human Reliability Analysis (PRIME-HRA) method. The PRIME-HRA method suggests a way on how to develop dynamic simulation models using dynamic risk assessment tools such as the Event Modeling Risk Assessment Using Linked Diagram (EMRALD) [1] and the Human Unimodel for Nuclear Technology to Enhance Reliability (HUNTER) [2]. EMRALD and HUNTER are the dynamic probabilistic risk assessment and HRA tools developed at Idaho National Laboratory. In this paper, differences on analyzing recovery actions in the Technique for Human Error-Rate Prediction (THERP), the Cause-Based Decision Tree (CBDT) and the Korean Standard HRA (K-HRA) and challenges of these approaches are introduced. How we have developed the PRIME-HRA is also introduced in this paper. Then, the proposed approach to analyzing recovery human actions in dynamic context is partially discussed with an example.

99 GENERAL AND MISCELLANEOUS↗

Simulation-Based Recovery Action Analysis Using the EMRALD Dynamic Risk Assessment Tool

A recovery action is defined as the action that prevents deviant conditions from producing unwanted effects. It generally indicates a kind of countermeasure performed in response to a failure of human action. The recovery actions especially play an important role in complex systems like nuclear power plants (NPPs), which consist of highly sophisticated controllers to ensure that desired performance and safety must be achieved and maintained. This is because a combination of human error and its recovery failure may be able to cause a catastrophic effect on a system. Analyzing recovery actions has been a critical part of HRA, which is a technique to evaluate human errors and provide human error probabilities (HEPs) for application in probabilistic safety assessment (PSA). If recovery actions are not adequately analyzed and applied to PSA models, the PSA results may be under-estimated or be not able to reasonably account for the failure of human actions in the context of PSA. For this reason, some regulatory documents such as ASME/ANS RA-Sb-2013 by the American Society for Mechanical Engineers and the American Nuclear Society and NUREG-1792 by U.S. Nuclear Regulatory Commission have emphasized the importance of recovery analysis within the HRA. A couple of existing HRA methods, such as the Technique for Human Error-Rate Prediction (THERP), the Cause-Based Decision Tree (CBDT), and the Korean Standard HRA (K-HRA), have respectively suggested their own approaches to the HRA recovery analysis. However, there are a couple of limitations to treating recovery actions using only the current HRA methods available. The biggest limitation is that the existing recovery analysis does not explicitly consider a variety of recovery action types and recovery sequences as they occur in actual NPPs. To handle the limitations of existing recovery analysis, this study proposes a simulation-based recovery analysis method using the Event Modeling Risk Assessment Using Linked Diagram (EMRALD) software. The EMRALD software is a dynamic simulation tool for PSA. It supports realistic and dynamic modeling of human actions as they would be performed at NPPs. It is also favorable to simultaneously model the specific moment at which an action is performed, the time it takes to perform the action, and the failure probability of that action. In this paper, a detailed methodology for modeling recovery actions in the simulation platform is proposed with a couple of examples. Then, outputs from the simulation are discussed as reviewing if this novel approach can complement the challenges of existing recovery analyses.

99 GENERAL AND MISCELLANEOUS↗

Analysis and forecast intercomparisons using the FGGE SOP-1 data base

The First GARP Global Experiment (FGGE) data base has provided the research community with the most complete global coverage of meteorological informaiton since measurements were first taken. It is important to understand the characteristics of the FGGE data base in terms of its accuracy and representativeness compared to the true state of the atmosphere. The uncertainty associated with the initial conditions used in a numerical model plays a significant role in subsequent error growth as shown by predictability theory. The ultimate limit of forecast skill is directly related to the initial uncertainty. The accuracy of analyses using FGGE data base coupled with the errors due to modeling imperfections determines the present skill of numerical models. An estimte of initial uncertainty is determined by examining differences in several FGGE analyses. The estimate is then used to determine an ultimate limit of forecast skill from derived predictability error growth rates. Several different calculations of predictability error growth are also compared. Finally, present-day forecast skill using FGGE analyses is contrasted to the estimates of ultimate skill, and the partition of model error versus initial uncertainty is discussed.

Baumhefner, D. P.↗

ScaleML: Machine Learning based Heap Memory Object Scaling Prediction

Memory subsystem contributes 28-40% of total energy consumption. Several studies investigated energy prediction and consumption via profiling memory object access patterns. However, such profiling leads to higher energy consumption due to intense memory object-level profiling to achieve high prediction accuracy. Further, memory object access pattern prediction has been considered through analyzing the variation between memory object access patterns, referred to as scaling rate. The existing techniques for scaling rate prediction, such as Linear Scaling Rate (LSR), suffer from a high error rate in prediction with changes in access patterns, which leads to a high error rate of energy consumption prediction. In this paper, we compare and evaluate several memory object access pattern prediction models including LSR and machine learning (ML) models. Further, we propose SCALEML, a heap memory object scaling rate prediction mechanism that employs an ML model to achieve high access pattern prediction accuracy with variations in memory object access patterns. We evaluate SCALEML using various application benchmarks. The experimental results show that SCALEML achieves about 20% higher accuracy than the LSR model for predicting the scaling rate of object access patterns and energy estimation.

Park, Joongeon↗

$\mathrm{PPT}$-Multicore: performance prediction of Open$\mathrm{MP}$ applications using reuse profiles and analytical modeling

In this report we present PPT-Multicore, an analytical model embedded in the Performance Prediction Toolkit (PPT) to predict parallel applications’ performance running on a multicore processor. PPT-Multicore builds upon our previous work towards a multicore cache model. We extract LLVM basic block labeled memory trace using an architecture-independent LLVM-based instrumentation tool only once in an application’s lifetime. The model uses the memory trace and other parameters from an instrumented sequentially executed binary. We use probabilistic and computationally efficient reuse profiles to predict the cache hit rates and runtimes of OpenMP programs’ parallel sections. We model Intel’s Broadwell, Haswell, and AMD’s Zen2 architectures and validate our framework using different applications from PolyBench and PARSEC benchmark suites. The results show that PPT-Multicore can predict cache hit rates with an overall average error rate of 1.23% while predicting the runtime with an error rate of 9.08%.

97 MATHEMATICS AND COMPUTING↗

Per-beam, planar IMRT QA passing rates do not predict clinically relevant patient dose errors

Purpose: The purpose of this work is to determine the statistical correlation between per-beam, planar IMRT QA passing rates and several clinically relevant, anatomy-based dose errors for per-patient IMRT QA. The intent is to assess the predictive power of a common conventional IMRT QA performance metric, the Gamma passing rate per beam. Methods: Ninety-six unique data sets were created by inducing four types of dose errors in 24 clinical head and neck IMRT plans, each planned with 6 MV Varian 120-leaf MLC linear accelerators using a commercial treatment planning system and step-and-shoot delivery. The error-free beams/plans were used as ''simulated measurements'' (for generating the IMRT QA dose planes and the anatomy dose metrics) to compare to the corresponding data calculated by the error-induced plans. The degree of the induced errors was tuned to mimic IMRT QA passing rates that are commonly achieved using conventional methods. Results: Analysis of clinical metrics (parotid mean doses, spinal cord max and D1cc, CTV D95, and larynx mean) vs IMRT QA Gamma analysis (3%/3 mm, 2/2, 1/1) showed that in all cases, there were only weak to moderate correlations (range of Pearson's r-values: -0.295 to 0.653). Moreover, the moderate correlations actually had positive Pearson's r-values (i.e., clinically relevant metric differences increased with increasing IMRT QA passing rate), indicating that some of the largest anatomy-based dose differences occurred in the cases of high IMRT QA passing rates, which may be called ''false negatives.'' The results also show numerous instances of false positives or cases where low IMRT QA passing rates do not imply large errors in anatomy dose metrics. In none of the cases was there correlation consistent with high predictive power of planar IMRT passing rates, i.e., in none of the cases did high IMRT QA Gamma passing rates predict low errors in anatomy dose metrics or vice versa. Conclusions: There is a lack of correlation between conventional IMRT QA performance metrics (Gamma passing rates) and dose errors in anatomic regions-of-interest. The most common acceptance criteria and published actions levels therefore have insufficient, or at least unproven, predictive power for per-patient IMRT QA.

60 APPLIED LIFE SCIENCES↗

Hardness assurance for proton direct ionization-induced SEEs using a high-energy proton beam

The low-energy proton energy spectra of all shielded space environments have the same shape. This shape is easily reproduced in the laboratory by degrading a high-energy proton beam, producing a high-fidelity test environment. We use this test environment to dramatically simplify rate prediction for proton direct ionization effects, allowing the work to be done at high-energy proton facilities, on encapsulated parts, without knowledge of the IC design, and with little or no computer simulations required. Proton direct ionization (PDI) is predicted to significantly contribute to the total error rate under the conditions investigated. Scaling effects are discussed using data from 65-nm, 45-nm, and 32-nm SOI SRAMs. These data also show that grazing-angle protons will dominate the PDI-induced error rate due to their higher effective LET, so PDI hardness assurance methods must account for angular effects to be conservative. As a result, we show that this angular dependence can be exploited to quickly assess whether an IC is susceptible to PDI.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Accelerators for critical experiments involving single-particle upset in solid-state microcircuits

Charged-particle interactions in microelectronic circuit chips (integrated circuits) present a particularly insidious problem for solid-state electronic systems due to the generation of soft errors or single-particle event upset (SEU) by either cosmic rays or other radiation sources. Particle accelerators are used to provide both light and heavy ions in order to assess the propensity of integrated circuit chips for SEU. Critical aspects of this assessment involve the ability to analytically model SEU for the prediction of error rates in known radiation environments. In order to accurately model SEU, the measurement and prediction of energy deposition in the form of an electron-hole plasma generated along an ion track is of paramount importance. This requires the use of accelerators which allow for ease in both energy control (change of energy) and change of ion species. This and other aspects of ion-beam control and diagnostics (e.g., uniformity and flux) are of critical concern for the experimental verification of theoretical SEU models.

Zoutendyk, J. A.↗

Effect of flutter on theoretical bit error rates for digital recording systems.

Tape recorders employed to record and eventually reproduce digital data introduce errors into the data. It is desirable to understand the sources of these errors so that predictions may be made of the resultant error rate. While specific predictions are difficult to apply to whole classes of machines and their respective electronic systems, it is possible to make general predictions which give insight into the problems and processes involved. A heuristic viewpoint is developed for understanding the problems involved in machines and systems that now exist.

Byers, R. A.↗

Corrosion of the International Simple Glass under acidic to hyperalkaline conditions

Assessment of glass dissolution kinetics, under disposal relevant temperature and pH environments, is required to credibly estimate radionuclide release rates from vitrified radioactive waste. Leaching of the International Simple Glass (ISG) under acidic to hyperalkaline conditions was examined. Forward rate measurements have been obtained using the dynamic leaching SPFT protocol and rate parameters for B, Na and Si in the basic regime; errors in rates predicted using these parameters at high pH and temperature are significant because the fitting uses logarithmic data. Longer term behaviour under hyperalkaline conditions, representative of some disposal environments, was investigated using the PCT and MCC-1 static leaching protocols with Ca(OH) 2 solutions for up to 120 days (PCT) and 720 days (MCC-1). In hyperalkaline conditions dissolution was incongruent for all elements and the presence of alternating zirconia-rich and zirconia-poor alteration layers was viewed on all leached monoliths, indicating the occurrence of a self-organisation phenomenon during leaching.

36 MATERIALS SCIENCE↗

Outstanding conference paper award 2014 IEEE nuclear and space radiation effects conference

The recipients of the 2014 NSREC Outstanding Conference Paper Award are Nathaniel A. Dodds, James R. Schwank, Marty R. Shaneyfelt, Paul E. Dodd, Barney L. Doyle, Michael Trinczek, Ewart W. Blackmore, Kenneth P. Rodbell, Michael S. Gordon, Robert A. Reed, Jonathan A. Pellish, Kenneth A. LaBel, Paul W. Marshall, Scot E. Swanson, Gyorgy Vizkelethy, Stuart Van Deusen, Frederick W. Sexton, and M. John Martinez, for their paper entitled "Hardness Assurance for Proton Direct Ionization-Induced SEEs Using a High-Energy Proton Beam." For older CMOS technologies, protons could only cause single-event effects (SEEs) through nuclear interactions. Numerous recent studies on 90 nm and newer CMOS technologies have shown that protons can also cause SEEs through direct ionization. Furthermore, this paper develops and demonstrates an accurate and practical method for predicting the error rate caused by proton direct ionization (PDI).

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

New insights gained on mechanisms of low-energy proton-induced SEUs by minimizing energy straggle

In this study, we present low-energy proton single-event upset (SEU) data on a 65 nm SOI SRAM whose substrate has been completely removed. Since the protons only had to penetrate a very thin buried oxide layer, these measurements were affected by far less energy loss, energy straggle, flux attrition, and angular scattering than previous datasets. The minimization of these common sources of experimental interference allows more direct interpretation of the data and deeper insight into SEU mechanisms. The results show a strong angular dependence, demonstrate that energy straggle, flux attrition, and angular scattering affect the measured SEU cross sections, and prove that proton direct ionization is the dominant mechanism for low-energy proton-induced SEUs in these circuits.

74 ATOMIC AND MOLECULAR PHYSICS↗

Experimental annotation of post-translational features and translated coding regions in the pathogen Salmonella Typhimurium

Complete and accurate genome annotation is crucial for comprehensive and systematic studies of biological systems. For example systems biology-oriented genome scale modeling efforts greatly benefit from accurate annotation of protein-coding genes to develop proper functioning models. However, determining protein-coding genes for most new genomes is almost completely performed by inference, using computational predictions with significant documented error rates (> 15%). Furthermore, gene prediction programs provide no information on biologically important post-translational processing events critical for protein function. With the ability to directly measure peptides arising from expressed proteins, mass spectrometry-based proteomics approaches can be used to augment and verify coding regions of a genomic sequence and importantly detect post-translational processing events. In this study we utilized “shotgun” proteomics to guide accurate primary genome annotation of the bacterial pathogen Salmonella Typhimurium 14028 to facilitate a systems-level understanding of Salmonella biology. The data provides protein-level experimental confirmation for 44% of predicted protein-coding genes, suggests revisions to 48 genes assigned incorrect translational start sites, and uncovers 13 non-annotated genes missed by gene prediction programs. We also present a comprehensive analysis of post-translational processing events in Salmonella, revealing a wide range of complex chemical modifications (70 distinct modifications) and confirming more than 130 signal peptide and N-terminal methionine cleavage events in Salmonella. This study highlights several ways in which proteomics data applied during the primary stages of annotation can improve the quality of genome annotations, especially with regards to the annotation of mature protein products.

59 BASIC BIOLOGICAL SCIENCES↗

TDRSS performance evaluation for TDRSS services using analytical simulation

An analytical simulation package which can predict bit error rate and tracking performance for nonlinear, bandlimited satellite links was developed for the Tracking and Data Relay Satellite System (TDRSS). It is based on analytical simulation, i.e., a combination of simulation techniques and analytical performance evaluation. This allows the use of a more realistic signal format than is possible with a purely analytical approach and maintains the advantage of short computation time on bandlimited, nonlinear channels with a noisy uplink. The link models and the main features of the program are described and an overview of the mathematical approach is given. Sample results of computer runs are provided for current power budgets and system design parameters for both forward and return links.

Braun, W. R.↗

Single Event Analysis and Fault Injection Techniques Targeting Complex Designs Implemented in Xilinx-Virtex Family Field Programmable Gate Array (FPGA) Devices

An informative session regarding SRAM FPGA basics. Presenting a framework for fault injection techniques applied to Xilinx Field Programmable Gate Arrays (FPGAs). Introduce an overlooked time component that illustrates fault injection is impractical for most real designs as a stand-alone characterization tool. Demonstrate procedures that benefit from fault injection error analysis.

Single Event Upset Testing↗