Search NASA⌕ Search

Engineering topics

Kerr, C E

Publications and source records attributed to Kerr, C E.

Performance Analysis: Work Control Events Identified January - August 2010

This performance analysis evaluated 24 events that occurred at LLNL from January through August 2010. The analysis identified areas of potential work control process and/or implementation weaknesses and several common underlying causes. Human performance improvement and safety culture factors were part of the causal analysis of each event and were analyzed. The collective significance of all events in 2010, as measured by the occurrence reporting significance category and by the proportion of events that have been reported to the DOE ORPS under the ''management concerns'' reporting criteria, does not appear to have increased in 2010. The frequency of reporting in each of the significance categories has not changed in 2010 compared to the previous four years. There is no change indicating a trend in the significance category and there has been no increase in the proportion of occurrences reported in the higher significance category. Also, the frequency of events, 42 events reported through August 2010, is not greater than in previous years and is below the average of 63 occurrences per year at LLNL since 2006. Over the previous four years, an average of 43% of the LLNL's reported occurrences have been reported as either ''management concerns'' or ''near misses.'' In 2010, 29% of the occurrences have been reported as ''management concerns'' or ''near misses.'' This rate indicates that LLNL is now reporting fewer ''management concern'' and ''near miss'' occurrences compared to the previous four years. From 2008 to the present, LLNL senior management has undertaken a series of initiatives to strengthen the work planning and control system with the primary objective to improve worker safety. In 2008, the LLNL Deputy Director established the Work Control Integrated Project Team to develop the core requirements and graded elements of an institutional work planning and control system. By the end of that year this system was documented and implementation had begun. In 2009, training of the workforce began and as of the time of this report more than 50% of authorized Integration Work Sheets (IWS) use the activity-based planning process. In 2010, LSO independently reviewed the work planning and control process and confirmed to the Laboratory that the Integrated Safety Management (ISM) System was implemented. LLNL conducted a cross-directorate management self-assessment of work planning and control and is developing actions to respond to the issues identified. Ongoing efforts to strengthen the work planning and control process and to improve the quality of LLNL work packages are in progress: completion of remaining actions in response to the 2009 DOE Office of Health, Safety, and Security (HSS) evaluation of LLNL's ISM System; scheduling more than 14 work planning and control self-assessments in FY11; continuing to align subcontractor work control with the Institutional work planning and control system; and continuing to maintain the electronic IWS application. The 24 events included in this analysis were caused by errors in the first four of the five ISMS functions. The most frequent cause was errors in analyzing the hazards (Function 2). The second most frequent cause was errors occurring when defining the work (Function 1), followed by errors during the performance of work (Function 4). Interestingly, very few errors in developing controls (Function 3) resulted in events. This leads one to conclude that if improvements are made to defining the scope of work and analyzing the potential hazards, LLNL may reduce the frequency or severity of events. Analysis of the 24 events resulted in the identification of ten common causes. Some events had multiple causes, resulting in the mention of 39 causes being identified for the 24 events. The most frequent cause was workers, supervisors, or experts believing they understood the work and the hazards but their understanding was incomplete. The second most frequent cause was unclear, incomplete or confusing documents directing the work. Together, these two causes were mentioned 17 times and contributed to 13 of the events. All of the events with the cause of ''workers, supervisors, or experts believing they understood the work and the hazards but their understanding was incomplete'' had this error in the first two ISMS functions: define the work and analyze the hazard. This means that these causes result in the scope of work being ill-defined or the hazard(s) improperly analyzed. Incomplete implementation of these functional steps leads to the hazards not being controlled. The causes are then manifested in events when the work is conducted. The process to operate safely relies on accurately defining the scope of work. This review has identified a number of examples of latent organizational weakness in the execution of work control processes.

99 GENERAL AND MISCELLANEOUS↗

Performance Analysis: ITS Data through September 30, 2009

Data from ITS was analyzed to understand the issues at LLNL and to identify issues that may require additional management attention and these that meet the threshold for reporting to the DOE Noncompliance Tracking System (NTS). In this report we discuss assessments and issues entered in ITS and compare the number and type presently entered in ITS to previous time periods. Issues reported in ITS were evaluated and discussed. The analysis identified two noncompliances that meet the threshold for reporting to the DOE NTS. All of the data in ITS is analyzed; however, the primary focus of this report is to meet requirements for performance analysis of specific functional areas. The DOE Office of Enforcement expects LLNL to 'implement comprehensive management and independent assessments that are effective in identifying deficiencies and broader problems in safety and security programs, as well as opportunities for continuous improvement within the organization' and to 'regularly perform assessments to evaluate implementation of the contractor's's processes for screening and internal reporting.' LLNL has a self-assessment program, described in the document applicable during this time period, ES&H Manual Document 4.1, that includes line, management and independent assessments. LLNL also has in place a process to identify and report deficiencies of nuclear, worker safety and health and security requirements. In addition, the DOE Office of Enforcement expects that 'issues management databases are used to identify adverse trends, dominant problem areas, and potential repetitive events or conditions' (page 15, DOE Enforcement Process Overview, June 2009). LLNL requires that all worker safety and health and nuclear safety noncompliances be tracked as 'deficiencies' in the LLNL Issues Tracking System (ITS). Data from the ITS are analyzed for worker safety and health (WSH) and nuclear safety noncompliances that may meet the threshold for reporting to the DOE Noncompliance Tracking System (NTS). This report meets the expectations defined by the DOE Office of Enforcement to evaluate implementation of internal processes for screening and reporting, review the assessments conducted by LLNL, analyze the noncompliances found in these assessments, and evaluate the data in the ITS database to identify adverse trends, dominant problem areas, and potential repetitive events or conditions. The report attempts to answer three questions: (1) Is LLNL evaluating its programs and state of compliance; (2) What is LLNL finding; and (3) Is LLNL appropriately managing what it finds? The results from analyzing the deficiencies are presented in accordance with the two primary NTS reporting thresholds for WSH and nuclear safety noncompliances: (1) those related to certain events or conditions and (2) those that are management issues. In addition, WSH noncompliances were also analyzed to determine if any fell under the 'other significant condition' threshold. This report identifies deficiencies that meet the criteria for reporting to the DOE NTS; topics and subtopics that should remain under observation because the number of entries meets the test criteria or because of management concern; and topics and subtopics that are determined to no longer require observation. Topics and subtopics that are identified for continued observation are placed on a 'watch list.' The purpose of the watch list is for the Performance Analysis and Reporting Section (PARS) of the Contactor Assurance Office to analyze these topics and subtopics in future performance analysis reports.

99 GENERAL AND MISCELLANEOUS↗

Worker Safety and Health and Nuclear Safety Quarterly Performance Analysis (January - March 2008)

The DOE Office of Enforcement expects LLNL to 'implement comprehensive management and independent assessments that are effective in identifying deficiencies and broader problems in safety and security programs, as well as opportunities for continuous improvement within the organization' and to 'regularly perform assessments to evaluate implementation of the contractor's processes for screening and internal reporting.' LLNL has a self-assessment program, described in ES&H Manual Document 4.1, that includes line, management and independent assessments. LLNL also has in place a process to identify and report deficiencies of nuclear, worker safety and health and security requirements. In addition, the DOE Office of Enforcement expects LLNL to evaluate 'issues management databases to identify adverse trends, dominant problem areas, and potential repetitive events or conditions' (page 14, DOE Enforcement Process Overview, December 2007). LLNL requires that all worker safety and health and nuclear safety noncompliances be tracked as 'deficiencies' in the LLNL Issues Tracking System (ITS). Data from the ITS are analyzed for worker safety and health (WSH) and nuclear safety noncompliances that may meet the threshold for reporting to the DOE Noncompliance Tracking System (NTS). This report meets the expectations defined by the DOE Office of Enforcement to review the assessments conducted by LLNL, analyze the issues and noncompliances found in these assessments, and evaluate the data in the ITS database to identify adverse trends, dominant problem areas, and potential repetitive events or conditions. The report attempts to answer three questions: (1) Is LLNL evaluating its programs and state of compliance? (2) What is LLNL finding? (3) Is LLNL appropriately managing what it finds? The analysis in this report focuses on data from the first quarter of 2008 (January through March). This quarter is analyzed within the context of information identified in previous quarters to include April 2007 through March 2008. The results from analyzing the deficiencies are presented in accordance with the two primary NTS reporting thresholds for WSH and nuclear safety noncompliances: (1) those related to certain events or conditions and (2) those that are management issues. In addition, WSH noncompliances were also analyzed to determine if any fell under the 'other significant condition' threshold. This report also identifies noncompliance topical areas that may have issues that do not meet the NTS reporting threshold but should remain under observation. These are placed on the 'watch list' for continued analysis.

99 GENERAL AND MISCELLANEOUS↗