Search NASA⌕ Search

SEARCH · Search NASA

Results for “human error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37

Inspection error and its adverse effects - A model with implications for practitioners

Inspection error has clearly been shown to have adverse effects upon the results desired from a quality assurance sampling plan. These effects upon performance measures have been well documented from a statistical point of view. However, little work has been presented to convince the QC manager of the unfavorable cost consequences resulting from inspection error. This paper develops a very general, yet easily used, mathematical cost model. The basic format of the well-known Guthrie-Johns model is used. However, it is modified as required to assess the effects of attributes sampling errors of the first and second kind. The economic results, under different yet realistic conditions, will no doubt be of interest to QC practitioners who face similar problems daily. Sampling inspection plans are optimized to minimize economic losses due to inspection error. Unfortunately, any error at all results in some economic loss which cannot be compensated for by sampling plan design; however, improvements over plans which neglect the presence of inspection error are possible. Implications for human performance betterment programs are apparent, as are trade-offs between sampling plan modification and inspection and training improvements economics.

Collins, R. D., Jr.↗

Measurement of spine and total body mineral by dual-photon absorptiometry

The use of Gd-153 dual-photon absorptiometry at 43 and 100 keV to measure individual-bone and total-body bone minerals is discussed in a survey of recent studies on humans, phantoms, and monkeys. Precision errors of as low as 1 percent have been achieved in vivo, suggesting the use of sequential measurements in studies of immobilization and space-flight effects.

Mazess, R. B.↗

Aviation safety/automation program overview

The goal is to provide a technology base leading to improved safety of the national airspace system through the development and integration of human-centered automation technologies for aircraft crews and air traffic controllers. Information on the problems, specific objectives, human-automation interaction, intelligent error-tolerant systems, and air traffic control/cockpit integration is given in viewgraph form.

Morello, Samuel A.↗

The Table of Distribution and Allowances (TDA) system analyzer

TDA documents determine the personnel strengths for each Army installation. They reflect the number of people required to accomplish a certain mission by various characteristics. U.S. Army Training and Doctrine Command (TRADOC) analysts continuously scrutinize these documents to ensure that they comply with provided guidance. Part of this guidance has been used to develop a set of manual rules. Analysts apply these rules to the TDA to eliminate positions, downgrade positions, or reduce position strength. However, this process is very time consuming. ln addition, human involvement introduces inconsistencies and errors that are difficult to detect later. This paper explains how I represented these rules using the 'C' Language Production System (CLIPS) to develop an expert system that is applied consistently and comprehensively for all TRADOC installations. The TDA System Analyzer reduces the review process from about five days to just twenty minutes; giving the user more time to analyze the results and thereby make better decisions. Furthermore, the user is assured that the rules are applied uniformly to every TDA document. This paper also explains the integration of the TDA System Analyzer into TRADOC's On-Line TDA System. Providing the analyst an extra utility module that can be accessed from a familiar environment.

Mack, John F.↗

Automated spectral classification and the GAIA project

Two dimensional spectral types for each of the stars observed in the global astrometric interferometer for astrophysics (GAIA) mission would provide additional information for the galactic structure and stellar evolution studies, as well as helping in the identification of unusual objects and populations. The classification of the large quantity generated spectra requires that automated techniques are implemented. Approaches for the automatic classification are reviewed, and a metric-distance method is discussed. In tests, the metric-distance method produced spectral types with mean errors comparable to those of human classifiers working at similar resolution. Data and equipment requirements for an automated classification survey, are discussed. A program of auxiliary observations is proposed to yield spectral types and radial velocities for the GAIA-observed stars.

Lasala, Jerry↗

Dynamic Communication Resource Negotiations

Today's advanced network management systems can automate many aspects of the tactical networking operations within a military domain. However, automation of joint and coalition tactical networking across multiple domains remains challenging. Due to potentially conflicting goals and priorities, human agreement is often required before implementation into the network operations. This is further complicated by incompatible network management systems and security policies, rendering it difficult to implement automatic network management, thus requiring manual human intervention to the communication protocols used at various network routers and endpoints. This process of manual human intervention is tedious, error-prone, and slow. In order to facilitate a better solution, we are pursuing a technology which makes network management automated, reliable, and fast. Automating the negotiation of the common network communication parameters between different parties is the subject of this paper. We present the technology that enables inter-force dynamic communication resource negotiations to enable ad-hoc inter-operation in the field between force domains, without pre-planning. It also will enable a dynamic response to changing conditions within the area of operations. Our solution enables the rapid blending of intra-domain policies so that the forces involved are able to inter-operate effectively without overwhelming each other's networks with in-appropriate or un-warranted traffic. It will evaluate the policy rules and configuration data for each of the domains, then generate a compatible inter-domain policy and configuration that will update the gateway systems between the two domains.

policy negotiation↗

Networks: Blending and Integrating Data From Multiple Sources

This presentation covers gathering data from turbines to provide full transparency for reporting purposes, validating human-entered data to eradicate errors, exploring data-enabled remaining useful life predictions, and supervisory controls being used today.

17 WIND ENERGY↗

Modeling and Evaluating Pilot Performance in NextGen: Review of and Recommendations Regarding Pilot Modeling Efforts, Architectures, and Validation Studies

NextGen operations are associated with a variety of changes to the national airspace system (NAS) including changes to the allocation of roles and responsibilities among operators and automation, the use of new technologies and automation, additional information presented on the flight deck, and the entire concept of operations (ConOps). In the transition to NextGen airspace, aviation and air operations designers need to consider the implications of design or system changes on human performance and the potential for error. To ensure continued safety of the NAS, it will be necessary for researchers to evaluate design concepts and potential NextGen scenarios well before implementation. One approach for such evaluations is through human performance modeling. Human performance models (HPMs) provide effective tools for predicting and evaluating operator performance in systems. HPMs offer significant advantages over empirical, human-in-the-loop testing in that (1) they allow detailed analyses of systems that have not yet been built, (2) they offer great flexibility for extensive data collection, (3) they do not require experimental participants, and thus can offer cost and time savings. HPMs differ in their ability to predict performance and safety with NextGen procedures, equipment and ConOps. Models also vary in terms of how they approach human performance (e.g., some focus on cognitive processing, others focus on discrete tasks performed by a human, while others consider perceptual processes), and in terms of their associated validation efforts. The objectives of this research effort were to support the Federal Aviation Administration (FAA) in identifying HPMs that are appropriate for predicting pilot performance in NextGen operations, to provide guidance on how to evaluate the quality of different models, and to identify gaps in pilot performance modeling research, that could guide future research opportunities. This research effort is intended to help the FAA evaluate pilot modeling efforts and select the appropriate tools for future modeling efforts to predict pilot performance in NextGen operations.

pilot human performance models↗

A Business Case for Nuclear Plant Control Room Modernization

This paper presents a generic business case for implementation of technology that supports Control Room Modernization (CRM). The analysis presented in two forms; 1) a standalone technology upgrade, and 2) a technology upgrade that is built upon and incremental to a prior business case created for Mobile Work Packages (MWP). The business case contends that advanced communication and networking and analytical technologies will allow NPP to conduct control room operations with improved focus by reducing human factors and redundant manpower, and therefore operate with fewer errors. While some labor savings can be harvested in terms of overtime, the majority of savings are demonstrated as reduced time to take the plant off line and bring back on line in support of outages. The benefits are quantified to a rough order of magnitude that provides directional guidance to NPPs that are interested in developing a similar business case. This business case focuses on modernization of the operator control room and does not consider a complete overhaul and modernization of a plants instrument and control systems. While operators may be considering such an investment at their plants, the sizable capital investment required is not likely supported by a cost/benefit analysis alone. More likely, it is driven by obsolescence and reliability issues, and requires consideration of mechanical condition of plant systems, capital depreciation, financing, relicensing and overall viability of the plant asset over a 20-year horizon in a competitive market. Prior studies [REF] have indicated that such a modernization of plant I&C systems, alone or as part of a larger modernization effort, can yield very significant reductions in O&M costs. However, the depth of research and analysis required to develop a meaningful business case for a plant modernization effort is well beyond the scope of this study. While CRM as considered in this study can be easily integrated as part of grander plant modernization effort, it can also be considered as a stand-alone project, implemented as a supervisorial layer over and above existing systems. CRM is enabled by a suite of technologies, which are described in further detail in the body of this report. They include: • Modernized control room with interactive displays • High-bandwidth wireless networks • Mobile devices • Component identification technology • Mobile wireless video cameras • Smart or task based operator displays • Computer-Based Procedures (CBP)/Automated Mobile Work Packages (MWP) • Intelligent plant configuration • Advanced data analytics An analysis was conducted to determine how these technologies might impact outage operations at an NPP. The analysis concluded that outage management capabilities would be improved with application of these technologies, and result in annual benefits for the plant. These improved capabilities were identified and described in further detail in this report. • Reduction in need redundant manpower (verification, etc) • Improved critical path shutdown and restart duration during outages • Reduction in human factors and errors • Remote watches • Paperless outage coordination • Bulk work optimization

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Using computer-extracted image features for modeling of error-making patterns in detection of mammographic masses among radiology residents

Purpose: Mammography is the most widely accepted and utilized screening modality for early breast cancer detection. Providing high quality mammography education to radiology trainees is essential, since excellent interpretation skills are needed to ensure the highest benefit of screening mammography for patients. The authors have previously proposed a computer-aided education system based on trainee models. Those models relate human-assessed image characteristics to trainee error. In this study, the authors propose to build trainee models that utilize features automatically extracted from images using computer vision algorithms to predict likelihood of missing each mass by the trainee. This computer vision-based approach to trainee modeling will allow for automatically searching large databases of mammograms in order to identify challenging cases for each trainee. Methods: The authors’ algorithm for predicting the likelihood of missing a mass consists of three steps. First, a mammogram is segmented into air, pectoral muscle, fatty tissue, dense tissue, and mass using automated segmentation algorithms. Second, 43 features are extracted using computer vision algorithms for each abnormality identified by experts. Third, error-making models (classifiers) are applied to predict the likelihood of trainees missing the abnormality based on the extracted features. The models are developed individually for each trainee using his/her previous reading data. The authors evaluated the predictive performance of the proposed algorithm using data from a reader study in which 10 subjects (7 residents and 3 novices) and 3 experts read 100 mammographic cases. Receiver operating characteristic (ROC) methodology was applied for the evaluation. Results: The average area under the ROC curve (AUC) of the error-making models for the task of predicting which masses will be detected and which will be missed was 0.607 (95% CI,0.564-0.650). This value was statistically significantly different from 0.5 (p < 0.0001). For the 7 residents only, the AUC performance of the models was 0.590 (95% CI,0.537-0.642) and was also significantly higher than 0.5 (p = 0.0009). Therefore, generally the authors’ models were able to predict which masses were detected and which were missed better than chance. Conclusions: The authors proposed an algorithm that was able to predict which masses will be detected and which will be missed by each individual trainee. This confirms existence of error-making patterns in the detection of masses among radiology trainees. Furthermore, the proposed methodology will allow for the optimized selection of difficult cases for the trainees in an automatic and efficient manner.

60 APPLIED LIFE SCIENCES↗

Light Water Reactor Sustainability Program: Use of Time Distributions to Predict Operator Procedure Performance in Dynamic Human Reliability Analysis

The Human Unimodel for Nuclear Technology to Enhance Reliability (HUNTER) framework affords software capable of conducting human reliability analysis (HRA) using a dynamic approach built around operating procedures (OPs) from nuclear power plants (NPPs). Previous HUNTER reports document the development of this software tool, the coupling of HUNTER to the simulator code, the collection of operator performance data by using simulators to calibrate HUNTER models, and linking HUNTER to probabilistic risk assessment (PRA) software. The present report largely addresses two topics. The first is a new function in HUNTER called the HUNTER Procedure Performance Predictor (P3). HUNTER P3 uses HUNTER’s built in Monte Carlo tools featuring human performance variability to identify potential error traps in procedures. The second topic is time distribution analysis to generate time inputs for dynamic HRA. The current analysis was performed to investigate time distributions for task primitives, which are the minimum task unit of analysis used in dynamic HRA modeling. Using the time distribution data, the elapsed time for human actions in an extended loss of AC power (ELAP) scenario is then investigated. Time data and prediction are essential for modeling procedure performance.

99 GENERAL AND MISCELLANEOUS↗

Expanding Our Understanding of What Constitutes a Safety-Relevant Occurrence

Focusing on undesired operator behaviors is pervasive in system design and safety management cultures. This focus limits the data that are collected, the questions that are asked during data analysis, and therefore our understanding of what operators do in everyday work. Human performance represents a significant source of safety data that includes both desired and undesired actions. When safety is characterized only in terms of errors and failures, the vast majority of human impacts on system safety and performance are ignored. The outcomes of safety data analyses dictate what is learned from those data, which in turn informs safety policies and safety-related decision making. When learning opportunities are systematically restricted by focusing only on rare failure events, not only do we learn less (and less often), but we can draw misleading conclusions by relying on a non-representative sample of human performance data. The study of human contributions to safety represents a vast and largely unexplored opportunity to learn. Changes in how we define and think about safety can highlight new opportunities for collection and analysis of safety-relevant data. Developing an integrated safety picture to better inform system design, safety-related decision making and policies depends upon identifying, collecting, and interpreting safety producing behaviors in addition to safety reducing behaviors.

Jon B Holbrook↗

Human Factors and Habitability Challenges for Mars Missions

As NASA is planning to send humans deeper into space than ever before, adequate crew health and performance will be critical for mission success. Within the NASA Human Research Program (HRP), the Space Human Factors and Habitability (SHFH) team is responsible for characterizing the risks associated with human capabilities and limitations with respect to long-duration spaceflight, and for providing mitigations (e.g., guidelines, technologies, and tools) to promote safe, reliable and productive missions. SHFH research includes three domains: Advanced Environmental Health (AEH), Advanced Food Technology (AFT), and Space Human Factors Engineering (SHFE). The AEH portfolio focuses on understanding the risk of microbial contamination of the spacecraft and on the development of standards for exposure to potential toxins such as chemicals, bacteria, fungus, and lunar/Martian dust. The two risks that the environmental health project focuses on are adverse health effects due to changes in host-microbe interactions, and risks associated with exposure to dust in planetary surface habitats. This portfolio also proposes countermeasures to these risks by making recommendations that relate to requirements for environmental quality, foods, and crew health on spacecraft and space missions. The AFT portfolio focuses on reducing the mass, volume, and waste of the entire integrated food system to be used in exploration missions, and investigating processing methods to extend the shelf life of food items up to five years, while assuring that exploration crews will have nutritious and palatable foods. The portfolio also delivers improvements in both the food itself and the technologies for storing and preparing it. SHFE sponsors research to establish human factors and habitability standards and guidelines in five risk areas, and provides improved design concepts for advanced crew interfaces and habitability systems. These risk areas include: Incompatible vehicle/habitat design, inadequate human-computer interaction, inadequate critical task design, inadequate human-automation/robotic interaction, and performance errors due to training deficiencies. To address the identified research gaps within each risk, SHFH's research plan includes studies in the laboratory, in analogs, and on International Space Station (ISS). In addition to establishing and maintaining the risk-based research portfolio, SHFH is also implementing a qualitative approach to determine how we at NASA evaluate human performance. Via interviews with experts, such as trainers, flight controllers, and flight surgeons, we are collecting the metrics by which they assess human performance, evidence of performance issues, and potential or actual consequences. The Human Performance Data Project will determine what human performance data have been collected in the past at NASA, and what data should be collected in the future in order to complete our knowledgebase and reduce risks related to human factors and habitability.

Whitmore, Mihriban↗

Exploring Methods to Collect and Analyze Data on Human Contributions to Aviation Safety: A Panel Discussion

Focusing on undesired operator behaviors is pervasive in system design and safety management cultures in aviation. This focus limits the data that are collected, the questions that are asked during data analysis, and therefore our understanding of what operators do in everyday work. Human performance represents a significant source of aviation safety data that includes both desired and undesired actions. When safety is characterized only in terms of errors and failures, the vast majority of human impacts on system safety and performance are ignored. The outcomes of safety data analyses dictate what is learned from those data, which in turn informs safety policies and safety-related decision making. When learning opportunities are systematically restricted by focusing only on rare failure events, not only do we learn less (and less often), but we can draw misleading conclusions by relying on a non-representative sample of human performance data. Changes in how we define and think about safety can highlight new opportunities for collection and analysis of safety-relevant data. Developing an integrated safety picture to better inform safety-related decision making and policies depends upon identifying, collecting, and interpreting safety-producing behaviors in addition to safety-reducing behaviors. Opportunities and challenges in collecting and analyzing the largely unexploited data on desired, safety-producing operator behaviors are discussed.

Aviation Safety↗

Exploring Methods to Collect and Analyze Data on Human Contributions to Aviation Safety: A Panel Discussion

Focusing on undesired operator behaviors is pervasive in system design and safety management cultures in aviation. This focus limits the data that are collected, the questions that are asked during data analysis, and therefore our understanding of what operators do in everyday work. Human performance represents a significant source of aviation safety data that includes both desired and undesired actions. When safety is characterized only in terms of errors and failures, the vast majority of human impacts on system safety and performance are ignored. The outcomes of safety data analyses dictate what is learned from those data, which in turn informs safety policies and safety-related decision making. When learning opportunities are systematically restricted by focusing only on rare failure events, not only do we learn less (and less often), but we can draw misleading conclusions by relying on a non-representative sample of human performance data. Changes in how we define and think about safety can highlight new opportunities for collection and analysis of safety-relevant data. Developing an integrated safety picture to better inform safety-related decision making and policies depends upon identifying, collecting, and interpreting safety producing behaviors in addition to safety reducing behaviors. The panel will discuss opportunities and challenges in collecting and analyzing the largely unexploited data on desired, safety-producing operator behaviors.

aviation safety↗

Mentoring Human Performance - 12480

Although the positive effects of implementing a human performance approach to operations can be hard to quantify, many organizations and industry areas are finding tangible benefits to such a program. Recently, a unique mentoring program was established and implemented focusing on improving the performance of managers, supervisors, and work crews, using the principles of Human Performance Improvement (HPI). The goal of this mentoring was to affect behaviors and habits that reliably implement the principles of HPI to ensure continuous improvement in implementation of an Integrated Safety Management System (ISMS) within a Conduct of Operations framework. Mentors engaged with personnel in a one-on-one, or one-on-many dialogue, which focused on what behaviors were observed, what factors underlie the behaviors, and what changes in behavior could prevent errors or events, and improve performance. A senior management sponsor was essential to gain broad management support. A clear charter and management plan describing the goals, objectives, methodology, and expected outcomes was established. Mentors were carefully selected with senior management endorsement. Mentors were assigned to projects and work teams based on the following three criteria: 1) knowledge of the work scope; 2) experience in similar project areas; and 3) perceived level of trust they would have with project management, supervision, and work teams. This program was restructured significantly when the American Reinvestment and Recovery Act (ARRA) and the associated funding came to an end. The program was restructured based on an understanding of the observations, attributed successes and identified shortfalls, and the consolidation of those lessons. Mentoring the application of proven methods for improving human performance was shown effective at increasing success in day-to-day activities and increasing confidence and level of skill of supervisors. While mentoring program effectiveness is difficult to measure, and return on investment is difficult to quantify, especially in complex and large organizations where the ability to directly correlate causal factors can be challenging, the evidence presented by Sydney Dekker, James Reason, and others who study the field of human factors does assert managing and reducing error is possible. Employment of key behaviors-HPI techniques and skills-can be shown to have a significant impact on error rates. Our mentoring program demonstrated reduced error rates and corresponding improvements in safety and production. Improved behaviors are the result, of providing a culture with consistent, clear expectations from leadership, and processes and methods applied consistently to error prevention. Mentoring, as envisioned and executed in this program, was effective in helping shift organizational culture and effectively improving safety and production. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Risk of Performance and Behavioral Health Decrements Due to Inadequate Cooperation, Coordination, Communication, and Psychosocial Adaptation within a Team

A team is defined as: "two or more individuals who interact socially and adaptively, have shared or common goals, and hold meaningful task interdependences; it is hierarchically structured and has a limited life span; in it expertise and roles are distributed; and it is embedded within an organization/environmental context that influences and is influenced by ongoing processes and performance outcomes" (Salas, Stagl, Burke, & Goodwin, 2007, p. 189). From the NASA perspective, a team is commonly understood to be a collection of individuals that is assigned to support and achieve a particular mission. Thus, depending on context, this definition can encompass both the spaceflight crew and the individuals and teams in the larger multi-team system who are assigned to support that crew during a mission. The Team Risk outcomes of interest are predominantly performance related, with a secondary emphasis on long-term health; this is somewhat unique in the NASA HRP in that most Risk areas are medically related and primarily focused on long-term health consequences. In many operational environments (e.g., aviation), performance is assessed as the avoidance of errors. However, the research on performance errors is ambiguous. It implies that actions may be dichotomized into "correct" or "incorrect" responses, where incorrect responses or errors are always undesirable. Researchers have argued that this dichotomy is a harmful oversimplification, and it would be more productive to focus on the variability of human performance and how organizations can manage that variability (Hollnagel, Woods, & Leveson, 2006) (Category III1). Two problems occur when focusing on performance errors: 1) the errors are infrequent and, therefore, difficult to observe and record; and 2) the errors do not directly correspond to failure. Research reveals that humans are fairly adept at correcting or compensating for performance errors before such errors result in recognizable or recordable failures. Astronauts are notably adept high performers. Most failures are recorded only when multiple, small errors occur and humans are unable to recognize and correct or compensate for these errors in time to prevent a failure (Dismukes, Berman, Loukopoulos, 2007) (Category III). More commonly, observers record variability in levels of performance. Some teams commit no observable errors but fail to achieve performance objectives or perform only adequately, while other teams commit some errors but perform spectacularly. Successful performance, therefore, cannot be viewed as simply the absence of errors or the avoidance of failure Johnson Space Center (JSC) Joint Leadership Team, 2008). While failure is commonly attributed to making a major error, focusing solely on the elimination of error(s) does not significantly reduce the risk of failure. Failure may also occur when performance is simply insufficient or an effort is incapable of adjusting sufficiently to a contextual change (e.g., changing levels of autonomy).

Landon, Lauren Blackwell↗

WE-G-BRA-03: Developing a Culture of Patient Safety Utilizing the National Radiation Oncology Incident Learning System (ROILS)

Purpose: To transition from an in-house incident reporting system to a ROILS standards system with the intent to develop a safety focused culture in the Department and enroll in ROILS. Methods: Since the AAPM Safety Summit (2010) several safety and reporting systems have been implemented within the Department. Specific checklists and SBAR reporting systems were introduced. However, the active learning component was lost due to reporting being viewed with distrust and possible retribution.To Facilitate introducing ROILS each leader in the Department received a copy of the ROILS participation guide. Four specific tasks were assigned to each leader: develop a reporting tree, begin the ROILS based system, facilitate adopting ROILS Terminology, and educate the staff on expectations of safety culture. Next, the ROILS questions were broken down into area specific questions (10–15) per departmental area. Excel spreadsheets were developed for each area and setup for error reporting entries. The Role of the Process Improvement Committee (PI) has been modified to review and make recommendations based on the ROILS entries. Results: The ROILS based Reporting has been in place for 4 months. To date 64 reports have been entered. Since the adoption of ROILS the reporting of incidents has increased from 2/month to 18/month on average. Three reports had a dosimetric effect on the patient (<5%) dose variance. The large majority of entries have been Characterized as Processes not followed or not sure how to Characterize, and Human Behavior. Conclusion: The majority of errors are typo’s that create confusion. The introduction of the ROILS standards has provided a platform for making changes to policies that increase patient safety. The goal is to develop a culture that sees reporting at a national level as a safe and effective way to improve our safety, and to dynamically learn from other institutions reporting.

60 APPLIED LIFE SCIENCES↗