Search NASA⌕ Search

SEARCH · Search NASA

Results for “Human Errors”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Development of a hybrid neural network and transfer learning model for optimized ICP-MS/MS operation

Correct function and calibration of instrumentation is a crucial assumption for any scientific experiment. One such instrument, tandem inductively coupled plasma mass spectrometer (ICP-MS/MS), has in-depth calibration settings that range across 30+ different parameters, making it difficult to determine optimal conditions without expertise and some degree of trial and error. Often, these settings are hand-tuned, a time-intensive process prone to local maxima and human error. While some automation is available, the automation also may favor local optimizations over a global optimum. In addition to these difficulties, day to day instrument variability can further complicate the calibration process. We propose a solution to this problem as a machine learning (ML) algorithm that learns how each parameter helps determine the calibration sensitivity across several elements, and re-weights parameters over time as instrument variability changes (e.g., a global neural network (NN) with a time-dependent transfer learning (TL) component). This model would be able to generate a surface of predicted calibration sensitivities and their respective parameters, and a simple multivariate algorithm would be able to pull out the optimum results with the settings associated with them. Here-in, we describe our initial findings in working towards this goal, including data extraction from historical files, exploratory data analysis, and some initial model building to better describe the data and the feasibility of our goal.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Demonstration and Evaluation of the Human-Technology Integration Function Allocation Methodology

There is an imminent need for the existing nuclear power plants to reduce their operating and maintenance (O&M) costs to remain economically viable. Digital technology, including automation, provides a significant opportunity for the existing nuclear power plant fleet to transform the way in which work is accomplished, reducing O&M costs, and allowing the fleet to remain economically competitive. One notable opportunity to significantly reduce O&M costs pertains to modifications to the plant equipment and main control room (MCR). Existing instrumentation and control (I&C) technologies in the MCR are highly analog, costly to operate and maintain, and demand a high cognitive and physical workload from plant staff (i.e., operators). Digitalizing the MCR has a range of broad economic benefits, including improved plant performance and reduced manual work. Further, digital I&C systems can fundamentally change the way in which plant staff operate the plant; this is the concept of operation. Human-technology integration is important to ensure that impacts to the concept of operation are done in a way that account for capabilities of people and technology. Human-technology integration employs human factors engineering (HFE) methods and principles to maximize the benefits of digital technology, reducing human error, improving overall decision-making and usability. The U.S. Department of Energy Light Water Reactor Sustainability Program is applying human-technology integration research to ensure digital technologies are safe, reliable, and efficient. This paper documents the demonstration of the human-technology guidance developed by the Light Water Reactor Sustainability Program from a first-of-a-kind digital I&C upgrade, specifically addressing function analysis and allocation for a new digital I&C system that included changes in automation levels. The program’s specific approach is included in this work, following lessons learned. This document serves as a resource for industry to follow in applying human-technology integration and HFE to digital modifications, specific to function analysis and allocation. The lessons learned should be considered in the planning and execution of HFE activities that support such digital modifications.

99 GENERAL AND MISCELLANEOUS↗

The Impact of Cultural Values and Organizational Processes on Nuclear Security Operations

Human performance is a pivotal factor in the design, testing, maintenance, and operation of security systems. The effectiveness of these systems relies not only on the capabilities, limitations, motives, and attitudes of the individuals involved, but also on the quality of training, instructional content, and evaluation methods provided. To uphold security standards, seamless integration between technologies and operators necessitates reliable human input. In security operations, human errors, often attributed to blame, sanctions, low motivation, individual accountability, or complacency, are primary causes of system failures. Complacency, characterized by a false sense of security, reflects a lack of awareness of potential threats and is a significant contributing factor to lapses in security. Security incidents arise from various factors, many extend beyond individual control, highlighting the need for a holistic approach to human performance that integrates organizational processes and team collaboration. Historically, errors have been attributed to individual moral or cognitive failures. However, insights from Operational Experiences (OEs) suggest that organizational processes weakness and deficiencies in nuclear cultural values contribute more significantly to security failures than individual mistakes. This paper consolidates lessons learned from diverse international nuclear security cultures and aims to highlight the importance of security culture in shaping global perspectives on nuclear security. It underscores the role of cultural values in shaping nuclear security practices and enhancing the resilience of security systems in the nuclear sector.

Zineddin, Dr. Z. [ORNL] (ORCID:0009000848740725)↗

A Feasibility Study on the Integration of Human Performance Data From Diverse Sources Based on the Complexity of a Proceduralized Task

Securing the safety of socio-technical systems including nuclear facilities is the upmost goal to ensure their sustainability because historical records demonstrate that the performance degradation of human operators (e.g., human errors) is one of the crucial contributors to the occurrence of unexpected events resulting in extensive casualties and financial losses. This implies that the collection of human performance data in diverse conditions with which they could be faced during the operation of nuclear facilities. As this collection requires significant resources, it is necessary to resolve how to accomplish it with limited resources. To address this challenge, as suggested in the SHEEP framework, it is indispensable to extract valuable insights after integrating various kinds of human performance data obtained from different sources. However, a practical method to soundly integrate them seems to be still incomplete. Accordingly, the applicability of TACOM (Task Complexity) measure is investigated as a tool to identify useful information based on the integration of human performance data observed from different simulation conditions. As a result, it is expected that the TACOM measure would play an important role in addressing the technical challenge in securing human performance data.

99 GENERAL AND MISCELLANEOUS↗

Bridging the Gap Between Modern UX Design and Particle Accelerator Control Room Interfaces

Accelerator control systems often represent relatively complex and safety-sensitive human-machine interfaces within process control industries. These systems are technically robust and reflect the cumulative integration of solutions built and adapted across decades. One of the regular, unfortunate casualties of provisional accelerator control system updates is their human-system interfaces (HSIs) which often lag behind modern usability and design standards. An additional challenge is that although there is a multitude of established human factors (HF), and user experience (UX) principles for everyday digital applications, there are very few (if any) established principles for complex and safety-critical applications for an accelerator. This paper argues for the importance of established HF and UX principles (herein referred to as human-centered design principles) into the development of accelerator HSIs, emphasizing the need for clarity, consistency, responsiveness, and cognitive accessibility. Drawing from HF/UX best practices and human-centered design, this paper discusses how these approaches can enhance operator performance, reduce human error, and improve accelerator personnel collaboration. Case studies from Accelerator Control Operations Research Network (ACORN) at Fermilab are explored to demonstrate how interfaces built with human-centered design principles can scale with system complexity while remaining intuitive and efficient for diverse user roles including operators, machine experts, and engineers. By bridging the gap between traditional control system design and modern human-centered design methods, this paper provides a roadmap for evolving accelerator HSIs into more usable, maintainable, and effective tools.

Hill, Rachael [Idaho Natl. Lab.]↗

Framework for a Digital Documented Safety Analysis

This framework is developed to progress the digital implementation of digital tools applied to the DOE authorization process, with future applications to NRC SAR development/review, to accelerate the design and review processes of advanced nuclear reactors. The engineering design and licensing process for nuclear reactors is currently burdened by a document-based approach that leads to duplications and errors due to a lack of traceability among numerous static documents. Changes to design information require labor-intensive manual tracing through these documents, creating a high potential for human error. The adoption of a digital ecosystem, utilizing a digital thread to link various aspects of project design and analysis, promises dynamic documentation generation, automatic updates, and error reduction. Model Based Definition (MBD) and Product Lifecycle Management (PLM) tools are central to this digital transformation.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

An Analysis of Grid Operator Survey Responses: Inexperience, Workload and Fatigue in the Control Room

Although a wide array of tools and technologies have been developed over the last decade to support power grid operators, deployment of these tools has been less successful. One reason for unsuccessful deployment may be an inadequate understanding of the factors that contribute to operator error in the control room. An analysis of operators’ current vulnerabilities may provide the baseline understanding needed to inform new technology integration. In an attempt to learn more about these vulnerabilities and their perceived impact on human error we collected and analyzed survey data from 20 electric grid control room operators. We asked survey respondents to consider the various operator, technology and interaction vulnerabilities that may arise during work in the control room and record their attitudes and experiences toward each. Results suggest operator inexperience, high mental workload and fatigue are the most common vulnerabilities experienced during a shift. Survey results were analyzed to explore these vulnerabilities in greater depth.

Inexperience, Workload, Fatigue↗

Data-Enabled Fusion Technology (Final Scientific/Technical Report)

Advancing Scientific Understanding in Fusion Energy and Machine Learning This research represented a significant step forward in machine learning (ML) applications for fusion energy experiments. The project integrated advanced data-driven modeling, optimization techniques, and artificial intelligence to enhance the predictive capabilities and operational efficiency of plasma-based fusion systems. Specifically, tasks focused on ML-enhanced diagnostics, operator guidance tools, and predictive modeling helped improve the ability to interpret complex fusion experiments. Key areas of advancement included: 1) data-driven plasma control, i.e., using ML algorithms to optimize experimental conditions and classify plasma behaviors based on historical data; 2) spectroscopy and diagnostics, i.e., applying AI models to extract previously inaccessible insights from experimental spectroscopy data; and 3) configuration mapping and operator guidance, i.e., developing a predictive framework to assist scientists in identifying the most effective experimental parameters, reducing reliance on manual adjustments. By refining these ML-driven techniques, the project contributed to the broader scientific community’s understanding of plasma dynamics and fusion energy viability. Technical Effectiveness and Economic Feasibility The methods investigated demonstrated high technical effectiveness, as reflected in milestones assessing the predictive accuracy, performance, and optimization of fusion configurations. The development of an Operator Guidance Tool (OGT), for example, led to more precise control of plasma conditions by learning from experimental data and offering real-time adjustments. From an economic standpoint, DeFT provided: 1) the ability to reduce trial-and-error experimentation, which lowered operational costs; 2) improved data interpretation methods, which enabled more efficient resource allocation in large-scale fusion research projects; and 3) the automation of key diagnostic tasks, which reduced manual labor and human error, increasing overall efficiency. 13 The final assessments of predictive models and optimization strategies demonstrated that these approaches were scalable and could be implemented across multiple fusion energy research programs. Public Benefit and Societal Impact This project contributed directly to the broader goal of achieving sustainable and commercially viable fusion energy, which had profound implications for clean energy production and climate change mitigation. The integration of AI-driven solutions into fusion research: 1) sped up scientific discovery, accelerating progress towards achieving energy breakthroughs; 2) reduced the cost of experimentation, making fusion research more accessible; and 3) provided a framework for future AI applications in high-energy physics, benefiting adjacent fields like space exploration, material science, and renewable energy. Additionally, by fostering collaborations between AI researchers and plasma physicists, this project promoted interdisciplinary innovation that could lead to broader applications beyond fusion research.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Blind photovoltaic modeling intercomparison: A multidimensional data analysis and lessons learned

The Photovoltaic (PV) Performance Modeling Collaborative (PVPMC) organized a blind PV performance modeling intercomparison to allow PV modelers to blindly test their models and modeling ability against real system data. Measured weather and irradiance data were provided along with detailed descriptions of PV systems from two locations (Albuquerque, New Mexico, USA, and Roskilde, Denmark). Participants were asked to simulate the plane-of-array irradiance, module temperature, and DC power output from six systems and submit their results to Sandia for processing. The results showed overall median mean bias (i.e., the average error per participant) of 0.6% in annual irradiation and –3.3% in annual energy yield. While most PV performance modeling results seem to exhibit higher precision and accuracy as compared to an earlier blind PV modeling study in 2010, human errors, modeling skills, and derates were found to still cause significant errors in the estimates.

14 SOLAR ENERGY↗

DAQExpert the service to increase CMS data-taking efficiency

The Data Acquisition (DAQ) system of the Compact Muon Solenoid (CMS) experiment at the LHC is a complex system responsible for the data readout, event building and recording of accepted events. Its proper functioning plays a critical role in the data-taking efficiency of the CMS experiment. In order to ensure high availability and recover promptly in the event of hardware or software failure of the subsystems, an expert system, the DAQ Expert, has been developed. It aims at improving the data taking efficiency, reducing the human error in the operations and minimising the on-call expert demand. Introduced in the beginning of 2017, it assists the shift crew and the system experts in recovering from operational faults, streamlining the post mortem analysis and, at the end of Run 2, triggering fully automatic recovery without human intervention. DAQ Expert analyses the real-time monitoring data originating from the DAQ components and the high-level trigger updated every few seconds. It pinpoints data flow problems, and recovers them automatically or after given operator approval. We analyse the CMS downtime in the 2018 run focusing on what was improved with the introduction of automated recovery; present challenges and design of encoding the expert knowledge into automated recovery jobs. Furthermore, we demonstrate the web-based, ReactJS interfaces that ensure an effective cooperation between the human operators in the control room and the automated recovery system. We report on the operational experience with automated recovery.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Safety evaluation of connected and automated vehicles in mixed traffic with conventional vehicles at intersections

Connected and Automated Vehicles (CAVs) can potentially improve the performance of the transportation system by reducing human errors. This paper investigates the safety impact of CAVs in a mixed traffic with conventional vehicles at intersections. Analyzing real-world AV crashes in California revealed that rear-end crashes at intersections are the dominant crash type. Therefore, to enhance our understanding of the future interactions between human-driven vehicles with CAVs at intersections, a simulation framework was developed to model the mixed traffic environment of Automated Vehicles (AV), cooperative AVs, and conventional human-driven vehicles. In order to model AVs driving behavior, Adaptive Cruise Control (ACC) and cooperative ACC (CACC) models are utilized. Particularly, this study explores system improvements due to automation and connectivity across varying CAV market penetration scenarios. ACC and CACC car following models are used to mimic the behavior of AVs and cooperative AVs. Real-world connected vehicle data are utilized to modify and tune the acceleration/deceleration regimes of the Wiedemann model. Next, the driving volatility concept capturing variability in vehicle speeds was utilized to calibrate the simulation to represent the safety performance of a real-world environment. Two surrogate safety measures are used to evaluate the safety performance of a representative intersection under different market penetration rate of CAVs: the number of longitudinal conflicts and driving volatility. At low levels of ACC market penetration, the safety improvements were found to be marginal, but safety improved substantially with more than 40% ACC penetration. Additional safety improvements can be achieved more quickly through the addition of cooperation and connectivity through CACC. Furthermore, ACC/CACC vehicles were found to improve mobility performance in terms of average speed and travel time at intersections.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Qualitative and Quantitative Evaluation for Representative Human Reliability Analysis Methods

The Korea Institute of Nuclear Safety (KINS) is the regulatory expert organization established by the Korean government to strengthen the nation’s technical capabilities relating to nuclear safety regulation. KINS oversees the technical aspects of nuclear safety regulation, including safety reviews, inspections, education, and safety research—all conducted based on technical knowledge and accumulated regulatory experience. In 2023, KINS requested that Idaho National Laboratory (INL) validates representative human reliability analysis (HRA) methods used throughout the world, thus affording KINS with a basis for determining an HRA method adequate for its domestic regulatory purposes. The present paper mainly examines INL’s efforts in this regard. The resulting INL study covered four representative HRA methods widely used by nuclear utilities and regulatory institutes. These methods were qualitatively evaluated by applying specific evaluation criteria and determining how well each method reflected critical HRA issues. For this assessment, INL benchmarked the Halden International HRA Empirical Study. Using the Halden empirical data, along with information on human failure events (HFEs), the present study employed the selected HRA methods to estimate human error probabilities (HEPs) for the HFEs. It also performed statistical analyses to compare the HEPs predicted via the HRA methods against those from the Halden empirical data.

99 - GENERAL AND MISCELLANEOUS↗

Ecological Adaptive Cruise Control of Plug-In Hybrid Electric Vehicle With Connected Infrastructure and On-Road Experiments

Abstract This paper examines both mathematical formulation and practical implementation of an ecological adaptive cruise controller (ECO-ACC) with connected infrastructure. Human errors are typical sources of accidents in urban driving, which can be remedied by rigorous control theories. Designing an ECO-ACC is, therefore, a classical research problem to improve safety and energy efficiency. We add two main contributions to the literature. First, we propose a mathematical framework of an online ECO-ACC for plug-in hybrid electric vehicle (PHEV). Second, we demonstrate ECO-ACC in a real world, which includes other human drivers and uncertain traffic signals on a 2.6 (km) length of the corridor with eight signalized intersections in Southern California. The demonstration results show, on average, 30.98% of energy efficiency improvement and 8.51% additional travel time.

Automation & Control Systems↗

EXTRACTING HUMAN RELIABILITY FINDINGS FROM HUMAN FACTORS STUDIES IN THE HUMAN SYSTEMS SIMULATION LABORATORY

Modernization of U.S. nuclear power plants (NPPs) is widespread, with most plants currently replacing and transitioning equipment, control systems, and human system interfaces (HSI)s from analog to digital displays. This conversion remedies the obsolescence of analog parts along with needs for increased intuitiveness of design, safety, and capabilities. The Human Factors and Reliability team at Idaho National Laboratory (INL) carried out twelve control room modernization studies in the newly designed Human Systems Simulation Laboratory (HSSL) over nine years. The HSSL was constructed as a testbed for evaluating human factors techniques and performance measures, HSI frameworks, and cutting-edge operational concepts in NPPs. Installing a full-scope training simulator enabled direct design and evaluation work on the same instrumentation and control (I&C) and HSIs located at U.S. plants. The subsequent addition of glass top bays afforded crews opportunities to implement operations via the simulator using full-scale representations of their home NPP. Additionally, functional HSI prototypes were created, providing an environment for operator-in-the-loop benchmark studies. The HSSL has assisted in upgrades of six commercial NPP control rooms and served as an invaluable proving ground for new NPP operations technology. Human reliability analysis (HRA) was not originally the focus of the studies; however, data relating to HRA such as type and frequency of human errors can be extracted from the studies. INL is currently extracting data from the HSSL study reports to apprise how information gathered from simulation, HSI, and other related studies can create a broad look across different data sources to help inform HRA methods.

99 GENERAL AND MISCELLANEOUS↗

Modular Autonomous Experimentation for Biological Applications

The Modular Autonomous Research System (MARS) was created to address a key challenge in scientific discovery: experiments are often slow, require significant manual labor, and generate data that is not easily integrated across different tools. This limits how quickly scientists can explore new materials, processes, and chemical reactions. Our motivation was to design a system that makes research faster, more reliable, and adaptable by combining automation with artificial intelligence. By doing so, we aimed to reduce human error, accelerate discovery, and allow researchers to quickly test many possibilities that would otherwise take months or years. Our approach was to build a flexible platform that connects laboratory robots, measurement instruments, and a central data system, all guided by artificial intelligence. MARS integrates liquid handling robots, robotic arms, and plate readers with an intelligent decision-making system that chooses the most informative experiments to run next. This creates a closed loop where experiments are performed automatically, the data is analyzed in real time, and new conditions are immediately tested. Through this work, we demonstrated that MARS can carry out multiple experiments with little or no human intervention, adapt to different scientific problems, and handle uncertain or noisy measurements in a robust way. The results show that modular and intelligent automation can significantly accelerate the pace of discovery, providing a model for future self-driving laboratories. This approach addresses the growing scientific need for adaptable, data-driven research platforms that can keep up with the complexity and scale of modern science.

59 BASIC BIOLOGICAL SCIENCES↗

Procedure Parsing: A Method for Parsing Handwritten Documents into Computer-Based Procedures

The nuclear industry is heavily procedure driven, where almost everything has a step-by-step instruction that is expected to be followed in detail. Historically, these procedures were printed on paper copies. Recently, the industry transitioned towards electronic copies (i.e., PDFs on tablets). One major drive for this transition is the introduction of human error and loss of situation awareness when using paper copies. However, electronic copies of documents inherently have the same error traps as their paper cousins. Therefore, there is an increased interest in a way to utilize the information in the step-by-step guidance, but to present it in a dynamic manner that guides the user and adapts to any encountered conditions. Researchers at Idaho National Laboratory propose a flexible, automated method based on document parsing and augmented by natural language processing (NLP) techniques, to address these shortcomings and capitalize on these recent advancements in machine learning. The proposed method provides a cost-effective solution for computer-assisted procedure parsing of hand-written control room procedures, originally authored in Word or PDF formats, into instructions that can be displayed as computer-based procedures (CBP) in a modern graphical user interface. The researchers devised, implemented and demonstrated the Operating Procedure Extender for Novel Systems (OPENS) method in 2020. The key to OPENS is to map the original procedure text into a context-free grammar, tying content to equipment, locations, and other steps, actions, etc. This formal grammar is then used to isolate and define keywords and actions verbs, such as “measure” or “evaluate” and tie them to specific equipment referenced within that step or located in other steps, substeps, actions, subactions and tables throughout the procedure. OPENS generates an abstract syntax tree from the document which it uses to store a copy of this information in the open-standard, machine-readable and human-readable file formats XML and JSON. The XML is useful to preserve the relational aspects of the procedure for referencing tables and branching information so the user can be directed to the next appropriate active step based on the values entered for that step and previous steps. The JSON is useful for storing and exchanging data objects used to track responses to previous steps and state changes in simulated environments. In future iterations, these formats can also be used for storing more detailed information about input during plant operation or simulation. The techniques the researcher developed could further be improved by integration of recent advancements in machine learning. NLP methods could standardize documents, correct for grammatical error, and provide automated semantic validation. The researcher expects that self-supervised techniques applied to collections of natural language instructions could strengthen the model with broader context. All these methods together give us a practical way to automatically extract protocols from documents and user interactions, empowering researchers, procedure writers and nuclear operators while moving the industry forward.

99 GENERAL AND MISCELLANEOUS↗

A Comparison of Three Types of Computer-Based Procedures: An Experiment Using the Rancor Microworld Simulator

The nuclear power industry has historically used paper-based procedures, but a shift towards computer-based procedures (CBPs) has the potential to reduce human errors, alleviate mental workload, and improve work performance. Twenty-seven participants were randomly assigned to one of three CBP types using the Rancor Microworld Simulator, and each performed two different types of operational scenarios (startup and loss of feedwater). The three CBP types varied in levels of digitalization. It was hypothesized that there would be less favorable impressions of the most basic procedures, and that these would demonstrate lower usability than types with greater digitalization. Overall, our predictions were partially supported with some interesting caveats, specifically with some performance benefits for CBPs that provided indicators but not embedded controls. We discuss our findings in terms of optimal levels of digitalization/automation within nuclear operations and suggest pathways for future directions.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗