Search NASA⌕ Search

SEARCH · Search NASA

Results for “Performance (Human)”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

The HUNTER Dynamic Human Reliability Analysis Tool: Development of a Module for Performance Shaping Factors

Human Unimodel for Nuclear Technology to Enhance Reliability (HUNTER) is a framework to support dynamic human reliability analysis (HRA) in communication with a variety of methods and tools. In this paper, how we have developed one of the HUNTER modules, the individual module for evaluating performance shaping factors (PSFs), is introduced. The PSF refers to any factor that influences human performance such as workload or complexity. It has been used for highlighting human errors and adjusting the error probabilities in the existing HRA. We consider the eight PSFs suggested in the Standardized Plant Analysis Risk-HRA (SPAR-H) method, which is the representative HRA method widely used in the nuclear field. To support our dynamic modeling using the eight SPAR-H PSFs, we reviewed human performance literature and developed data-based mathematical models to rate and quantify PSFs in the context of dynamic HRA. We also design the individual module composed of the two functions: 1) the PSF qualification function that automatically or manually evaluates a PSF level, and 2) the PSF quantification function that dynamically or statically determines the PSF multiplier values and integrate them to adjust human error probabilities (HEPs). How each function works with the SPAR-H PSFs and how the PSFs adjust the HEPs are investigated through literature and discussed in this paper.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2022

The HUNTER Dynamic Human Reliability Analysis Tool: Development of a Module for Performance Shaping Factors

The Human Unimodel for Nuclear Technology to Enhance Reliability (HUNTER) is a framework to support dynamic human reliability analysis (HRA) in communication with a variety of methods and tools. This paper explores how we developed one of the HUNTER modules: namely, the Individual module for evaluating performance shaping factors (PSFs). A PSF is any factor that influences human performance (e.g., workload or complexity). In the existing HRA, they are used to highlight human errors and adjust error probabilities. We consider the eight PSFs suggested in the Standardized Plant Analysis Risk-HRA (SPAR-H) method, a representative HRA method widely used in the nuclear field. To support our dynamic modeling using the eight SPAR-H PSFs, we reviewed the human performance literature and developed data-based mathematical models to rate and quantify PSFs in the context of dynamic HRA. We also designed the Individual module to consist of two functions: (1) the PSF qualification function for automatically or manually evaluating PSF levels, and (2) the PSF quantification function for dynamically or statically determining PSF multiplier values and integrating them to adjust human error probabilities (HEPs). How each function works in regard to the SPAR-H PSFs, and how the PSFs serve to adjust the HEPs, were investigated via literature review and are discussed in this paper.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2023

Optimizing Information Automation Using a New Method Based on System-Theoretic Process Analysis: Tool Development and Method Evaluation

This report is an update to a prior report that describes progress and findings for a program of research supporting the design and optimization of information automation systems for nuclear power plants. Much of the domestic nuclear fleet is currently focused on modernizing technologies and processes, including transitioning toward digitalization in the control room and throughout the plant, along with a greater interest in the use of automation, artificial intelligence, robotics, and other emerging technologies. While there are significant opportunities to apply these technologies toward greater plant safety, efficiency, and overall cost-effectiveness, optimizing their design and avoiding potential safety and performance risks depends on ensuring that human performance-related organizational and technical design issues are identified and addressed early in the design process. This report describes modeling tools and techniques, based on sociotechnical systems theory, to support these design goals and their application in the current research effort. The report is primarily intended for senior nuclear energy stakeholders, including regulators, corporate management, and senior plant management. We have developed and employed a method to design an optimized information automation ecosystem (IAE) based on the systems-theoretic constructs underlying sociotechnical systems theory in general and the Systems-Theoretic Accident Modeling and Processes (STAMP) approach in particular. We argue that an IAE can be modeled as an interactive information control system whose behavior can be understood in terms of dynamic control, feedback, and communication relationships amongst the system’s technical and organizational components. We have employed two STAMP-based tools in this effort. The first is Causal Analysis based on STAMP (CAST), an accident and incident analysis technique that was used to examine a performance- and safety-related incident at an industry partner’s plant involving the unintentional activation of an emergency diesel generator. This analysis provided insight into the behavior of the plant’s current information control structure within the context of a specific, significant event. The second tool is Systems Theoretic Process Analysis (STPA) which is a proactive risk analysis tool used to examine existing and potential, planned sociotechnical systems. STPA was used to identify risk factors in the current design of a generic nuclear power plant (NPP) preventive maintenance system. Our analyses focused on identifying near-term system improvements and longer-term design requirements for an optimized IAE system. CAST analysis findings indicate an important underlying contributor to the incident under investigation, and a significant risk to information automation system performance, was perceived time and schedule pressure, which exposed weaknesses in interdepartmental coordination between and within responsible plant organizations and challenged the resilience of established plant processes, until a human caused the eventual event. These findings are discussed in terms of their risk to overall system performance and their implications for information automation system resilience and brittleness. STPA findings exposed several areas of concern in the design of current preventive maintenance systems. We also present two preliminary information automation models. The proactive issue resolution (PIR) model is a test case of an information automation concept with significant near-term potential for application and subsequent reduction in significant plant events. The IAE model is a more general representation of a broader, plantwide information automation system and represents an end-state vision for our work. From our results, we have generated an initial set of preliminary system-level requirements and safety constraints for these models. We have also focused on early development of easy to learn, easy to use “transportable” tools for sociotechnical systems analysis. We intend these to be used by NPP personnel as a means of gaining reliable and relatively quick insight into (1) sociotechnical systems factors impacting incidents and accidents, (2) potential sociotechnical risk factors in existing or planned system designs, and (3) potential weaknesses in a system’s safety and/or information control structure. We conclude the report with a set of summary recommendations, a discussion of planned and potential follow-on research and development, and a draft list of system-level requirements and safety constraints for optimized information automation systems.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2025

Confidence-weighted integration of human and machine judgments for superior decision-making

Large language models (LLMs) can surpass humans in certain forecasting tasks. What role does this leave for humans in the overall decision process? One possibility is that humans, despite performing worse than LLMs, can still add value when teamed with them. A human and machine team can surpass each individual teammate when team members’ confidence is well calibrated and team members diverge in which tasks they find difficult (i.e., calibration and diversity are needed). We simplified and extended a Bayesian approach to combining judgments using a logistic regression framework that integrates confidence-weighted judgments for any number of team members. Using this straightforward method, we demonstrated its effectiveness in both image classification and neuroscience forecasting tasks. Combining human judgments with one or more machines consistently improved overall team performance. Our hope is that this simple and effective strategy for integrating the judgments of humans and machines will lead to productive collaborations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

Identification of Performance Shaping Factor Lag and Linger Effects for Dynamic Human Reliability Analysis: Application of Experimental Data

Many researchers have emphasized the importance of dynamic probabilistic safety assessment (PSA), which highlights the necessity of studies for dynamic human reliability analysis (HRA). Dynamic HRA concentrates on a dynamic account of human actions or how performance shaping factors (PSFs) can dynamically modify the human error probability (HEP) over time. In contrast, existing static HRA does not consider human actions as changes over time or event progressions. Accordingly, previous research on dynamic HRA conceptually suggested PSF lag and linger effects to treat dependence between operator actions in dynamic HRA versus existing approaches. As follow-up research, this study attempted to identify PSF lag and linger effects for dynamic HRA on the basis of experimental data. Firstly, mathematical models for PSF lag and linger effects were developed based on a literature survey in the field of biology. Secondly, we analyzed experimental scenarios from a control room study to identify operator actions considered in PSA. Lastly, based on the experimental data, the effect of the stress PSF with lag and linger effects was compared to that without PSF lag and linger effects. This paper concludes with an overall discussion of PSF lag and linger effects based on the relation between the stress PSF and error occurrence.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2025

Bridging the Gap Between Modern UX Design and Particle Accelerator Control Room Interfaces

Accelerator control systems often represent relatively complex and safety-sensitive human-machine interfaces within process control industries. These systems are technically robust and reflect the cumulative integration of solutions built and adapted across decades. One of the regular, unfortunate casualties of provisional accelerator control system updates is their human-system interfaces (HSIs) which often lag behind modern usability and design standards. An additional challenge is that although there is a multitude of established human factors (HF), and user experience (UX) principles for everyday digital applications, there are very few (if any) established principles for complex and safety-critical applications for an accelerator. This paper argues for the importance of established HF and UX principles (herein referred to as human-centered design principles) into the development of accelerator HSIs, emphasizing the need for clarity, consistency, responsiveness, and cognitive accessibility. Drawing from HF/UX best practices and human-centered design, this paper discusses how these approaches can enhance operator performance, reduce human error, and improve accelerator personnel collaboration. Case studies from Accelerator Control Operations Research Network (ACORN) at Fermilab are explored to demonstrate how interfaces built with human-centered design principles can scale with system complexity while remaining intuitive and efficient for diverse user roles including operators, machine experts, and engineers. By bridging the gap between traditional control system design and modern human-centered design methods, this paper provides a roadmap for evolving accelerator HSIs into more usable, maintainable, and effective tools.

Hill, Rachael [Idaho Natl. Lab.]↗
DOE OSTI2025

Advanced Transmission Technologies – GETs and HPCs Session 1: ATT Foundations and Dynamic Line Ratings (DLRs)

The INL TADA GETs Cohort Session 1, held on November 4, 2025, convened experts to address the integration of advanced transmission technologies, including Grid-Enhancing Technologies (GETs) and High Performance Conductors (HPCs), with a focus on digital assurance challenges. The session highlighted the growing importance of cybersecurity, supply chain transparency, reliability, and business risk management in deploying GETs, especially Dynamic Line Ratings (DLRs). Participants examined how expanded attack surfaces, limited vendor pools, and new regulatory requirements—such as FERC Orders 881, 2023, and 1920—are influencing utilities and technology providers. The workshop underscored the need for cyber-informed engineering, secure-by-design principles, and practical risk management strategies, while fostering collaboration and knowledge sharing among industry peers. Technical discussions covered the evolution from static to dynamic line ratings, complexities of cloud-based architectures, and NERC CIP compliance challenges. The session concluded with a collaborative risk exercise and a preview of future workshops on advanced power flow control and transmission topology optimization, reinforcing the cohort’s commitment to advancing digital assurance in the energy sector.

24 - POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Human Health Risk Assessment for Improper Landfill Disposal of End-of-Life CdTe PV

The present work is a continuation of the 2020 IEA PVPS Task 12 Human Health Risk Assessment Methods for PV Part 3: Module Disposal Risks. The 2020 report performed a human health risk assessment (HHRA) for disposal of a cadmium telluride (CdTe) PV module in an unlined landfill, focusing solely on risks from cadmium. This study extends the 2020 HHRA on CdTe PV, analyzing eleven constituent elements: Cd, Se, Te, Cu, Si, Cr(III), Mo, Sn, Zn, Ni, and Al. The present HHRA was performed through two methods: utilization of the U.S. Environmental Protection Agency's (USEPA) Delisting Risk Assessment Software (DRAS V.4.0) on eight exposure pathways for cancer risk and non-cancer hazards; and comparison of exposure point concentrations to federal standards for groundwater, surface water, air, and soil exposure pathways. Cancer risks and non-cancer hazards posed by elemental leaching through all evaluated exposure pathways, using both methods, were found to be several orders of magnitude below USEPA health-protective thresholds. Cadmium exhibited both the highest risks and lowest uncertainty considering data availability on chemical content, leachate, and federal screening levels.

chemicals↗
DOE OSTI2024

Human Health Risk Assessment for Improper Landfill Disposal of End-of-Life CdTe Modules

The present work is a continuation of the 2020 IEA PVPS Task 12 Human Health Risk Assessment Methods for PV Part 3: Module Disposal Risks. The 2020 report performed a human health risk assessment (HHRA) for disposal of a cadmium telluride (CdTe) PV module in an unlined landfill, focusing solely on risks from cadmium. This study extends the 2020 HHRA on CdTe PV, analyzing eleven constituent elements: Cd, Se, Te, Cu, Si, Cr(III), Mo, Sn, Zn, Ni, and Al. The present HHRA was performed through two methods: utilization of the U.S. Environmental Protection Agency's (USEPA) Delisting Risk Assessment Software (DRAS V.4.0) on eight exposure pathways for cancer risk and non-cancer hazards; and comparison of exposure point concentrations to federal standards for groundwater, surface water, air, and soil exposure pathways. Cancer risks and non-cancer hazards posed by elemental leaching through all evaluated exposure pathways, using both methods, were found to be several orders of magnitude below USEPA health-protective thresholds. Cadmium exhibited both the highest risks and lowest uncertainty considering data availability on chemical content, leachate, and federal screening levels.

CdTe↗
DOE OSTI2021

Systematic Enterprise Risk Management by Integrating the RISMC Toolkit and Cost-Benefit Analysis (Final Report)

The goal of this research is to theorize and quantify the relationships between safety and the financial performance of nuclear power plants (NPPs). The Socio-Technical Risk Analysis (SoTeRiA) theoretical framework, which connects the social aspects (e.g., safety culture) and structural features (e.g., safety practices) of an organization with organizational safety and financial risks, is used to theorize the direct and indirect relationships between safety and the financial performance of NPPs. An Integrated Enterprise Risk Management (I-ERM) methodological framework is developed to operationalize SoTeRiA to quantify NPP safety and financial performance in a unified platform where their underlying physical degradation mechanisms, coupled with maintenance performance (considering human and organizational factors), are explicitly incorporated to depict the interconnections and dependencies between safety and financial performance. In this study, NPP safety refers to both occupational safety and system safety (estimated from Probabilistic Risk Assessment, PRA), and financial performance refers to the monetary values associated with NPP operation and maintenance (O&M) strategies. This report covers a case study demonstrating the feasibility of the I-ERM methodological framework. More detailed development of one of the I-ERM modules, i.e., Probabilistic Physics-of-Failure (PPoF) analysis, and its connection with other I-ERM modules is demonstrated in a second case study. The outcome of this research will help NPP decision-makers create cost-saving maintenance strategies while maintaining safety by providing cost- and risk-informed recommendations regarding maintenance work processes and operational strategies.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2026

From Rules to Reasoning: A Survey of Large Language Model-Based Approaches to Scientific Hypothesis and Idea Generation

Scientific hypothesis generation represents a fundamental challenge in contemporary research due to exponentially expanding literature volumes and increasing disciplinary specialization. Large language models (LLMs) have emerged as transformative tools for automated scientific discovery, moving beyond traditional rule-based and literature-mining approaches. Four paradigmatic approaches define current LLM-driven hypothesis generation: direct prompting and fine-tuning methods, knowledge-enhanced frameworks integrating retrieval-augmented generation (RAG), multi-agent collaborative systems simulating research teams, and reasoning-focused approaches implementing cognitive architectures. Domain-specific applications demonstrate statistical equivalence to human expert performance in social psychology, experimental validation in biomedical research, and near-expert quality in astronomy. Evaluation methodologies encompass human expert assessment, LLM-as-judge frameworks, and comprehensive benchmarking systems. Technical challenges include hallucination management, knowledge integration limitations, and balancing novelty with feasibility. Future directions emphasize hybrid neural-symbolic architectures and sophisticated human-AI collaboration models for responsible scientific discovery acceleration.

AI-driven discovery↗
DOE OSTI2022

EFCOG Best Practice HPI for Knowledge Workers ISM-HPI-22-02

This document is a collection of these best practices as determined by team members. This best practice attempts to: Realize opportunities to break the myth where people believe that HPI does not apply to them as they perform no physical work. Recommend options to create an environment that promotes intellectual collaboration and trust, enabling candor and vulnerability. Explain how errors manifest differently from the same human fallibility. Knowledge workers (KW) have errors that take different perspectives to find and mitigate the unique manifestation of these conditions. Help KW identify the critical steps (or risk important steps) in their processes. Reduce risk/consequence from KW errors (limit latent errors as well as finding latent conditions), building resiliency into KW tasks. Mitigation strategies may be different.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2022

Report on PTT Imaging of Defects in AM Metallic Materials-Part 2

Metal Additive Manufacturing (AM) is a promising method for cost-efficient fabrication of complex shape structures for applications in harsh environment, such as in a nuclear reactor. However, internal defects (pores) occur in high-strength AM alloys, which are manufactured with Laser Powder Bed Fusion (LPBF) AM method. Pulsed Infrared Thermography (PIT) is an efficient nondestructive evaluation (NDE) method to examine actual structures, because this method offers one-sided non-contact measurements, and fast processing of large sample areas. However, imaging of material defects, particularly defects with sizes at microscopic level, is challenging. In this report, we benchmark the performance of several Unsupervised Learning (UL) algorithms designed to enhance imaging of microscopic defects in metals with PIT. UL aims to learn the latent principal patterns (dictionaries) in PIT data to detect defects with minimal human supervision. Performance of Independent Component Analysis (ICA), Sparse Coding (SC), Principal Component Analysis (PCA) and Exploratory Factor Analysis (EFA) was compared using F-score, UL model training time and defects reconstruction time. We obtained the average F-score of 0.75, and a highest F-score of 0.89 for the EFA algorithm. Overall, EFA outperforms other UL algorithms considered in this study.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Pulsed Thermal Tomography Nondestructive Examination of Additively Manufactured Reactor Materials and Components (Final Technical Report)

Metal Additive Manufacturing (AM) is a promising method for cost-efficient fabrication of complex shape structures for applications in harsh environment, such as in a nuclear reactor. However, internal defects (pores) occur in high-strength AM alloys, which are manufactured with Laser Powder Bed Fusion (LPBF) AM method. Pulsed Infrared Thermography (PIT) is an efficient nondestructive evaluation (NDE) method to examine actual structures, because this method offers one-sided non-contact measurements, and fast processing of large sample areas. However, imaging of material defects, particularly defects with sizes at microscopic level, is challenging. In this report, we benchmark the performance of several Unsupervised Learning (UL) algorithms designed to enhance imaging of microscopic defects in metals with PIT. UL aims to learn the latent principal patterns (dictionaries) in PIT data to detect defects with minimal human supervision. Performance of Independent Component Analysis (ICA), Sparse Coding (SC), Principal Component Analysis (PCA) and Exploratory Factor Analysis (EFA) was compared using F-score, UL model training time and defects reconstruction time. We obtained the average F-score of 0.75, and a highest F-score of 0.89 for the EFA algorithm. Overall, EFA outperforms other UL algorithms considered in this study. In another approach, we investigate Thermal Tomography (TT), which is a computational method for reconstruction of depth profile of internal material defects from PIT nondestructive evaluation (NDE). TT algorithm obtains depth reconstructions of thermal effusivity, which has been shown to provide visualization of subsurface internals defects in metals. In many applications, one needs to determine the defect shape and orientation from reconstructed effusivity images. Interpretation of TT images is non-trivial because of blurring, which increases with depth due to heat diffusion-based nature of image formation. We have developed a deep learning convolutional neural network (CNN) to classify size and orientation of subsurface material defects in TT images. CNN was trained with TT images produced with computer simulations of 2D metallic structures (thin plates) containing elliptical subsurface voids. Performance of CNN was investigated using test TT images developed with computer simulations of plates containing elliptical defects, and defects with shape imported from scanning electron microscopy (SEM) images. CNN demonstrated the ability to classify radii and angular orientation of elliptical defects in previously unseen test TT images. We have also demonstrated that CNN trained on TT images of elliptical defects is capable of classifying shape and orientation of irregular defects. Training the CNN on irregular defect shapes instead of on elliptical shapes would make the resulting classifications more descriptive of actual defect shapes. However, this requires a much higher volume of SEM images of material defects, which are difficult to obtain because of random occurrence of defects in LPBF. To address this challenge, we developed a generative adversarial network (GAN) to augment the existing dataset of SEM defect images. The GAN model is demonstrated to create novel yet realistic defect shapes that can be used as input for simulated PTT images to train CNN. We also investigate several approaches based on Gaussian Random Circle and Bezier Curves for constructing parametric models of irregular-shape defects.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Artificial Intelligence Application to D and D - 20492

As aging facilities across the DOE complex await decommissioning, there is an ongoing need to understand any changes in the structural conditions. Many of these facilities were built over 50 years ago and, in some cases, these facilities have gone beyond the expected operational lifetime. Many facilities have been placed in a state of 'cold and dark,' sitting unused and awaiting decommissioning. Especially challenging are the aging facilities that provide unique operational/production capabilities to support critical DOE missions and cannot be shut down. In any of these scenarios, the structural integrity of these facilities may become compromised as time passes. It is critical that adequate inspections be performed on a continual basis and that the data collected undergoes sufficient analysis to support timely identification of any new or worsening structural issues as well as prompt needed maintenance and repairs to maintain the facilities in a safe condition. In recent days, Artificial Intelligence (AI) [1] and its application to various domains are growing at fast speed. FIU is performing research in this area and exploring the associated technologies to solve nuclear decommissioning problems. Artificial intelligence refers to the capability of a program to autonomously act, react and adapt to the working environment. AI enables the machine to behave like humans and perform the cognitive functions such as 'learning' and 'problem solving'. AI systems gradually moving from traditional approaches (algorithms and expert systems) towards more efficient and advanced technologies (machine learning [1] and deep learning [2] [3]). AI is the study of algorithms and statistical models that is being used by computers to perform specific tasks without using explicit instructions. FIU is working to develop a pilot-scale infrastructure to implement structural health monitoring using AI technologies with focus on machine learning, deep learning. This research is focused on Computer Vision/Image Classification area of AI applications. This can also be expanded to other areas of AI related to Object Recognition and Character Recognition in images. In addition to utilizing existing data sets, FIU will collect and investigate image and video data using FIU test-bed mockups to monitor structural health of the facility. Resulting data will be processed and analyzed using machine learning/deep learning technologies. The proposed pilot system is intended to serve as a starting point to engage the DOE field sites on related data sets and their decision making needs. It is anticipated that proposed machine learning/deep learning technologies can be effectively employed using anomaly detection to solve EM challenges in surveillance and maintenance of the D and D facilities. FIU will work with research stakeholders to identify applications at various sites and other DOE facilities. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗