Search NASA⌕ Search

SEARCH · Search NASA

Results for “Human Factors Evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Implications of Safety and Operational Features of Small, Advanced Reactors for the Evaluation of Important Human Actions

The design and operational characteristics of non-light water reactors are likely to change the role of human actions in safety function management and the types of human actions that are deemed important. The objectives of this report are to: • Identify the implications of small, advanced reactor design characteristics on human performance and the changing role of human actions in the management of safety functions. • Identify the methods that may be used to identify important human actions. • Identify how HFE safety reviewers can help ensure that the methods adequately model human actions to identify those that are important to safety. We identified the implications of small, advanced reactor characteristics on the role of personnel in safety function management. Then we addressed how designers can identify which human actions are important to safety using both probabilistic risk assessment (PRA) and deterministic analyses. PRA identifies important human actions using risk-importance criteria. Deterministically identified important human actions include those identified by analyses of situations such as transients and accidents and defense in depth. In all cases, the acceptability of the analyses is dependent on the modeling, quantification, and criterion selection to determine which human actions are important. How well the designers address these processes determines the acceptability of their methodology.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

The HUNTER Dynamic Human Reliability Analysis Tool: Development of a Module for Performance Shaping Factors

The Human Unimodel for Nuclear Technology to Enhance Reliability (HUNTER) is a framework to support dynamic human reliability analysis (HRA) in communication with a variety of methods and tools. This paper explores how we developed one of the HUNTER modules: namely, the Individual module for evaluating performance shaping factors (PSFs). A PSF is any factor that influences human performance (e.g., workload or complexity). In the existing HRA, they are used to highlight human errors and adjust error probabilities. We consider the eight PSFs suggested in the Standardized Plant Analysis Risk-HRA (SPAR-H) method, a representative HRA method widely used in the nuclear field. To support our dynamic modeling using the eight SPAR-H PSFs, we reviewed the human performance literature and developed data-based mathematical models to rate and quantify PSFs in the context of dynamic HRA. We also designed the Individual module to consist of two functions: (1) the PSF qualification function for automatically or manually evaluating PSF levels, and (2) the PSF quantification function for dynamically or statically determining PSF multiplier values and integrating them to adjust human error probabilities (HEPs). How each function works in regard to the SPAR-H PSFs, and how the PSFs serve to adjust the HEPs, were investigated via literature review and are discussed in this paper.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2022

The HUNTER Dynamic Human Reliability Analysis Tool: Development of a Module for Performance Shaping Factors

Human Unimodel for Nuclear Technology to Enhance Reliability (HUNTER) is a framework to support dynamic human reliability analysis (HRA) in communication with a variety of methods and tools. In this paper, how we have developed one of the HUNTER modules, the individual module for evaluating performance shaping factors (PSFs), is introduced. The PSF refers to any factor that influences human performance such as workload or complexity. It has been used for highlighting human errors and adjusting the error probabilities in the existing HRA. We consider the eight PSFs suggested in the Standardized Plant Analysis Risk-HRA (SPAR-H) method, which is the representative HRA method widely used in the nuclear field. To support our dynamic modeling using the eight SPAR-H PSFs, we reviewed human performance literature and developed data-based mathematical models to rate and quantify PSFs in the context of dynamic HRA. We also design the individual module composed of the two functions: 1) the PSF qualification function that automatically or manually evaluates a PSF level, and 2) the PSF quantification function that dynamically or statically determines the PSF multiplier values and integrate them to adjust human error probabilities (HEPs). How each function works with the SPAR-H PSFs and how the PSFs adjust the HEPs are investigated through literature and discussed in this paper.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2023

Discerning Deception: An Empirically-Driven Agent-Based Model of Expert Evaluation of Scientific Content

Both human subject experiments and computational, modeling and simulations have been used to study detection of deception. This work aims to combine these two methods by integrating empirically-derived information (from human subject experiments) into agent-based models to generate novel insights into the complex problems of detection of disinformation content. Computational experiments are used to simulate across multiple scenarios for evaluation and decision-making regarding the validity of potentially deceptive scientific documents. Factors influencing the human agent behaviors in the model were identified through a human subject experiment that was conducted to evaluate and characterize decision making related to disinformation discernment. Correlation and regression analyses were used to translate insights from the human subjects experiment to inform the parameterization of agent features and scenario development. Three scenarios were evaluated with the agent-based models to help evaluate the replicability of the simulations (validation analysis) and assess the influence of human agent and document features (sensitivity analyses). A replication of the human participant experiment demonstrated that the agent-based simulations compare favorably to empirical findings. The agent-based modeling was then used to conduct sensitivity analysis on the accuracy of deception detection as a function of document proportions and human agent features. Results indicate that precision values are adversely impacted when the proportion of deceptive documents is lower in the overall sample, whereas recall values are more sensitive to changes in human agent features. These findings indicate important nuances in accuracy evaluations that should be further considered (including consideration of potential alternate metrics) in future agent-based models of disinformation. Additional areas for future exploration include extension of simulations to consider other ways to align the agent-based model design with psychological theory and inclusion of agent-agent interactions, especially as it pertains to sharing of scientific information within an organizational context.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2025

Important Human Actions for Advanced Reactors: Implications for Human Factors

As advanced reactor platforms continue to develop and gain traction in the energy sector there is a need for risk-informed, scalable regulations that match that progress. This is a core component of the U.S. Nuclear Regulatory Commission’s proposed Part 53 Rule Making; the Accelerating Deployment of Versatile, Advanced Nuclear for Clean Energy (ADVANCE) Act; and other efforts that seek to update nuclear power regulations. This paper covers one key aspect of that regulatory evolution: Important Human Actions (IHA). In this paper, we discuss how the understanding and definitions of IHAs have changed and what that means for human factors engagement through the process of developing these technologies. Instead of a narrow focus on control actions that led to an increase in core damage risk, the new focus is on IHAs is “wherever they occur.” What this means is that having a highly automated or passive safety system does not eliminate IHAs. Rather, it shifts the focus point to all the actions that enable these systems. Everything from maintenance, to design, to training can be considered an IHA and that dramatically shifts the efforts and level of engagement necessary for human factors to enable these technologies. We discuss the notions of risk-informed human factors that underpin these efforts, give several examples, and briefly describe the risk assessment methodologies that will be needed. In the past, IHAs were identified and then became a focus point of human factors engineering (HFE) activities to ensure a robust evaluation of the task was completed. The future is less clear. HFE for nuclear energy will need to evolve and become more integrated in technology development than ever before.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

A Methodology for Evaluating Operator Usage of Machine Learning Recommendations for Power Grid Contingency Analysis

This work presents the application of a methodology to measure domain expert trust and workload, elicit feedback, and understand the technological usability and impact when a machine learning assistant is introduced into contingency analysis for real-time power grid simulation. The goal of this framework is to rapidly collect and analyze a broad variety of human factors data in order to accelerate the development and evaluation loop for deploying machine learning applications. We describe our methodology and analysis, and we discuss insights gained from a pilot participant about the current usability state of an early technology readiness level (TRL) artificial neural network (ANN) recommender.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Experimental Analysis of the Effects of Simulator Complexity on Human Performance

Human Reliability Analysis predicts accidents caused by human errors and is an important factor in Probabilistic Safety Assessment that comprehensively evaluates the safety of nuclear power plants. This study compares and analyzes the human performance of nuclear power plant operators according to the simulator complexity as part of the HRA data collection support method development project conducted by Idaho National Laboratory. This experiment was conducted by setting two types of simulators and scenarios as independent variables. The data collected by conducting the experiments in two different simulators were analyzed using an analysis of variance test and a correlation analysis, and four human performance charts were derived.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2022

A SIMPLE TOOL TO EVALUATE COLOR FOR LEGIBILITY AND DISTINGUISHABILITY WHEN DESIGNING DIGITAL DISPLAYS

Color is important in helping users effectively process information like text and symbols when performing tasks on digital displays. Interface designers in safety- and mission-critical industries often utilize human factors design guidelines and standards to make important design decisions like the use of color for legibility and distinguishability. However, such guidance sometimes requires additional interpretation and calculation to readily apply to the design question at hand. This work describes a simple tool that can be used to evaluate the adequacy of color choices from a palette for being legible or distinguishable. The tool eliminates having to manually convert colors to a readable format while providing a specific set of colors that are acceptable from select human factors standards. This paper provides an exemplary case study applied to a digital modification at a nuclear power plant to highlight how the tool may be used in safety and mission-critical industries.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2021

Dynamic Human-in-the-Loop Simulated Nuclear Power Plant Thermal Dispatch System Demonstration and Evaluation Study

An Idaho National Laboratory research team performed a human-in-the-loop study with two formerly licensed retired operators to evaluate thermal power dispatch operations supported by the modified GSE Systems GPWR plant simulator. Virtual representations of the analog control panels were presented on touch-screen bays configured to mimic the control room layout in the newly renovated Human Systems Simulation Laboratory. The operators performed 15 scenarios covering normal evolutions to transition the plant from full turbine operation to joint turbine and thermal power dispatch operations in addition to transient response scenarios induced with simulated faults to evaluate the impact of thermal power dispatch system on operator and plant responses. A prototype human-system interface (HSI) was developed and displayed in tandem with the virtual analog panels to support the operators executing the procedurally drive evolutions and transient responses. An interdisciplinary team of operations experts, nuclear engineers, and human factors experts observed the operators performing the scenarios to evaluate the operations. Only a preliminary analysis of the results has been performed. The full analysis will be shared in a milestone report scheduled for release at the end of September; however, some high-level conclusions were readily available. Two high level findings for the system design were captured in the study. The manual control supported by the HSI to transition from standard operations to thermal power dispatch operation imposed a considerable amount of workload on the operators due to tedious manual valve manipulations and system monitoring required to verify their intended effect. An additional operator would be required in the control room to support the daily evolution. Automatic control for the transition was deemed a requirement for plant adoption without imposing additional staffing costs. The second finding was the necessity for an automatic thermal power dispatch system trip isolation function linked to a turbine and reactor trip signal. The operators completed scenarios with automatic isolation functionality and manually required actuation of the thermal power dispatch system. The operator response was sufficiently slower in the manual trip condition, such that operators were unable to manually actuate key post trip safety functions an indicate a degraded control capability that should be avoided. With an automatic trip signal little to no impact of the thermal power dispatch system was identified on the primary plant response and therefore the system could be readily and safely adopted. Together these two findings represent the need to support the adoption of thermal power dispatch capability into existing operations by leveraging automation to augment any additional operator tasking required to control and monitor an additional system beyond existing operations.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2024

Activity-Based Protein Profiling to Probe Relationships between Cytochrome P450 Enzymes and Early-Age Metabolism of Two Polycyclic Aromatic Hydrocarbons (PAHs): Phenanthrene and Retene

A growing body of literature has linked early life exposures to polycyclic aromatic hydrocarbons (PAH) with adverse neurodevelopmental effects. Once in the body, metabolism serves as a powerful mediator of PAH toxicity by bioactivating and detoxifying PAH metabolites. Since enzyme expression and activity varies considerably throughout human development, we evaluated infant metabolism of PAHs as a potential contributing factor to PAH susceptibility. Here, we measured and compared rates of phenanthrene and retene (two primary PAH constituents of woodsmoke) metabolism in human hepatic microsomes from individuals ≤21 months of age to a pooled sample (n = 200) consisting primarily of adults. We used activity-based protein profiling (ABPP) to characterize cytochrome P450 enzymes (CYPs) in the same hepatic microsome samples. Once incubated in microsomes, phenanthrene demonstrated rapid depletion. Best fit models for phenanthrene metabolism demonstrated either 1 or 2 phases, depending on the sample, indicating that multiple enzymes could metabolize phenanthrene. We observed no statistically significant differences in phenanthrene metabolism as a function of age, although samples from the youngest individuals had the slowest phenanthrene metabolism rates. We observed slower rates of retene metabolism compared to phenanthrene also in multiple phases. Rates of retene metabolism increased in an age-dependent manner until adult (pooled) levels were achieved at ~12 mo. ABPP identified 28 unique CYPs among all samples, and we observed lower amounts of active CYPs in individuals ≤21 months of age compared to the pooled sample. Phenanthrene metabolism correlated to CYPs 1A1, 1A2, 2C8, 4A22, 3A4, and 3A43 and activities and retene metabolism correlated to CYPs 1A1, 1A2, and 2C8 activities measured by ABPP and vendor-supplied substrate marker activities. These results will aid efforts to determine human health risk and susceptibility to PAHs exposures during early life.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Role of uncertainties in protecting ecological resources during remediation and restoration

Cleanup of contaminated waste sites is a National priority to protect human health and the environment, while restoring land to productive uses. While there are uncertainties with under standing risk to individuals from exposure, the aim of this study was to focus on uncertainties and complexities for ecological systems, complicated by hundreds of species occupying any remediation site which participate in multiple-interacting food webs. The ability to better predict the effectiveness of remediation in fostering future ecosystems might facilitate remedy selection and improve strategic environmental management. This investigation examined (1) uncertainties in ecosystem processes, (2) uncertainties in exposure from contamination before remediation, and (3) uncertainties during remediation. Two Department of Energy sites Hanford Site and Savannah River Site were used as case studies to illustrate how the uncertainties affect eco-receptors. Several types of ecological, physical, and human dimension uncertainties are defined. Ecological uncertainties include temporal, spatial, individual, developmental, and exogenous types. Physical uncertainties are weather-related, watershed variations, slope/aspect, soil/sediment structure and form, unforeseen events, and temporal patterns. Human dimension uncertainties include current land use, future land use, extractive and non-extractive recreation. The effects of remedial strategies varied between the two sites because Hanford is a primarily arid shrub-steppe ecotype, while Savannah River is a wet forest ecotype. Defining the associated ecological sensitivities and uncertainties and providing examples might help policy-makers, managers, planners, and contractors to be aware of issues to consider throughout planning, remediation, and restoration. Adding ecological uncertainty analysis to risk evaluations and remediation planning is analogous to using safety factors in human health risk assessment.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2025

Yes, No, Maybe So: Human Factors Considerations for Fostering Calibrated Trust in Foundation Models Under Uncertainty

High-stakes analytical environments require analysts to evaluate evidence and generate conclusions to inform critical decisions often under conditions of uncertainty. Probabilistic decision-making based on incomplete or inaccurate information can reduce productivity, compromise national interests, and endanger public safety. Researchers are developing expert systems built on foundation models (FMs) to support analysts’ decision-making processes by enabling human-artificial intelligence (AI) teaming, in part through the quantification and expression of uncertainty information. As FMs continue to mature, it is imperative to correspondingly consider analysts’ needs for appropriately interpreting and using uncertainty information. However, prior research indicates that it remains unclear how analysts engage with FM-generated uncertainty information and the extent to which these interactions influence trust in, and reliance on, expert systems. We plan to review the state of the science and conduct an exploratory, qualitative study to (a) understand how properly communicated uncertainty can foster calibrated trust and appropriate reliance and (b) identify approaches for effectively conveying FM-generated uncertainty information during analytical workflows. We will administer semi-structured interviews with analysts from a specific high-stakes analytical environment to collect their current experiences with job-related uncertainty and their impressions when viewing FM-generated uncertainty information. During the interview protocol, participants will be presented with several different FM outputs and invited to discuss their thoughts and beliefs about the uncertainty information displayed. Participants may provide insights into how trust and reliance may be influenced by uncertainty. The results of this study will help us to better understand how analysts currently interpret and use uncertainty information. Our findings may inform human factors recommendations for effectively conveying uncertainty information to foster calibrated trust in, and appropriate reliance on, expert systems. Interaction designers and FM developers can use this knowledge to enhance human-AI teaming and ensure the responsible deployment of FM-based expert systems in analytical workflows.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

The Technical, Economic, Risk, and Adoption Assessment for Evaluating Work Reduction Opportunities in the Nuclear Industry

Automation and cost-saving initiatives, such as process automation with advances in artificial intelligence, are gaining traction in modernization efforts across the nuclear industry. As these innovations are increasingly adopted, it becomes crucial to evaluate their impacts comprehensively. Various technical and economic attributes, along with risk and human readiness factors, must be achieved to ensure that innovative projects enabling automation and modernization are successful. However, no systematic or integrated framework exists that allows plants to evaluate these innovative projects. To address this gap, the Technical, Economic, Risk, and Adoption (TERA) assessment offers a structured method to evaluate innovative technologies, ensuring solutions meet both operational and safety standards. The TERA framework integrates the disparate perspectives to assess modernization opportunities in nuclear operations. It combines qualitative and quantitative models to evaluate the relationship between performance and business impacts, while also enabling continuous re-evaluation during project development. This approach helps plant owners identify high-priority opportunities, optimize cost savings, and minimize risks, ensuring projects remain on track to achieve desired returns. By providing a comprehensive, systematic methodology, TERA enables informed, data-driven decisions that support successful modernization efforts, enhancing efficiency, safety, and cost savings across nuclear operations. This paper explains the TERA framework and its benefits for the nuclear industry.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Examining the Use of the Technology Acceptance Model for Adoption of Advanced Digital Technologies in Nuclear Power Plants

The United States nuclear industry is being economically challenged and needs wide-scale adoption of enabling technology like advanced automation to remain viable. To enable wide-scale adoption of advanced technology, addressing the human-technology integration challenges and factors that influence technology acceptance (i.e., ‘buy in’) is pertinent. This work examines the Technology Acceptance Model as a framework for characterizing the factors influencing technology adoption in the nuclear industry. An outcome of this work is to support the development of future tools such as a technology acceptance survey that can be used to assess technology acceptance throughout the lifespan of a modernization program to provide a systematic way of ensuring stakeholder and operations ‘buy in.’

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2025

Trustworthiness and Trust: Identifying Factors that Drive Successful Human-AI Interaction in Nuclear Power Plant Applications

Emerging technologies such as artificial intelligence (AI) and machine learning (ML) are rapidly evolving and considered a promising tool for efficient and continued safe operations of the U.S. nuclear power plants (NPPs). Emerging AI techniques like large language models (LLMs) are one such technology that may support personnel at existing NPPs perform work more efficiently. For example, operators may query the current operational status of a power plant via a chat interface leveraging LLMs to access plant-related information in an interactive manner rather than manually collecting various sensor data for tasks such as surveillances or completing work orders. This is a fundamental shift in the way operators currently perform their tasks today. The literature of human-automation interaction indicates that trust is a crucial factor that drives successful interaction between a human operator and an automated system, like an AI-infused NPP application. This work presents the results of a literature review on key factors that relate to trust in AI/LLM technologies for NPP applications. The relevant literature of human factors and cognitive engineering has identified various factors related to trust including trustworthiness, performance characteristics, operator skill and perceived risk. This preliminary literature review will guide development and evaluation of models involving the identified factors influencing trust in AI and develop a framework for human-centered design for interface between humans and AI. By addressing trust, this work supports developing a technical basis for designing key characteristics of AI/LLM to support calibrated trust, which will ultimately support wide-scale adoption of AI/LLM technologies, as well as ensure safe, effective, and reliable use.

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2025

Review of Reactor Facilities without Main Control Rooms

Small, advanced reactors may require few, if any, safety-related human actions (HAs) and fewer HAs to monitor and control the plant. In comparison to large light water reactors, these are significant changes that have implications for many aspects of an applicant's human factors engineering (HFE), including control room design, plant staffing, and the management of safety functions. To support the Nuclear Regulatory Commission's (NRC) ability to evaluate these changes, information needs to be developed addressing the characteristics and potential issues. The objectives of our research were to (1) identify when a traditional main control room (MCR) may not be necessary, (2) identify workplace design alternatives to traditional MCRs, and (3) develop guidance for reviewing an applicant's workplace designs with and without a MCR. We determined that the safety question isn't so much justifying why a design has no MCR, but rather verifying that important human actions can be accurately and reliably performed under a range of challenging conditions using the HSIs provided regardless of their location. We developed guidance to review alternatives to MCRs based on HFE analyses for determining workplace location and design.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

Evaluation of color in digital nuclear power plant control room displays

Human system interface design in industrial process control is guided by industry standards, human factors best practices, and domain-specific conventions, and often there is a conflict between one or more of the sources of design input for specific design elements. In the nuclear domain, one design element for which conflict arises is the use of color to represent equipment state. Here, this study evaluates the tradeoffs associated with using color in a process control display versus using white and shades of gray. The performance metrics were response time, accuracy, and eye movement metrics using a simplified experimental task and professional operators. Results revealed that adhering to color conventions in nuclear power yielded small advantages in simple tasks, but did not exist for more complex tasks. The results did not provide strong evidence for or against using a particular color scheme and revealed the need for further research on the use of color for commercial nuclear power plants and other process control industries.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2024

How do deer respiratory epithelial cells weather the initial storm of SARS-CoV-2 WA1/2020 strain?

The potential infectivity of severe acute respiratory syndrome associated coronavirus-2 (SARS-CoV-2) in animals raises a public health and economic concern, particularly the high susceptibility of white-tailed deer (WTD) to SARS-CoV-2. The disparity in the disease outcome between humans and WTD is very intriguing, as the latter are often asymptomatic, subclinical carriers of SARS-CoV-2. To date, no studies have evaluated the innate immune factors responsible for the contrasting SARS-CoV-2-associated disease outcomes in these mammalian species. A comparative transcriptomic analysis in primary respiratory epithelial cells of human (HRECs) and WTD (Deer-RECs) infected with the SARS-CoV-2 WA1/2020 strain was assessed throughout 48 h post inoculation (hpi). Both HRECs and Deer-RECs were susceptible to virus infection, with significantly ( P < 0.001) lower virus replication in Deer-RECs. The number of differentially expressed genes (DEG) gradually increased in Deer-RECs but decreased in HRECs throughout the infection. The ingenuity pathway analysis of DEGs further identified that genes commonly altered during SARS-CoV-2 infection mainly belong to cytokine and chemokine response pathways mediated via interleukin-17 (IL-17) and nuclear factor-κB (NF-κB) signaling pathways. Inhibition of the NF-κB signaling in the Deer-RECs pathway was predicted as early as 6 hpi. The findings from this study could explain the lack of clinical signs reported in WTD in response to SARS-CoV-2 infection as opposed to the severe clinical outcomes reported in humans. IMPORTANCE. This study demonstrated that human and white-tailed deer primary respiratory epithelial cells are susceptible to the SARS-CoV-2 WA1/2020 strain infection. However, the comparative transcriptomic analysis revealed that deer cells could limit viral replication without causing hypercytokinemia by downregulating IL-17 and NF-κB signaling pathways. Identifying differentially expressed genes in human and deer cells that modulate key innate immunity pathways during the early infection will lead to developing targeted therapies toward preventing or mitigating the “cytokine storm” often associated with severe cases of coronavirus disease 19 (COVID-19). Moreover, results from this study will aid in identifying novel prognostic biomarkers in predicting SARS-CoV-2 adaption and transmission in deer and associated cervids.

60 APPLIED LIFE SCIENCES↗