Search NASA⌕ Search

SEARCH · Search NASA

Results for “Performance (Human)”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Instantiation of HCML Demonstrating Bayesian Predictive Modeling for Attentional Control

The research team developed models of Attentional Control (AC) that are unique to existing modeling approaches in the literature. The goal was to enable the research team to (1) make predictions about AC and human performance in real-world scenarios and (2) to make predictions about individual characteristics based on human data. First, the team developed a proof-of-concept approach for representing an experimental design and human subjects data in a Bayesian model, then demonstrated an ability to draw inferences about conditions of interest relevant to real-world scenarios. Ultimately, this effort was successful, and we were able to make reasonable (meaning supported by behavioral data) inferences about conditions of interest to develop a risk model for AC (where risk is defined as a mismatch between AC and attentional demand). The team additionally defined a path forward for a human-constrained machine learning (HCML) approach to make predictions about an individual's state based on performance data. The effort represents a successful first step in both modeling efforts and serves as a basis for future work activities. Numerous opportunities for future work have been defined.

97 MATHEMATICS AND COMPUTING↗

Simulator Data Analysis to Inform Digitalized Environment Impacts on Human Reliability

The U.S. Nuclear Regulatory Commission (NRC) has developed a human reliability analysis (HRA) method, termed the Integrated Human Event Analysis System for Event and Condition Assessment (IDHEAS-ECA), in order to estimate human error probabilities (HEPs) in risk-informed regulatory applications. To update the quantification part of IDHEAS-ECA, the NRC required human performance and error data from fully digitalized main control rooms (MCRs); therefore, it requested that Idaho National Laboratory (INL) revisit previous data collection studies and investigate how the following three factors impact human reliability: self-checking, peer-checking, and automation. The HRA data collection studies revisited were the Human Reliability Data Extraction (HuREX) project, developed by the Korea Atomic Energy Research Institute (KAERI), and the Simplified Human Error Experimental Program (SHEEP), developed by INL. HuREX is a representative HRA data collection study that collects human reliability data from full-scope simulators staffed by licensed operators. SHEEP, on the other hand, has been proposed to complement such full-scope studies by collecting data via simplified simulators staffed by non-licensed student operators. In the HuREX study, KAERI collected HRA data from fully digitalized MCRs for the Advanced Power Reactor (APR)–1400. The SHEEP data were obtained from simplified simulators that partially mimicked the features of digitalized MCRs. The present report mainly discusses how the impacts of the aforementioned three factors on human errors were derived from these two data collection studies.

99 GENERAL AND MISCELLANEOUS↗

PWR loading pattern optimization with reinforcement learning

The core loading pattern optimization problem belongs to the class of combinatorial optimization problem and has been studied since the dawn of commercial nuclear energy industry. It is characterized by multiple objectives and constraints, with a very high number of candidate patterns, which makes it impossible to solve explicitly. Stochastic optimization methodologies including Genetic Algorithms and Simulated Annealing are used by different nuclear utilities and vendors to perform fuel cycle reload design. Nevertheless, hand-designed solutions continue to be the prevalent method in the industry. To improve the state-of-the-art core reload patterns, we aim to create a method as scalable as possible, that agrees with the designer's goal of performance and safety. To help in this task Deep Reinforcement Learning (DRL), in particular Proximal Policy Optimization is leveraged. DRL has recently experienced a strong impetus from its successes applied to games, sometimes even reaching 'super-human' performances. This paper lays out the foundation of this method and proposes to study the behavior of several hyper-parameters that influence the DRL algorithm. The algorithm is highly dependent on multiple factors such as an exploration/exploitation trade-off that manifests through different parameters such as the number of loading patterns seen and the number of samples collected before a policy update, but also the shape of the objective function derived for the core design. Experimental results also demonstrate the effectiveness of the method in finding high-quality solutions from scratch within a reasonable amount of time. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Using Qualified On-Site Nuclear Power Plant Simulators in Human Factors Validations of Control Room Upgrades

Existing commercial nuclear power plants (NPPs) are valuable assets in the infrastructure portfolio of the United States (U.S.) because they safely and reliably generate about 1/5th of all the electricity used. The instrumentation and control (I&C) systems in commercial NPPs are the ‘eyes and ears' of the operator, allowing operators to maintain situation awareness, thereby allowing the plant to operate safely and efficiently for all phases of operation. Because the I&C systems in NPPs are still mostly based on analog technologies, which are reliable but not especially cost-effective, upgrading the existing I&C in com-mercial NPPs to new digital I&C is very important. Furthermore, simulators and simulation are critical human factors engineering tools for this I&C modernization work. NPP control room simulators are essential test beds to simulate normal, abnormal, and emergency operations that allow human factors researchers to safely and realistically evaluate early design phase prototypes of the upgraded digital I&C, and validate final as-built digital I&C systems that have been modernized deployed in NPPs. This paper describes research performed using qualified on-site NPP simulators to perform human factors validations of digital I&C control room upgrades.

99 GENERAL AND MISCELLANEOUS↗

Digital risk analysis in nuclear engineering projects: Designing for safety, performance, reliability, and security

Cyber-informed engineering and security-by-design frameworks are important in promoting the need to identify cybersecurity concerns early in the systems engineering lifecycle so risks from adversarial cyber-attacks can be eliminated or reduced through engineering design practices. In addition to adversarial risk, risk in operational technology systems also includes non-adversarial and unintentional risk from other factors such as human performance errors, environmental conditions, design flaws, and device degradation or failure. This paper introduces a new concept for characterizing digital risk, both adversarial and non-adversarial, and provides the basis for initial research into a novel digital risk analysis approach focused on incorporating attack difficulty into a multi-attribute analysis technique using robust decision-making. This digital risk characterization is also used to frame a discussion on the challenges of competing objectives and competing stakeholder requirements in an integrated energy system project that incorporates a small modular reactor and industrial facility.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Virtual Reality for Shoot/No-Shoot Decision Training in Law Enforcement: A Literature Review and Research Agenda

Virtual reality (VR) can materially improve “shoot / no-shoot” (SNS) training by giving officers realistic, repeatable practice making high-stakes decisions under pressure. Traditional tools—live-fire ranges and video simulators—build basics, but they cannot adapt to each officer in real time or fully mirror the complexity of the field. VR closes that gap by creating immersive scenarios that are safer, more flexible, easier to scale across units, and able to capture objective performance data. SNS decisions are not just about marksmanship; they rely on perception, judgment, memory, and the ability to hold fire when a threat is uncertain. Effective training therefore needs realism, decision complexity, and branching outcomes that reflect the true consequences of choices. These elements strengthen recognition of hostile intent while reducing false positives and building the self-control required in ambiguous situations. VR brings specific advantages: dynamic environments, full-body interaction, and the ability to measure performance with precision—enabling targeted feedback and better transfer of learning to the street. At the same time, responsible deployment must address scenario quality (credible environments and behaviors), lawful decision models, and user wellbeing (appropriate stress levels, comfort, and safety). Sandia’s VIPER Lab is positioned to lead this work. The team combines human-performance science, AI/ML, and VR/AR development with a deep equipment bench (e.g., omnidirectional treadmill, eye-tracking, haptics, multiple HMDs). This ecosystem supports building and validating next-generation SNS training that is immersive, measurable, and trustworthy. Bottom line: Investment in VR-enabled SNS training that blends evidence-based design with careful validation and legal safeguards is expected to pay off in safer, more consistent decision-making and improved community trust, delivered through training that is practical to deploy at scale.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Assessing Cognitive Impacts of Errors from Machine Learning and Deep Learning Models: Final Report

Due to their recent increases in performance, machine learning and deep learning models are being increasingly adopted across many domains for visual processing tasks. One such domain is international nuclear safeguards, which seeks to verify the peaceful use of commercial nuclear energy across the globe. Despite recent impressive performance results from machine learning and deep learning algorithms, there is always at least some small level of error. Given the significant consequences of international nuclear safeguards conclusions, we sought to characterize how incorrect responses from a machine or deep learning-assisted visual search task would cognitively impact users. We found that not only do some types of model errors have larger negative impacts on human performance than other errors, the scale of those impacts change depending on the accuracy of the model with which they are presented and they persist in scenarios of evenly distributed errors and single-error presentations. Further, we found that experiments conducted using a common visual search dataset from the psychology community has similar implications to a safeguards- relevant dataset of images containing hyperboloid cooling towers when the cooling tower images are presented to expert participants. While novice performance was considerably different (and worse) on the cooling tower task, we saw increased novice reliance on the most challenging cooling tower images compared to experts. These findings are relevant not just to the cognitive science community, but also for developers of machine and deep learning that will be implemented in multiple domains. For safeguards, this research provides key insights into how machine and deep learning projects should be implemented considering their special requirements that information not be missed.

97 MATHEMATICS AND COMPUTING↗

Back to Basics: First Principles of HRA

Human Reliability Analysis (HRA) continues to suffer from a myriad of technical gaps in its foundations. Core issues have been widely discussed but remain largely unaddressed, although the path taken to this point was paved with good intentions. Now, while this characterization may seem dramatic it is not intended to throw doubt onto HRA as a discipline or to diminish the value it has on increasing safety and resilience in nuclear power. Rather, it is intended to communicate that HRA has some serious challenges and is desperately in need of a critical evaluation. To quote Dougherty [1], “the misrepresentations that will undoubtedly arise may serve to provoke the necessary creativity.” What bears noting is that in the last thirty years since Alan Swain declared that “no adequate HRA had ever been done,” there has been little effort to correct the issues he highlighted. Human factors practice is still poorly implemented, many complex systems are fundamentally incompatible with reliable human performance, and there remains poor foundational support for many of the assumptions within HRA. We propose three categories of issues in HRA, philosophical, theoretical, and empirical and potential solutions to these issues.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Artificial Intelligence for Accelerating Nuclear Applications, Science, and Technology

Artificial intelligence (AI) and machine learning (ML) methods have had significant impacts in science and technology in recent years. These methods for generating models from datasets or logic-based algorithms that emulate aspects of human performance can similarly accelerate the fields of nuclear applications, science, and technology toward the IAEA goals of contributing to peace, health, and prosperity. In order to accomplish advances with AI in general and ML in particular across these fields, IAEA can play a significant role by establishing, hosting and curating centralised resources, including databases, adhering to FAIR (findable, accessible, interoperable and reusable) principles and Open Science best practices, providing stewardship of data sharing, supporting training efforts and development of relevant workforces, as well as enabling connections among the scientific, technology, mathematics, AI and ethics communities. Many areas can benefit from the use of AI in the realm of nuclear applications. In human health, these areas include clinical research, epidemiology, nutrition, medical imaging, radiotherapy and education of health professionals. AI-based tools are also being used to facilitate different clinical tasks in imaging, computer-assisted diagnosis in mammography and lung cancer screening programmes, and dose prediction in nuclear medicine procedures. ML methods in particular may also increase the efficiency and accuracy of the analysis of computerised tomography and dual-energy absorptiometry scans for body composition and bone analysis. The application of AI methods to nuclear and related technologies in food and agriculture can lead to significant advances and improved efficiency in the optimisation of agricultural production, food product development, management of supply chains, food safety and food authenticity control. In the water and environmental sector, AI can help inform policies to mitigate the world’s water problems. The application of AI techniques to hydrology and environmental sciences is expected to improve patterns identification and enable model predictions under a changing climate.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Efficient multi-scale representation of visual objects using a biologically plausible spike-latency code and winner-take-all inhibition

Deep neural networks have surpassed human performance in key visual challenges such as object recognition, but require a large amount of energy, computation, and memory. In contrast, spiking neural networks (SNNs) have the potential to improve both the efficiency and biological plausibility of object recognition systems. Here we present a SNN model that uses spike-latency coding and winner-take-all inhibition (WTA-I) to efficiently represent visual stimuli using multi-scale parallel processing. Mimicking neuronal response properties in early visual cortex, images were preprocessed with three different spatial frequency (SF) channels, before they were fed to a layer of spiking neurons whose synaptic weights were updated using spike-timing-dependent-plasticity. We investigate how the quality of the represented objects changes under different SF bands and WTA-I schemes. We demonstrate that a network of 200 spiking neurons tuned to three SFs can efficiently represent objects with as little as 15 spikes per neuron. Furthermore, studying how core object recognition may be implemented using biologically plausible learning rules in SNNs may not only further our understanding of the brain, but also lead to novel and efficient artificial vision systems.

59 BASIC BIOLOGICAL SCIENCES↗

A framework to collect human reliability analysis data for nuclear power plants using a simplified simulator and student operators

Data scarcity in human reliability analysis (HRA) has been a major challenge in the quantification process. Many institutes have collected HRA data through experiments using full-scope simulators with actual operators. Nevertheless, there are still some limitations to relying solely on full-scope studies. This paper aims to propose how full-scope data collection studies can be supported through the Simplified Human Error Experimental Program (SHEEP). The SHEEP framework was developed by Idaho National Laboratory (INL) to collect HRA data through a simplified simulator and student operators. This paper introduces the major tasks in the SHEEP framework, with a particular focus on differences that arise due to participant type (i.e., student vs. actual operator), based on experiments using a simplified simulator (i.e., the Rancor Microworld). This paper also describes whether the data collected via this approach could support a representative full-scope data collection study (i.e., the HuREX study) based on the experimental data.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Ambient energy for buildings: Beyond energy efficiency

The following Key Messages comprise the salient findings of this study: 1. Ambient energy (from sun, air, ground, and sky) can heat and cool buildings; provide hot water, ventilation and daylighting; dry clothes; and cook food. These services account for about three-quarters of building energy consumption and a third of total US demand. Biophilic design (direct and indirect connections with nature) is an intrinsic adjunct to ambient energy systems, and improves wellness and human performance. 2. The current strategy of electrification and energy efficiency for buildings will not meet our climate goals, because the transition to an all-renewable electric grid is too slow. Widespread adoption of ambient energy is needed. Solar-heated buildings also flatten the seasonal demand for electricity compared to all-electric buildings, reducing required production capacity and long-term energy storage. In addition, ambient-conditioned buildings improve resilience by remaining livable during power outages. 3. National policies, incentives, and marketing should be enacted to promote ambient energy use. Federal administrative priorities should reflect the importance of ambient energy for buildings. Use of ambient energy should be encouraged through existing and new building codes and standards. 4. Ambient energy system design tools are needed for architects, engineers, builders, building scientists, realtors, appraisers, and consumers. PVWatts is used over 100 million times per year for photovoltaic system design. A similar, simple, and accessible tool for ambient design is crucial. 5. Training on ambient energy is needed throughout secondary, post-secondary, and continuing education for workforce development. Currently, only about 10% of colleges teach courses on passive heating and cooling systems. 6. Ambient-conditioned buildings should be demonstrated in all US climate zones. Performance should be monitored and reported, with quantitative case studies made widely available. 7. While current technology is sufficient to build high-performance ambient buildings now, research is needed to develop new technologies to harness ambient energy more effectively and more economically. Such advancements will facilitate adoption of ambient energy technologies in a wider range of buildings, including retrofits. Examples include windows with much lower thermal losses, use of the building shell as thermal storage, alternative light-weight thermal storage systems, sky radiation cooling systems, automated controls for solar gains and passive cooling, and ground coupling.

14 SOLAR ENERGY↗

Detection of Diversion in a Realistic Heat Pipe Microreactor Using Supervised Machine Learning

Microreactors (MRs) pose new challenges for international safeguards. Here, their small size and mass reproducibility make them ideal for deployment in greater numbers and in remote locations, making the job of safeguards inspectors more challenging. Machine learning (ML) is currently being applied to many fields to augment human performance and increase automation; in particular, ML could be used to provide insight for international inspectors to help detect the diversion of nuclear fuel from MR cores. Four ML model types (k-nearest neighbors, decision tree, random forest, and histogram-based gradient boosted ensemble) were trained on integrated flux and critical control drum angle data generated with Serpent 2 for a realistic heat pipe MR design, achieving nearly 100% binary classification accuracy of nominal and diversion core configurations by the end of 1 full power year for three of the four model types. Regression model variants were also trained, using the same input data, for predicting the number of fuel pins diverted. Root-mean-square errors below 5% of the total number of fuel pins were achieved by the 1 full power year mark for all models.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

¬¬Integration of Quantification of Margins and Uncertainties Methodology into Parallel Discrete Event Simulator Framework

Parallel Discrete Events Simulation (PDES) is becoming increasingly important to lab efforts in security and intelligence. It is used to model complex asynchronous systems such as computer networks, satellite systems, vehicular traffic, and human performance. Uncertainty Quantification (UQ) techniques have become a mainstay of Verification and Validation (V&V) efforts on physics simulations. However, PDES models are very different from traditional physics simulations, and research into UQ techniques for PDES is in its infancy. It is not clear which traditional UQ techniques can be applied to PDES, or what new techniques will need to be developed. The goal of this project was to identify existing UQ techniques that can be applied to PDES, and to develop new techniques as necessary. The project implemented or developed techniques to handle issues that do not appear in traditional physics simulations, but are common among PDES, including sampling techniques for high-dimensional homogenous inputs, response surfaces for high-variance heteroskedastic output, and characterization of skewed output distributions. These are foundational UQ techniques that must be used in any complete UQ analysis (Tong 2018).

97 MATHEMATICS AND COMPUTING↗

MalGen: Malware Generation with Specific Behaviors to Improve Machine Learning-based Detectors

In recent years, infections and damage caused by malware have increased at exponential rates. At the same time, machine learning (ML) techniques have shown tremendous promise in many domains, often out performing human efforts by learning from large amounts of data. Results in the open literature suggest that ML is able to provide similar results for malware detection, achieving greater than 99% classifcation accuracy [49]. However, the same detection rates when applied in deployed settings have not been achieved. Malware is distinct from many other domains in which ML has shown success in that (1) it purposefully tries to hide, leading to noisy labels and (2) often its behavior is similar to benign software only differing in intent, among other complicating factors. This report details the reasons for the diffcultly of detecting novel malware by ML methods and offers solutions to improve the detection of novel malware.

97 MATHEMATICS AND COMPUTING↗

Best Practice: The intersection of HPI and Work Planning and Control

The EFCOG Human Performance Improvement (HPI) Task Team (TT) and the Work Planning & Control (WP&C) TT collaborated to develop a Best Practice that provides examples of how to integrate of HPI into WP&C tasks. This document is a collection of some best practices as determined by team members.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Digital Engineering and Cybersecurity Decision Analysis in Early Phases of SMR-Driven IES Projects

Considerable efforts are underway to ensure cybersecurity is integrated into the systems engineering lifecycle. Cyber-informed engineering and security-by-design frameworks are intended to identify and engineer out cybersecurity risks throughout the lifecycle. While these approaches are valuable for promoting the need to include cybersecurity considerations in early design phases to create more secure systems, they may not consider the entirety of digital risks. Digital risks in a digital instrumentation and control system include adversarial and unintentional risks from internal and external factors, such as human performance errors, design flaws, environmental conditions, and equipment degradation or failure. This report provides a detailed discussion on digital risk prior to describing the background and concept of operations for a small modular reactor-driven integrated energy system connected to industrial applications. The challenges of competing objectives and competing stakeholder requirements are discussed and the impacts on digital engineering, security considerations, and interdependencies are evaluated for mission-level, facility-level, and system-level decisions.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

SCITUNE: Aligning Large Language Models with Human-Curated Scientific Multimodal Instructions

Instruction finetuning is a popular paradigm to align large language models (LLM) with human intent. Despite its popularity, this idea is less explored in improving the LLMs to align existing foundation models with scientific disciplines, concepts and goals. In this work, we present SciTune as a tuning framework to improve the ability of LLMs to follow scientific multimodal instructions. To test our methodology, we use a human-generated scientific instruction tuning dataset and train a large multimodal model LLaMA-SciTune that connects a vision encoder and LLM for science-focused visual and language understanding. LLaMA-SciTune significantly outperforms the state-of-the-art models in the generated figure types and captions in multiple scientific multimodal benchmarks. In comparison to the models that are fine-tuned with machine generated data only, LLaMA-SciTune surpasses human performance on average and in many sub-categories on the ScienceQA benchmark.

• Artificial intelligence (AI) / machine learning ↗