Search NASA⌕ Search

SEARCH · Search NASA

Results for “human errors”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Analysis of Tasks in Autonomous Systems Using the EMRALD Dynamic Risk Assessment Tool

An autonomous system refers to the system that has the power and ability for self-governance in the performance of system functions. Autonomous systems have been actively pursued in a variety of domains such as automotive, aviation, maritime, medicine, and nuclear fields. As an unmanned concept employing the highest automation level, the autonomous system basically performs most of the work in normal operations or emergency situations. However, despite advances in technology, many researchers have noted these systems still require human actions. The nature of human actions on autonomous systems is different than the human actions that are considered in existing systems. Nevertheless, only a few studies have been conducted on 1) characterizing the different types of errors and risks associated with human actions interacting with autonomous systems and 2) how to evaluate human actions in the autonomous operations. As a starting point, this study aims to investigate differences of tasks in autonomous operation compared to those in existing nuclear power plant operation using the Event Modeling Risk Assessment Using Linked Diagram (EMRALD) software. In this paper, insights aspect of human error and time are derived out and discussed based on the output of the EMRALD models.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2021

Assessing Cognitive Impacts of Errors from Machine Learning and Deep Learning Models: Final Report

Due to their recent increases in performance, machine learning and deep learning models are being increasingly adopted across many domains for visual processing tasks. One such domain is international nuclear safeguards, which seeks to verify the peaceful use of commercial nuclear energy across the globe. Despite recent impressive performance results from machine learning and deep learning algorithms, there is always at least some small level of error. Given the significant consequences of international nuclear safeguards conclusions, we sought to characterize how incorrect responses from a machine or deep learning-assisted visual search task would cognitively impact users. We found that not only do some types of model errors have larger negative impacts on human performance than other errors, the scale of those impacts change depending on the accuracy of the model with which they are presented and they persist in scenarios of evenly distributed errors and single-error presentations. Further, we found that experiments conducted using a common visual search dataset from the psychology community has similar implications to a safeguards- relevant dataset of images containing hyperboloid cooling towers when the cooling tower images are presented to expert participants. While novice performance was considerably different (and worse) on the cooling tower task, we saw increased novice reliance on the most challenging cooling tower images compared to experts. These findings are relevant not just to the cognitive science community, but also for developers of machine and deep learning that will be implemented in multiple domains. For safeguards, this research provides key insights into how machine and deep learning projects should be implemented considering their special requirements that information not be missed.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

EFCOG Human Performance Improvement Task Group: Task 20-2, Asking Better Error Precursor Questions for Effective Job Planning, Pre-Job Briefs, and Event Investigations

The second principle of human performance states: “error-likely situations are predictable, manageable, and preventable.” An error-likely situation comes into play when task-related factors exceed the capabilities of the individual, creating a mismatch at the point when the individual is “touching” either the physical or the paper plant. The simple presence of adverse conditions cannot be error-likely unless a specific action is to occur within that set of adverse conditions.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2022

EFCOG Best Practice HPI for Knowledge Workers ISM-HPI-22-02

This document is a collection of these best practices as determined by team members. This best practice attempts to: Realize opportunities to break the myth where people believe that HPI does not apply to them as they perform no physical work. Recommend options to create an environment that promotes intellectual collaboration and trust, enabling candor and vulnerability. Explain how errors manifest differently from the same human fallibility. Knowledge workers (KW) have errors that take different perspectives to find and mitigate the unique manifestation of these conditions. Help KW identify the critical steps (or risk important steps) in their processes. Reduce risk/consequence from KW errors (limit latent errors as well as finding latent conditions), building resiliency into KW tasks. Mitigation strategies may be different.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2020

Overcoming small minirhizotron datasets using transfer learning

Minirhizotron technology is widely used to study root growth and development. Yet, standard approaches for tracing roots in minirhiztron imagery is extremely tedious and time consuming. Machine learning approaches can help to automate this task. However, lack of enough annotated training data is a major limitation for the application of machine learning methods. Transfer learning is a useful technique to help with training when available datasets are limited. In this paper, we investigated the effect of pre-trained features from the massives-cale, irrelevant ImageNet dataset and a relatively moderate-scale, but relevant peanut root dataset on switchgrass root imagery segmentation applications. We compiled two minirhizotron image datasets to accomplish this study: one with 17,550 peanut root images and another with 28 switchgrass root images. Both datasets were paired with manually labeled ground truth masks. Deep neural networks based on the U-net architecture were used with different pre-trained features as initialization for automated, precise pixel-wise root segmentation in minirhizotron imagery. We observed that features pre-trained on a closely related but relatively moderate size dataset like our peanut dataset were more effective than features pre-trained on the large but unrelated ImageNet dataset. Here, we achieved high quality segmentation on peanut root dataset with 99.04% accuracy at the pixel-level and overcame errors in human-labeled ground truth masks. By applying transfer learning technique on limited switchgrass dataset with features pre-trained on peanut dataset, we obtained 99% segmentation accuracy in switchgrass imagery using only 21 images for training (fine tuning). Furthermore, the peanut pre-trained features can help the model converge faster and have much more stable performance.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Perspectives on Machine Learning-assisted Plasma Medicine: Towards Automated Plasma Treatment

Cold atmospheric plasmas (CAPs) have shown great promise for medical applications through their synergistic chemical, electrical, and thermal effects, which can induce therapeutic outcomes. However, safe and reproducible plasma treatment of complex biological surfaces poses a major hurdle to the widespread adoption of CAPs for medical applications. Predictive modeling of the mutual interactions between the plasma and biological surfaces and, thus, systematic approaches to quantify and predict plasma treatment outcomes remain largely elusive due to the lack of mechanistic understanding of plasma-surface interactions that can span across vastly different length-and time-scales. In addition, real-time sensing capabilities in biomedical CAP devices are often limited, which can be detrimental to plasma treatment due to the intrinsic plasma and surface variability during the treatment, as well as sensitivity to external perturbations. All of these challenges can make reproducible and effective plasma treatment of biological surfaces difficult to realize, which is further compounded by errors due to human operation of hand-held CAP devices. Machine learning and data-driven approaches can be particularly useful in addressing these challenges in three major ways: (i) data-driven modeling of hard-to-model plasma-surface interactions and plasma treatment outcomes; (ii) learning data analytics for plasma and surface diagnostics in real-time; and (iii) developing predictive controllers that enable reliable and effective CAP treatments. Furthermore, this paper discusses the promise of machine learning to accelerate plasma medicine research in these areas, toward machine learning-assisted and automated CAP treatment of complex biological surfaces.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Machine-Learning Assisted Identification of Accurate Battery Lifetime Models with Uncertainty

Reduced-order battery lifetime models, which consist of algebraic expressions for various aging modes, are widely utilized for extrapolating degradation trends from accelerated aging tests to real-world aging scenarios. Identifying models with high accuracy and low uncertainty is crucial for ensuring that model extrapolations are believable, however, it is difficult to compose expressions that accurately predict multivariate data trends; a review of cycling degradation models from literature reveals a wide variety of functional relationships. Here, a machine-learning assisted model identification method is utilized to fit degradation in a stand-out LFP-Gr aging data set, with uncertainty quantified by bootstrap resampling. The model identified in this work results in approximately half the mean absolute error of a human expert model. Models are validated by converting to a state-equation form and comparing predictions against cells aging under varying loads. Parameter uncertainty is carried forward into an energy storage system simulation to estimate the impact of aging model uncertainty on system lifetime. The new model identification method used here reduces life-prediction uncertainty by more than a factor of three (86% ± 5% relative capacity at 10 years for human-expert model, 88.5% ± 1.5% for machine-learning assisted model), empowering more confident estimates of energy storage system lifetime.

25 ENERGY STORAGE↗
DOE OSTI2020

Power Distribution Designing For Resilience Application (powdder)

Power Distribution Designing for Resilience Application (PowDDeR) is a software application to succinctly capture the capabilities of a power system to respond to disturbances, including natural or human (malicious or errors) caused disturbances. The software provides a measure of resilience for power systems.

McJunkin, TimothyR↗
DOE OSTI2025

A Typology of Quantum-Classical Faults

This paper introduces an extended taxonomy of faults specific to hybrid quantum-classical systems, addressing the unique challenges that arise from integrating quantum accelerators into high-performance computing (HPC) infrastructures. Building on the foundational fault classification by Avizienis et al., we incorporate fault types unique to quantum computing-such as qubit decoherence, spontaneous gate errors, and photon loss-alongside traditional and human-induced faults including development errors, operational mistakes, and malicious attacks. Our taxonomy classifies faults by their origin (natural vs. human-made), intent (accidental, deliberate non-malicious, or malicious), system boundaries (internal vs. external), and persistence (transient to permanent). We also explore how different architectural integration patterns-ranging from tight coupling to loose on-premise and cloud-based configurations-shape the manifestation and propagation of faults. These scenarios are analyzed in terms of timing mismatches, interface inconsistencies, and security threats such as data tampering and denial-of-service attacks. Through this fault-centric lens, we aim to support the co-design of dependable quantum-classical systems and highlight the critical role that integration strategies play in ensuring reproducibility, resilience, and security across hybrid computing platforms.

Giusto, Edorado [University of Naples Federico II,↗
DOE OSTI2024

Evaluating the mutagenicity of N-nitrosodimethylamine in 2D and 3D HepaRG cell cultures using error-corrected next generation sequencing

Human liver-derived metabolically competent HepaRG cells have been successfully employed in both two-dimensional (2D) and 3D spheroid formats for performing the comet assay and micronucleus (MN) assay. In the present study, we have investigated expanding the genotoxicity endpoints evaluated in HepaRG cells by detecting mutagenesis using two error-corrected next generation sequencing (ecNGS) technologies, Duplex Sequencing (DS) and High-Fidelity (HiFi) Sequencing. Both HepaRG 2D cells and 3D spheroids were exposed for 72 h to N-nitrosodimethylamine (NDMA), followed by an additional incubation for the fixation of induced mutations. NDMA-induced DNA damage, chromosomal damage, and mutagenesis were determined using the comet assay, MN assay, and ecNGS, respectively. The 72-h treatment with NDMA resulted in concentration-dependent increases in cytotoxicity, DNA damage, MN formation, and mutation frequency in both 2D and 3D cultures, with greater responses observed in the 3D spheroids compared to 2D cells. The mutational spectrum analysis showed that NDMA induced predominantly A:T → G:C transitions, along with a lower frequency of G:C → A:T transitions, and exhibited a different trinucleotide signature relative to the negative control. These results demonstrate that the HepaRG 2D cells and 3D spheroid models can be used for mutagenesis assessment using both DS and HiFi Sequencing, with the caveat that severe cytotoxic concentrations should be avoided when conducting DS. With further validation, the HepaRG 2D/3D system may become a powerful human-based metabolically competent platform for genotoxicity testing.

3D spheroids↗
DOE OSTI2020

Comparison of Human Performance between Operators and Students Using Rancor Microworld Simulator: A Preliminary Result

This paper describes an experiment using the Rancor Microworld simulator to probe into differences in human performance between students and actual operators. Six human performance measures – 1) time, 2) error, 3) workload, 4) situational awareness, 5) attention patterns, and 6) number of manipulations – are measured from experiments. The experiment has been conducted for 11 operators and 20 students so far. More experiments and analyses will be continued. Further experimental studies using Rancor Microworld are expected to be able to collect additional data that may be missing from full-scope studies and contribute to items that can support human reliability data.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2023

Human DNA polymerase η promotes RNA-templated error-free repair of DNA double-strand breaks

A growing body of evidence indicates that RNA plays a critical role in orchestrating DNA double-strand break repair (DSBR). Recently, we showed that homologous nascent RNA can be used as a template for error-free repair of double-strand breaks (DSBs) in the transcribed genome and to restore the missing sequence at the break site via the transcription-coupled classical nonhomologous end-joining (TC-NHEJ) pathway. TC-NHEJ is a complex multistep process in which a reverse transcriptase (RT) is essential for synthesizing the DNA strand from template RNA. However, the identity of the RT involved in the TC-NHEJ pathway remained unknown. Here, we report that DNA polymerase eta (Pol η), known to possess RT activity, plays a critical role in TC-NHEJ. We found that Pol η forms a multiprotein complex with RNAP II and other TC-NHEJ factors, while also associating with nascent RNA. Moreover, purified Pol η, along with DSBR proteins PNKP, XRCC4, and Ligase IV can fully repair RNA templated 3'-phosphate-containing gapped DNA substrate. In addition, we demonstrate here that Pol η deficiency leads to accumulation of R-loops and persistent strand breaks in the transcribed genes. Finally, we determined that, in Pol η depleted but not in control cells, TC-NHEJ-mediated repair was severely abrogated when a reporter plasmid containing a DSB with several nucleotide deletion within the E. coli lacZ gene was introduced for repair in lacZ-expressing mammalian cells. Thus, our data strongly suggest that RT activity of Pol η is required in error-free DSBR.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Visualization Quality Assessment

Understanding how inaccuracies in visualizations affect users’ perception and understanding of scientific data is hard. Inaccuracies in visualizations are quite common and could arise from a range of sources such as errors in the original dataset arising from compression artifacts, errors in the capturing device, noise during transmission of the data, effects due to the algorithm being used to convert data to visualization images, images generated from neural networks, and sources we have yet to discover. Many image quality assessment metrics have been developed to quantify image errors. However, these are usually focused on “natural images” rather than visualizations of scientific data. Common image quality assessment metrics (IQAs) include MSE, PSNR, perceptual metrics such SSIM, FSIM as well as perceptual metrics using deep learning approaches. However, a critical part of understanding how errors are perceived by humans, and subsequently developing more accurate quality assessment metrics, is through user evaluation studies. The goal of this software is to develop a visualization quality assessment (VQA) process that will enable the generation of VQAs that can be used to quantify errors in scientific data visualizations. The VQA development process will include software to support user evaluation experimental design, analysis of visualization differences against standard quality metrics, and the ability to develop additional VQA metrics specific to scientific visualization images.

Grosset, Andre↗
DOE OSTI2022

An Approach to Dynamic Human Reliability Analysis Using the EMRALD Dynamic Risk Assessment Tool

There is a need for research into dynamic human reliability analysis (HRA) (i.e., simulation- or computation-based HRA), as many researchers have emphasized the importance of applying dynamic approaches to probabilistic safety assessments (PSAs). This study proposes the Procedure-based Investigation Method of EMRALD Risk Assessment – Human Reliability Analysis (PRIMERA-HRA), a dynamic HRA approach based on the Event Modeling Risk Assessment Using Linked Diagram (EMRALD) software developed by Idaho National Laboratory (INL). This study suggests how this software can be used to model human actions and evaluate error probabilities. The applicability of this approach is also be investigated in light of an extended loss of AC power (ELAP) scenario. This paper then discusses the major insights derived by comparing this dynamic HRA approach against the static one.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2026

Satellite Embedding-Based Population Imputation for Areas with Missing Building Footprint Data: A Computer Vision-Based Approach

High-resolution population modeling is important for supporting effective decision-making across diverse sectors. LandScan Mosaic generates population estimates at the level of individual buildings and aggregates them to 3 arc-second grids, and this approach performs well in regions where building footprint data are comprehensive and reliable. However, large portions of the globe still suffer from incomplete, sparse, or entirely missing building stock datasets, creating a structural limitation for strictly building-based population models. To address this research gap, this study proposes a computer vision-based framework that employs Google Earth Engine satellite embeddings and UNet, which allows us to directly impute grid-level population estimates in building-data-deficient areas. Applied to Taiwan as a case study, the framework achieved strong predictive performance with R$^{2}$ of 0.89, RMSE of 18.70, and MAE of 8.41, outperforming traditional machine learning approaches. Notably, the proposed framework effectively addressed building false-positive errors inherent in Global Human Settlement Layer (GHSL) data, correctly identifying uninhabited areas that were erroneously classified as populated. The framework also offers significant advantages for global population mapping, particularly in terms of scalability and temporal consistency, thereby extending the coverage and accuracy of high-resolution population products in data-scarce regions worldwide. Urban planners, decision makers, and related stakeholders can obtain granular population distributions to support more accurate and targeted infrastructure investment, service delivery, resource allocation, and risk assessment decisions.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Human Performance Improvement Task Group Task 21-1 Best Practice: Using virtual capabilities or options for HPI application (to reduce errors, strengthening defenses, strengthening the organization, and/or increasing capacity)

In 2020 the world was impacted by COVID-19. How work is done was dramatically changed for a large portion of the workforce. Many have made the abrupt shift to working from their home while others have adapted to COVID protocols (such as social distancing and wearing facemasks). Fundamentally, Human and Organizational Performance Improvement concepts and science did not change – only the delivery method changed (in some cases). The primary effect has been to accelerate dynamics already present in society – from e-commerce to online education to remote healthcare. Change is never easy for humans. However, remote work should be viewed as an opportunity; not a fix to a problem. In this Best Practice paper, you’ll get practical suggestions to help you reduce errors and improve Human Performance in remote, socially-distanced “work-from-home” environments.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗