SEARCH · Search NASA

Results for “human performance data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Efforts to enhance reproducibility in a human performance research project

Background: Ensuring the validity of results from funded programs is a critical concern for agencies that sponsor biological research. In recent years, the open science movement has sought to promote reproducibility by encouraging sharing not only of finished manuscripts but also of data and code supporting their findings. While these innovations have lent support to third-party efforts to replicate calculations underlying key results in the scientific literature, fields of inquiry where privacy considerations or other sensitivities preclude the broad distribution of raw data or analysis may require a more targeted approach to promote the quality of research output. Methods: We describe efforts oriented toward this goal that were implemented in one human performance research program, Measuring Biological Aptitude, organized by the Defense Advanced Research Project Agency's Biological Technologies Office. Our team implemented a four-pronged independent verification and validation (IV&V) strategy including 1) a centralized data storage and exchange platform, 2) quality assurance and quality control (QA/QC) of data collection, 3) test and evaluation of performer models, and 4) an archival software and data repository. Results: Our IV&V plan was carried out with assistance from both the funding agency and participating teams of researchers. QA/QC of data acquisition aided in process improvement and the flagging of experimental errors. Holdout validation set tests provided an independent gauge of model performance. Conclusions: In circumstances that do not support a fully open approach to scientific criticism, standing up independent teams to cross-check and validate the results generated by primary investigators can be an important tool to promote reproducibility of results.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2022

A data-centric weak supervised learning for highway traffic incident detection

Using the data from loop detector sensors for near-real-time detection of traffic incidents on highways is crucial to averting major traffic congestion. While recent supervised machine learning methods offer solutions to incident detection by leveraging human-labeled incident data, the false alarm rate is often too high to be used in practice. Specifically, the inconsistency in the human labeling of the incidents significantly affects the performance of supervised learning models. To that end, we focus on a data-centric approach to improve the accuracy and reduce the false alarm rate of traffic incident detection on highways. We develop a weak supervised learning workflow to generate high-quality training labels for the incident data without the ground truth labels, and we use those generated labels in the supervised learning setup for final detection. This approach comprises three stages. First, we introduce a data preprocessing and curation pipeline that processes traffic sensor data to generate high-quality training data through leveraging labeling functions, which can be domain knowledge-related or simple heuristic rules. Second, we evaluate the training data generated by weak supervision using three supervised learning models-random forest, k-nearest neighbors, and a support vector machine ensemble-and long short-term memory classifiers. The results show that the accuracy of all of the models improves significantly after using the training data generated by weak supervision. Third, we develop an online real-time incident detection approach that leverages the model ensemble and the uncertainty quantification while detecting incidents. Finally, we show that our proposed weak supervised learning workflow achieves a high incident detection rate (0.90) and low false alarm rate (0.08).

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Reinforcement Learning for Anomaly Detection in Nuclear Power Plant Operation and Maintenance

In nuclear power plants (NPPs), timely identification of sensor and human errors is critical to ensure safe and efficient plant operations. Anomaly detection models can be employed for this task. However, traditional anomaly detection approaches may have high dependency on labeled datasets and struggle with adaptability in complex, dynamic environments. Reinforcement learning (RL) has demonstrated significant potential in fault diagnosis and anomaly detection; however, its application to anomaly detection in NPPs remains a relatively underexplored research direction. Hence, to address this gap, in this study, we present a novel physics-informed reinforcement learning model, PIRL-AD: Physics-Informed Reinforcement Learning for Anomaly Detection, that integrates domain knowledge from calorimetric equations into the RL framework for enhanced sensor and human error anomaly detection. We evaluate the performance of PIRL-AD against a non-physics informed RL benchmark and a support vector machine (SVM) on data collected from a forced flow loop testbed. Experimental results suggest that PIRL-AD outperforms other baselines on a range of anomalous datasets that include both sensor and human-induced anomalies across key performance metrics, statistically outperforming the RL and SVM benchmarks with respect to geometric mean (respectively, 92.96% vs. 91.06% vs. 83.01%) and F1-score (respectively, 89.23% vs. 86.98% vs. 77.01%). Furthermore, the findings suggest the potential of physics-integrated reinforcement learning models for enhanced anomaly detection performance in NPPs.

Reinforcement learning↗

NASA NTRS2005

Creating Communications, Computing, and Networking Technology Development Road Maps for Future NASA Human and Robotic Missions

For human and robotic exploration missions in the Vision for Exploration, roadmaps are needed for capability development and investments based on advanced technology developments. A roadmap development process was undertaken for the needed communications, and networking capabilities and technologies for the future human and robotics missions. The underlying processes are derived from work carried out during development of the future space communications architecture, an d NASA's Space Architect Office (SAO) defined formats and structures for accumulating data. Interrelationships were established among emerging requirements, the capability analysis and technology status, and performance data. After developing an architectural communications and networking framework structured around the assumed needs for human and robotic exploration, in the vicinity of Earth, Moon, along the path to Mars, and in the vicinity of Mars, information was gathered from expert participants. This information was used to identify the capabilities expected from the new infrastructure and the technological gaps in the way of obtaining them. We define realistic, long-term space communication architectures based on emerging needs and translate the needs into interfaces, functions, and computer processing that will be required. In developing our roadmapping process, we defined requirements for achieving end-to-end activities that will be carried out by future NASA human and robotic missions. This paper describes: 10 the architectural framework developed for analysis; 2) our approach to gathering and analyzing data from NASA, industry, and academia; 3) an outline of the technology research to be done, including milestones for technology research and demonstrations with timelines; and 4) the technology roadmaps themselves.

Bhasin, Kul↗

DOE OSTI2023

Human and Technology Integration Evaluation of Advanced Automation and Data Visualization

While the existing United States (U.S.) light water reactors are highly reliable, safe, and provide a significant proportion of carbon-free electricity, the cost of operating and maintaining them has become less competitive compared to other electricity generating sources. The reason for the gap in operating and maintenance (O&M) costs can be at least in part attributed to the advent of new digital technologies that other electricity generating industries are currently using. Advanced capabilities including digital instrumentation and control (I&C) systems, advanced automation and analytics, and greater span of data integration (i.e., connectedness) across these non-nuclear plants has transformed the way work is performed and ultimately given them a competitive advantage in terms of the cost required for operating, maintaining, and supporting them. To reduce O&M cost and address obsolescence of the aging I&C infrastructure of the existing U.S. light water reactors, the U.S. Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) Program Plant Modernization Pathway is conducting targeting multidisciplinary research that 1) delivers a sustainable business model to enable a cost-competitive U.S. nuclear industry and 2) is developing technology modernization solutions that address aging and obsolescence challenges. The work described in this report supports these two objectives and describes the demonstration of human and technology integration across recent industry collaborations to support their large-scale digital I&C modifications. This technical report describes the demonstration of the human and technology integration methodology in performing full-scale performance-based human-in-the-loop tests to evaluate plant-specific advanced automation and data visualization applications within these collaborators’ digital modifications. This technical report also documents future applications of human and technology integration that expand beyond main control room modernization and digital I&C upgrades, which have been a central focus to date. Thus, this technical report discusses how to implement human and technology integration across new business opportunities and how to develop an evaluation plan that defines measures and criteria, and documents key assumptions to support full plant modernization.

99 GENERAL AND MISCELLANEOUS↗

NASA NTRS2018

Evaluation of the Validity of Bio-Mathematical Models in Predicting Fatigue in an Operational Environment

During long-duration spaceflight missions, crewmembers and ground-support staff experience irregular sleep schedules, erratic natural light patterns, and high workload due to mission demands. Such conditions can cause circadian misalignment and sleep loss, which in turn cause deficits in cognitive performance. While bio-mathematical models have been implemented within workplace settings to predict fatigue profiles, the accuracy of sleep-wake models under conditions of non-traditional shiftwork is little known. Thus, the present study aims to evaluate the validity of four sleep-wake models (e.g., SAFTE-FAST, the Unified Model of Performance, the Adenosine-Circadian Model, and the State-Space Model) designed to predict human performance and fatigue levels against objective measures of performance in a spaceflight analog. To accomplish this aim, we will collect Psychomotor Vigilance Task (PVT) data from four crews (n=16) in the Human Exploration Research Analog (HERA) over 45 days. HERA is a closed, 3-story habitat at Johnson Space Center where inhabitants are exposed to extreme space exploration scenarios under varying sleep-wake conditions. The PVT is a simple reaction time test that involves minimal learning, making it sensitive to the effects of sleep loss and circadian misalignment. Findings from this study will help inform work scheduling and implementation of effective countermeasures (e.g., caffeine, lighting) to improve work efficiency and combat fatigue, as well as offer valuable insight into the applicability of bio-mathematical fatigue models in future space exploration missions.

fatigue↗

NASA NTRS1992

How should Fitts' Law be applied to human-computer interaction?

The paper challenges the notion that any Fitts' Law model can be applied generally to human-computer interaction, and proposes instead that applying Fitts' Law requires knowledge of the users' sequence of movements, direction of movement, and typical movement amplitudes as well as target sizes. Two experiments examined a text selection task with sequences of controlled movements (point-click and point-drag). For the point-click sequence, a Fitts' Law model that used the diagonal across the text object in the direction of pointing (rather than the horizontal extent of the text object) as the target size provided the best fit for the pointing time data, whereas for the point-drag sequence, a Fitts' Law model that used the vertical size of the text object as the target size gave the best fit. Dragging times were fitted well by Fitts' Law models that used either the vertical or horizontal size of the terminal character in the text object. Additional results of note were that pointing in the point-click sequence was consistently faster than in the point-drag sequence, and that pointing in either sequence was consistently faster than dragging. The discussion centres around the need to define task characteristics before applying Fitts' Law to an interface design or analysis, analyses of pointing and of dragging, and implications for interface design.

NASA Program Space Human Factors↗

NASA NTRSDate not supplied

Where is the Human in the Loop? Human Factors Analysis of Extended Visual Line of Sight Unmanned Aerial System Operations within a Remote Operations Environment

Many envisioned technological and conceptual innovations focus on allocating more functions to automation, relegating the human as an afterthought if not a nuisance. Yet, until complete autonomy is realized, the human will remain “in the loop”. The National Aeronautics and Space Administration is supporting research for the development and maturation of automated technologies and architectures for the future of advanced air mobility. Standing up a remote operations center used to control, manage, and monitor multiple highly automated vehicles is an important step towards realizing the advanced air mobility vision. At the National Aeronautics and Space Administration’s Langley Research Center, a remote operation center exists and has been tested using humans piloting simulated vehicles. In this paper, we explore the human element within live flight operations that rely on increasingly automated technologies. Four ground control station operators performed multiple live flight operations. We employed a naturalistic approach and relied on qualitative data such as interviews and discussions with subject matter experts to help facilitate discovery. The present work evaluates the functions that the human and the automation had during the live operations, lists psychological constructs that may have promoted or reduced task performance, and provides recommendations on design of the remote operations environment and training of future ground control station operators.

Advanced Air Mobility↗

NASA NTRSDate not supplied

Where is the Human in the Loop? Human Factors Analysis of Extended Visual Line of Sight Unmanned Aerial System Operations within a Remote Operations Environment

Advanced Air Mobility↗

DOE OSTI2020

Automatic Seismic Phase Picking Using Deep Learning for the EGS Collab project

Microseismic monitoring plays an important role in many energy-related and environmental industries.The microseismic event catalog and seismic structure of the subsurface are two of the primary outputsof the microseismic monitoring system. Though rough locations of microseismic events can be estimated automatically, obtaining high-resolution microseismic event locations requires a significant amount of human laborespecially on seismic phase picking. Unlike traditional automatic pickers that are usually less precise than human analysts, a fewrecently proposed algorithms based on deepneural networks(DNN)were able to match or surpass human performance for earthquake signals. Due to differences in the spatial scale of the study area, sensor sampling rate, and geometry of the monitoring system, it is not clear whether these deepneural networkmodels can be used to speed up microseismic data processing. In this paper, we adapted the DNN based technique for automatic phase picking of microseismic signals. We usedmicroseismic data recorded at the experiment 1 site of the enhancedgeothermal system (EGS) Collab project anddesigneda workflowthat we call transfer-learning aided double-difference tomography (TADT),thatcombines transfer learning and seismic tomography. We re-train an existing DNN with our data to obtain a newmodel using around 3500 seismogramsand associated manual phase picks. Thistransfer learnedmodel is able to reach human performance but muchfaster than human analysts. The transfer-learning-derived phase pickswereused to improve microseismic event locations and imagethesubsurface. The results are similar to or slightly better than those obtained with manual phase picks.

Chai, Chengping↗

DOE OSTI2024

Improving the User Interface of the DeepLynx Data Warehouse

DeepLynx is an open-source ontology-based data warehouse created by INL to support the creation and life cycle of digital engineering projects, with a particular emphasis on digital twins [1]. Digital twins are systems that represent physical assets and process in a real-time digital environment [1]. Most well-known commercial data warehouses use Graphical User Interfaces (GUIs) for users to interact with their systems [3]. Limited publications have addressed the design of these interfaces and understanding of their target users. The current users and development team acknowledge the need to improve the current UI, not just for aesthetics but to improve functionality and workflow of DeepLynx. Traditional data warehouse users are developers, data scientists and business analysts [2]. DeepLynx users have a vast range of experience using data warehouses, and diverse roles, including engineers, scientists and management positions. Because there is a broader audience of target users for DeepLynx than a typical data warehouse, it is essential that DeepLynx has a useable and intuitive user interface. To achieve this the team performed human-computer interaction methods, including a Heuristic Evaluation of current UI using Neilsen’s Usability Heuristic, create personas based on current users by designing a user survey, data analysis and develop of personas. Followed by a redesign of the UI following using Neilsen’s Usability Heuristic and Norman’s Principles of Interactive Design in industry standard software Figma. Lastly a Heuristic Evaluation of new UI design, using Neilsen’s Usability Heuristic and User testing of redesign UI and have a group of users complete a Thinking Aloud Test of the new UI. Preliminary results of the Heuristic Evaluation of current UI arise issue with Consistency and Standards, Visibility of System Status, Match System and Real World and Recognition Rather than Recall. These issues were addressed in the proposed redesign by applying Neilsen’s Usability Heuristic and Norman’s Principles of Interactive Design. Next steps include formalized list of lessons learned and design implications for future publications.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1995

An Analytic Approximation to Very High Specific Impulse and Specific Power Interplanetary Space Mission Analysis

A simple, analytic approximation is derived to calculate trip time and performance for propulsion systems of very high specific impulse (50,000 to 200,000 seconds) and very high specific power (10 to 1000 kW/kg) for human interplanetary space missions. The approach assumed field-free space, constant thrust/constant specific power, and near straight line (radial) trajectories between the planets. Closed form, one dimensional equations of motion for two-burn rendezvous and four-burn round trip missions are derived as a function of specific impulse, specific power, and propellant mass ratio. The equations are coupled to an optimizing parameter that maximizes performance and minimizes trip time. Data generated for hypothetical one-way and round trip human missions to Jupiter were found to be within 1% and 6% accuracy of integrated solutions respectively, verifying that for these systems, credible analysis does not require computationally intensive numerical techniques.

Williams, Craig Hamilton↗

NASA NTRS2004

Using a Low Cost Flight Simulation Environment for Interdisciplinary Education

A multi-disciplinary and inter-disciplinary education is increasingly being emphasized for engineering undergraduates. However, often the focus is on interaction between engineering disciplines. This paper discusses the experience at Tuskegee University in providing interdisciplinary research experiences for undergraduate students in both Aerospace Engineering and Psychology through the utilization of a low cost flight simulation environment. The environment, which is pc-based, runs a low-cost of-the-shelf software and is configured for multiple out-of-the-window views and a synthetic heads down display with joystick, rudder and throttle controls. While the environment is being utilized to investigate and evaluate various strategies for training novice pilots, students were involved to provide them with experience in conducting such interdisciplinary research. On the global inter-disciplinary level these experiences included developing experimental designs and research protocols, consideration of human participant ethical issues, and planning and executing the research studies. During the planning phase students were apprised of the limitations of the software in its basic form and the enhancements desired to investigate human factors issues. A number of enhancements to the flight environment were then undertaken, from creating Excel macros for determining the performance of the 'pilots', to interacting with the software to provide various audio/video cues based on the experimental protocol. These enhancements involved understanding the flight model and performance, stability & control issues. Throughout this process, discussions of data analysis included a focus from a human factors perspective as well as an engineering point of view.

Khan, M. Javed↗

NASA NTRS2003

Evaluation of Human vs. Teleoperated Robotic Performance in Field Geology Tasks at a Mars Analog Site

Exploration mission designers and planners have costing models used to assess the affordability of given missions - but very little data exists on the relative science return produced by different ways of exploring a given region. Doing cost-benefit analyses for future missions requires a way to compare the relative field science productivity of spacesuited humans vs. virtual presence/teleoperation from a nearby habitat or orbital station, vs. traditional terrestrial-controlled rover operations. The goal of this study was to define science-return metrics for comparing human and robotic fieldwork, and then obtain quantifiable science-return performance comparisons between teleoperated rovers and spacesuited humans. Test runs with a simulated 2015-class rover and with spacesuited geologists were conducted at Haughton Crater in the Canadian Arctic in July 2002. Early results imply that humans will be 1-2 orders of magnitude more productive per unit time in exploration than future terrestrially-controlled robots.

Glass, B.↗

NASA NTRS1974

Assess program: Interactive data management systems for airborne research

Two data systems were developed for use in airborne research. Both have distributed intelligence and are programmed for interactive support among computers and with human operators. The C-141 system (ADAMS) performs flight planning and telescope control functions in addition to its primary role of data acquisition; the CV-990 system (ADDAS) performs data management functions in support of many research experiments operating concurrently. Each system is arranged for maximum reliability in the first priority function, precision data acquisition.

Munoz, R. M.↗

DOE OSTI2020

A NWB-based dataset and processing pipeline of human single-neuron activity during a declarative memory task

A challenge for data sharing in systems neuroscience is the multitude of different data formats used. Neurodata Without Borders: Neurophysiology 2.0 (NWB:N) has emerged as a standardized data format for the storage of cellular-level data together with meta-data, stimulus information, and behavior. A key next step to facilitate NWB:N adoption is to provide easy to use processing pipelines to import/export data from/to NWB:N. Here, we present a NWB-formatted dataset of 1863 single neurons recorded from the medial temporal lobes of 59 human subjects undergoing intracranial monitoring while they performed a recognition memory task. We provide code to analyze and export/import stimuli, behavior, and electrophysiological recordings to/from NWB in both MATLAB and Python. The data files are NWB:N compliant, which affords interoperability between programming languages and operating systems. This combined data and code release is a case study for how to utilize NWB:N for human single-neuron recordings and enables easy re-use of this hard-to-obtain data for both teaching and research on the mechanisms of human memory.

Science & Technology - Other Topics↗

DOE OSTI2023

An Overview of the Risk Assessment Information System

This technical memorandum (TM) presents an overview of the Risk Assessment Information System (RAIS), a collection of web-based tools designed to assist with the environmental risk assessment process. The objective of the RAIS is to be a single resource for the risk assessment process, providing guidance when planning and performing the steps: data assessment, exposure assessment, toxicity assessment, and risk characterization. The RAIS evolved as a result of the initial remediation efforts at various United States (U.S.) Department of Energy (DOE) facilities. The goal was to increase the efficiency and transparency of the human health and ecological assessments being performed by DOE’s Office of Environmental Management, Oak Ridge Operations (ORO) office by providing a repository for toxicity information, physicochemical data, risk assessment procedures, standardized risk calculation methods, and web-based tools. Since the initial launch in 1996, the RAIS has expanded its user base outside of the federal government and now has users from over 100 countries, universities, states, and local governments. What sets the RAIS apart from other risk assessment sites are the publicly available, searchable toxicity and physicochemical databases and the wide range of chemical and radionuclide risk calculation tools. The purpose of this TM is to present the RAIS tools in order of the website menus and explain how they fit in the risk assessment process. In addition, this TM describes differences between the chemical and radionuclide tools of the RAIS. Screening level equations, chronic daily intake equations, and default exposure factors used in the chemical and radionuclide calculators are included in the appendices of this TM. This TM is not intended to be a detailed guide to risk assessment or the RAIS tools. The tools on the RAIS can be used to comply with procedures from multiple agencies, including but not limited to DOE, U.S. Environmental Protection Agency (EPA), U.S. Department of Defense (DoD), and many state governments. Further information on the RAIS tools can be found in the user guides and tutorials available on the webpage.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

NASA NTRS1993

Intelligent data presentation for real-time spacecraft monitoring

This paper describes an intelligent user interface that is currently under development. The interface serves as a front end for real-time spacecraft monitoring software. The software operates under circumstances in which neither an intelligent human without automated assistance nor an automated system without intelligence are sufficiently effective. The user interface is supported by dynamic trade-off evaluation (DTE), a new technique that has been developed to automate general types of performance trade-offs in real-time problem solving systems. In this application, DTE is used to perform dynamic input data management for the purpose of determining which input data should be monitored in time constrained situations and how to present the monitoring information to a human analyst who has the ultimate responsibility for the spacecraft. This application has demonstrated that DTE can be used to dynamically vary the data that is monitored, making it possible to detect and correctly analyze all anomalous data by examining only a subset of the total input data. In carefully structured experimental evaluations that use real spacecraft data and real decision making, DTE provides the ability to handle a three-fold increase in input data (in real-time) without loss of performance and to intelligently present the information to a mission analyst.

Schwuttke, U. M.↗