Results for “Task performance” — Page 9

DOE OSTI2020

EFCOG Human Performance Improvement Task Group: Task 20-2, Asking Better Error Precursor Questions for Effective Job Planning, Pre-Job Briefs, and Event Investigations

The second principle of human performance states: “error-likely situations are predictable, manageable, and preventable.” An error-likely situation comes into play when task-related factors exceed the capabilities of the individual, creating a mismatch at the point when the individual is “touching” either the physical or the paper plant. The simple presence of adverse conditions cannot be error-likely unless a specific action is to occur within that set of adverse conditions.

99 GENERAL AND MISCELLANEOUS↗

NASA NTRS1985

Space Station Application of Simulator-Developed Aircrew Coordination and Performance Measures

This paper summarizes a study in progress at NASA/Ames Research Center to develop measures of aircrew coordination and decision-making factors and to relate them to flight task performance, that is, to crew and system performance measures. The existence of some similar interpersonal process and task performance requirements suggests a potential application of these methods in space station crew research -- particularly research conducted in ground-based mock-ups. The secondary objective of this study should also be of interest: to develop information on crew process and performance for application in developing crew training programs.

Murphy, Miles↗

NASA NTRS2015

Detection of Operator Performance Breakdown as an Automation Triggering Mechanism

Performance breakdown (PB) has been anecdotally described as a state where the human operator "loses control of context" and "cannot maintain required task performance." Preventing such a decline in performance is critical to assure the safety and reliability of human-integrated systems, and therefore PB could be useful as a point at which automation can be applied to support human performance. However, PB has never been scientifically defined or empirically demonstrated. Moreover, there is no validated objective way of detecting such a state or the transition to that state. The purpose of this work is: 1) to empirically demonstrate a PB state, and 2) to develop an objective way of detecting such a state. This paper defines PB and proposes an objective method for its detection. A human-in-the-loop study was conducted: 1) to demonstrate PB by increasing workload until the subject reported being in a state of PB, and 2) to identify possible parameters of a detection method for objectively identifying the subjectively-reported PB point, and 3) to determine if the parameters are idiosyncratic to an individual/context or are more generally applicable. In the experiment, fifteen participants were asked to manage three concurrent tasks (one primary and two secondary) for 18 minutes. The difficulty of the primary task was manipulated over time to induce PB while the difficulty of the secondary tasks remained static. The participants' task performance data was collected. Three hypotheses were constructed: 1) increasing workload will induce subjectively-identified PB, 2) there exists criteria that identifies the threshold parameters that best matches the subjectively-identified PB point, and 3) the criteria for choosing the threshold parameters is consistent across individuals. The results show that increasing workload can induce subjectively-identified PB, although it might not be generalizable-only 12 out of 15 participants declared PB. The PB detection method based on signal detection analysis was applied to the performance data and the results showed that PB can be identified using the method, particularly when the values of the parameters for the detection method were calibrated individually.

multi-task environment↗

NASA NTRS2025

Countermeasures for Mitigation of Sensorimotor Decrements Following Head-Down Tilt Bed Rest

BACKGROUND Astronauts experience postflight disturbances in postural and locomotor control due to sensorimotor adaptations during spaceflight. These alterations may have adverse consequences if a rapid egress is required after landing. Although exercise is partially effective for mitigating cardiovascular and muscular deconditioning, additional countermeasures are needed to further preserve sensorimotor function. Proprioception training and electrical muscle stimulation (EMS) are two promising in-flight countermeasures. Since prolonged head down tilt bed rest (HDTBR) is a spaceflight analog for body unloading and causes postural and locomotor control decrements that parallel those observed after spaceflight, it can be used to facilitate the development of these countermeasures. METHODS This study will determine the effects of proprioception training and EMS on functional task performance and sensorimotor function following 60 days of 6° HDTBR. Subjects will be randomly assigned to one of four groups: 1) an EMS arm, 2) a proprioception training arm, 3) an exercise plus proprioceptive training arm, and 4) a control arm. The EMS countermeasure will include daily bilateral stimulation of selected bilateral lower extremity muscles (30 minutes per session). Proprioception training will be performed three days per week (25 minutes per session) consisting of body-loaded postural tasks in the horizontal position on an air bearing sled. Exercise training will mimic current protocols used on the International Space Station, but treadmill aerobic exercise will be replaced with additional cycling aerobic exercise. Primary outcome measures will include pre- and post- HDTBR functional tests that require high demand for dynamic control of postural stability. Secondary measures will be used to explore key physiological changes that underlie countermeasure benefits. All HDTBR and data collection activities will be completed by the German Aerospace Center (DLR) at the :envihab facility. Given the constrained samples size, a Bayesian modelling approach will be used to quantify the probability that there is an effect of a given magnitude. HARDWARE AND PROTOCOL DEVELOPMENT Final hardware modifications and protocol developments were completed in preparation for Campaign 1, which began in September 2024. These included shipment, setup, and operator training for the transportable gravity bed, horizontal squat device, foam obstacle course, EMS devices, leg dexterity system, foot sole skin sensitivity system, and Radiofrequency Echographic Multi Spectrometry (REMS) ultrasound device. In addition, specialized protocols were developed for data collection using DLR’s equipment, including muscle morphology magnetic resonance imaging (MRI), optical coherence tomography, venous blood flow MRI and ultrasound, muscle ultrasound and impedance, and skin blood flow ultrasound. We will present early data from the first campaign, which concluded in November, 2024. These will be compared with previous data from the recent 30-day HDTBR campaigns (Spaceflight associated neuro-ocular syndrome countermeasures (SANS-CM)) conducted at DLR. RELEVANCE The deliverable from this project will be proof-of-concept sensorimotor countermeasure designs for functional task performance with full assessment of efficacy in a spaceflight analog. If one or more countermeasures are effective, they will be translated for validation with the suite of operationally implemented in-flight countermeasures.

T R Macaulay↗

NASA NTRSDate not supplied

Clinical Decision Support - Concepts of Operation

We are entering a new era in space exploration to return to the moon and explore Mars. These ambitious goals will require significant changes to in-flight and habitat medical care due to constraints on mass, volume, power, crew time and medical evacuation capabilities. These constraints make it absolutely necessary to develop transformative solutions using new technologies. The Exploration Medical Capability (ExMC) Element of the Human Research Program (HRP) pushes the boundary of space medical systems to advance the care of astronauts on future exploration missions beyond low Earth orbit by identifying and testing next-generation medical care and crew health maintenance technologies. The Clinical Decision Support (CDS) project addresses the gap Medical-701 within the Inflight Medical Conditions risk: Enhance medical capabilities within an exploration medical system. For long-duration, deep space missions, computational and data resources will play an important role in maintaining crew health, wellness and performance where the crew will need to be more self-reliant. The aim of the CDS project is to develop and provide recommended requirements for an in-vehicle CDSS that acts as an assistant for delivering optimal health and performance and medical care during exploration missions. The CDSS is envisioned as a software-based tool that will augment a crewmembers’ knowledge, skills and abilities to assist in decision-making and crew health and performance (CHP) management thus increasing CHP systems capabilities. The human interface will be context aware and lessen the cognitive load to assimilate and use information as well as combine large disparate data sets in such a manner that provides the crew with actionable insight to decisions related to crew medical, health and performance management. Crew autonomy will be provided through a CDS that presents knowledge and data in a context aware manner to augment a crew members’ knowledge, skills and abilities during the process of observation, orientation, decisions and action. The CDS project addresses the need for crew members to operate independently during long duration space exploration missions that require medical Levels of Care (LoC) V, the highest level specified by NASA-STD-3001 and described in more detail by the ExMC interpretation of LoC document (NASA/TM-2017-219290), where significant changes to in-flight and habitat medical care necessitate increasing crew autonomy in decision making and task performance. The CDS project will develop and test a series of iterative and increasingly more complex system prototypes. These annual demonstrations of the data system integration with the crew health and performance domain will inform exploration medical system requirements for an on-board Clinical Decision Support System (CDSS) through a series of use cases that guide CDS prototype functionality. CDS concepts are based on ExMC Concept of Operations documents (presented separately) and will highlight architecture extensibility to other more complex analyses and tests using core crew health and performance integrated data management, processing and visualization capabilities. This approach also establishes how externally developed analyses and approaches could be added to expand a clinical decision support system and thus highlight how a comprehensive system can be commercially and/or globally developed. The CDS project will build upon the concept of an integrated data management approach based on the Medical Data Architecture (MDA) project to more fully address challenges associated with in-flight and habitat medical, health and performance care due to constraints on mass, volume, power, crew time and medical evacuation capabilities required for medical LoC V. These requirements will be derived through systems engineering approaches and software prototype developments over the course of the multi-year CDS project to address crew health and performance decision-making and task performance, often autonomously executed by the crew, in a manner that is consistent with the appropriate medical level of care for the mission. This presentation will provide an overview of the vision for the CDS project and highlight the initial accomplishments in project planning, implementation and requirements identification in fiscal year 2020.

clinical decision support↗

NASA NTRSDate not supplied

Clinical Decision Support - Overview and Update

We are entering a new era in space exploration to return to the moon and explore Mars. These ambitious goals will require significant changes to in-flight and habitat medical care due to constraints on mass, volume, power, crew time and medical evacuation capabilities. These constraints make it absolutely necessary to develop transformative solutions using new technologies. The Exploration Medical Capability (ExMC) Element of the Human Research Program (HRP) pushes the boundary of space medical systems to advance the care of astronauts on future exploration missions beyond low Earth orbit by identifying and testing next-generation medical care and crew health maintenance technologies. The Clinical Decision Support (CDS) project addresses the gap Medical-701 within the Inflight Medical Conditions risk: Enhance medical capabilities within an exploration medical system. For long-duration, deep space missions, computational and data resources will play an important role in maintaining crew health, wellness and performance where the crew will need to be more self-reliant. The aim of the CDS project is to develop and provide recommended requirements for an in-vehicle CDSS that acts as an assistant for delivering optimal health and performance and medical care during exploration missions. The CDSS is envisioned as a software-based tool that will augment a crewmembers’ knowledge, skills and abilities to assist in decision-making and crew health and performance (CHP) management thus increasing CHP systems capabilities. The human interface will be context aware and lessen the cognitive load to assimilate and use information as well as combine large disparate data sets in such a manner that provides the crew with actionable insight to decisions related to crew medical, health and performance management. Crew autonomy will be provided through a CDS that presents knowledge and data in a context aware manner to augment a crew members’ knowledge, skills and abilities during the process of observation, orientation, decisions and action. The CDS project addresses the need for crew members to operate independently during long duration space exploration missions that require medical Levels of Care (LoC) V, the highest level specified by NASA-STD-3001 and described in more detail by the ExMC interpretation of LoC document (NASA/TM-2017-219290), where significant changes to in-flight and habitat medical care necessitate increasing crew autonomy in decision making and task performance. The CDS project will develop and test a series of iterative and increasingly more complex system prototypes. These annual demonstrations of the data system integration with the crew health and performance domain will inform exploration medical system requirements for an on-board Clinical Decision Support System (CDSS) through a series of use cases that guide CDS prototype functionality. CDS concepts are based on ExMC Concept of Operations documents (presented separately) and will highlight architecture extensibility to other more complex analyses and tests using core crew health and performance integrated data management, processing and visualization capabilities. This approach also establishes how externally developed analyses and approaches could be added to expand a clinical decision support system and thus highlight how a comprehensive system can be commercially and/or globally developed. The CDS project will build upon the concept of an integrated data management approach based on the Medical Data Architecture (MDA) project to more fully address challenges associated with in-flight and habitat medical, health and performance care due to constraints on mass, volume, power, crew time and medical evacuation capabilities required for medical LoC V. These requirements will be derived through systems engineering approaches and software prototype developments over the course of the multi-year CDS project to address crew health and performance decision-making and task performance, often autonomously executed by the crew, in a manner that is consistent with the appropriate medical level of care for the mission. This presentation will provide an overview of the vision for the CDS project and highlight the initial accomplishments in project planning, implementation and requirements identification in fiscal year 2020.

clinical decision support system↗

NASA NTRS1985

Assessment of simulation fidelity using measurements of piloting technique in flight. II

Two components of the Vertical Motion Simulator (presently being used to assess the fidelity of UH-60A simulation) are evaluated: (1) the dash/quickstop Nap-of-the-earth (NOE) piloting task, and (2) the bop-up task. Data from these two flight test experiments are presented which provide information on the effect of reduced visual field of view, variation in scene content and texture, and the affect of pure time delay in the closed-loop pilot response. In comparison with task performance results obtained in flight tests, the results from the simulation indicate that the pilot's NOE task performance in the simulator is significantly degraded.

Ferguson, S. W.↗

NASA NTRS1988

EMMA: The expert system for munition maintenance

Expert Missile Maintenance Aid (EMMA) is a first attempt to enhance maintenance of the tactical munition at the field and depot level by using artificial intelligence (AI) techniques. The ultimate goal of EMMA is to help a novice maintenance technician isolate and diagnose electronic, electromechanical, and mechanical equipment faults to the board/chassis level more quickly and consistently than the best human expert using the best currently available automatic test equipment (ATE). To this end, EMMA augments existing ATE with an expert system that captures the knowledge of design and maintenance experts. The EMMA program is described, including the evaluation of field-level expert system prototypes, the description of several study tasks performed during EMMA, and future plans for a follow-on program. This paper will briefly address several study tasks performed during EMMA. The paper concludes with a discussion of future plans for a follow-on program and other areas of concern.

Mullins, Barry E.↗

NASA NTRS1994

A virtual work space for both hands manipulation with coherency between kinesthetic and visual sensation

This paper describes the construction of a virtual work space for tasks performed by two handed manipulation. We intend to provide a virtual environment that encourages users to accomplish tasks as they usually act in a real environment. Our approach uses a three dimensional spatial interface device that allows the user to handle virtual objects by hand and be able to feel some physical properties such as contact, weight, etc. We investigated suitable conditions for constructing our virtual work space by simulating some basic assembly work, a face and fit task. We then selected the conditions under which the subjects felt most comfortable in performing this task and set up our virtual work space. Finally, we verified the possibility of performing more complex tasks in this virtual work space by providing simple virtual models and then let the subjects create new models by assembling these components. The subjects can naturally perform assembly operations and accomplish the task. Our evaluation shows that this virtual work space has the potential to be used for performing tasks that require two-handed manipulation or cooperation between both hands in a natural manner.

Ishii, Masahiro↗

NASA NTRS2001

An Experimental Investigation of Dextrous Robots Using EVA Tools and Interfaces

This investigation of robot capabilities with extravehicular activity (EVA) equipment looks at how improvements in dexterity are enabling robots to perform tasks once thought to be beyond machines. The approach is qualitative, using the Robonaut system at the Johnson Space Center (JSC), performing task trials that offer a quick look at this system's high degree of dexterity and the demands of EVA. Specific EVA tools attempted include tether hooks, power torque tools, and rock scoops, as well as conventional tools like scissors, wire strippers, forceps, and wrenches. More complex EVA equipment was also studied, with more complete tasks that mix tools, EVA hand rails, tethers, tools boxes, PIP pins, and EVA electrical connectors. These task trials have been ongoing over an 18 month period, as the Robonaut system evolved to its current 43 degree of freedom (DOF) configuration, soon to expand to over 50. In each case, the number of teleoperators is reported, with rough numbers of attempts and their experience level, with a subjective difficulty rating assigned to each piece of EVA equipment and function. JSC' s Robonaut system was successful with all attempted EVA hardware, suggesting new options for human and robot teams working together in space.

Ambrose, Robert↗

NASA NTRS1977

Task and work performance on Skylab missions 2, 3, and 4: Time and motion study: Experiment M151

Human task performance was evaluated under weightlessness conditions during long duration space flight in order to study the characteristics of the adaptation function. Results show that despite pronounced variability in training schedules and in initial reaction to the Skylab environment, in-flight task performance was relatively equivalent among Skylab crews, and behavioral performance continued to improve from beginning to end of all missions.

Kubis, J. F.↗

NASA NTRS1991

Strategic behavior, workload, and performance in task scheduling

Scheduling theory is proposed as a normative model for strategic behavior when operators are confronted by several tasks, all of which should be completed within a fixed time span, and when they are free to choose the order in which the tasks should be done. Three experiments are described to investigate the effect of knowing the correct scheduling rule on the efficiency of performance, subjective workload, and choice of strategy under different conditions of time pressure. The most potent effects are from time pressure. The reasons for the weak effect of knowing the rules are discussed, and implications for strategic behavior, displays, and decision aids are indicated.

Moray, Neville↗

NASA NTRS1978

Secondary visual workload capability with primary visual and kinesthetic-tactual displays

Subjects performed a cross-adaptive tracking task with a visual secondary display and either a visual or a quickened kinesthetic-tactual (K-T) primary display. The quickened K-T display resulted in superior secondary task performance. Comparisons of secondary workload capability with integrated and separated visual displays indicated that the superiority of the quickened K-T display was not simply due to the elimination of visual scanning. When subjects did not have to perform a secondary task, there was no significant difference between visual and quickened K-T displays in performing a critical tracking task.

Gilson, R. D.↗

NASA NTRS2001

Space Station Human Factors: Designing a Human-Robot Interface

The experiments described in this paper are part of a larger joint MIT/NASA research effort and focus on the development of a methodology for designing and evaluating integrated interfaces for highly dexterous and multifunctional telerobot. Specifically, a telerobotic workstation is being designed for an Extravehicular Activity (EVA) anthropomorphic space station telerobot called Robonaut. Previous researchers have designed telerobotic workstations based upon performance of discrete subsets of tasks (for example, peg-in-hole, tracking, etc.) without regard for transitions that operators go through between tasks performed sequentially in the context of larger integrated tasks. The experiments presented here took an integrated approach to describing teleoperator performance and assessed how subjects operating a full-immersion telerobot perform during fine position and gross position tasks. In addition, a Robonaut simulation was also developed as part of this research effort, and experimentally tested against Robonaut itself to determine its utility. Results show that subject performance of teleoperated tasks using both Robonaut and the simulation are virtually identical, with no significant difference between the two. These results indicate that the simulation can be utilized as both a Robonaut training tool, and as a powerful design platform for telepresence displays and aids.

Rochlis, Jennifer L.↗

NASA NTRS1974

Study to design and develop remote manipulator system

Modeling of human performance in remote manipulation tasks is reported by automated procedures using computers to analyze and count motions during a manipulation task. Performance is monitored by an on-line computer capable of measuring the joint angles of both master and slave and in some cases the trajectory and velocity of the hand itself. In this way the operator's strategies with different transmission delays, displays, tasks, and manipulators can be analyzed in detail for comparison. Some progress is described in obtaining a set of standard tasks and difficulty measures for evaluating manipulator performance.

Hill, J. W.↗

DOE OSTI2022

Optimal vocabulary selection approaches for privacy-preserving deep NLP model training for information extraction and cancer epidemiology

With the use of artificial intelligence and machine learning techniques for biomedical informatics, security and privacy concerns over the data and subject identities have also become an important issue and essential research topic. Without intentional safeguards, machine learning models may find patterns and features to improve task performance that are associated with private personal information. The privacy vulnerability of deep learning models for information extraction from medical textural contents needs to be quantified since the models are exposed to private health information and personally identifiable information. The objective of the study is to quantify the privacy vulnerability of the deep learning models for natural language processing and explore a proper way of securing patients’ information to mitigate confidentiality breaches. The target model is the multitask convolutional neural network for information extraction from cancer pathology reports, where the data for training the model are from multiple state population-based cancer registries. This study proposes the following schemes to collect vocabularies from the cancer pathology reports; (a) words appearing in multiple registries, and (b) words that have higher mutual information. We performed membership inference attacks on the models in high-performance computing environments. The comparison outcomes suggest that the proposed vocabulary selection methods resulted in lower privacy vulnerability while maintaining the same level of clinical task performance.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2023

Test and Evaluation of Systems with Embedded Machine Learning Components

As Machine Learning (ML) continues to advance, it is being integrated into more systems. Often, the ML component represents a significant portion of the system that reduces the burden on the end user or significantly improves task performance. However, the ML component represents an unknown complex phenomenon that is learned from collected data without the need to be explicitly programmed. Despite the improvement in task performance, the models are often black boxes. Evaluating the credibility and the vulnerabilities of ML models poses a gap in current test and evaluation practice. For high consequence applications, the lack of testing and evaluation procedures represents a significant source of uncertainty and risk. To help reduce that risk, here we present considerations to evaluate systems embedded with an ML component within a red-teaming inspired methodology. We focus on (1) cyber vulnerabilities to an ML model, (2) evaluating performance gaps, and (3) adversarial ML vulnerabilities.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1994

Advanced Video Analysis Needs for Human Performance Evaluation

Evaluators of human task performance in space missions make use of video as a primary source of data. Extraction of relevant human performance information from video is often a labor-intensive process requiring a large amount of time on the part of the evaluator. Based on the experiences of several human performance evaluators, needs were defined for advanced tools which could aid in the analysis of video data from space missions. Such tools should increase the efficiency with which useful information is retrieved from large quantities of raw video. They should also provide the evaluator with new analytical functions which are not present in currently used methods. Video analysis tools based on the needs defined by this study would also have uses in U.S. industry and education. Evaluation of human performance from video data can be a valuable technique in many industrial and institutional settings where humans are involved in operational systems and processes.

Campbell, Paul D.↗