Recall of paired-associates as a function of overt and covert rehearsal procedures
Effect on memory of mode of studying paired associates, and mathematical model employing short term rehearsal buffer and long term memory
MATHEMATICAL MODEL↗
SEARCH · Search NASA
Results for “human performance modeling”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Fifth Annual NASA-University Conference on Manual Control
Studies on display systems, optimal control methods, human performance theory, and neuromuscular models
Source record↗
Crew workload strategies in advanced cockpits
Many methods of measuring and predicting operator workload have been developed that provide useful information in the design, evaluation, and operation of complex systems and which aid in developing models of human attention and performance. However, the relationships between such measures, imposed task demands, and measures of performance remain complex and even contradictory. It appears that we have ignored an important factor: people do not passively translate task demands into performance. Rather, they actively manage their time, resources, and effort to achieve an acceptable level of performance while maintaining a comfortable level of workload. While such adaptive, creative, and strategic behaviors are the primary reason that human operators remain an essential component of all advanced man-machine systems, they also result in individual differences in the way people respond to the same task demands and inconsistent relationships among measures. Finally, we are able to measure workload and performance, but interpreting such measures remains difficult; it is still not clear how much workload is too much or too little nor the consequences of suboptimal workload on system performance and the mental, physical, and emotional well-being of the human operators. The rationale and philosophy of a program of research developed to address these issues will be reviewed and contrasted to traditional methods of defining, measuring, and predicting human operator workload. Viewgraphs are given.
Hart, Sandra G.↗
NASA Specialized Center for Research and Training (NSCORT) in space environmental health
Activities of the Center for Space Environmental Health (CSEH), one of several NSCORTs supported by NASA in order to advance knowledge in environmental health in space habitats, are reviewed. Research in environmental health will define the standards or requirements needed to protect human health. This information will affect mission plans and the design of space habitats. This reseach will study unique contaminant stresses and lead to risk models for human health and performance.
Clarkson, Thomas W.↗
Using Computational Cognitive Modeling to Diagnose Possible Sources of Aviation Error
We present a computational model of a closed-loop, pilot-aircraft-visual scene-taxiway system created to shed light on possible sources of taxi error. Creating the cognitive aspects of the model using ACT-R required us to conduct studies with subject matter experts to identify experiential adaptations pilots bring to taxiing. Five decision strategies were found, ranging from cognitively-intensive but precise, to fast, frugal but robust. We provide evidence for the model by comparing its behavior to a NASA Ames Research Center simulation of Chicago O'Hare surface operations. Decision horizons were highly variable; the model selected the most accurate strategy given time available. We found a signature in the simulation data of the use of globally robust heuristics to cope with short decision horizons as revealed by errors occurring most frequently at atypical taxiway geometries or clearance routes. These data provided empirical support for the model.
Pilots↗
Self-Motion and Depth Estimation from Image Sequences
An image-based version of a computational model of human self-motion perception (developed in collaboration with Dr. Leland S. Stone at NASA Ames Research Center) has been generated and tested. The research included in the grant proposal sought to extend the utility of the self-motion model so that it could be used for explaining and predicting human performance in a greater variety of aerospace applications. The model can now be tested with video input sequences (including computer generated imagery) which enables simulation of human self-motion estimation in a variety of applied settings.
Perrone, John↗
An improved dataset for predicting mammal infecting viruses from genetic sequence information
There have been several attempts to develop machine learning (ML) models to identify human infecting viruses from their genomic sequences, with varying degrees of success. Direct comparison between models is problematic, because these models are typically trained and evaluated on different datasets with alternative data splitting schemes, features, and model performance metrics. In this paper we present a standardized dataset of mammal infecting and non-infecting viral pathogens, refined from the previous work of Mollentze et al. to include the latest literature evidence, roughly doubling the number of curated host-virus records available to the community, and new host target labels, primate and mammal. The new host labels were included for several reasons, including previous reports that classification performance is better at broader taxonomic ranks and the idea that there may be more data for primate infection that might serve as a suitable proxy for zoonotic potential and avoidance of false positives for human infection due to absence of evidence. On this dataset, we report the performance of eight machine learning models for predicting mammal-infecting viruses from their genomic sequences. We find that randomly assigning cases in our improved dataset to training/testing sets, when compared to the original assignments into training/testing in Mollentze et al., increases the overall average ROC AUC of prediction of human infection from 0.663 ± 0.070 to 0.784 ± 0.013, consistent with the reduction in phylogenetic distance between train and test sets (relative entropy change from 3.00 to 0.08). The broadest host category of mammal infection can be predicted most reliably at 0.850 ± 0.020. We share our improved dataset and code to enable standardized comparisons of machine learning methods to predict human host infections. Overall, we have presented preliminary evidence that classification of virus host infection is more tractable at higher taxonomic ranks, that unsurprisingly reducing the phylogenetic distance between training and test sets can improve predictive performance, that peptide kmer features appear to be harmful to out of sample model performance, and we are left with the question of whether models for virus host prediction can reasonably be expected to perform well in out of sample scenarios given the likelihood that viruses do not share a common ancestor. Consistent with this concern, when the data is resampled such that there is no overlap between viral families in training and test sets (relative entropy > 24), models perform no better than random chance at prediction of human infection regardless of whether kmers are included (ROC AUC 0.50 ± 0.08) or not (ROC AUC 0.50 ± 0.04).
59 BASIC BIOLOGICAL SCIENCES↗
Simulation-Based Recovery Action Analysis Using the EMRALD Dynamic Risk Assessment Tool
A recovery action is defined as the action that prevents deviant conditions from producing unwanted effects. It generally indicates a kind of countermeasure performed in response to a failure of human action. The recovery actions especially play an important role in complex systems like nuclear power plants (NPPs), which consist of highly sophisticated controllers to ensure that desired performance and safety must be achieved and maintained. This is because a combination of human error and its recovery failure may be able to cause a catastrophic effect on a system. Analyzing recovery actions has been a critical part of HRA, which is a technique to evaluate human errors and provide human error probabilities (HEPs) for application in probabilistic safety assessment (PSA). If recovery actions are not adequately analyzed and applied to PSA models, the PSA results may be under-estimated or be not able to reasonably account for the failure of human actions in the context of PSA. For this reason, some regulatory documents such as ASME/ANS RA-Sb-2013 by the American Society for Mechanical Engineers and the American Nuclear Society and NUREG-1792 by U.S. Nuclear Regulatory Commission have emphasized the importance of recovery analysis within the HRA. A couple of existing HRA methods, such as the Technique for Human Error-Rate Prediction (THERP), the Cause-Based Decision Tree (CBDT), and the Korean Standard HRA (K-HRA), have respectively suggested their own approaches to the HRA recovery analysis. However, there are a couple of limitations to treating recovery actions using only the current HRA methods available. The biggest limitation is that the existing recovery analysis does not explicitly consider a variety of recovery action types and recovery sequences as they occur in actual NPPs. To handle the limitations of existing recovery analysis, this study proposes a simulation-based recovery analysis method using the Event Modeling Risk Assessment Using Linked Diagram (EMRALD) software. The EMRALD software is a dynamic simulation tool for PSA. It supports realistic and dynamic modeling of human actions as they would be performed at NPPs. It is also favorable to simultaneously model the specific moment at which an action is performed, the time it takes to perform the action, and the failure probability of that action. In this paper, a detailed methodology for modeling recovery actions in the simulation platform is proposed with a couple of examples. Then, outputs from the simulation are discussed as reviewing if this novel approach can complement the challenges of existing recovery analyses.
99 GENERAL AND MISCELLANEOUS↗
Machine Learning for Predicting Team Functioning in HERA Missions
Team functioning is integral to success in future long term space exploration missions. Proactively detecting declines in team functioning can mitigate conflict and ensure mission success. This project developed a speech-based artificial intelligence (AI) system that unobtrusively predicts degradation in team functioning, including performance and cohesion, in the Human Exploration Research Analog (HERA) Campaigns 4 and 5. The AI system conducted automated analysis of the prosodic (tone of voice) and linguistic (language content) components of speech, modeling interpersonal dynamics at both the turn-taking and day-wide levels. We investigated team functioning via observing structured interactions (i.e., multi-mission space exploration vehicle-extra vehicular activity [MMSEV-EVA], team interaction battery [TIB]) and unstructured interactions before the MMSEV-EVA task. We developed machine learning models to predict team functioning (objective task accuracy, self reported team efficacy and self reported team cohesion) by analyzing OpenSmile acoustic features, linguistic descriptors extracted via the linguistic inquiry and word count (LIWC) dictionary, and semantic embeddings. In the TIB, static models using logistic regression and random forests were not able to predict task accuracy, but predicted team efficacy and cohesion during both the decision making and relational tasks to a moderate level (60-70%). Majority voting on the individual turns to predict day long team efficacy further increased accuracies (70-80%). Finally, long short-term memory (LSTM) models showed the best performance across all variables (80-91%), including task performance. In the MMSEV-EVA, static models achieved an accuracy of 60% with majority voting, which increased to 80% through the incorporation of mission day as a variable, accounting for the learning effect. A key finding across both tasks was the "team-dependent" nature of these interactions; models achieved much higher accuracy when trained on prior days of the same team's data rather than attempting to generalize across entirely different teams, with even 1-2 days of prior data per team achieving 5-15% improvement over team-independent models. In addition, the incorporation of pre-task data from the same team also improves model performance, e.g., incorporating data from the decision-making task of the TIB, which preceded the relational task, improved the prediction of team efficacy and cohesion during the latter. We compared model performance when trained on machine-generated data compared to data that had been further corrected by human annotators. Overall, models trained on human-corrected data exhibited a modest improvement in performance, particularly when acoustic features were used. We found no significant correlation between word error rate (WER) and model accuracy (r(55) = -0.08, p = 0.51), but model’s accuracy was significantly higher for medium/high quality transcription (0.74 (SD = 0.48)) compared to the low-quality group (0.64 (SD = 0.36)) (t(63)=2.82, p = 0.006). Based on these, several design recommendation emerge, that could inform Standards at NASA. Models predicting team functioning should incorporate at least one to two days of historical interaction data, include brief pre-task discussions, and explicitly model temporal learning effects, especially for longer operational tasks. Minimum quality standards for automated speech-processing pipelines are needed, given the performance gains observed with manually corrected acoustic data. Finally, systems should leverage both acoustic features and language embeddings in complementary ways, with modality choices and fusion strategies tailored to mission context, task demands, and data quality requirements.
Shrivatsa Mishra↗
Visualization and modeling of factors influencing visibility in computer-aided crewstation design
We have developed two modules for use in computer-aided design (CAD) of crewstation environments that enhance the designer's appreciation of factors influencing the pilot's vision and visual processing capacity. The Binocular Optics Module (BOM) is an interactive tool for visualizing geometric aspects of (1) how retinal imagery of the environment changes on the pilot's retinas under conditions of eye and object motion, and (2) how visual capabilities that can be modeled as regions or contours on the retinas, affect spatial perception of the environment. The Visual Performance Module (VPM) contains a signal processing model of human visual discrimination that quantitatively predicts visual discrimination performance. The outputs of the VPM are retinal contours that represent performance probabilities. These contours may be used as inputs to the BOM for visualizing those volumes of space within the crewstation that bound different levels of the pilot's of visual discrimination capability. Used together, the BOM and VPM provide the designer with the opportunity to interactively explore relationships between environmental retinal imagery and visual function, and the ability to factor the pilot's visual capabilities into the earliest phases of crewstation CAD.
Arditi, Aries↗
Artemis III and IV Crew Health and Performance System Model Development
To maintain Crew Health and Performance (CHP) during an Artemis mission, the NASA Human Research Program (HRP) and Exploration Medical Capabilities (ExMC) element recognize the challenge that many different vehicles, habitats, and operational groups must come together to develop and implement cross program capabilities. To address this challenge, the ExMC team created the prototype 2023 Artemis CHP System Model to analyze how human system requirements are implemented throughout an Artemis mission and help understand the effects of changing an individual vehicle or habitat requirement on a full mission. Since presenting this work at the 2024 HRP Investigators’ Workshop, ExMC has continued this effort, now called the Artemis III and IV CHP System Model, to better support its operational end users within the NASA Human Health and Performance Directorate (HHPD) workforce. In this presentation, we will recapitulate how visualizing requirements and their relationships using a Model-Based Systems Engineering approach (MBSE) serves to improve understanding of an Artemis mission’s CHP capabilities along with discussion on updates made to the model to increase accessibility for users within HHPD so that it may be used in the development of cross program CHP capabilities at NASA.
Crew Health and Performance↗
Dual-Use Space Technology Transfer Conference and Exhibition, Volume 1
This document contains papers presented at the Dual-Use Space Technology Transfer Conference and Exhibition held at the Johnson Space Center February 1-3, 1994. Possible technology transfers covered during the conference were in the areas of information access; innovative microwave and optical applications; materials and structures; marketing and barriers; intelligent systems; human factors and habitation; communications and data systems; business process and technology transfer; software engineering; biotechnology and advanced bioinstrumentation; communications signal processing and analysis; new ways of doing business; medical care; applications derived from control center data systems; human performance evaluation; technology transfer methods; mathematics, modeling, and simulation; propulsion; software analysis and decision tools systems/processes in human support technology; networks, control centers, and distributed systems; power; rapid development perception and vision technologies; integrated vehicle health management; automation technologies; advanced avionics; ans robotics technologies. More than 77 papers, 20 presentations, and 20 exhibits covering various disciplines were presented b experts from NASA, universities, and industry.
Kumar Krishen↗
Dual-Use Space Technology Transfer Conference and Exhibition
This is the second volume of papers presented at the Dual-Use Space Technology Transfer Conference and Exhibition held at the Johnson Space Center February 1-3, 1994. Possible technology transfers covered during the conference were in the areas of information access; innovative microwave and optical applications; materials and structures; marketing and barriers; intelligent systems; human factors and habitation; communications and data systems; business process and technology transfer; software engineering; biotechnology and advanced bioinstrumentation; communications signal processing and analysis; medical care; applications derived from control center data systems; human performance evaluation; technology transfer methods; mathematics, modeling, and simulation; propulsion; software analysis and decision tools; systems/processes in human support technology; networks, control centers, and distributed systems; power; rapid development; perception and vision technologies; integrated vehicle health management; automation technologies; advanced avionics; and robotics technologies.
Krishen, Kumar↗
Analysis of driver performance under reduced visibility
Mathematical models describing vehicle dynamics as well as human behavior may be useful in evaluating driver performance and in establishing design criteria for vehicles more compatible with man. In 1977, a two level model of driver steering behavior was developed, but its parameters were identified for clear visibility conditions only. Since driver performance degrades under conditions of reduced visibility, e.g., fog, the two level model should be investigated to determine its applicability to such conditions. The data analysis of a recently performed driving simulation experiment showed that the model still performed reasonably well under fog conditions, although there was a degradation in its predictive capacity during fog. Some additional parameters affecting anticipation and lag time may improve the model's performance for reduced visibility conditions.
Kaeppler, W. D.↗
Ames vision group research overview
A major goal of the reseach group is to develop mathematical and computational models of early human vision. These models are valuable in the prediction of human performance, in the design of visual coding schemes and displays, and in robotic vision. To date researchers have models of retinal sampling, spatial processing in visual cortex, contrast sensitivity, and motion processing. Based on their models of early human vision, researchers developed several schemes for efficient coding and compression of monochrome and color images. These are pyramid schemes that decompose the image into features that vary in location, size, orientation, and phase. To determine the perceptual fidelity of these codes, researchers developed novel human testing methods that have received considerable attention in the research community. Researchers constructed models of human visual motion processing based on physiological and psychophysical data, and have tested these models through simulation and human experiments. They also explored the application of these biological algorithms to applications in automated guidance of rotorcraft and autonomous landing of spacecraft. Researchers developed networks for inhomogeneous image sampling, for pyramid coding of images, for automatic geometrical correction of disordered samples, and for removal of motion artifacts from unstable cameras.
Watson, Andrew B.↗
Human Factors Research for Space Exploration: Measurement, Modeling, and Mitigation
As part of NASA's Human Research Program, the Space Human Factors Engineering Project serves as the bridge between Human Factors research and Human Spaceflight applications. Our goal is to be responsive to the operational community while addressing issues at a sufficient level of abstraction to ensure that our tools and solutions generalize beyond the point design. In this panel, representatives from four of our research domains will discuss the challenges they face in solving current problems while also enabling future capabilities. Historically, engineering-dominated organizations have tended to view good Human Factors (HF) as a desire rather than a requirement in system design and development. Our field has made significant gains in the past decade, however; the Department of Defense, for example, now recognizes Human-System Integration (HSI), of which HF is a component, as an integral part of their divisions hardware acquisition processes. And our own agency was far more accepting of HF/HSI requirements during the most recent vehicle systems definition than in any prior cycle. Nonetheless, HF subject matter experts at NASA often find themselves in catch up mode... coping with legacy systems (hardware and software) and procedures that were designed with little regard for the human element, and too often with an attitude of we can deal with any operator issues during training. Our challenge, then, is to segregate the true knowledge gaps in Space Human Factors from the prior failures to incorporate best (or even good) HF design principles. Further, we strive to extract the overarching core HF issues from the point-design-specific concerns that capture the operators (and managers) attention. Generally, our approach embraces a 3M approach to Human Factors: Measurement, Modeling, and Mitigation. Our first step is to measure human performance, to move from subjective anecdotes to objective, quantified data. Next we model the phenomenon, using appropriate methods in our field, modifying them to suit the unique aspects of the space environment. Finally, we develop technologies, tools, and procedures to mitigate the decrements in human performance and capabilities that occur in space environments. When successful, we decrease risks to crew safety and to mission success. When extremely successful (or lucky), we devise generalizable solutions that advance the state of our practice. Our panel is composed of researchers from diverse domains of our project... from different boxes, if you will, of the Human Factors Analysis and Classification System (HFACS).
Kaiser, Mary K.↗
A model of human decisionmaking in multiple process monitoring situations
It is proposed that human decisionmaking performance in multiple process monitoring situations can be modeled in terms of the detection of process related events and the allocation of attention among processes once events are felt to have occurred. An elementary pattern recognition technique, discriminant analysis, is used to generate estimates of event occurrence probability. A queueing theory framework is then utilized to incorporate these probabilities as well as other task characteristics into the solution of the attention allocation problem. The performance of the model is compared with that of subjects in two experiments.
Greenstein, J. S.↗
Assessing Cognitive Impacts of Errors from Machine Learning and Deep Learning Models: Final Report
Due to their recent increases in performance, machine learning and deep learning models are being increasingly adopted across many domains for visual processing tasks. One such domain is international nuclear safeguards, which seeks to verify the peaceful use of commercial nuclear energy across the globe. Despite recent impressive performance results from machine learning and deep learning algorithms, there is always at least some small level of error. Given the significant consequences of international nuclear safeguards conclusions, we sought to characterize how incorrect responses from a machine or deep learning-assisted visual search task would cognitively impact users. We found that not only do some types of model errors have larger negative impacts on human performance than other errors, the scale of those impacts change depending on the accuracy of the model with which they are presented and they persist in scenarios of evenly distributed errors and single-error presentations. Further, we found that experiments conducted using a common visual search dataset from the psychology community has similar implications to a safeguards- relevant dataset of images containing hyperboloid cooling towers when the cooling tower images are presented to expert participants. While novice performance was considerably different (and worse) on the cooling tower task, we saw increased novice reliance on the most challenging cooling tower images compared to experts. These findings are relevant not just to the cognitive science community, but also for developers of machine and deep learning that will be implemented in multiple domains. For safeguards, this research provides key insights into how machine and deep learning projects should be implemented considering their special requirements that information not be missed.
97 MATHEMATICS AND COMPUTING↗