Search NASA⌕ Search

SEARCH · Search NASA

Results for “cognitive training”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Individualized Cognitive Modeling for Close-Loop Task Mitigation

An accurate real-time operator functional state assessment makes it possible to perform task management, minimize risks, and improve mission performance. In this paper, we discuss the development of an individualized operator functional state assessment model that identifies states likely leading to operational errors. To address large individual variations, we use two different approaches to build a model for each individual using its data as well as data from subjects with similar responses. If a subject's response is similar to that of the individual of interest in a specific functional state, all the training data from this subject will be used to build the individual model. The individualization methods have been successfully verified and validated with a driving test data set provided by University of Iowa. With the individualized models, the mean squared error can be significantly decreased (by around 20%).

Zhang, Guangfan↗

Language Model For Earth Science: Exploring Potential Downstream Applications As Well As Current Challenges

The use of deep learning techniques to build transformer language models such as SciBERT and GPT3 have transformed the natural language technology (NLT) landscape. These new NLTs are being used in speech to text and vice versa, auto-mated text classification, sentiment analysis, topic modeling, text summarization, and cognitive assistants. While Earth science has no shortage of unstructured data such as journal and conference papers, little efforts have focused on harnessing NLTs for knowledge extraction and supporting the scientific process. This paper surveys the use of language models in different science. BERT-E, a new Earth science-specific language model, is presented. BERT-E is generated using a transfer learning solution. A language model that has already been trained for general Science (SciBERT) is fine-tuned using abstracts and full text extracted from various Earth science-related articles. A downstream keywords classification application is used for evaluation, and the use of BERT-E shows improved performance. The need to develop a robust set of benchmarks in evaluating the language model such as BERT-E is discussed. Finally, example applications are presented to inspire additional ideas for applications using domain-specific language models.

R Ramachandran↗

Evidence Report: Risk of Inadequate Human-Computer Interaction

Human-computer interaction (HCI) encompasses all the methods by which humans and computer-based systems communicate, share information, and accomplish tasks. When HCI is poorly designed, crews have difficulty entering, navigating, accessing, and understanding information. HCI has rarely been studied in an operational spaceflight context, and detailed performance data that would support evaluation of HCI have not been collected; thus, we draw much of our evidence from post-spaceflight crew comments, and from other safety-critical domains like ground-based power plants, and aviation. Additionally, there is a concern that any potential or real issues to date may have been masked by the fact that crews have near constant access to ground controllers, who monitor for errors, correct mistakes, and provide additional information needed to complete tasks. We do not know what types of HCI issues might arise without this "safety net". Exploration missions will test this concern, as crews may be operating autonomously due to communication delays and blackouts. Crew survival will be heavily dependent on available electronic information for just-in-time training, procedure execution, and vehicle or system maintenance; hence, the criticality of the Risk of Inadequate HCI. Future work must focus on identifying the most important contributing risk factors, evaluating their contribution to the overall risk, and developing appropriate mitigations. The Risk of Inadequate HCI includes eight core contributing factors based on the Human Factors Analysis and Classification System (HFACS): (1) Requirements, policies, and design processes, (2) Information resources and support, (3) Allocation of attention, (4) Cognitive overload, (5) Environmentally induced perceptual changes, (6) Misperception and misinterpretation of displayed information, (7) Spatial disorientation, and (8) Displays and controls.

Kritina Holden↗

The effects of cuing in time-shared tasks

The results of two divided-attention experiments involving the editing of route-way-point displays on an avionics computer unit are reported. Two side tasks were required of the subjects, and either no cue, verbal cues appearing on the CRT, or symbolic cues (lights on the keyboard adjacent to keys to be used) were given to facilitate the primary editing task. Forty female and 30 male undergraduates were trained in the separate and combined tasks and divided randomly into groups of 25 for the cuing tests. A second test with three 10-subject groups was conducted at least one month later to investigate the efficacy of cuing for infrequently used procedures. It is found that only symbolic cuing significantly improved primary-task performance, increasing editing accuracy in the repetitive tests and reducing editing time in the delayed tests. Verbal cuing, probably because it requires additional cognitive effort, has no significant beneficial effect. These results are considered important for designing instruments for work environments requiring the performance of concurrent tasks, and as aircraft cockpits.

Chechile, R. A.↗

Best Practices for the Application of Functional Near Infrared Spectroscopy to Operator State Sensing

Functional Near Infrared Spectroscopy (fNIRS) is an emerging neuronal measurement technique with many advantages for application in operational and training contexts. Instrumentation and protocol improvements, however, are required to obtain useful signals and produce expeditiously self-applicable, comfortable and unobtrusive headgear. Approaches for improving the validity and reliability of fNIRS data for the purpose of sensing the mental state of commercial aircraft operators are identified, and an exemplary system design for attentional state monitoring is outlined. Intelligent flight decks of the future can be responsive to state changes to optimally support human performance. Thus, the identification of cognitive performance decrement, such as lapses in operator attention, may be used to predict and avoid error-prone states. We propose that attentional performance may be monitored with fNIRS through the quantification of hemodynamic activations in cortical regions which are part of functionally-connected attention and resting state networks. Activations in these regions have been shown to correlate with behavioral performance and task engagement. These regions lie beneath superficial tissue in head regions beyond the forehead. Headgear development is key to reliably and robustly accessing locations beyond the hair line to measure functionally-connected networks across the whole head. Human subject trials using both fNIRS and functional Magnetic Resonance Imaging (fMRI) will be used to test this system. Data processing employs Support Vector Machines for state classification based on the fNIRS signals. If accurate state classification is achieved based on sensed activation patterns, fNIRS will be shown to be useful for monitoring attentional performance.

Harrivel, Angela R.↗

GeoAI advances in specific landform mapping

Landform mapping (also referred to as geomorphology or geomorphometry) can be divided into two domains: general and specific (Evans 2012). Whereas general landform mapping categorizes all elements of the study area into landform classes, such as ridges, valleys, peaks, and depressions, the mapping of specific landforms requires the delineation (even if fuzzy) of individual landforms. The former is mainly driven by physical properties such as elevation, slope, and curvature. The latter, however, must consider the cognitive (human) reasoning that discriminates individual landforms in addition to these physical properties (Arundel and Sinha 2018). Both mapping forms are important. General geomorphometry is needed to understand geological and ecological processes and as boundary layer input to climate and environmental models. Specific geomorphometry supports such activities as disaster management and recovery, emergency response, transportation, and navigation. In the United States, individual landforms of interest are named in the U.S. Geological Survey (USGS) Geographic Names Information System, a point dataset captured specifically to digitize geographic names from the USGS Historical Topographic Map Collection (HTMC). Named landform extent is represented only by the name placement in the HTMC. Recent work has investigated CNN-based deep learning methods to capture these extents in machine-readable form. These studies first relied on physical properties (Arundel et al. 2020) and then included the HTMC as a band in RGB images in limited testing (Arundel et al. 2023). Results from the HTMC dataset surpassed those using just physical properties and using the HTMC alone performed best due to the hillshading and elevation (contour) data incorporated into the topographic maps. However, results fell short of an operational capacity to map all named landforms in the United States. Thus, our current work expands upon past research by focusing on the HTMC and physical information as inputs and the named landform label extents. Specifically, we propose to leverage pre-trained foundation models for segmentation and optical character recognition (OCR) models to jointly map landforms in the United States. Our approach aims to bridge the disparities among the independent information sources to facilitate informed decision-making. The modeling pipeline performs (1) segmentation using the physical information and (2) information extraction using OCR, in parallel. Then a computer vision approach merges the two branches into a labeled segmentation. References: Arundel, Samantha T., Wenwen Li, and Sizhe Wang. 2020. “GeoNat v1.0: A Dataset for Natural Feature Mapping with Artificial Intelligence and Supervised Learning.” Transactions in GIS 24 (3): 556–72. https://doi.org/10.1111/tgis.12633. Arundel, Samantha T, and Gaurav Sinha. 2018. “Validating GEOBIA Based Terrain Segmentation and Classification for Automated Delineation of Cognitively Salient Landforms BT - Proceedings of Workshops and Posters at the 13th International Conference on Spatial Information Theory (COSIT 2017).” In Proceedings of Workshops and Posters at the 13th International Conference on Spatial Information Theory (COSIT 2017), Lecture Notes in Geoinformation and Cartography, edited by Paolo Fogliaroni, Andrea Ballatore, and Eliseo Clementini, 9–14. Cham: Springer International Publishing. Arundel, Samantha T., Gaurav Sinha, Wenwen Li, David P. Martin, Kevin G. McKeehan, and Philip T. Thiem. 2023. “Historical Maps Inform Landform Cognition in Machine Learning.” Abstracts of the ICA 6 (August): 1–2. https://doi.org/10.5194/ica-abs-6-10-2023. Evans, Ian S. 2012. “Geomorphometry and Landform Mapping: What Is a Landform?” Geomorphology 137 (1): 94–106. https://doi.org/10.1016/j.geomorph.2010.09.029.

machine learning↗

Comparison of Physical Workload Across Eva-Simulation Analog Environments: Hybrid Space Suit Simulator and Pressurized Suit Testing

NASA conducts research, testing, and training across a variety of analog environments to support characterization of human performance during Extravehicular Activities (EVAs). Time utilizing pressurized suits in an offloaded environment is both limited and expensive, making it challenging to carry out extensive research with these suits. The Human Physiology, Performance, Protection, and Operations (H-3PO) Laboratory at NASA Johnson Space Center designed a Hybrid Space Suit Simulator (HS3) as a low-cost, workload approximator and easy access research tool to provide relevant physical and cognitive workloads during simulated EVAs. A pilot study was conducted in a 1g analog environment where six healthy subjects (3 male, 3 female) underwent simulated 5-hour EVAs in the HS3. This study used a COSMED K5 portable metabolic analyzer and a Polar H10 heart rate monitor to evaluate physical workload during the EVAs. For direct comparison, EVA tasks and timelines were modeled after a similar study conducted in pressurized suits (Mark-III spacesuit, n=3 male; small xPGS spacesuit, n=3 female) at NASA’s Active Response Gravity Offload System (ARGOS) offloaded to Lunar gravity (1/6 g). The 1g HS3 data demonstrated increased metabolic rate when compared to pressurized, Lunar-offloaded suited simulated EVAs for certain tasks including the kneeling scoop (HS3: 1194±199 BTU/hr, ARGOS: 860±170 BTU/hr, p < 0.05) and 20 lb object relocation (HS3: 1651±136 BTU/hr, ARGOS: 1048±252.8 BTU/hr, p < 0.05), but it did not demonstrate any significant differences in heart rate (p > 0.05). Other simulated EVA tasks, such as a 500 m traverse (HS3: 1431±177 BTU/hr, ARGOS: 1212±294 BTU/hr, p > 0.05), showed similar workload profiles with no significant workload differences between HS3 and ARGOS. The HS3 is a useful research tool for increasing workloads in EVA research without pressurized suits, though it may overestimate workload during certain EVA tasks when used in 1g environments.

Zachary Wusk↗

Self-Motion Perception: Assessment by Real-Time Computer Generated Animations

Our overall goal is to develop materials and procedures for assessing vestibular contributions to spatial cognition. The specific objective of the research described in this paper is to evaluate computer-generated animations as potential tools for studying self-orientation and self-motion perception. Specific questions addressed in this study included the following. First, does a non- verbal perceptual reporting procedure using real-time animations improve assessment of spatial orientation? Are reports reliable? Second, do reports confirm expectations based on stimuli to vestibular apparatus? Third, can reliable reports be obtained when self-motion description vocabulary training is omitted?

Parker, Donald E.↗

Emergence of relations and the essence of learning: a review of Sidman's Equivalence relations and behavior: a research story. Book review

The author reviews and comments on the book Equivalence relations and behavior: a research story by Murray Sidman. Sidman's book reports his research about equivalence relations and competencies in children with mental retardation and how it relates to behavior. Sidman used the idea of stimulus-stimulus relations among features of the environment to develop his theories about equivalence relations. Experimental work with children and animals demonstrated their ability to use equivalence relations to learn new tasks. The subject received feedback and reinforcement for specific choices made during training, then was presented with new choices during testing. Results of the tests indicate that subjects were able to establish relations and retrieve them in different situations.

NASA Discipline Space Human Factors↗

Assessing and Promoting Functional Resilience in Flight Crews During Exploration Missions

The NASA Human Research Program works to mitigate risks to health and performance on extended missions. However, research should be directed not only to mitigating known risks, but also to providing crews with tools to assess and enhance resilience, as a group and individually. We can draw on ideas from complexity theory to assess resilience. The entire crew or the individual crewmember can be viewed as a complex system composed of subsystems; the interactions between subsystems are of crucial importance. Understanding the interactions can provide important information even in the absence of complete information on the component subsystems. Enabled by advances in noninvasive measurement of physiological and behavioral parameters, subsystem monitoring can be implemented within a mission and during training to establish baselines. Coupled with mathematical modeling, this can provide assessment of health and function. Since the web of physiological systems (and crewmembers) can be interpreted as a network in mathematical terms, we can draw on recent work that relates the structure of such networks to their resilience (ability to self-organize in the face of perturbation). Some of the many parameters and interactions to choose from include: sleep cycles, coordination of work and meal times, cardiorespiratory rhythms, circadian rhythms and body temperature, stress markers and cognition, sleep and performance, immune function and nutritional status. Tools for resilience are then the means to measure and analyze these parameters, incorporate them into models of normal variability and interconnectedness, and recognize when parameters or their couplings are outside of normal limits.

Shelhamer, M.↗

Psychosocial issues in long-term space flight: overview

Anecdotal evidence of the individual and interpersonal problems that occurred during the Shuttle-Mir Space Program (SMSP) and other long-duration Russian/Soviet missions, and studies of personnel in other isolated and confined extreme (ICE) environments suggest that psychosocial elements of behavior and performance are likely to have a significant impact on the outcome of long-duration missions in space. This impact may range from individual decrements in performance, health and well being, to catastrophic mission failure. This paper reviews our current understanding of the psychosocial issues related to long duration space missions according to three different domains of behavior: the individual domain, the interpersonal domain and the organizational domain. Individual issues include: personality characteristics that predict successful performance, stress due to isolation and confinement and its effect on emotions and cognitive performance, adaptive and maladaptive coping styles and strategies, and requirements for the psychological support of astronauts and their families during the mission. Interpersonal issues include: impact of crew diversity and leadership styles on small group dynamics, adaptive and maladaptive features of ground-crew interactions, and processes of crew cohesion, tension and conflict. Organizational issues include: the influence of organizational culture and mission duration on individual and group performance, and managerial requirements for long duration missions. Improved screening and selection of astronaut candidates, leadership, coping and interpersonal skills training of personnel, and organizational change are key elements in the prevention of performance decrements on long-duration missions.

Review, Tutorial↗

A Touchpad-Based Method for Inducing Attentional Tunneling

Attentional tunneling is a recognized problem for aviation safety in the flight deck. A prototype system (touchpad and associated application and experimental software) was developed and evaluated for its success in inducing attentional tunneling in a reliable and predictable manner in training and experimental contexts. Two experiments involving a total of sixteen participants examined baseline performance for visual memory of a color or number sequence, simultaneous with performing a competing auditory detection task. Spatial auditory separation of the auditory stimuli was also evaluated. Data are provided for various aspects of touchpad entry (accuracy, speed) as well as hit and false alarm rates for the auditory task. The results will help determine means of inducing attentional tunneling in more complex flight simulator experiments, and for developing an inexpensive prototype for pilots to measure cognitive fixation and develop mitigation strategies.

aviation safety↗

Earth Independent Medical Operations (EIMO)

Inherent in interplanetary space travel are unprecedented challenges that could threaten mission success and negatively impact crew health and performance. Return to definitive care is essentially untenable and resources will be constrained with practically no re-supply capability. Access to ground-based medical expertise will be significantly delayed under nominal conditions with exacerbation during conjunction or prolonged dust storms. Taken together, these challenges necessitate the development of a progressively autonomous medical operational support system to assist the crew medical officer (CMO). While support from ground based medical experts will remain indispensable for pre-mission planning, the approach to management of acute/emergent medical contingencies will require a gradual transition of medical care and decision making from terrestrial to space-based assets, enabling support of astronaut health and performance and reducing overall mission risk. To progressively enable EIMO, a series of meetings were convened with subject matter experts from within NASA, academia and industry to facilitate mapping of the path to support autonomous medical operations. Topics explored in these meetings included the scope of data (storage capacity, usage, transmission rate and bandwidth, computing capacity), CMO training, supply and resource management and task load balance. Recommendations from these meetings will inform the EIMO Concept of Operations and definition of the associated requirements culminating in updates to the NASA 3001 standards. The EIMO project team will work with stakeholders to conceptualize a clinical decision support system (CDSS) to assist the CMO in response to medical contingencies when terrestrial support is delayed or otherwise unavailable. The CDSS will be a system of systems that will utilize data from numerous input vectors. Successful deployment of the CDSS will facilitate medical decision making while decreasing the cognitive load leading to an improvement in task load balancing. Additional benefits of the envisioned CDSS include assistance with inventory management, locating resources, storage/retrieval of medical records, highlighting trends in recorded data, in addition to providing a consult for diagnosis and treatment. More advanced features might include passive monitoring to identify early warning signs of behavioral or medical anomalies to possibly pre-empt onset of conditions that would compromise crew health and performance.

Benjamin Easter↗

Principal Investigator-in-a-Box

Human performance in orbit is currently limited by several factors beyond the intrinsic awkwardness of motor control in weightlessness. Cognitive functioning can be affected by such factors as cumulative sleep loss, stress and the psychological effects of long-duration small-group isolation. When an astronaut operates a scientific experiment, the performance decrement associated with such factors can lead to lost or poor quality data and even the total loss of a scientific objective, at great cost to the sponsors and to the dismay of the Principal Investigator. In long-duration flights, as anticipated on the International Space Station and on any planetary exploration, the experimental model is further complicated by long delays between training and experiment, and the large number of experiments each crew member must perform. Although no documented studies have been published on the subject, astronauts report that an unusually large number of simple errors are made in space. Whether a result of the effects of microgravity, accumulated fatigue, stress or other factors, this pattern of increased error supports the need for a computerized decision-making aid for astronauts performing experiments. Artificial intelligence and expert systems might serve as powerful tools for assisting experiments in space. Those conducting space experiments typically need assistance exactly when the planned checklist does not apply. Expert systems, which use bits of human knowledge and human methods to respond appropriately to unusual situations, have a flexibility that is highly desirable in circumstances where an invariably predictable course of action/response does not exist. Frequently the human expert on the ground is unavailable, lacking the latest information, or not consulted by the astronaut conducting the experiment. In response to these issues, we have developed "Principal Investigator-in-a-Box," or [PI], to capture the reasoning process of the real expert, the Principal Investigator, and combine that with real-time data available in space in order to advise the astronaut about how to proceed in real time. [PI] advises the astronaut during the progress of an experiment in much the same way a real Principal Investigator might do while looking over the astronaut's shoulder. In its original application, [PI] mimicked several of the tasks of the Principal Investigator, including data quality monitoring, troubleshooting, prescheduling, protocol management and "interesting data" detection. The proposed research focuses on the efficacy of this technique as applied to the data quality monitoring and troubleshooting aspects of [PI].

Young, Laurence R.↗

Cognitive Task Analysis of Business Jet Pilots' Weather Flying Behaviors: Preliminary Results

This report presents preliminary findings from a cognitive task analysis (CTA) of business aviation piloting. Results describe challenging weather-related aviation decisions and the information and cues used to support these decisions. Further, these results demonstrate the role of expertise in business aviation decision-making in weather flying, and how weather information is acquired and assessed for reliability. The challenging weather scenarios and novice errors identified in the results provide the basis for experimental scenarios and dependent measures to be used in future flight simulation evaluations of candidate aviation weather information systems. Finally, we analyzed these preliminary results to recommend design and training interventions to improve business aviation decision-making with weather information. The primary objective of this report is to present these preliminary findings and to document the extended CTA methodology used to elicit and represent expert business aviator decision-making with weather information. These preliminary findings will be augmented with results from additional subjects using this methodology. A summary of the complete results, absent the detailed treatment of methodology provided in this report, will be documented in a separate publication.

Latorella, Kara↗

Investigations of rhesus monkey video-task performance: evidence for enrichment

We have developed the Language Research Center's Computerized Test System (LRC-CTS) for psychological research. Basically, the LRC-CTS is a battery of software tasks--computerized versions of many of the classic testing paradigms of cognitive and comparative psychology--and the hardware required to administer them. An XT- or 386-compatible computer is connected to a color monitor, onto which computer-generated stimuli are presented. Sound feedback is delivered through an external speaker/amplifier, and a joystick is used as an input device. The animals reach through the mesh of their home cages to manipulate the joystick, which causes isomorphic movements of a cursor on the screen thereby allowing animals to respond according to the varied demands of the tasks. Correct responses are rewarded with a fruit-flavored chow pellet. Using this technology, we have trained and tested rhesus monkeys, a variety of apes, human adults, and normally developing or mentally retarded human children. Other labs using the LRC-CTS are beginning to report encouraging results with other monkey species as well. From this research, a number of interesting and important psychological findings have resulted. In the present paper, however, evidence will be reviewed which suggests that the LRC-CTS is an effective means of providing environmental enrichment to singly housed rhesus monkeys.

Non-NASA Center↗

Human factors of the high technology cockpit

The rapid advance of cockpit automation in the last decade has outstripped the ability of the human factors profession to understand the changes in human functions required. High technology cockpits require less physical (observable) workload, but are highly demanding of cognitive functions such as planning, alternative selection, and monitoring. Furthermore, automation creates opportunity for new and more serious forms of human error, and many pilots are concerned about the possibility of complacency affecting their performance. On the positive side, the equipment works as advertized with high reliability, offering highly efficient, computer-based flight. These findings from the cockpit studies probably apply equally to other industries, such as nuclear power production, other modes of transportation, medicine, and manufacturing, all of which traditionally have looked to aviation for technological leadership. The challenge to the human factors profession is to aid designers, operators, and training departments in exploiting the positive side of automation, while seeking solutions to the negative side. Viewgraphs are given.

Wiener, Earl L.↗

Designing a training tool for imaging mental models

The training process can be conceptualized as the student acquiring an evolutionary sequence of classification-problem solving mental models. For example a physician learns (1) classification systems for patient symptoms, diagnostic procedures, diseases, and therapeutic interventions and (2) interrelationships among these classifications (e.g., how to use diagnostic procedures to collect data about a patient's symptoms in order to identify the disease so that therapeutic measures can be taken. This project developed functional specifications for a computer-based tool, Mental Link, that allows the evaluative imaging of such mental models. The fundamental design approach underlying this representational medium is traversal of virtual cognition space. Typically intangible cognitive entities and links among them are visible as a three-dimensional web that represents a knowledge structure. The tool has a high degree of flexibility and customizability to allow extension to other types of uses, such a front-end to an intelligent tutoring system, knowledge base, hypermedia system, or semantic network.

Dede, Christopher J.↗