Search NASA⌕ Search

SEARCH · Search NASA

Results for “Cognitive computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Human performance in the modern cockpit

This panel was organized by the Aerospace Human Factors Committee to illustrate behavioral research on the perceptual, cognitive, and group processes that determine crew effectiveness in modern cockpits. Crew reactions to the introduction of highly automated systems in the cockpit will be reported on. Automation can improve operational capabilities and efficiency and can reduce some types of human error, but may also introduce entirely new opportunities for error. The problem solving and decision making strategies used by crews led by captains with various personality profiles will be discussed. Also presented will be computational approaches to modeling the cognitive demands of cockpit operations and the cognitive capabilities and limitations of crew members. Factors contributing to aircrew deviations from standard operating procedures and misuse of checklist, often leading to violations, incidents, or accidents will be examined. The mechanisms of visual perception pilots use in aircraft control and the implications of these mechanisms for effective design of visual displays will be discussed.

Dismukes, R. K.↗

Artificial Neural Networks to Predict Cognitive Impairment of Rodents Subjected to Space Radiation

INTRODUCTION We use artificial neural networks (ANNs) as an example machine learning (ML) tool to predict the cognitive performance impairment of rats induced by irradiation. The experimental data in the analyses is attentional set-shifting (ATSET) test scores from a rodent model exposed to ≤15 cGy of individual galactic cosmic radiation (GCR) ions: 4He, 28Si, or 56Fe, expected for a Lunar or Mars mission [1]. This work investigates rats at a subject-based level and uses applied dose and performance scores taken before irradiation to predict whether a rat will be impaired when irradiated. The results of this study are significant to crewed space missions as they support the potential of predicting an astronaut’s impairment in a specific task before spaceflight through the implementation of appropriately trained ML tools. METHODS Data used in this work are scores from the ATSET, a multi-stage constrained cognitive flexibility test [2]. Our computational model utilizes the number of attempts to reach the criterion to pass a stage as a behavioral performance measure for rats. We use the post-irradiation scores, generate thresholds from cumulative distribution plots of non-irradiated rats, and calculate the percent of irradiated rats whose scores fall below the threshold to infer how each radiation type/dose affects a population. Rats scoring above the threshold are labeled impaired while the others are non-impaired. We then employ ANNs as a typical ML technique, and use each subject’s individual scores taken before radiation along with the applied dose, to predict their personal susceptibility to cognitive impairment due to space radiation exposure. RESULTS AND CONCLUSION A significant finding is the exhibition of a dose-dependent increasing probability of impairment for 1 to 10 cGy of 28Si or 56Fe in the simple discrimination (SD) stage of the ATSET, and for 1 to 10 cGy of 56Fe in the compound discrimination (CD) stage. On a subject-based level, implementing ML classifiers such as ANNs identifies rats that have a higher tendency for impairment after GCR exposure [1]. The receiver operating characteristic (ROC) and the precision-recall (PR) curves of the ML models show a better prediction of impairment when 56Fe is the ion in question in both SD (Figure 1) and CD stages. They, however, do not depict impairment due to 4He in SD (Figure 1) and 28Si in CD, suggesting no dose-dependent impairment response in these cases. In this work, “good” prediction pertains to “better-than-random-chance”, due to the limited sample size and the high inter- and intra-individual variabilities in response to brain stimulation paradigms, as applicable to both animals and humans. More behavioral tests and biomarkers should be investigated on the same subjects, to be fed to the ML models to capture the agents responsible for performance alterations of some individuals versus others.

machine learning↗

Machine Learning Models to Predict Cognitive Impairment of Rodents Subjected to Space Radiation

INTRODUCTION We use artificial neural networks (ANNs) as an example machine learning (ML) tool to predict the cognitive performance impairment of rats induced by irradiation. The experimental data in the analyses is attentional set-shifting (ATSET) test scores from a rodent model exposed to ≤15 cGy of individual galactic cosmic radiation (GCR) ions: 4He, 28Si, or 56Fe, expected for a Lunar or Mars mission [1]. This work investigates rats at a subject-based level and uses applied dose and performance scores taken before irradiation to predict whether a rat will be impaired when irradiated. The results of this study are significant to crewed space missions as they support the potential of predicting an astronaut’s impairment in a specific task before spaceflight through the implementation of appropriately trained ML tools. METHODS Data used in this work are scores from the ATSET, a multi-stage constrained cognitive flexibility test [2]. Our computational model utilizes the number of attempts to reach the criterion to pass a stage as a behavioral performance measure for rats. We use the post-irradiation scores, generate thresholds from cumulative distribution plots of non-irradiated rats, and calculate the percent of irradiated rats whose scores fall below the threshold to infer how each radiation type/dose affects a population. Rats scoring above the threshold are labeled impaired while the others are non-impaired. We then employ ANNs as a typical ML technique, and use each subject’s individual scores taken before radiation along with the applied dose, to predict their personal susceptibility to cognitive impairment due to space radiation exposure. RESULTS AND CONCLUSION A significant finding is the exhibition of a dose-dependent increasing probability of impairment for 1 to 10 cGy of 28Si or 56Fe in the simple discrimination (SD) stage of the ATSET, and for 1 to 10 cGy of 56Fe in the compound discrimination (CD) stage. On a subject-based level, implementing ML classifiers such as ANNs identifies rats that have a higher tendency for impairment after GCR exposure [1]. The receiver operating characteristic (ROC) and the precision-recall (PR) curves of the ML models show a better prediction of impairment when 56Fe is the ion in question in both SD (Figure 1) and CD stages. They, however, do not depict impairment due to 4He in SD (Figure 1) and 28Si in CD, suggesting no dose-dependent impairment response in these cases. In this work, “good” prediction pertains to “better-than-random-chance”, due to the limited sample size and the high inter- and intra-individual variabilities in response to brain stimulation paradigms, as applicable to both animals and humans. More behavioral tests and biomarkers should be investigated on the same subjects, to be fed to the ML models to capture the agents responsible for performance alterations of some individuals versus others.

machine learning↗

Cognitive signal processing

Unsupervised signal pattern recognition - computer simulation of noisy signal pattern format, and construction of asymptotic Bayes decision boundary form

BAYESIAN STATISTICS↗

The Design of Model-Based Training Programs

This paper proposes a model-based training program for the skills necessary to operate advance avionics systems that incorporate advanced autopilots and fight management systems. The training model is based on a formalism, the operational procedure model, that represents the mission model, the rules, and the functions of a modem avionics system. This formalism has been defined such that it can be understood and shared by pilots, the avionics software, and design engineers. Each element of the software is defined in terms of its intent (What?), the rationale (Why?), and the resulting behavior (How?). The Advanced Computer Tutoring project at Carnegie Mellon University has developed a type of model-based, computer aided instructional technology called cognitive tutors. They summarize numerous studies showing that training times to a specified level of competence can be achieved in one third the time of conventional class room instruction. We are developing a similar model-based training program for the skills necessary to operation the avionics. The model underlying the instructional program and that simulates the effects of pilots entries and the behavior of the avionics is based on the operational procedure model. Pilots are given a series of vertical flightpath management problems. Entries that result in violations, such as failure to make a crossing restriction or violating the speed limits, result in error messages with instruction. At any time, the flightcrew can request suggestions on the appropriate set of actions. A similar and successful training program for basic skills for the FMS on the Boeing 737-300 was developed and evaluated. The results strongly support the claim that the training methodology can be adapted to the cockpit.

Polson, Peter↗

Do You See What I See? Interactive Visualization of Mission Design and Navigation

Mission Design and Navigation (MDNav) is an intensive process requiring advanced computational resources, expert human intuition, and many successive human-in-the-loop iterations to converge on acceptable trajectory designs or navigation solutions. The current bottleneck in MDNav is not the underlying computational algorithms but the human cognitive capacity to prune through a multitude of simulated results to select high-value candidates. One approach to alleviate this burden is through the judicious application of visualizations that allow humans to interactively filter data in multiple dimensions to reveal salient patterns and highlight divergences. When designed efficiently, such interactive visualizations should aid human operators to get familiar with data faster, visually observe correlations, and communicate findings more effortlessly. In this work, we present three visualization case studies that have the potential to increase human operator efficiency in MDNav. While identifying the most critical “pain points” that operators face, and also working on potential solutions, we followed a human-centered design approach. We started with a series of interviews with potential users, and then rapidly created prototypes for alternative solutions, validated outcomes with feedback from users through out development of these proof of concept visualizations. With this survey of our current efforts, we demonstrate the transformative capability of interactive data visualizations for improving mission development and operations, enabling operators to grow intuition, and communicating key concepts across diverse mission teams.

Arora, Nitin↗

Pharmacodynamics of Promethazine in Human Subjects

Promethazine (PMZ) is the drug of choice for the treatment of symptoms associated with space motion sickness in astronauts. Side effects of PMZ include sedation, dizziness and cognitive performance impairment. In this study, we examined pharmacodynamics (PD) in human subjects and validated methods for evaluating cognitive performance effects of medications in space. METHODS: PMZ (12.5,25, and 50 mg) or placebo was administered by IM injection to human subjects in a randomized double-blind treatment design. Samples and data were collected for 72 h post dose. PD evaluation was performed using a battery of performance tests administered using WinSCAT (Windows based Space Cognitive Assessment Test) on a laptop computer, and ARES (ANAM Readiness Evaluation System) on a PDA, plasma concentrations of PMZ were measured using a LC-MS method. RESULTS: Results indicate a linear correlation between PMZ concentration and cognitive performance parameters (p<0.01). Test accuracy decreased and test completion time and response time increased significantly with increasing plasma PMZ concentration. CONCLUSIONS: These results suggest a concentration dependent decrement in cognitive performance associated with PMZ. WinSCAT and ARES are sensitive tools for the assessment PMZ PD and may be applicable for such evaluations with other neurocognitive drugs.

Gatlin, K. T.↗

Building brains for bodies

We describe a project to capitalize on newly available levels of computational resources in order to understand human cognition. We will build an integrated physical system including vision, sound input and output, and dextrous manipulation, all controlled by a continuously operating large scale parallel MIMD computer. The resulting system will learn to 'think' by building on its bodily experiences to accomplish progressively more abstract tasks. Past experience suggests that in attempting to build such an integrated system we will have to fundamentally change the way artificial intelligence, cognitive science, linguistics, and philosophy think about the organization of intelligence. We expect to be able to better reconcile the theories that will be developed with current work in neuroscience.

Brooks, Rodney Allen↗

The use of analytical models in human-computer interface design

Recently, a large number of human-computer interface (HCI) researchers have investigated building analytical models of the user, which are often implemented as computer models. These models simulate the cognitive processes and task knowledge of the user in ways that allow a researcher or designer to estimate various aspects of an interface's usability, such as when user errors are likely to occur. This information can lead to design improvements. Analytical models can supplement design guidelines by providing designers rigorous ways of analyzing the information-processing requirements of specific tasks (i.e., task analysis). These models offer the potential of improving early designs and replacing some of the early phases of usability testing, thus reducing the cost of interface design. This paper describes some of the many analytical models that are currently being developed and evaluates the usefulness of analytical models for human-computer interface design. This paper will focus on computational, analytical models, such as the GOMS model, rather than less formal, verbal models, because the more exact predictions and task descriptions of computational models may be useful to designers. The paper also discusses some of the practical requirements for using analytical models in complex design organizations such as NASA.

Gugerty, Leo↗

Designing resilient IoT and Edge Computing with federated tinyML

The rapid growth of the Internet of Things (IoT) and Edge Computing (EC) has brought significant conveniences to modern society but has also greatly expanded the cyber attack surfaces, particularly as these technologies are being increasingly integrated into critical systems such as power grids, healthcare, and smart homes. Here, to improve IoT/EC’s cybersecurity posture, we leveraged Artificial Intelligence (AI) and Machine Learning (ML) by employing tinyML to monitor voluminous IoT data for cyber threats while addressing devices’ resource constraints, and utilizing Federated Learning (FL) to share local detection knowledge across the system while preserving privacy. Building on our three-layer architecture combining tinyML and FL to enhance autonomous cyber attack detection, this paper demonstrated that the architecture improves detection accuracy, reduces resource consumption, and enables lightweight, secure IoT device monitoring. These results were validated using the public N-BaIoT dataset as well as real IoT network traffic data collected under multiple attack scenarios from our testbeds. Additionally, we introduced an enhanced FL methodology with a novel preprocessing stage, including federated feature selection and global preprocessor construction, to address IoT/EC data heterogeneity. We developed a physical IoT testbed for attack simulations and data collection, implemented a tinyML-powered detector for realistic model validation, and also built a virtual testbed for scalable evaluations of FL models across diverse network environments.

Cognitive cyber↗

A principled approach to the measurement of situation awareness in commercial aviation

The issue of how to support situation awareness among crews of modern commercial aircraft is becoming especially important with the introduction of automation in the form of sophisticated flight management computers and expert systems designed to assist the crew. In this paper, cognitive theories are discussed that have relevance for the definition and measurement of situation awareness. These theories suggest that comprehension of the flow of events is an active process that is limited by the modularity of attention and memory constraints, but can be enhanced by expert knowledge and strategies. Three implications of this perspective for assessing and improving situation awareness are considered: (1) Scenario variations are proposed that tax awareness by placing demands on attention; (2) Experimental tasks and probes are described for assessing the cognitive processes that underlie situation awareness; and (3) The use of computer-based human performance models to augment the measures of situation awareness derived from performance data is explored. Finally, two potential example applications of the proposed assessment techniques are described, one concerning spatial awareness using wide field of view displays and the other emphasizing fault management in aircraft systems.

Tenney, Yvette J.↗

Users manual for the Automated Performance Test System (APTS)

The characteristics of and the user information for the Essex Automated Performance Test System (APTS) computer-based portable performance assessment battery are given. The battery was developed to provide a menu of performance test tapping the widest possible variety of human cognitive and motor functions, implemented on a portable computer system suitable for use in both laboratory and field settings for studying the effects of toxic agents and other stressors. The manual gives guidance in selecting, administering and scoring tests from the battery, and reviews the data and studies underlying the development of the battery. Its main emphasis is on the users of the battery - the scientists, researchers and technicians who wish to examine changes in human performance across time or as a function of changes in the conditions under which test data are obtained. First the how to information needed to make decisions about where and how to use the battery is given, followed by the research background supporting the battery development. Further, the development history of the battery focuses largely on the logical framework within which tests were evaluated.

Lane, N. E.↗

Self-Motion Perception: Assessment by Real-Time Computer Generated Animations

Our overall goal is to develop materials and procedures for assessing vestibular contributions to spatial cognition. The specific objective of the research described in this paper is to evaluate computer-generated animations as potential tools for studying self-orientation and self-motion perception. Specific questions addressed in this study included the following. First, does a non- verbal perceptual reporting procedure using real-time animations improve assessment of spatial orientation? Are reports reliable? Second, do reports confirm expectations based on stimuli to vestibular apparatus? Third, can reliable reports be obtained when self-motion description vocabulary training is omitted?

Parker, Donald E.↗

Photothermally Activated Artificial Neuromorphic Synapses

Biological nervous systems rely on the coordination of billions of neurons with complex, dynamic connectivity to enable the ability to process information and form memories. In turn, artificial intelligence and neuromorphic computing platforms have sought to mimic biological cognition through software-based neural networks and hardware demonstrations utilizing memristive circuitry with fixed dynamics. Here, to incorporate the advantages of tunable dynamic software implementations of neural networks into hardware, we develop a proof-of-concept artificial synapse with adaptable resistivity. This synapse leverages the photothermally induced local phase transition of VO 2 thin films by temporally modulated laser pulses. Such a process quickly modifies the conductivity of the film site-selectively by a factor of 500 to “activate” these neurons and store “memory” by applying varying bias voltages to induce self-sustained Joule heating between electrodes after activation with a laser. These synapses are demonstrated to undergo a complete heating and cooling cycle in less than 120 ns.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Cognitive Aging as a Human Factor: Effects of Age on Human Performance

Nuclear power plant (NPP) control room operators must make ongoing computations and decisions that maximize production and ensure safety, which places a high cognitive burden on the operators. How cognitions such as attention, visuospatial ability, and working memory interact with socio-technical systems to achieve optimal operations is well studied. However, there is an absence of research that examines how cognitive functioning within the NPP control room environment is moderated by developmental aging processes. This is of critical importance because different types of cognitive actions are known to develop and peak at different times across the adult life span, and it is becoming increasingly clear that there is no age at which all cognitive faculties operate at maximum capacity. Thus, given that NPPs are experiencing an aging workforce, it is vital to identify how mission critical cognitions change with age. This paper reviews implications of aging on reactor operators in the current and new fleet. We highlight lessons that can be learned from state-of-the-art human factors research that considers aging, lessons from the large cognitive aging literature, and lessons from aging workers in other industries that use sophisticated socio-technical systems, such as aviation. We also consider the important subject of aging effects versus expertise and present preliminary data that support the premise that age of operator is linked to effective and efficient operations but that this relationship may be moderated by level of operations expertise. In conclusion, we apply these lessons to future considerations for aging research in current nuclear operations and with the advent of advanced modernized control rooms.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Computer modeling of human decision making

Models of human decision making are reviewed. Models which treat just the cognitive aspects of human behavior are included as well as models which include motivation. Both models which have associated computer programs, and those that do not, are considered. Since flow diagrams, that assist in constructing computer simulation of such models, were not generally available, such diagrams were constructed and are presented. The result provides a rich source of information, which can aid in construction of more realistic future simulations of human decision making.

Gevarter, William B.↗

A Cognitive-System Model for En Route Air Traffic Management

NASA Ames Research Center has been engaged in the development of advanced air traffic management technologies whose basic form is cognitive aiding systems for air traffic controller and flight deck operations. In the design and evaluation of such systems the dynamic interaction between the airborne aiding system and the ground-based aiding systems forms a critical coupling for control. The human operator is an integral control element in the system and the optimal integration of human decision and performance parameters with those of the automation aiding systems offers a significant challenge to cognitive engineering. This paper presents a study in full mission simulation and the development of a predictive computational model of human performance. We have found that this combination of methodologies provide a powerful design-aiding process. We have extended the computational model Man Machine Integrated Design and Analysis System (N13DAS) to include representation of multiple cognitive agents (both human operators and intelligent aiding systems), operating aircraft airline operations centers and air traffic control centers in the evolving airspace. The demands of this application require the representation of many intelligent agents sharing world-models, and coordinating action/intention with cooperative scheduling of goals and actions in a potentially unpredictable world of operations. The operator's activity structures have been developed to include prioritization and interruption of multiple parallel activities among multiple operators, to provide for anticipation (knowledge of the intention and action of remote operators), and to respond to failures of the system and other operators in the system in situation-specific paradigms. We have exercised this model in a multi-air traffic sector scenario with potential conflict among aircraft at and across sector boundaries. We have modeled the control situation as a multiple closed loop system. The inner and outer loop alerting structure of air traffic management has many implications that need to be investigated to assure adequate design. First, there are control and stability factors implicit in the design. As the inner loop response time approaches that of the outer loop, system stability may be compromised in that controllers may be solving a problem the nature of which has already been changed by pilot action. Second, information exchange and information presentation for both air and ground must be designed to complement as opposed to compete with each other. Third, the level of individual and shared awareness in trajectory modification and flight conformance needs to be defined. Fourth, the level of required awareness and performance impact of mixed fleet operations and failed-mode recovery must be explored.

Corker, Kevin M.↗

Computational Models of Human Performance: Validation of Memory and Procedural Representation in Advanced Air/Ground Simulation

The Man-Machine Interaction Design and Analysis System (MIDAS) under joint U.S. Army and NASA cooperative is intended to assist designers of complex human/automation systems in successfully incorporating human performance capabilities and limitations into decision and action support systems. MIDAS is a computational representation of multiple human operators, selected perceptual, cognitive, and physical functions of those operators, and the physical/functional representation of the equipment with which they operate. MIDAS has been used as an integrated predictive framework for the investigation of human/machine systems, particularly in situations with high demands on the operators. We have extended the human performance models to include representation of both human operators and intelligent aiding systems in flight management, and air traffic service. The focus of this development is to predict human performance in response to aiding system developed to identify aircraft conflict and to assist in the shared authority for resolution. The demands of this application requires representation of many intelligent agents sharing world-models, coordinating action/intention, and cooperative scheduling of goals and action in an somewhat unpredictable world of operations. In recent applications to airborne systems development, MIDAS has demonstrated an ability to predict flight crew decision-making and procedural behavior when interacting with automated flight management systems and Air Traffic Control. In this paper, we describe two enhancements to MIDAS. The first involves the addition of working memory in the form of an articulatory buffer for verbal communication protocols and a visuo-spatial buffer for communications via digital datalink. The second enhancement is a representation of multiple operators working as a team. This enhanced model was used to predict the performance of human flight crews and their level of compliance with commercial aviation communication procedures. We show how the data produced by MIDAS compares with flight crew performance data from full mission simulations. Finally, we discuss the use of these features to study communication issues connected with aircraft-based separation assurance.

Corker, Kevin M.↗