Search NASA⌕ Search

SEARCH · Search NASA

Results for “Cognitive computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

TPSAS-NF1676L-14834-DND

A recent spin-off from flight deck adaptive automation research at NASA Langley Research Center is a biocybernetic invention referred to informally as MindShift. When using the MindShift technology, a person is able to play off-the-shelf Nintendo Wii games enhanced with biofeedback, which is used to improve self-regulation of physiological functioning. Therefore, the user experiences the challenge of regulating their physiological responses during gameplay in addition to the intended challenges presented in the video game. The research projects being conducted under the supervision of Dr. Alan Pope and Chad Stephens at NASA Langley Research Center examine the effects of interacting with the MindShift invention technology on subjects' self-regulation of heart rate and brainwave activity, performance in the games, performance on cognitive tasks, and subjective experience of effort (i.e., workload). The MindShift invention's effects are being compared to the effects of interacting with the games without the MindShift technology and to the effects of interacting with commercial-off-the-shelf (COTS) brain-computer interface (BCI) technology, specifically the Mattel Mind Flex and the Uncle Milton Star Wars Force Trainer. A 32-channel electroencephalograph system is used to record subjects' brainwave and electrocardiographic activity. The potential for biofeedback game system applications is wide-ranging - from a more engaging form of clinical biofeedback training to a new challenge for avid gamers. Consequently, research needs to be conducted to fully understand the effects that these new games have on a person's physiological and psychological functioning. Biocybernetic technology like MindShift developed from the idea that operators of critical systems such as aerospace systems could hone their stress management and attention skills in biofeedback-augmented leisure activities while off-the-job in order to positively affect their on-the-job performance. This human performance enhancement technology is applicable to skill training on manually controlled critical tasks, such as unmanned aerial vehicle teleoperation, thus enabling the training of cognitive skills to be concurrent with manual skills. Furthermore, this type of technology can apply to medical and clinical uses of biofeedback by serving as an additional form of clinical biofeedback training that may be particularly useful for those with ADHD.

Brittany N Neilson↗

Advances in Autonomous Communications and Operations: Tes-N Series

Advances in nanosat subsystems over the past decade have taken the CubeSat standard from a communication-limited educational tool to a powerful platform enabling space research. The potential for autonomous operations may greatly increase the capability of downlinking even larger data sets. This is enabled through miniaturization of software-defined radio/cognitive communication solutions and a rapidly growing number of ground stations and satellite network crosslinks. The TechEdSat-n orbital flight series is currently demonstrating experiments using cognitive communication concepts including User Initiated Service (UIS) and High-rate Delay Tolerant Networks (HDTN), which show a significant step toward improved capability. At the core of this is the use of the Iridium L-band Short Burst Data (SBD) modems, pioneered by TES-n for space applications. SBD enables unique rapid command, control, and scheduling to initiate the UIS and HDTN protocols. This occurs by performing GPS-assisted on-orbit ephemeris determination, enabling negotiation with high bandwidth ground assets to repeatedly downlink over a specific commercial or government-owned ground station. The technique is RF band-agnostic and may be extended to higher bandwidth stations and SDRs. This may also include free-space optical communication, through both laser and omnidirectional LEDs, which can provide an attractive protocol for downlinking very large datasets over far fewer ground stations. In addition, this may be extended to lunar applications for such future concepts as LunaNet, whereby scheduling and cognitive technologies can assist in greatly improving Earth downlink capabilities with ground stations which will see greater competition for usage. Lastly, the NASA Communication Service Program (CSP), intended to eventually replace the NASA Tracking and Data Relay Satellite System (TDRSS) will also demonstrate the feasibility of commercially-provided satellite communication capabilities. All of these combined advances, including large advances in on-board computation on small platforms, will result in more remarkable data processing capability – yielding even more as of yet unknown discoveries.

Autonomy↗

Evaluating human performance modeling for system assessment: Promise and problems

The development and evaluation of computational human performance models is examined. An intention is to develop models which can be used to interact with system prototypes and simulations to perform system assessment. Currently LR is working on a set of models emulating cognitive, psychomotor, auditory, and visual activity for multiple operator positions of a command and control simulation system. These models, developed in conjunction with BBN Systems and Technologies, function within the simulation environment and allow for both unmanned system assessment and manned (human-in-loop) assessment of system interface and team interactions. These are relatively generic models with built-in flexibility which allows modification of some model parameters. These models have great potential for improving the efficiency and effectiveness of system design, test, and evaluation. However, the extent of the practical utility of these models is unclear. Initial verification efforts comparing model performance within the simulation to actual human operators on a similar, independent simulation have been performed and current efforts are directed at comparing human and model performance within the same simulation environment.

Patterson, Robert W.↗

Human performance models for computer-aided engineering

This report discusses a topic important to the field of computational human factors: models of human performance and their use in computer-based engineering facilities for the design of complex systems. It focuses on a particular human factors design problem -- the design of cockpit systems for advanced helicopters -- and on a particular aspect of human performance -- vision and related cognitive functions. By focusing in this way, the authors were able to address the selected topics in some depth and develop findings and recommendations that they believe have application to many other aspects of human performance and to other design domains.

Elkind, Jerome I.↗

Incongruity, Incongruity Resolution, and Mental States: The Measure and Modification of Situational Awareness and Control

Cognition and emotion combine to define mental states. Situational awareness depends on both knowledge of the environment and the mood of the individual. Cognitive scientists from William James and Sigmond Freud to contemporary theorists in artificial intelligence and neuropsychology have acknowledged the critical role of subjective state in determining the efficiency and flexibility of information processing. One of the most explicit computational models of mental states to incorporate both knowledge and arousal has been described. Knowledge is carried in a typical neural net with categorical nodes and probabilistic links. Arousal determines the focus among these nodes and links. High arousal results in a restricted range of activation. Low arousal causes a wider range of stimulation and a broader linking of categories or "ideas." From this model Gerlernter generates "creativity" in problem solving from a network that is widely active and the possibility of "fixation" from a highly aroused system.

Derks, Peter L.↗

Using EEG To Detect and Monitor Mental Fatigue

This project aims to develop EEG-based methods for detecting and monitoring mental fatigue. Mental fatigue poses a serious risk, even when performance is not apparently degraded. When such fatigue is associated with sustained performance of a single type of cognitive task it may be related to the metabolic energy required for sustained activation of cortical areas specialized for that task. The objective of this study was to adapt EEG to monitor cortical energy over a long period of performance of a cognitive task. Multielectrode event related potentials (ERPs) were collected every 15 minutes in nine subjects who performed a mental arithmetic task (algebraic sum of four randomly generated negative or positive digits). A new problem was presented on a computer screen 0.5 seconds after each response; some subjects endured for as long as three hours. ERPs were transformed to a quantitative measure of scalp electrical field energy. The average energy level at electrode P3 (near the left angular gyrus), 100-300 msec latency, was compared over the series of ERPs. For most subjects, scalp energy density at P3 gradually fell over the period of task performance and dramatically increased just before the subject was unable to continue the task. This neural response can be simulated for individual subjects using, a differential equation model in which it is assumed that the mental arithmetic task requires a commitment of metabolic energy that would otherwise be used for brain activities that are temporarily neglected. Their cumulative neglect eventually requires a reallocation of energy away from the mental arithmetic task.

Montgomery, Leslie↗

Testing a Neural Network Accelerator on a High-Altitude Balloon

The cognitive communications project has been working to re d machine learning approaches to support their deployment and sustained use in space environments. It has historically been difficult to implement such techniques on space platforms, however, due to the computational requirements they levy onto general-purpose avionics hardware. While technologies exist to accelerate the computation of aspects of neural networks, such platforms have not historically been deployed in space environments. Given that testing payloads in such environments can be both cost- and time-prohibitive, high-altitude balloons can be used as a way to approximate a space environment at a much lower cost, thus providing a cost-effective way in which to test newer approaches to hardware acceleration for artificial intelligence which may be deployed onto spacecraft more directly. This paper describes a successful test of a commercial off- the-shelf neural network accelerator on a high-altitude balloon. It begins by explaining our selection criteria when evaluating different commercial neural network acceleration techniques: primary considerations include size, weight, and power (SWaP) as well as ease of integration. Next, the paper describes the development and implementation of an experimental flight test platform: flight and ground components are discussed. Afterward, the paper discusses the experimental payload itself: this includes the experimental procedure as well as the specific image and method used for testing. Finally, the paper concludes with an evaluation of both the experimental device tested at altitude as well as the flight test framework itself, identifying how the existing platform can be used to continue tes g commercial off-the-shelf (COTS) solutions for acceleration.

Clark, Gilbert↗

No Fatigue Effect on Blink Rate

Blink rate is reported to vary dependent upon ongoing task performance, perceptual, attentional and cognitive factors, and fatigue. Five levels of task difficulty were operationally defined and task performance as lines read aloud per minute were measured. A single noninvasive infrared TV eyetracker was modified to measure blinking and an on-line computer program identified and counted blinks while the subject performed the tasks. Blink rate decreased by 50% when either task performance increased (fast reading) or visual difficulty increased (blurred text); blink rate increased greatly during rest breaks. There was no change in blink rate during one hour experiments even though subjects complained of severe fatigue.

Kim, W.↗

Adaptive Distributed Environment for Procedure Training (ADEPT)

ADEPT (Adaptive Distributed Environment for Procedure Training) is designed to provide more effective, flexible, and portable training for NASA systems controllers. When creating a training scenario, an exercise author can specify a representative rationale structure using the graphical user interface, annotating the results with instructional texts where needed. The author's structure may distinguish between essential and optional parts of the rationale, and may also include "red herrings" - hypotheses that are essential to consider, until evidence and reasoning allow them to be ruled out. The system is built from pre-existing components, including Stottler Henke's SimVentive instructional simulation authoring tool and runtime. To that, a capability was added to author and exploit explicit control decision rationale representations. ADEPT uses SimVentive's Scalable Vector Graphics (SVG)- based interactive graphic display capability as the basis of the tool for quickly noting aspects of decision rationale in graph form. The ADEPT prototype is built in Java, and will run on any computer using Windows, MacOS, or Linux. No special peripheral equipment is required. The software enables a style of student/ tutor interaction focused on the reasoning behind systems control behavior that better mimics proven Socratic human tutoring behaviors for highly cognitive skills. It supports fast, easy, and convenient authoring of such tutoring behaviors, allowing specification of detailed scenario-specific, but content-sensitive, high-quality tutor hints and feedback. The system places relatively light data-entry demands on the student to enable its rationale-centered discussions, and provides a support mechanism for fostering coherence in the student/ tutor dialog by including focusing, sequencing, and utterance tuning mechanisms intended to better fit tutor hints and feedback into the ongoing context.

Domeshek, Eric↗

Effective Team Support: From Modeling to Software Agents

The purpose of this research contract was to perform multidisciplinary research between CMU psychologists, computer scientists and engineers and NASA researchers to design a next generation collaborative system to support a team of human experts and intelligent agents. To achieve robust performance enhancement of such a system, we had proposed to perform task and cognitive modeling to thoroughly understand the impact technology makes on the organization and on key individual personnel. Guided by cognitively-inspired requirements, we would then develop software agents that support the human team in decision making, information filtering, information distribution and integration to enhance team situational awareness. During the period covered by this final report, we made substantial progress in modeling infrastructure and task infrastructure. Work is continuing under a different contract to complete empirical data collection, cognitive modeling, and the building of software agents to support the teams task.

Remington, Roger W.↗

A Programming Environment Evaluation Methodology for Object-Oriented Systems

The object-oriented design strategy as both a problem decomposition and system development paradigm has made impressive inroads into the various areas of the computing sciences. Substantial development productivity improvements have been demonstrated in areas ranging from artificial intelligence to user interface design. However, there has been very little progress in the formal characterization of these productivity improvements and in the identification of the underlying cognitive mechanisms. The development and validation of models and metrics of this sort require large amounts of systematically-gathered structural and productivity data. There has, however, been a notable lack of systematically-gathered information on these development environments. A large part of this problem is attributable to the lack of a systematic programming environment evaluation methodology that is appropriate to the evaluation of object-oriented systems.

Dominick, Wayne D.↗

Intelligent tutoring in the spacecraft command/control environment

The spacecraft command/control environment is becoming increasingly complex. As we enter the era of Space Station and the era of more highly automated systems, it is evident that the critical roles played by operations personnel in supervising the many required control center system components is becoming more cognitively demanding. In addition, the changing and emerging roles in the operations picture have far-reaching effects on the achievement of mission objectives. Thus highly trained and competent operations personnel are mandatory for success. Keeping pace with these developments has been computer-aided instruction utilizing various artificial intelligence technologies. The impacts of this growing capability on the stringent requirements for efficient and effective control center operations personnel is an area of much concentrated study. Some of the research and development of automated tutoring systems for the spacecraft command/control environment is addressed.

Truszkowski, Walter F.↗

Preliminary Results Obtained in Integrated Safety Analysis of NASA Aviation Safety Program Technologies

This is a listing of recent unclassified RTO technical publications processed by the NASA Center for AeroSpace Information from January 1, 2001 through March 31, 2001 available on the NASA Aeronautics and Space Database. Contents include 1) Cognitive Task Analysis; 2) RTO Educational Notes; 3) The Capability of Virtual Reality to Meet Military Requirements; 4) Aging Engines, Avionics, Subsystems and Helicopters; 5) RTO Meeting Proceedings; 6) RTO Technical Reports; 7) Low Grazing Angle Clutter...; 8) Verification and Validation Data for Computational Unsteady Aerodynamics; 9) Space Observation Technology; 10) The Human Factor in System Reliability...; 11) Flight Control Design...; 12) Commercial Off-the-Shelf Products in Defense Applications.

Source record↗

Assessments of Physiology and Cognition in Hybrid-Reality Environments (APACHE) – A VR “Sandbox” for Planetary Spacewalk Research

NASA is planning to return to the Moon in the mid-2020s as a steppingstone to Mars missions in the 2030s. Spacewalks, or extravehicular activities (EVAs), performed on the Moon and Mars will differ in a variety of ways from those that have been performed in decades past. NASA has identified multiple risks to human health and performance associated with a crewed mission to Mars, especially those associated with exploration EVAs which are expected to be a primary mission activity. Crew may be expected to conduct up to 24 hours of EVA per person per week, where the likelihood of injury and/or mental mistakes are increased compared to ground-based training or current microgravity EVAs and the consequences of which can be catastrophic. Current test environments for exploration EVA research and technology development are large, costly facilities that are limited in their availability or capabilities. Spacesuit testing in a reduced gravity environment such as NASA’s Neutral Buoyancy Laboratory, while a good representation of the crew’s physical workload during exploration EVAs, typically has small datasets and is difficult to integrate physiological sensors or other types of crew performance measures. Meanwhile, scientific field-based testing such as NASA’s Desert Research and Technology Studies offers an operationally relevant environment for exploration EVAs, particularly for cognitive workload, but is also limited by small datasets, lack of a pressurized spacesuit, and obtrusive measures. The limitations of current analogs for exploration EVAs identify a need for a new test environment that can approximate both the physical and cognitive demands associated with exploration EVAs to enable rapid, controlled, and repeatable evaluations of human health and performance risks of exploration missions. In response, the Human Physiology, Performance, Protection, and Operations Laboratory (H-3PO) at NASA Johnson Space Center has developed a hybrid reality exploration EVA analog named the Assessments of Physiology And Cognition in Hybrid-reality Environments (APACHE)[ to address these limitations using a combination of virtual, physical, and hybrid reality techniques. The APACHE facility resides at NASA Johnson Space Center and serves as a large “sandbox” for EVA research and simulation. At its center is a roughly 15x20ft space surrounded by a 14” tall sandbox partially filled with lunar regolith simulant to emulate the physical feeling of walking on a planetary surface and to allow for simulated geology operations. Nearby, a curved passive treadmill (Skillmill Connect, Technogym, Fairfield, NJ) and an omnidirectional treadmill (Infinadeck, Infinadeck, Rocklin, CA) are included to enable exploration of these large virtual environments while also imposing the physical demands, representative timelines, and cognitive burdens required to navigate and traverse these distances during exploration EVA. A 6DOF motion platform is used to simulate rover operations and supports various human performance evaluations and associated risks. Lastly, APACHE can support two extravehicular (EV) crewmembers working in tandem. A computer workstation is located nearby and also supports an intravehicular (IV) crewmember as part of a full mission simulation. The IV crewmember has direct video and audio communication with the EV crew in VR to provide operational and procedural support.

Human Performance↗

Helicopter Human Factors

Even under optimal conditions, helicopter flight is a most demanding form of human-machine interaction, imposing continuous manual, visual, communications, and mental demands on pilots. It is made even more challenging by small margins for error created by the close proximity of terrain in NOE flight and missions flown at night and in low visibility. Although technology advances have satisfied some current and proposed requirements, hardware solutions alone are not sufficient to ensure acceptable system performance and pilot workload. However, human factors data needed to improve the design and use of helicopters lag behind advances in sensor, display, and control technology. Thus, it is difficult for designers to consider human capabilities and limitations when making design decisions. This results in costly accidents, design mistakes, unrealistic mission requirements, excessive training costs, and challenge human adaptability. NASA, in collaboration with DOD, industry, and academia, has initiated a program of research to develop scientific data bases and design principles to improve the pilot/vehicle interface, optimize training time and cost, and maintain pilot workload and system performance at an acceptable level. Work performed at Ames, and by other research laboratories, will be reviewed to summarize the most critical helicopter human factors problems and the results of research that has been performed to: (1) Quantify/model pilots use of visual cues for vehicle control; (2) Improve pilots' performance with helmet displays of thermal imagery and night vision goggles for situation awareness and vehicle control; (3) Model the processes by which pilots encode maps and compare them to the visual scene to develop perceptually and cognitively compatible electronic map formats; (4) Evaluate the use of spatially localized auditory displays for geographical orientation, target localization, radio frequency separation; (5) Develop and flight test control/display concepts; (6) Quantify, model, predict, and improve pilots, workload-management strategies; and (7) Design computer-game trainers to reduce training time and cost.

Hart, Sandra G.↗

Radiation Transport Models in Space: from Supernovae to Cells

Humans embarking on deep space exploration missions will encounter persistent exposure to galactic cosmic rays (GCR) - an energetic and highly complex radiation field that is unlike anything found on Earth. Exposure to such radiation fields is attributed to various adverse health effects, including cancer, cardiovascular disease, and cognitive impairment and is identified by NASA as one of the five main hazards of human spaceflight. It is therefore critical to be able to fully characterize the exposure received by humans behind shielding in space and project consequent health risks. A wide variety of computational models have been developed over the years to help meet this requirement. In this talk, an overview of the GCR environment in deep space is provided. Methods of propagating GCR fields through the shielding that protects humans in space are described along with simulation tools used to assess biological damage at the cellular scale. Finally, the NASA cancer risk model is briefly described, and risk projections are provided for various mission scenarios. Radiation transport models and solution methods pervade many aspects of this talk. For example, the GCR spectrum impinging on spacecraft is determined by solving the Fokker-Planck transport equation to propagate cosmic rays (believed to originate from supernovae) from the edge of the heliosphere to the vicinity of Earth. The Boltzmann transport equation is solved to transport this GCR spectrum through shielding and human tissue. Monte Carlo methods are used to simulate the transport of low energy electrons that dominate biological damage at the cellular scale. Progress and challenges in each of these areas will be highlighted.

Tony C. Slaba↗

Operator modeling in commerical aviation: Cognitive models, intelligent displays, and pilot's assistants

One of the goals of the National Aviation Safety/Automation program is to address the issue of human-centered automation in the cockpit. Human-centered automation is automation that, in the cockpit, enhances or assists the crew rather than replacing them. The Georgia Tech research program focused on this general theme, with emphasis on designing a computer-based pilot's assistant, intelligent (i.e, context-sensitive) displays, and an intelligent tutoring system for understanding and operating the autoflight system. In particular, the aids and displays were designed to enhance the crew's situational awareness of the current state of the automated flight systems and to assist the crew's situational awareness of the current state of the automated flight systems and to assist the crew in coordinating the autoflight system resources. The activities of this grant included: (1) an OFMspert to understand pilot navigation activities in a 727 class aircraft; (2) an extension of OFMspert to understand mode control in a glass cockpit, Georgia Tech Crew Activity Tracking System (GT-CATS); (3) the design of a training system to teach pilots about the vertical navigation portion of the flight management system -VNAV Tutor; and (4) a proof-of-concept display, using existing display technology, to facilitate mode awareness, particularly in situations in which controlled flight into terrain (CFIT) is a potential.

Govindaraj, T.↗

Rheoencephalographic and electroencephalographic measures of cognitive workload: analytical procedures

This investigation demonstrates the feasibility of mental workload assessment by rheoencephalographic (REG) and multichannel electroencephalographic (EEG) monitoring. During the performance of this research, unique testing, analytical and display procedures were developed for REG and EEG monitoring that extend the current state of the art and provide valuable tools for the study of cerebral circulatory and neural activity during cognition. REG records are analyzed to provide indices of the right and left hemisphere hemodynamic changes that take place during each test sequence. The EEG data are modeled using regression techniques and mathematically transformed to provide energy-density distributions of the scalp electrostatic field. These procedures permit concurrent REG/EEG cognitive testing not possible with current techniques. The introduction of a system for recording and analysis of cognitive REG/EEG test sequences facilitates the study of learning and memory disorders, dementia and other encephalopathies.

Arousal/physiology↗