SEARCH · Search NASA

Results for “Cognitive computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

All sources NASA NTRS DOE OSTI

NASA NTRSDate not supplied

Assessments of Physiology and Cognition in Hybrid-Reality Environments (APACHE)

NASA is planning to return to the Moon in the mid-2020s as a stepping stone to Mars missions in the 2030s. Spacewalks, or extravehicular activities (EVAs), performed on the Moon and Mars will differ in a variety of ways from those that have been performed in decades past. NASA has identified multiple risks to human health and performance associated with a crewed mission to Mars, especially those associated with exploration EVAs which are expected to be a primary mission activity. Crew may be expected to conduct up to 24 hours of EVA per person per week, where the likelihood of injury and/or mental mistakes are increased compared to ground-based training or current microgravity EVAs and the consequences of which can be catastrophic. Current test environments for exploration EVA research and technology development are large, costly facilities that are limited in their availability or capabilities. Spacesuit testing in a reduced gravity environment such as NASA’s Neutral Buoyancy Laboratory, while a good representation of the crew’s physical workload during exploration EVAs, typically has small datasets and is difficult to integrate physiological sensors or other types of crew performance measures. Meanwhile, scientific field-based testing such as NASA’s Desert Research and Technology Studies offers an operationally relevant environment for exploration EVAs, particularly for cognitive workload, but is also limited by small datasets, lack of a pressurized spacesuit, and obtrusive measures. The limitations of current analogs for exploration EVAs identify a need for a new test environment that can approximate both the physical and cognitive demands associated with exploration EVAs to enable rapid, controlled, and repeatable evaluations of human health and performance risks of exploration missions. In response, the Human Physiology, Performance, Protection, and Operations Laboratory (H-3PO) at NASA Johnson Space Center has developed a hybrid reality exploration EVA analog named the Assessments of Physiology And Cognition in Hybrid-reality Environments (APACHE) to address these limitations using a combination of virtual, physical, and hybrid reality techniques. The APACHE facility resides at NASA Johnson Space Center and serves as a large “sandbox” for EVA research and simulation. At its center is a roughly 15x20ft space surrounded by a 14” tall sandbox partially filled with lunar regolith simulant to emulate the physical feeling of walking on a planetary surface and to allow for simulated geology operations. Nearby, a curved passive treadmill (Skillmill Connect, Technogym, Fairfield, NJ) and an omnidirectional treadmill (Infinadeck, Infinadeck, Rocklin, CA) are included to enable exploration of these large virtual environments while also imposing the physical demands, representative timelines, and cognitive burdens required to navigate and traverse these distances during exploration EVA. A 6DOF motion platform is used to simulate rover operations and supports various human performance evaluations and associated risks. Lastly, APACHE can support two extravehicular (EV) crewmembers working in tandem. A computer workstation is located nearby and also supports an intravehicular (IV) crewmember as part of a full mission simulation. The IV crewmember has direct video and audio communication with the EV crew in VR to provide operational and procedural support. The software used in APACHE was created by the JSC Engineering Directorate, in partnership with Buendea, powered by a custom Unreal Engine 5 (UE5.3, Epic Games) project. APACHE currently utilizes the HTC Vive Pro Eye in a wireless configuration for VR simulations. There are two virtual environments that subjects can explore within APACHE, a Lunar and Martian surface. The virtual Lunar surface was created from LIDAR data of the Lunar South Pole to create roughly 16 sq km of explorable terrain. The virtual Martian surface contains roughly 400 sq km of explorable terrain derived from Mars Reconnaissance Orbiter LIDAR data of the Jezero Crater. The immersion and related cognitive burdens of conducting a planetary EVA is simulated through a series of EVA-relevant tasks performed in the VR environment, using these high-fidelity visual representations. Additionally, APACHE includes biosensor driven informatics, such as real-time heart rate monitoring and/or derived values from model simulations, for active monitoring by the EV crew and added cognitive demand. A “Wizard of Oz” control panel enables test operators to activate contingency events such as simulated spacesuit malfunctions, loss of communications, and/or limited visibility. Embedded performance measures such as accuracy, completeness, and execution time have been developed for various exploration tasks to objectively quantify crew performance during an EVA and compare impacts to performance when different environmental stressors, both physical and cognitive, are added to or removed from the simulation. Additionally, validated cognitive and operational performance measures such as the Digit Symbol Substitution Task have been recreated and embedded in VR for direct and relatively unobtrusive measurement of motor perception. The APACHE environment currently supports multiple research studies at NASA. Examples include the CHAPEA project, a series of simulated year-long missions on Mars by a 4-person crew; and the CO2 Contingency Walk Back Study, an investigation of elevated CO2 exposure on crew performance during a contingency EVA scenario. APACHE also provides a test environment to support the development of the Crew State and Risk Model, which is a collection of individualized, mathematical models of crew physical and cognitive state; and the Personalized EVA Informatics and Decision Support system, an operational tool for flight controllers, and eventually a self-reliant Martian crew, to make biomedically-informed decisions in real-time to optimize the EVA planning and execution with respect to crew health and performance. Some technical challenges associated with developing the APACHE environment, as well as current limitations, include VR limitless natural walking with a hybrid spacesuit simulator, optimizing performance for wireless PC VR streaming while maintaining a high degree of visual fidelity, and the integration of various physiological (metabolic masks) and psychometric (eye tracking) sensors with the VR headset.

Human Performance↗

DOE OSTI2024

In-vivo neuronal dysfunction by Aβ and tau overlaps with brain-wide inflammatory mechanisms in Alzheimer’s disease

The molecular mechanisms underlying neuronal dysfunction in Alzheimer’s disease (AD) remain uncharacterized. Here, we identify genes, molecular pathways and cellular components associated with whole-brain dysregulation caused by amyloid-beta (Aβ) and tau deposits in the living human brain. We obtained in-vivo resting-state functional MRI (rs-fMRI), Aβ- and tau-PET for 47 cognitively unimpaired and 16 AD participants from the Translational Biomarkers in Aging and Dementia cohort. Adverse neuronal activity impacts by Aβ and tau were quantified with personalized dynamical models by fitting pathology-mediated computational signals to the participant’s real rs-fMRIs. Then, we detected robust brain-wide associations between the spatial profiles of Aβ-tau impacts and gene expression in the neurotypical transcriptome (Allen Human Brain Atlas). Within the obtained distinctive signature of in-vivo neuronal dysfunction, several genes have prominent roles in microglial activation and in interactions with Aβ and tau. Moreover, cellular vulnerability estimations revealed strong association of microglial expression patterns with Aβ and tau’s synergistic impact on neuronal activity (q < 0.001). These results further support the central role of the immune system and neuroinflammatory pathways in AD pathogenesis. Neuronal dysregulation by AD pathologies also associated with neurotypical synaptic and developmental processes. In addition, we identified drug candidates from the vast LINCS library to halt or reduce the observed Aβ-tau effects on neuronal activity. Top-ranked pharmacological interventions target inflammatory, cancer and cardiovascular pathways, including specific medications undergoing clinical evaluation in AD. Our findings, based on the examination of molecular-pathological-functional interactions in humans, may accelerate the process of bringing effective therapies into clinical practice.

60 APPLIED LIFE SCIENCES↗

NASA NTRS1997

Superimposition, symbology, visual attention, and the head-up display

In two experiments we examined a number of related factors postulated to influence head-up display (HUD) performance. We addressed the benefit of reduced scanning and the cost of increasing the number of elements in the visual field by comparing a superimposed HUD with an identical display in a head-down position in varying visibility conditions. We explored the extent to which the characteristics of HUD symbology support a division of attention by contrasting conformal symbology (which links elements of the display image to elements of the far domain) with traditional instrument landing system (ILS) symbology. Together the two experiments provide strong evidence that minimizing scanning between flight instruments and the far domain contributes substantially to the observed HUD performance advantage. Experiment 1 provides little evidence for a performance cost attributable to visual clutter. In Experiment 2 the pattern of differences in lateral tracking error between conformal and traditional ILS symbology supports the hypothesis that, to the extent that the symbology forms an object with the far domain, attention may be divided between the superimposed image and its counterpart in the far domain.

Attention↗

NASA NTRSDate not supplied

TPSAS-NF1676L-14834-DND

A recent spin-off from flight deck adaptive automation research at NASA Langley Research Center is a biocybernetic invention referred to informally as MindShift. When using the MindShift technology, a person is able to play off-the-shelf Nintendo Wii games enhanced with biofeedback, which is used to improve self-regulation of physiological functioning. Therefore, the user experiences the challenge of regulating their physiological responses during gameplay in addition to the intended challenges presented in the video game. The research projects being conducted under the supervision of Dr. Alan Pope and Chad Stephens at NASA Langley Research Center examine the effects of interacting with the MindShift invention technology on subjects' self-regulation of heart rate and brainwave activity, performance in the games, performance on cognitive tasks, and subjective experience of effort (i.e., workload). The MindShift invention's effects are being compared to the effects of interacting with the games without the MindShift technology and to the effects of interacting with commercial-off-the-shelf (COTS) brain-computer interface (BCI) technology, specifically the Mattel Mind Flex and the Uncle Milton Star Wars Force Trainer. A 32-channel electroencephalograph system is used to record subjects' brainwave and electrocardiographic activity. The potential for biofeedback game system applications is wide-ranging - from a more engaging form of clinical biofeedback training to a new challenge for avid gamers. Consequently, research needs to be conducted to fully understand the effects that these new games have on a person's physiological and psychological functioning. Biocybernetic technology like MindShift developed from the idea that operators of critical systems such as aerospace systems could hone their stress management and attention skills in biofeedback-augmented leisure activities while off-the-job in order to positively affect their on-the-job performance. This human performance enhancement technology is applicable to skill training on manually controlled critical tasks, such as unmanned aerial vehicle teleoperation, thus enabling the training of cognitive skills to be concurrent with manual skills. Furthermore, this type of technology can apply to medical and clinical uses of biofeedback by serving as an additional form of clinical biofeedback training that may be particularly useful for those with ADHD.

Brittany N Neilson↗

NASA NTRSDate not supplied

Advances in Autonomous Communications and Operations: Tes-N Series

Advances in nanosat subsystems over the past decade have taken the CubeSat standard from a communication-limited educational tool to a powerful platform enabling space research. The potential for autonomous operations may greatly increase the capability of downlinking even larger data sets. This is enabled through miniaturization of software-defined radio/cognitive communication solutions and a rapidly growing number of ground stations and satellite network crosslinks. The TechEdSat-n orbital flight series is currently demonstrating experiments using cognitive communication concepts including User Initiated Service (UIS) and High-rate Delay Tolerant Networks (HDTN), which show a significant step toward improved capability. At the core of this is the use of the Iridium L-band Short Burst Data (SBD) modems, pioneered by TES-n for space applications. SBD enables unique rapid command, control, and scheduling to initiate the UIS and HDTN protocols. This occurs by performing GPS-assisted on-orbit ephemeris determination, enabling negotiation with high bandwidth ground assets to repeatedly downlink over a specific commercial or government-owned ground station. The technique is RF band-agnostic and may be extended to higher bandwidth stations and SDRs. This may also include free-space optical communication, through both laser and omnidirectional LEDs, which can provide an attractive protocol for downlinking very large datasets over far fewer ground stations. In addition, this may be extended to lunar applications for such future concepts as LunaNet, whereby scheduling and cognitive technologies can assist in greatly improving Earth downlink capabilities with ground stations which will see greater competition for usage. Lastly, the NASA Communication Service Program (CSP), intended to eventually replace the NASA Tracking and Data Relay Satellite System (TDRSS) will also demonstrate the feasibility of commercially-provided satellite communication capabilities. All of these combined advances, including large advances in on-board computation on small platforms, will result in more remarkable data processing capability – yielding even more as of yet unknown discoveries.

Autonomy↗

NASA NTRS1992

Evaluating human performance modeling for system assessment: Promise and problems

The development and evaluation of computational human performance models is examined. An intention is to develop models which can be used to interact with system prototypes and simulations to perform system assessment. Currently LR is working on a set of models emulating cognitive, psychomotor, auditory, and visual activity for multiple operator positions of a command and control simulation system. These models, developed in conjunction with BBN Systems and Technologies, function within the simulation environment and allow for both unmanned system assessment and manned (human-in-loop) assessment of system interface and team interactions. These are relatively generic models with built-in flexibility which allows modification of some model parameters. These models have great potential for improving the efficiency and effectiveness of system design, test, and evaluation. However, the extent of the practical utility of these models is unclear. Initial verification efforts comparing model performance within the simulation to actual human operators on a similar, independent simulation have been performed and current efforts are directed at comparing human and model performance within the same simulation environment.

Patterson, Robert W.↗

NASA NTRS1989

Human performance models for computer-aided engineering

This report discusses a topic important to the field of computational human factors: models of human performance and their use in computer-based engineering facilities for the design of complex systems. It focuses on a particular human factors design problem -- the design of cockpit systems for advanced helicopters -- and on a particular aspect of human performance -- vision and related cognitive functions. By focusing in this way, the authors were able to address the selected topics in some depth and develop findings and recommendations that they believe have application to many other aspects of human performance and to other design domains.

Elkind, Jerome I.↗

NASA NTRS1997

Incongruity, Incongruity Resolution, and Mental States: The Measure and Modification of Situational Awareness and Control

Cognition and emotion combine to define mental states. Situational awareness depends on both knowledge of the environment and the mood of the individual. Cognitive scientists from William James and Sigmond Freud to contemporary theorists in artificial intelligence and neuropsychology have acknowledged the critical role of subjective state in determining the efficiency and flexibility of information processing. One of the most explicit computational models of mental states to incorporate both knowledge and arousal has been described. Knowledge is carried in a typical neural net with categorical nodes and probabilistic links. Arousal determines the focus among these nodes and links. High arousal results in a restricted range of activation. Low arousal causes a wider range of stimulation and a broader linking of categories or "ideas." From this model Gerlernter generates "creativity" in problem solving from a network that is widely active and the possibility of "fixation" from a highly aroused system.

Derks, Peter L.↗

NASA NTRS2001

Using EEG To Detect and Monitor Mental Fatigue

This project aims to develop EEG-based methods for detecting and monitoring mental fatigue. Mental fatigue poses a serious risk, even when performance is not apparently degraded. When such fatigue is associated with sustained performance of a single type of cognitive task it may be related to the metabolic energy required for sustained activation of cortical areas specialized for that task. The objective of this study was to adapt EEG to monitor cortical energy over a long period of performance of a cognitive task. Multielectrode event related potentials (ERPs) were collected every 15 minutes in nine subjects who performed a mental arithmetic task (algebraic sum of four randomly generated negative or positive digits). A new problem was presented on a computer screen 0.5 seconds after each response; some subjects endured for as long as three hours. ERPs were transformed to a quantitative measure of scalp electrical field energy. The average energy level at electrode P3 (near the left angular gyrus), 100-300 msec latency, was compared over the series of ERPs. For most subjects, scalp energy density at P3 gradually fell over the period of task performance and dramatically increased just before the subject was unable to continue the task. This neural response can be simulated for individual subjects using, a differential equation model in which it is assumed that the mental arithmetic task requires a commitment of metabolic energy that would otherwise be used for brain activities that are temporarily neglected. Their cumulative neglect eventually requires a reallocation of energy away from the mental arithmetic task.

Montgomery, Leslie↗

NASA NTRS2019

Testing a Neural Network Accelerator on a High-Altitude Balloon

The cognitive communications project has been working to re d machine learning approaches to support their deployment and sustained use in space environments. It has historically been difficult to implement such techniques on space platforms, however, due to the computational requirements they levy onto general-purpose avionics hardware. While technologies exist to accelerate the computation of aspects of neural networks, such platforms have not historically been deployed in space environments. Given that testing payloads in such environments can be both cost- and time-prohibitive, high-altitude balloons can be used as a way to approximate a space environment at a much lower cost, thus providing a cost-effective way in which to test newer approaches to hardware acceleration for artificial intelligence which may be deployed onto spacecraft more directly. This paper describes a successful test of a commercial off- the-shelf neural network accelerator on a high-altitude balloon. It begins by explaining our selection criteria when evaluating different commercial neural network acceleration techniques: primary considerations include size, weight, and power (SWaP) as well as ease of integration. Next, the paper describes the development and implementation of an experimental flight test platform: flight and ground components are discussed. Afterward, the paper discusses the experimental payload itself: this includes the experimental procedure as well as the specific image and method used for testing. Finally, the paper concludes with an evaluation of both the experimental device tested at altitude as well as the flight test framework itself, identifying how the existing platform can be used to continue tes g commercial off-the-shelf (COTS) solutions for acceleration.

Clark, Gilbert↗

NASA NTRS1984

No Fatigue Effect on Blink Rate

Blink rate is reported to vary dependent upon ongoing task performance, perceptual, attentional and cognitive factors, and fatigue. Five levels of task difficulty were operationally defined and task performance as lines read aloud per minute were measured. A single noninvasive infrared TV eyetracker was modified to measure blinking and an on-line computer program identified and counted blinks while the subject performed the tasks. Blink rate decreased by 50% when either task performance increased (fast reading) or visual difficulty increased (blurred text); blink rate increased greatly during rest breaks. There was no change in blink rate during one hour experiments even though subjects complained of severe fatigue.

Kim, W.↗

NASA NTRS2013

Adaptive Distributed Environment for Procedure Training (ADEPT)

ADEPT (Adaptive Distributed Environment for Procedure Training) is designed to provide more effective, flexible, and portable training for NASA systems controllers. When creating a training scenario, an exercise author can specify a representative rationale structure using the graphical user interface, annotating the results with instructional texts where needed. The author's structure may distinguish between essential and optional parts of the rationale, and may also include "red herrings" - hypotheses that are essential to consider, until evidence and reasoning allow them to be ruled out. The system is built from pre-existing components, including Stottler Henke's SimVentive instructional simulation authoring tool and runtime. To that, a capability was added to author and exploit explicit control decision rationale representations. ADEPT uses SimVentive's Scalable Vector Graphics (SVG)- based interactive graphic display capability as the basis of the tool for quickly noting aspects of decision rationale in graph form. The ADEPT prototype is built in Java, and will run on any computer using Windows, MacOS, or Linux. No special peripheral equipment is required. The software enables a style of student/ tutor interaction focused on the reasoning behind systems control behavior that better mimics proven Socratic human tutoring behaviors for highly cognitive skills. It supports fast, easy, and convenient authoring of such tutoring behaviors, allowing specification of detailed scenario-specific, but content-sensitive, high-quality tutor hints and feedback. The system places relatively light data-entry demands on the student to enable its rationale-centered discussions, and provides a support mechanism for fostering coherence in the student/ tutor dialog by including focusing, sequencing, and utterance tuning mechanisms intended to better fit tutor hints and feedback into the ongoing context.

Domeshek, Eric↗

NASA NTRS2003

Effective Team Support: From Modeling to Software Agents

The purpose of this research contract was to perform multidisciplinary research between CMU psychologists, computer scientists and engineers and NASA researchers to design a next generation collaborative system to support a team of human experts and intelligent agents. To achieve robust performance enhancement of such a system, we had proposed to perform task and cognitive modeling to thoroughly understand the impact technology makes on the organization and on key individual personnel. Guided by cognitively-inspired requirements, we would then develop software agents that support the human team in decision making, information filtering, information distribution and integration to enhance team situational awareness. During the period covered by this final report, we made substantial progress in modeling infrastructure and task infrastructure. Work is continuing under a different contract to complete empirical data collection, cognitive modeling, and the building of software agents to support the teams task.

Remington, Roger W.↗

DOE OSTI2026

Visualization for Insight and Data Analysis in Energy Research

This talk explores how advanced visualization technologies are transforming analytical reasoning and knowledge discovery in energy research, drawing on recent work at the National Laboratory of the Rockies' Computational Science Center. Through a series of scientific case studies, we demonstrate how immersive and high-resolution visualization environments enable scientists and engineers to identify previously unseen patterns and features - insights that often remain hidden in traditional desktop-based analysis. By embedding richer information into interactive analytics tools, these approaches support the exploration of complex, multivariate parameter spaces, where interaction itself catalyzes understanding. Beyond capability, we emphasize the critical role of visualization design grounded in perception and cognition, showing how visual encodings directly influence analytical outcomes. Spanning applications from materials science to integrated energy systems, these visualization approaches accelerate innovation and improve decision-making by enabling deeper, more reliable insight into increasingly complex energy data.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

INTEGRATED WORKFLOW MANAGEMENT FOR PARTICLE ACCELERATOR SIMULATION

Supercomputing systems are used for a wide range of computationally demanding tasks in many fields of science and engineering. They play a key role in numerical simulation, in which mathematical models are computed in order to simulate the behavior of physical systems. Scientists and engineers that use supercomputers for numerical simulation often have their productivity limited by the need to manually organize and manage extremely large amounts of data that are often produced and consumed by the software programs run on these systems. Recognizing these limitations, Kitware Inc. (Clifton Park, NY) and SLAC National Accelerator Laboratory (Menlo Park, CA) are developing an advanced software platform that can reduce the cognitive overhead required by knowledge workers when using supercomputers for numerical simulation. Phase I of the project is complete and includes the development of new capabilities for organizing simulation project files, improvements to the user interface and overall usability, and deployment of a “middle tier” server to sit between user desktop machines and supercomputers to offload much of the data management workload. The project also developed prototype software for executing sequences of numerical simulations, and a prototype for migrating supercomputing software to cloud-based computing systems to provide a potential alternative to supercomputers with different logistical and price-to-performance tradeoffs.

Tourtellott, John↗

NASA NTRS1987

A Programming Environment Evaluation Methodology for Object-Oriented Systems

The object-oriented design strategy as both a problem decomposition and system development paradigm has made impressive inroads into the various areas of the computing sciences. Substantial development productivity improvements have been demonstrated in areas ranging from artificial intelligence to user interface design. However, there has been very little progress in the formal characterization of these productivity improvements and in the identification of the underlying cognitive mechanisms. The development and validation of models and metrics of this sort require large amounts of systematically-gathered structural and productivity data. There has, however, been a notable lack of systematically-gathered information on these development environments. A large part of this problem is attributable to the lack of a systematic programming environment evaluation methodology that is appropriate to the evaluation of object-oriented systems.

Dominick, Wayne D.↗

NASA NTRS1988

Intelligent tutoring in the spacecraft command/control environment

The spacecraft command/control environment is becoming increasingly complex. As we enter the era of Space Station and the era of more highly automated systems, it is evident that the critical roles played by operations personnel in supervising the many required control center system components is becoming more cognitively demanding. In addition, the changing and emerging roles in the operations picture have far-reaching effects on the achievement of mission objectives. Thus highly trained and competent operations personnel are mandatory for success. Keeping pace with these developments has been computer-aided instruction utilizing various artificial intelligence technologies. The impacts of this growing capability on the stringent requirements for efficient and effective control center operations personnel is an area of much concentrated study. Some of the research and development of automated tutoring systems for the spacecraft command/control environment is addressed.

Truszkowski, Walter F.↗

NASA NTRS2001

Preliminary Results Obtained in Integrated Safety Analysis of NASA Aviation Safety Program Technologies

This is a listing of recent unclassified RTO technical publications processed by the NASA Center for AeroSpace Information from January 1, 2001 through March 31, 2001 available on the NASA Aeronautics and Space Database. Contents include 1) Cognitive Task Analysis; 2) RTO Educational Notes; 3) The Capability of Virtual Reality to Meet Military Requirements; 4) Aging Engines, Avionics, Subsystems and Helicopters; 5) RTO Meeting Proceedings; 6) RTO Technical Reports; 7) Low Grazing Angle Clutter...; 8) Verification and Validation Data for Computational Unsteady Aerodynamics; 9) Space Observation Technology; 10) The Human Factor in System Reliability...; 11) Flight Control Design...; 12) Commercial Off-the-Shelf Products in Defense Applications.

Source record↗