Search NASA⌕ Search

SEARCH · Search NASA

Results for “Cognitive computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

209 records · Page 12

The Hopper: A Wearable Robotic Device Testbed for Micro-Gravity Bone-Loading Proof-of-Concept

Wearable robotic systems are showing increased potential for addressing crew countermeasures needs. Wearable robots offer a compactness, programmability, and eccentric loading capability not present in more conventional exercise equipment. Correspondingly, advancements in the man to machine interface has progressed, allowing for higher loads to be applied directly to the person in new and novel ways. Recently, the X1 exoskeleton, a lower extremity wearable robot originally designed for mobility assistance and rehabilitation, underwent human subject testing to assess its potential as a knee dynamometer. This was of interest to NASA physiologists because currently strength is not assessed in flight due to hardware limitations, and thus there is a poor understanding of the time course of in-flight changes to muscle strength. The study concluded that the X1 compared well with the Biodex, the "gold standard" in terrestrial dynamometry, with coefficients of variation less than 6.0%. In a following study, the X1 powered ankle was evaluated for its efficacy in exercising calf muscles. Current on-orbit countermeasures equipment does not adequately protect the calf from atrophy. The results of this study were also positive (targeted muscle activity demonstrated via comparing pre- and post-exercise magnetic resonance imaging T2 measurements), again showing the efficacy of wearable robotic devices for addressing the countermeasure needs of our astronauts. Based on these successes and lessons learned, the Grasshopper was co-developed between IHMC (Florida Institute for Human and Machine Cognition) and NASA. The Grasshopper, or the Hopper for short, is a wearable robotic device designed to address muscle and bone density loss for astronauts spending extended periods of time in micro-gravity. The Grasshopper connects to the user's torso like a hiking backpack, over the shoulders and around the waist. At the feet are footplates that strap to the user. There are two actuators, one at each "knee" joint, which are capable of high fidelity torque control. Because the Hopper uses motors instead of gravity to create the load on the user, the device is suited for use on space missions. Exercise in zero-gravity conditions is critical to maintain muscle strength and bone mass. In operation, the actuators try to fold up, or collapse, the device, putting a compressive load between the user's feet and torso. This force is similar to carrying a heavy backpack. The user then bends and extends his or her knees, replicating a weightlifting squat exercise. The applied load is precisely controlled by a computer, and can be programmed to simulate gravitation loads or any desired load prescription, such as free-weight squat exercise. It is even possible to perform eccentric exercises, or negatives, without the need for a spotter. Because the hip joints, as well as the spine and long leg bones, are in the applied load path, there is the potential to stimulate bone growth, countering the typical bone loss when astronauts return from extended duration space travel.

Beck, C. E.↗

Image Mapping and Visual Attention on the Sensory Ego-Sphere

The Sensory Ego-Sphere (SES) is a short-term memory for a robot in the form of an egocentric, tessellated, spherical, sensory-motor map of the robot s locale. Visual attention enables fast alignment of overlapping images without warping or position optimization, since an attentional point (AP) on the composite typically corresponds to one on each of the collocated regions in the images. Such alignment speeds analysis of the multiple images of the area. Compositing and attention were performed two ways and compared: (1) APs were computed directly on the composite and not on the full-resolution images until the time of retrieval; and (2) the attentional operator was applied to all incoming imagery. It was found that although the second method was slower, it produced consistent and, thereby, more useful APs. The SES is an integral part of a control system that will enable a robot to learn new behaviors based on its previous experiences, and that will enable it to recombine its known behaviors in such a way as to solve related, but novel, task problems with apparent creativity. The approach is to combine sensory-motor data association and dimensionality reduction to learn navigation and manipulation tasks as sequences of basic behaviors that can be implemented with a small set of closed-loop controllers. Over time, the aggregate of behaviors and their transition probabilities form a stochastic network. Then given a task, the robot finds a path in the network that leads from its current state to the goal. The SES provides a short-term memory for the cognitive functions of the robot, association of sensory and motor data via spatio-temporal coincidence, direction of the attention of the robot, navigation through spatial localization with respect to known or discovered landmarks, and structured data sharing between the robot and human team members, the individuals in multi-robot teams, or with a C3 center.

Fleming, Katherine Achim↗

A Novel RF Architecture for Simultaneous Communication, Navigation, and Remote Sensing with Software-Defined Radio

The rapid growth of SmallSat and CubeSat missions at NASA has necessitated a re-evaluation of communication and remote-sensing architectures. Novel designs for CubeSat-sized single-board computers can now include larger Field-Programmable Gate Arrays (FPGAs) and faster System-on-Chip (SoCs) devices. These components substantially improve onboard processing capabilities so that varying subsystems no longer require an independent processor. By replacing individual Radio Frequency (RF) systems with a single software-defined radio (SDR) and processor, mission designers have greater control over reliability, performance, and efficiency. The presented architecture combines individual processing systems into a single design and establishes a modular SDR architecture capable of both remote-sensing and communication applications. This new approach based on a multi-input multi-output (MIMO) SDR features a scalable architecture optimized for Size, Weight, Power, and Cost (SWaP-C), with sufficient noise performance and phase-coherence to enable both remote-sensing and navigation applications, while providing a communication solution for simultaneous S-band and X-band transmission. This SDR design is developed around the NASA CubeSat Card Standard (CS2) that provides the required modularity through simplified backplane and interchangeable options for multiple radiation-hardened/tolerant processors. This architecture provides missions with a single platform for high-rate communication and a future platform to develop cognitive radio systems.

Advanced Avionics, Hybrid Processing, Data Process↗

Cognitive engineering models in space systems

NASA space systems, including mission operations on the ground and in space, are complex, dynamic, predominantly automated systems in which the human operator is a supervisory controller. Models of cognitive functions in complex systems are needed to describe human performance and form the theoretical basis of operator workstation design, including displays, controls, and decision aids. Currently, there several candidate modeling methodologies. They include the Rasmussen abstraction/aggregation hierarchy and decision ladder, the goal-means network, the problem behavior graph, and the operator function model. The research conducted under the sponsorship of this grant focuses on the extension of the theoretical structure of the operator function model and its application to NASA Johnson mission operations and space station applications. The initial portion of this research consists of two parts. The first is a series of technical exchanges between NASA Johnson and Georgia Tech researchers. The purpose is to identify candidate applications for the current operator function model; prospects include mission operations and the Data Management System Testbed. The second portion will address extensions of the operator function model to tailor it to the specific needs of Johnson applications. At this point, we have accomplished two things. During a series of conversations with JSC researchers, we have defined the technical goal of the research supported by this grant to be the structural definition of the operator function model and its computer implementation, OFMspert. Both the OFM and OFMspert have matured to the point that they require infrastructure to facilitate use by researchers not involved in the evolution of the tools. The second accomplishment this year was the identification of the Payload Deployment and Retrieval System (PDRS) as a candidate system for the case study. In conjunction with government and contractor personnel in the Human-Computer Interaction Lab, the PDRS was identified as the most accessible system for the demonstration. Pursuant to this a PDRS simulation was obtained from the HCIL and an initial knowledge engineering effort was conducted to understand the operator's tasks in the PDRS application. The preliminary results of the knowledge engineering effort and an initial formulation of an operator function model (OFM) are contained in the appendices.

Mitchell, Christine M.↗

Evidence Report: Risk of Inadequate Human-Computer Interaction

Human-computer interaction (HCI) encompasses all the methods by which humans and computer-based systems communicate, share information, and accomplish tasks. When HCI is poorly designed, crews have difficulty entering, navigating, accessing, and understanding information. HCI has rarely been studied in an operational spaceflight context, and detailed performance data that would support evaluation of HCI have not been collected; thus, we draw much of our evidence from post-spaceflight crew comments, and from other safety-critical domains like ground-based power plants, and aviation. Additionally, there is a concern that any potential or real issues to date may have been masked by the fact that crews have near constant access to ground controllers, who monitor for errors, correct mistakes, and provide additional information needed to complete tasks. We do not know what types of HCI issues might arise without this "safety net". Exploration missions will test this concern, as crews may be operating autonomously due to communication delays and blackouts. Crew survival will be heavily dependent on available electronic information for just-in-time training, procedure execution, and vehicle or system maintenance; hence, the criticality of the Risk of Inadequate HCI. Future work must focus on identifying the most important contributing risk factors, evaluating their contribution to the overall risk, and developing appropriate mitigations. The Risk of Inadequate HCI includes eight core contributing factors based on the Human Factors Analysis and Classification System (HFACS): (1) Requirements, policies, and design processes, (2) Information resources and support, (3) Allocation of attention, (4) Cognitive overload, (5) Environmentally induced perceptual changes, (6) Misperception and misinterpretation of displayed information, (7) Spatial disorientation, and (8) Displays and controls.

Kritina Holden↗

Preserved number of entorhinal cortex layer II neurons in aged macaque monkeys

The perforant path, which consists of the projection from the layer II neurons of the entorhinal cortex to the outer molecular layer of the dentate gyrus, is a critical circuit involved in learning and memory formation. Accordingly, disturbances in this circuit may contribute to age-related cognitive deficits. In a previous study, we demonstrated a decrease in N-methyl-D-aspartate receptor subunit 1 immunofluorescence intensity in the outer molecular layer of aged macaque monkeys. In this study, we used the optical fractionator, a stereological method, to determine if a loss of layer II neurons occurred in the same animals in which the N-methyl-D-aspartate receptor subunit 1 alteration was observed. Our results revealed no significant differences in the number of layer II neurons between juvenile, young adult, and aged macaque monkeys. These results suggest that the circuit-specific decrease in N-methyl-D-aspartate receptor subunit 1 reported previously occurs in the absence of structural compromise of the perforant path, and thus may be linked to an age-related change in the physiological properties of this circuit.

Non-NASA Center↗

GeoAI Advances in Specific Landform Mapping

Landform mapping (also referred to as geomorphology or geomorphometry) can be divided into two domains: general and specific (Evans 2012). Whereas general landform mapping categorizes all elements of the study area into landform classes, such as ridges, valleys, peaks, and depressions, the mapping of specific landforms requires the delineation (even if fuzzy) of individual landforms. The former is mainly driven by physical properties such as elevation, slope, and curvature. The latter, however, must consider the cognitive (human) reasoning that discriminates individual landforms in addition to these physical properties (Arundel and Sinha 2018). Both mapping forms are important. General geomorphometry is needed to understand geological and ecological processes and as boundary layer input to climate and environmental models. Specific geomorphometry supports such activities as disaster management and recovery, emergency response, transportation, and navigation. In the United States, individual landforms of interest are named in the U.S. Geological Survey (USGS) Geographic Names Information System, a point dataset captured specifically to digitize geographic names from the USGS Historical Topographic Map Collection (HTMC). Named landform extent is represented only by the name placement in the HTMC. Recent work has investigated CNN-based deep learning methods to capture these extents in machine-readable form. These studies first relied on physical properties (Arundel et al. 2020) and then included the HTMC as a band in RGB images in limited testing (Arundel et al. 2023). Results from the HTMC dataset surpassed those using just physical properties and using the HTMC alone performed best due to the hillshading and elevation (contour) data incorporated into the topographic maps. However, results fell short of an operational capacity to map all named landforms in the United States. Thus, our current work expands upon past research by focusing on the HTMC and physical information as inputs and the named landform label extents. Specifically, we propose to leverage pre-trained foundation models for segmentation and optical character recognition (OCR) models to jointly map landforms in the United States. Our approach aims to bridge the disparities among the independent information sources to facilitate informed decision-making. The modeling pipeline performs (1) segmentation using the physical information and (2) information extraction using OCR, in parallel. Then a computer vision approach merges the two branches into a labeled segmentation.

machine learning↗

Neuro-Vestibular Examination During and Following Spaceflight (Vestibular Health)

BACKGROUND Adaptation to microgravity during spaceflight causes neurological disturbances that are either directly or indirectly mediated by the vestibular system. These disturbances can include space motion sickness, spatial disorientation, and cognitive impairment, as well as changes in head-eye coordination, vestibulo-ocular reflexes, and control of posture and locomotion. Otolith-mediated reflex gains appear to adapt rapidly during spaceflight and after landing. However, animal studies have shown that structural modifications of the vestibular sensory apparatus develop during long-duration spaceflight. To date, no studies have characterized the severity of vestibular syndromes experienced by astronauts as a function of the duration of spaceflight or whether the effects are caused by changes at the peripheral end organs, midbrain, cerebellum, or vestibular cortex. OBJECTIVES We will investigate temporal vestibular changes in crewmembers of short, 6-month, and one-year missions to identify trends in adaptation of vestibular health and performance in orbit and after landing. We will also determine whether the vestibular organs and/or the central vestibular system undergo structural changes during long-duration exposure to microgravity, which could cause vestibular disorders when transitioning to a different gravitational environment. METHODS Recordings of eye, head, and body movements, as well as subjective reports of perception of motion, will be used to determine the presence of abnormal eye movements, dysmetria, motion sickness symptoms, and illusions of motion during head or body movements. This includes characterization of temporal trends in central compensation for vestibular (otolith) asymmetry. Pre-flight data will be collected 90 days before launch. In-flight examinations will be performed early in the mission (Flight Days 1 and 30) and once every two or three months thereafter. Post-flight examinations will be performed on the following days after return (R) from the mission: R+0, R+4, R+9, and R+30. Ground-based control tests have been performed on healthy volunteers in the laboratory to estimate mean normative responses. RESULTS Data collection for this study is ongoing. Data processing techniques are being refined. Our eye tracking method for measuring three-dimensional eye movement takes advantage of modern computer vision software (OpenCV) and advances in the field of iris recognition to improve measurement of ocular-counterolling. RELEVANCE If the observed symptoms in crewmembers are more deleterious after the year-long missions than those documented after 6-month missions, then relevant countermeasures will be required to maintain the health and operational performance of astronauts during longer missions. Depending on the etiology of the vestibular syndrome revealed by these tests, countermeasures will be proposed based on vestibular rehabilitation therapies currently used in patients with vestibular disorders, such as habituation, gaze stabilization, and/or balance training exercises.

T R Macaulay↗

Use of Semi-Autonomous Tools for ISS Commanding and Monitoring

As the International Space Station (ISS) has moved into a utilization phase, operations have shifted to become more ground-based with fewer mission control personnel monitoring and commanding multiple ISS systems. This shift to fewer people monitoring more systems has prompted use of semi-autonomous console tools in the ISS Mission Control Center (MCC) to help flight controllers command and monitor the ISS. These console tools perform routine operational procedures while keeping the human operator "in the loop" to monitor and intervene when off-nominal events arise. Two such tools, the Pre-positioned Load (PPL) Loader and Automatic Operators Recorder Manager (AutoORM), are used by the ISS Communications RF Onboard Networks Utilization Specialist (CRONUS) flight control position. CRONUS is responsible for simultaneously commanding and monitoring the ISS Command & Data Handling (C&DH) and Communications and Tracking (C&T) systems. PPL Loader is used to uplink small pieces of frequently changed software data tables, called PPLs, to ISS computers to support different ISS operations. In order to uplink a PPL, a data load command must be built that contains multiple user-input fields. Next, a multiple step commanding and verification procedure must be performed to enable an onboard computer for software uplink, uplink the PPL, verify the PPL has incorporated correctly, and disable the computer for software uplink. PPL Loader provides different levels of automation in both building and uplinking these commands. In its manual mode, PPL Loader automatically builds the PPL data load commands but allows the flight controller to verify and save the commands for future uplink. In its auto mode, PPL Loader automatically builds the PPL data load commands for flight controller verification, but automatically performs the PPL uplink procedure by sending commands and performing verification checks while notifying CRONUS of procedure step completion. If an off-nominal condition occurs during procedure execution, PPL Loader notifies CRONUS through popup messages, allowing CRONUS to examine the situation and choose an option of how PPL loader should proceed with the procedure. The use of PPL Loader to perform frequent, routine PPL uplinks offloads CRONUS to better monitor two ISS systems. It also reduces procedure performance time and decreases risk of command errors. AutoORM identifies ISS communication outage periods and builds commands to lock, playback, and unlock ISS Operations Recorder files. Operation Recorder files are circular buffer files of continually recorded ISS telemetry data. Sections of these files can be locked from further writing, be played back to capture telemetry data that occurred during an ISS loss of signal (LOS) period, and then be unlocked for future recording use. Downlinked Operation Recorder files are used by mission support teams for data analysis, especially if failures occur during LOS. The commands to lock, playback, and unlock Operations Recorder files are encompassed in three different operational procedures and contain multiple user-input fields. AutoORM provides different levels of automation for building and uplinking the commands to lock, playback, and unlock Operations Recorder files. In its automatic mode, AutoORM automatically detects ISS LOS periods, then generates and uplinks the commands to lock, playback, and unlock Operations Recorder files when MCC regains signal with ISS. AutoORM also features semi-autonomous and manual modes which integrate CRONUS more into the command verification and uplink process. AutoORMs ability to automatically detect ISS LOS periods and build the necessary commands to preserve, playback, and release recorded telemetry data greatly offloads CRONUS to perform more high-level cognitive tasks, such as mission planning and anomaly troubleshooting. Additionally, since Operations Recorder commands contain numerical time input fields which are tedious for a human to manually build, AutoORM's ability to automatically build commands reduces operational command errors. PPL Loader and AutoORM demonstrate principles of semi-autonomous operational tools that will benefit future space mission operations. Both tools employ different levels of automation to perform simple and routine procedures, thereby offloading human operators to perform higher-level cognitive tasks. Because both tools provide procedure execution status and highlight off-nominal indications, the flight controller is able to intervene during procedure execution if needed. Semi-autonomous tools and systems that can perform routine procedures, yet keep human operators informed of execution, will be essential in future long-duration missions where the onboard crew will be solely responsible for spacecraft monitoring and control.

Brzezinski, Amy S.↗

Stimulus-response incompatibility activates cortex proximate to three eye fields

We used functional magnetic resonance imaging (fMRI) to investigate cortical activation during the performance of three oculomotor tasks that impose increasing levels of cognitive demand. (1) In a visually guided saccade (VGS) task, subjects made saccades to flashed targets. (2) In a compatible task, subjects made leftward and rightward saccades in response to foveal presentation of the uppercase words "LEFT" or "RIGHT." (3) In a mixed task, subjects made rightward saccades in response to the lowercase word "left" and leftward saccades in response to the lowercase word "right" on incompatible trials (60%). The remaining 40% of trials required compatible responses to uppercase words. The VGS and compatible tasks, when compared to fixation, activated the three cortical eye fields: the supplementary eye field (SEF), the frontal eye field (FEF), and the parietal eye field (PEF). The mixed task, when compared to the compatible task, activated three additional cortical regions proximate to the three eye fields: (1) rostral to the SEF in medial frontal cortex; (2) rostral to the FEF in dorsolateral prefrontal cortex (DLPFC); (3) rostral and lateral to the PEF in posterior parietal cortex. These areas may contribute to the suppression of prepotent responses and in holding novel visuomotor associations in working memory. Copyright 2001 Academic Press.

NASA Discipline Neuroscience↗

A Miniaturized Video System for Monitoring Drosophila Behavior

Long-term spaceflight may induce a variety of harmful effects in astronauts, resulting in altered motor and cognitive behavior. The stresses experienced by humans in space - most significantly weightlessness (microgravity) and cosmic radiation - are difficult to accurately simulate on Earth. In fact, prolonged and concomitant exposure to microgravity and cosmic radiation can only be studied in space. Behavioral studies in space have focused on model organisms, including Drosophila melanogaster. Drosophila is often used due to its short life span and generational cycle, small size, and ease of maintenance. Additionally, the well-characterized genetics of Drosophila behavior on Earth can be applied to the analysis of results from spaceflights, provided that the behavior in space is accurately recorded. In 2001, the BioExplorer project introduced a low-cost option for researchers: the small satellite. While this approach enabled multiple inexpensive launches of biological experiments, it also imposed stringent restrictions on the monitoring systems in terms of size, mass, data bandwidth, and power consumption. Suggested parameters for size are on the order of 100 mm3 and 1 kg mass for the entire payload. For Drosophila behavioral studies, these engineering requirements are not met by commercially available systems. One system that does meet many requirements for behavioral studies in space is the actimeter. Actimeters use infrared light gates to track the number of times a fly crosses a boundary within a small container (3x3x40 mm). Unfortunately, the apparatus needed to monitor several flies at once would be larger than the capacity of the small satellite. A system is presented, which expands on the actimeter approach to achieve a highly compact, low-power, ultra-low bandwidth solution for simultaneous monitoring of the behavior of multiple flies in space. This also provides a simple, inexpensive alternative to the current systems for monitoring Drosophila populations in terrestrial experiments, and could be especially useful in field experiments in remote locations. Two practical limitations of the system should be noted: first, only walking flies can be observed - not flying - and second, although it enables population studies, tracking individual flies within the population is not currently possible. The system used video recording and an analog circuit to extract the average light changes as a function of time. Flies were held in a 5-cm diameter Petri dish and illuminated from below by a uniform light source. A miniature, monochrome CMOS (complementary metal-oxide semiconductor) video camera imaged the flies. This camera had automatic gain control, and this did not affect system performance. The camera was positioned 5-7 cm above the Petri dish such that the imaging area was 2.25 sq cm. With this basic setup, still images and continuous video of 15 flies at one time were obtained. To reduce the required data bandwidth by several orders of magnitude, a band-pass filter (0.3-10 Hz) circuit compressed the video signal and extracted changes in image luminance over time. The raw activity signal output of this circuit was recorded on a computer and digitally processed to extract the fly movement "events" from the waveform. These events corresponded to flies entering and leaving the image and were used for extracting activity parameters such as inter-event duration. The efficacy of the system in quantifying locomotor activity was evaluated by varying environmental temperature, then measuring the activity level of the flies.

Bhattacharya, Sharmila↗