Search NASA⌕ Search

SEARCH · Search NASA

Results for “electrocorticography”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

Hierarchical Spatio-temporal Visual Analysis of Cluster Evolution in Electrocorticography Data

Here, we present ECoG ClusterFlow, a novel interactive visual analysis tool for the exploration of high-resolution Electrocorticography (ECoG) data. Our system detects and visualizes dynamic high-level structures, such as communities, using the time-varying spatial connectivity network derived from the high-resolution ECoG data. ECoG ClusterFlow provides a multi-scale visualization of the spatio-temporal patterns underlying the time-varying communities using two views: 1) an overview summarizing the evolution of clusters over time and 2) a hierarchical glyph-based technique that uses data aggregation and small multiples techniques to visualize the propagation of clusters in their spatial domain. ECoG ClusterFlow makes it possible 1) to compare the spatio-temporal evolution patterns across various time intervals, 2) to compare the temporal information at varying levels of granularity, and 3) to investigate the evolution of spatial patterns without occluding the spatial context information. Lastly, we present case studies done in collaboration with neuroscientists on our team for both simulated and real epileptic seizure data aimed at evaluating the effectiveness of our approach.

60 APPLIED LIFE SCIENCES↗

Multi-scale visual analysis of time-varying electrocorticography data via clustering of brain regions

There exists a need for effective and easy-to-use software tools supporting the analysis of complex Electrocorticography (ECoG) data. Understanding how epileptic seizures develop or identifying diagnostic indicators for neurological diseases require the in-depth analysis of neural activity data from ECoG. Such data is multi-scale and is of high spatio-temporal resolution. Comprehensive analysis of this data should be supported by interactive visual analysis methods that allow a scientist to understand functional patterns at varying levels of granularity and comprehend its time-varying behavior. We introduce a novel multi-scale visual analysis system, ECoG ClusterFlow, for the detailed exploration of ECoG data. Our system detects and visualizes dynamic high-level structures, such as communities, derived from the time-varying connectivity network. The system supports two major views: 1) an overview summarizing the evolution of clusters over time and 2) an electrode view using hierarchical glyph-based design to visualize the propagation of clusters in their spatial, anatomical context. We present case studies that were performed in collaboration with neuroscientists and neurosurgeons using simulated and recorded epileptic seizure data to demonstrate our system's effectiveness. ECoG ClusterFlow supports the comparison of spatio-temporal patterns for specific time intervals and allows a user to utilize various clustering algorithms. Neuroscientists can identify the site of seizure genesis and its spatial progression during various the stages of a seizure. Our system serves as a fast and powerful means for the generation of preliminary hypotheses that can be used as a basis for subsequent application of rigorous statistical methods, with the ultimate goal being the clinical treatment of epileptogenic zones.

60 APPLIED LIFE SCIENCES↗

Neural speech recognition: continuous phoneme decoding using spatiotemporal representations of human cortical activity

The superior temporal gyrus (STG) and neighboring brain regions play a key role in human language processing. Previous studies have attempted to reconstruct speech information from brain activity in the STG, but few of them incorporate the probabilistic framework and engineering methodology used in modern speech recognition systems. Here, in this work, we describe the initial efforts toward the design of a neural speech recognition (NSR) system that performs continuous phoneme recognition on English stimuli with arbitrary vocabulary sizes using the high gamma band power of local field potentials in the STG and neighboring cortical areas obtained via electrocorticography. The system implements a Viterbi decoder that incorporates phoneme likelihood estimates from a linear discriminant analysis model and transition probabilities from an n-gram phonemic language model. Grid searches were used in an attempt to determine optimal parameterizations of the feature vectors and Viterbi decoder. The performance of the system was significantly improved by using spatiotemporal representations of the neural activity (as opposed to purely spatial representations) and by including language modeling and Viterbi decoding in the NSR system. These results emphasize the importance of modeling the temporal dynamics of neural responses when analyzing their variations with respect to varying stimuli and demonstrate that speech recognition techniques can be successfully leveraged when decoding speech from neural signals. Guided by the results detailed in this work, further development of the NSR system could have applications in the fields of automatic speech recognition and neural prosthetics.

59 BASIC BIOLOGICAL SCIENCES↗

ECoG Cluster Flow v1.0

ECoG ClusterFlow is a novel multi-scale visual analysis system for the detailed exploration of dynamic functional connectivity graphs obtained through electrocorticography.

MURUGESAN, SUGEERTH↗

Multi-Channel Time-Frequency Analysis

This software contains models for multi-channel time series data. The models are time-frequency descriptions of the data. Also included are prediction performance evaluation tools. These models can be applied to electrophysiology data such as electrocorticography.

Kaplan, AlanD↗

High-Resolution, Non-Invasive Imaging of Upper Vocal Tract Articulators Compatible with Human Brain Recordings

A complete neurobiological understanding of speech motor control requires determination of the relationship between simultaneously recorded neural activity and the kinematics of the lips, jaw, tongue, and larynx. Many speech articulators are internal to the vocal tract, and therefore simultaneously tracking the kinematics of all articulators is nontrivial-especially in the context of human electrophysiology recordings. Here, we describe a noninvasive, multi-modal imaging system to monitor vocal tract kinematics, demonstrate this system in six speakers during production of nine American English vowels, and provide new analysis of such data. Classification and regression analysis revealed considerable variability in the articulator-to-acoustic relationship across speakers. Non-negative matrix factorization extracted basis sets capturing vocal tract shapes allowing for higher vowel classification accuracy than traditional methods. Statistical speech synthesis generated speech from vocal tract measurements, and we demonstrate perceptual identification. We demonstrate the capacity to predict lip kinematics from ventral sensorimotor cortical activity. These results demonstrate a multi-modal system to non-invasively monitor articulator kinematics during speech production, describe novel analytic methods for relating kinematic data to speech acoustics, and provide the first decoding of speech kinematics from electrocorticography. These advances will be critical for understanding the cortical basis of speech production and the creation of vocal prosthetics.

60 APPLIED LIFE SCIENCES↗

Columnar Localization and Laminar Origin of Cortical Surface Electrical Potentials

Electrocorticography (ECoG) methodologically bridges basic neuroscience and understanding of human brains in health and disease. However, the localization of ECoG signals across the surface of the brain and the spatial distribution of their generating neuronal sources are poorly understood. To address this gap, we recorded from rat auditory cortex using customized μECoG, and simulated cortical surface electrical potentials with a full-scale, biophysically detailed cortical column model. Experimentally, μECoG-derived auditory representations were tonotopically organized and signals were anisotropically localized to less than or equal to ±200 μm, that is, a single cortical column. Biophysical simulations reproduce experimental findings and indicate that neurons in cortical layers V and VI contribute ∼85% of evoked high-gamma signal recorded at the surface. Cell number and synchrony were the primary biophysical properties determining laminar contributions to evoked μECoG signals, whereas distance was only a minimal factor. Thus, evoked μECoG signals primarily originate from neurons in the infragranular layers of a single cortical column. SIGNIFICANCE STATEMENT ECoG methodologically bridges basic neuroscience and understanding of human brains in health and disease. However, the localization of ECoG signals across the surface of the brain and the spatial distribution of their generating neuronal sources are poorly understood. We investigated the localization and origins of sensory-evoked ECoG responses. We experimentally found that ECoG responses were anisotropically localized to a cortical column. Biophysically detailed simulations revealed that neurons in layers V and VI were the primary sources of evoked ECoG responses. These results indicate that evoked ECoG high-gamma responses are primarily generated by the population spike rate of pyramidal neurons in layers V and VI of single cortical columns and highlight the possibility of understanding how microscopic sources produce mesoscale signals.

Baratham, Vyassa L.↗

ECoG Cluster Flow v1.0

ECoG ClusterFlow is a novel multi-scale visual analysis system for the detailed exploration of dynamic functional connectivity graphs obtained through electrocorticography.

MURUGESAN, SUGEERTH↗

Implantable neuromodulation system for closed-loop stimulation and recording simultaneously at multiple brain sets

The present disclosure relates to a modular system for deep brain stimulation (DBS) and electrocorticography (ECoG). The system may have an implantable neuromodulator for generating electrical stimulation signals adapted to be applied to a desired region of a brain via an attached electrode array. An aggregator module may be used for collecting and aggregating electrical signals and transmitting the electrical signals to the neuromodulator. A control module may be used which is in communication with the aggregator module for controlling generation of the electrical signals and transmitting the electrical signals to the aggregator.

Pannu, Satinderpall S.↗

A high-density, high-channel count, multiplexed μECoG array for auditory-cortex recordings

Our understanding of the large-scale population dynamics of neural activity is limited, in part, by our inability to record simultaneously from large regions of the cortex. Here, we validated the use of a large-scale active microelectrode array that simultaneously records 196 multiplexed micro-electrocortigraphical (μECoG) signals from the cortical surface at a very high density (1,600 electrodes/cm 2 ). We compared μECoG measurements in auditory cortex using a custom “active” electrode array to those recorded using a conventional “passive” μECoG array. Both of these array responses were also compared with data recorded via intrinsic optical imaging, which is a standard methodology for recording sound-evoked cortical activity. Custom active μECoG arrays generated more veridical representations of the tonotopic organization of the auditory cortex than current commercially available passive μECoG arrays. Furthermore, the cortical representation could be measured efficiently with the active arrays, requiring as little as 13.5 s of neural data acquisition. Next, we generated spectrotemporal receptive fields from the recorded neural activity on the active μECoG array and identified functional organizational principles comparable to those observed using intrinsic metabolic imaging and single-neuron recordings. Furthermore, this new electrode array technology has the potential for large-scale, temporally precise monitoring and mapping of the cortex, without the use of invasive penetrating electrodes.

60 APPLIED LIFE SCIENCES↗

Human Sensorimotor Cortex Control of Directly Measured Vocal Tract Movements during Vowel Production

During speech production, we make vocal tract movements with remarkable precision and speed. Our understanding of how the human brain achieves such proficient control is limited, in part due to the challenge of simultaneously acquiring high-resolution neural recordings and detailed vocal tract measurements. To overcome this challenge, we combined ultrasound and video monitoring of the supralaryngeal articulators (lips, jaw, and tongue) with electrocorticographic recordings from the cortical surface of 4 subjects (3 female, 1 male) to investigate how neural activity in the ventral sensory-motor cortex (vSMC) relates to measured articulator movement kinematics (position, speed, velocity, acceleration) during the production of English vowels. We found that high-gamma activity at many individual vSMC electrodes strongly encoded the kinematics of one or more articulators, but less so for vowel formants and vowel identity. Neural population decoding methods further revealed the structure of kinematic features that distinguish vowels. Encoding of articulator kinematics was sparsely distributed across time and primarily occurred during the time of vowel onset and offset. In contrast, encoding was low during the steady-state portion of the vowel, despite sustained neural activity at some electrodes. Significant representations were found for all kinematic parameters, but speed was the most robust. These findings enabled by direct vocal tract monitoring demonstrate novel insights into the representation of articulatory kinematic parameters encoded in the vSMC during speech production.

47 OTHER INSTRUMENTATION↗