Search NASA⌕ Search

SEARCH · Search NASA

Results for “AUDITORY SIGNAL”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

101 records · Page 6
All sourcesNASA NTRSDOE OSTI
NASA NTRS2018

Methods and Apparatus for Autonomous Robotic Control

Sensory processing of visual, auditory, and other sensor information (e.g., visual imagery, LIDAR, RADAR) is conventionally based on "stovepiped," or isolated processing, with little interactions between modules. Biological systems, on the other hand, fuse multi-sensory information to identify nearby objects of interest more quickly, more efficiently, and with higher signal-to-noise ratios. Similarly, examples of the OpenSense technology disclosed herein use neurally inspired processing to identify and locate objects in a robot's environment. This enables the robot to navigate its environment more quickly and with lower computational and power requirements.

Versace, Massimiliano↗
NASA NTRS2004

Oscillatory Hierarchy Controlling Cortical Excitability and Stimulus Integration

Cortical gamma band oscillations have been recorded in sensory cortices of cats and monkeys, and are thought to aid in perceptual binding. Gamma activity has also been recorded in the rat hippocampus and entorhinal cortex, where it has been shown, that field gamma power is modulated at theta frequency. Since the power of gamma activity in the sensory cortices is not constant (gamma-bursts). we decided to examine the relationship between gamma power and the phase of low frequency oscillation in the auditory cortex of the awake macaque. Macaque monkeys were surgically prepared for chronic awake electrophysiological recording. During the time of the experiments. linear array multielectrodes were inserted in area AI to obtain laminar current source density (CSD) and multiunit activity profiles. Instantaneous theta and gamma power and phase was extracted by applying the Morlet wavelet transformation to the CSD. Gamma power was averaged for every 1 degree of low frequency oscillations to calculate power-phase relation. Both gamma and theta-delta power are largest in the supragranular layers. Power modulation of gamma activity is phase locked to spontaneous, as well as stimulus-related local theta and delta field oscillations. Our analysis also revealed that the power of theta oscillations is always largest at a certain phase of delta oscillation. Auditory stimuli produce evoked responses in the theta band (Le., there is pre- to post-stimulus addition of theta power), but there is also indication that stimuli may cause partial phase re-setting of spontaneous delta (and thus also theta and gamma) oscillations. We also show that spontaneous oscillations might play a role in the processing of incoming sensory signals by 'preparing' the cortex.

Shah, A. S.↗
NASA NTRS1991

Virtual acoustic displays

A 3D auditory display can potentially enhance information transfer by combining directional and iconic information in a quite naturalistic representation of dynamic objects in the interface. Another aspect of auditory spatial clues is that, in conjunction with other modalities, it can act as a potentiator of information in the display. For example, visual and auditory cues together can reinforce the information content of the display and provide a greater sense of presence or realism in a manner not readily achievable by either modality alone. This phenomenon will be particularly useful in telepresence applications, such as advanced teleconferencing environments, shared electronic workspaces, and monitoring telerobotic activities in remote or hazardous situations. Thus, the combination of direct spatial cues with good principles of iconic design could provide an extremely powerful and information-rich display which is also quite easy to use. An alternative approach, recently developed at ARC, generates externalized, 3D sound cues over headphones in realtime using digital signal processing. Here, the synthesis technique involves the digital generation of stimuli using Head-Related Transfer Functions (HRTF's) measured in the two ear-canals of individual subjects. Other similar approaches include an analog system developed by Loomis, et. al., (1990) and digital systems which make use of transforms derived from normative mannikins and simulations of room acoustics. Such an interface also requires the careful psychophysical evaluation of listener's ability to accurately localize the virtual or synthetic sound sources. From an applied standpoint, measurement of each potential listener's HRTF's may not be possible in practice. For experienced listeners, localization performance was only slightly degraded compared to a subject's inherent ability. Alternatively, even inexperienced listeners may be able to adapt to a particular set of HRTF's as long as they provide adequate cues for localization. In general, these data suggest that most listeners can obtain useful directional information from an auditory display without requiring the use of individually-tailored HRTF's.

Wenzel, Elizabeth M.↗
NASA NTRS1993

Quality metrics for sensor images

Methods are needed for evaluating the quality of augmented visual displays (AVID). Computational quality metrics will help summarize, interpolate, and extrapolate the results of human performance tests with displays. The FLM Vision group at NASA Ames has been developing computational models of visual processing and using them to develop computational metrics for similar problems. For example, display modeling systems use metrics for comparing proposed displays, halftoning optimizing methods use metrics to evaluate the difference between the halftone and the original, and image compression methods minimize the predicted visibility of compression artifacts. The visual discrimination models take as input two arbitrary images A and B and compute an estimate of the probability that a human observer will report that A is different from B. If A is an image that one desires to display and B is the actual displayed image, such an estimate can be regarded as an image quality metric reflecting how well B approximates A. There are additional complexities associated with the problem of evaluating the quality of radar and IR enhanced displays for AVID tasks. One important problem is the question of whether intruding obstacles are detectable in such displays. Although the discrimination model can handle detection situations by making B the original image A plus the intrusion, this detection model makes the inappropriate assumption that the observer knows where the intrusion will be. Effects of signal uncertainty need to be added to our models. A pilot needs to make decisions rapidly. The models need to predict not just the probability of a correct decision, but the probability of a correct decision by the time the decision needs to be made. That is, the models need to predict latency as well as accuracy. Luce and Green have generated models for auditory detection latencies. Similar models are needed for visual detection. Most image quality models are designed for static imagery. Watson has been developing a general spatial-temporal vision model to optimize video compression techniques. These models need to be adapted and calibrated for AVID applications.

Ahumada, AL↗
NASA NTRS1975

The auditory neural network in man

The principles of anatomy and physiology necessary for understanding brain wave recordings made from the scalp of normal people are briefly discussed. Brain waves evoked by sounds are described and certain of their features are related to the physical aspects of the stimulus and to the psychological state of the listener. The position is taken that data obtained through scalp probes can reveal a large amount of detail about brain functioning and that analysis of such records enable detection of the response of the nervous system to an acoustic message at the moment of its inception and to the progress of the message through the brain. Brain events responsible for distinguishing between similar signals and making decisions about them appear to generate characteristic and identifiable electrical waves. Some theoretical speculation about these data are introduced with the aim of generating a more heuristic model of the functioning brain.

Galambos, R.↗
NASA NTRS1987

Vestibulo-ocular and vestibulospinal function before and after cochlear implant surgery

Vestibular function in cochlear implant candidates varies from normal to total absence of function. In patients with intact vestibular function preoperatively, invasion of the otic capsule places residual vestibular function at risk. Speech-processing strategies that result in large amplitude electrical transients or strategies that employ high amplitude broad frequency carrier signals have the potential for disrupting vestibular function. Five patients were tested with and without electrical stimulation via cochlear electrodes. Two patients experienced subjective vestibular effects that were quickly resolved. No long-term vestibular effects were noted for the two types of second generation cochlear implants evaluated. Histopathological findings from another patient, who had electrically generated vestibular reflex responses to intramodiolar electrodes, indicated that responses elicited were a function of several variables including electrode location, stimulus intensity, stimulus amplitude, and stimulus frequency. Differential auditory, vestibulocolic, and vestibulospinal reflexes were demonstrated from the same electrode as a function of stimulus amplitude, frequency, and duration.

Case Reports↗
NASA NTRS1975

The auditory neural network in man

The principles of anatomy and physiology necessary for understanding brain wave recordings made from the scalp are briefly discussed. Brain waves evoked by sounds are then described and certain of their features are related to the physical aspects of the stimulus and the psychological state of the listener. It is proposed that data obtained through probes located outside the head can reveal a large amount of detail about brain activity. It is argued that analysis of such records enables one to detect the response of the nervous system to an acoustic message at the moment of its inception at the ear, and to follow the progress of the acoustic message up through the various brain levels as progressively more complex operations are performed upon it. Even those brain events responsible for the highest level of signal processing - distinguishing between similar signals and making decisions about them - seem to generate characteristic and identifiable electrical waves.

Galambos, R.↗
NASA NTRS1992

Microgravity vestibular investigations (10-IML-1)

Our perception of how we are oriented in space is dependent on the interaction of virtually every sensory system. For example, to move about in our environment we integrate inputs in our brain from visual, haptic (kinesthetic, proprioceptive, and cutaneous), auditory systems, and labyrinths. In addition to this multimodal system for orientation, our expectations about the direction and speed of our chosen movement are also important. Changes in our environment and the way we interact with the new stimuli will result in a different interpretation by the nervous system of the incoming sensory information. We will adapt to the change in appropriate ways. Because our orientation system is adaptable and complex, it is often difficult to trace a response or change in behavior to any one source of information in this synergistic orientation system. However, with a carefully designed investigation, it is possible to measure signals at the appropriate level of response (both electrophysiological and perceptual) and determine the effect that stimulus rearrangement has on our sense of orientation. The environment of orbital flight represents the stimulus arrangement that is our immediate concern. The Microgravity Vestibular Investigations (MVI) represent a group of experiments designed to investigate the effects of orbital flight and a return to Earth on our orientation system.

Reschke, Millard F.↗
NASA NTRS1999

Firing behavior of vestibular neurons during active and passive head movements: vestibulo-spinal and other non-eye-movement related neurons

The firing behavior of 51 non-eye movement related central vestibular neurons that were sensitive to passive head rotation in the plane of the horizontal semicircular canal was studied in three squirrel monkeys whose heads were free to move in the horizontal plane. Unit sensitivity to active head movements during spontaneous gaze saccades was compared with sensitivity to passive head rotation. Most units (29/35 tested) were activated at monosynaptic latencies following electrical stimulation of the ipsilateral vestibular nerve. Nine were vestibulo-spinal units that were antidromically activated following electrical stimulation of the ventromedial funiculi of the spinal cord at C1. All of the units were less sensitive to active head movements than to passive whole body rotation. In the majority of cells (37/51, 73%), including all nine identified vestibulo-spinal units, the vestibular signals related to active head movements were canceled. The remaining units (n = 14, 27%) were sensitive to active head movements, but their responses were attenuated by 20-75%. Most units were nearly as sensitive to passive head-on-trunk rotation as they were to whole body rotation; this suggests that vestibular signals related to active head movements were cancelled primarily by subtraction of a head movement efference copy signal. The sensitivity of most units to passive whole body rotation was unchanged during gaze saccades. A fundamental feature of sensory processing is the ability to distinguish between self-generated and externally induced sensory events. Our observations suggest that the distinction is made at an early stage of processing in the vestibular system.

Non-NASA Center↗
NASA NTRS1998

Virtual acoustics, aeronautics, and communications

An optimal approach to auditory display design for commercial aircraft would utilize both spatialized (3-D) audio techniques and active noise cancellation for safer operations. Results from several aircraft simulator studies conducted at NASA Ames Research Center are reviewed, including Traffic alert and Collision Avoidance System (TCAS) warnings, spoken orientation "beacons" for gate identification and collision avoidance on the ground, and hardware for improved speech intelligibility. The implications of hearing loss among pilots is also considered.

NASA Center ARC↗
NASA NTRS2014

Signal Processing Methods for Removing the Effects of Whole Body Vibration upon Speech

Humans may be exposed to whole-body vibration in environments where clear speech communications are crucial, particularly during the launch phases of space flight and in high-performance aircraft. Prior research has shown that high levels of vibration cause a decrease in speech intelligibility. However, the effects of whole-body vibration upon speech are not well understood, and no attempt has been made to restore speech distorted by whole-body vibration. In this paper, a model for speech under whole-body vibration is proposed and a method to remove its effect is described. The method described reduces the perceptual effects of vibration, yields higher ASR accuracy scores, and may significantly improve intelligibility. Possible applications include incorporation within communication systems to improve radio-communication systems in environments such a spaceflight, aviation, or off-road vehicle operations.

human response to vibration↗