Search NASA⌕ Search

SEARCH · Search NASA

Results for “Speech Acoustics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

xEMU Suit Integrated Audio Communications System: Ambient and EVA Pressure Testing System Performance

Testing across several airlock and EVA thermal and pressure scenarios has demonstrated that the Integrated Audio System of NASA’s Exploration Extravehicular Mobility Unit (xEMU) spacesuits transmits and receives intelligible audio communications without the use of a commcap or similar worn device. The xEMU audio system consists of internal loudspeakers and digital microphones (Integrated Communications System –ICS) combined with an adaptive Acoustic Echo Canceller (AEC), outbound voice operated transmission (VOX), and automatic gain control (AGC). Transducers are mounted in an “exploded commcap” configuration with helmet-attached speakers near the ears and three microphones positioned at the collar. The AGC removes inbound audio signals (e.g.,suit, Mission Control, Lander, C&W tones) from the outbound comms stream, reducing echo and feedback (squeal) in low-noise suit environments. The reduction of worn communication equipment increases crewmember comfort, range of movement, and situational awareness. However, test results also highlight the need for proper fan, duct, pump, and gas flow integration with suit acoustics and audio. Ductwork may serve as waveguides for various component and structure-borne noise. Sharply angled ducts can generate turbulent-flow noise. Gas flow from inlets above the crewmember’s head can generate noise when cascading over the faceplate and collar (or commcap) microphones. Sufficient acoustic noise levels (1) require increased gain to boost inbound audio, and (2) may distort signals resulting in AEC disruption or artifacts. Suit-noise levels decline with reduced pressure (density), but then elevated speech and audio effort/power become necessary. Whether the Integrated Audio System, commcap, or other device is used, suit acoustic noise can mask speech in outbound comms. This reduces intelligibility and requires other AECs/devices to suppress comms noise. Yet, adjusting a few components may yield significant improvement. We discuss xEMU audio functionality, demonstrate how acoustical treatment combined with inbound signal conditioning improved clarity during tests, and discuss future modifications.

xEMU↗
NASA NTRS2002

Speech motor control and acute mountain sickness

BACKGROUND: An objective method that accurately quantifies the severity of Acute Mountain Sickness (AMS) symptoms is needed to enable more reliable evaluation of altitude acclimatization and testing of potentially beneficial interventions. HYPOTHESIS: Changes in human articulation, as quantified by timed variations in acoustic waveforms of specific spoken words (voice onset time; VOT), are correlated with the severity of AMS. METHODS: Fifteen volunteers were exposed to a simulated altitude of 4300 m (446 mm Hg) in a hypobaric chamber for 48 h. Speech motor control was determined from digitally recorded and analyzed timing patterns of 30 different monosyllabic words characterized as voiced and unvoiced, and as labial, alveolar, or velar. The Environmental Symptoms Questionnaire (ESQ) was used to assess AMS. RESULTS: Significant AMS symptoms occurred after 4 h, peaked at 16 h, and returned toward baseline after 48 h. Labial VOTs were shorter after 4 and 39 h of exposure; velar VOTs were altered only after 4 h; and there were no changes in alveolar VOTs. The duration of vowel sounds was increased after 4 h of exposure and returned to normal thereafter. Only 1 of 15 subjects did not increase vowel time after 4 h of exposure. The 39-h labial (p = 0.009) and velar (p = 0.037) voiced-unvoiced timed separations consonants and the symptoms of AMS were significantly correlated. CONCLUSIONS: Two objective measures of speech production were affected by exposure to 4300 m altitude and correlated with AMS severity. Alterations in speech production may represent an objective measure of AMS and central vulnerability to hypoxia.

NASA Discipline Space Human Factors↗
NASA NTRS2003

Applications of Hilbert Spectral Analysis for Speech and Sound Signals

A new method for analyzing nonlinear and nonstationary data has been developed, and the natural applications are to speech and sound signals. The key part of the method is the Empirical Mode Decomposition method with which any complicated data set can be decomposed into a finite and often small number of Intrinsic Mode Functions (IMF). An IMF is defined as any function having the same numbers of zero-crossing and extrema, and also having symmetric envelopes defined by the local maxima and minima respectively. The IMF also admits well-behaved Hilbert transform. This decomposition method is adaptive, and, therefore, highly efficient. Since the decomposition is based on the local characteristic time scale of the data, it is applicable to nonlinear and nonstationary processes. With the Hilbert transform, the Intrinsic Mode Functions yield instantaneous frequencies as functions of time, which give sharp identifications of imbedded structures. This method invention can be used to process all acoustic signals. Specifically, it can process the speech signals for Speech synthesis, Speaker identification and verification, Speech recognition, and Sound signal enhancement and filtering. Additionally, as the acoustical signals from machinery are essentially the way the machines are talking to us. Therefore, the acoustical signals, from the machines, either from sound through air or vibration on the machines, can tell us the operating conditions of the machines. Thus, we can use the acoustic signal to diagnosis the problems of machines.

Huang, Norden E.↗
NASA NTRS2001

Direct comparison of the impact of head tracking, reverberation, and individualized head-related transfer functions on the spatial perception of a virtual speech source

A study of sound localization performance was conducted using headphone-delivered virtual speech stimuli, rendered via HRTF-based acoustic auralization software and hardware, and blocked-meatus HRTF measurements. The independent variables were chosen to evaluate commonly held assumptions in the literature regarding improved localization: inclusion of head tracking, individualized HRTFs, and early and diffuse reflections. Significant effects were found for azimuth and elevation error, reversal rates, and externalization.

NASA Discipline Space Human Factors↗
NASA NTRS2010

Speech Acquisition and Automatic Speech Recognition for Integrated Spacesuit Audio Systems

A voice-command human-machine interface system has been developed for spacesuit extravehicular activity (EVA) missions. A multichannel acoustic signal processing method has been created for distant speech acquisition in noisy and reverberant environments. This technology reduces noise by exploiting differences in the statistical nature of signal (i.e., speech) and noise that exists in the spatial and temporal domains. As a result, the automatic speech recognition (ASR) accuracy can be improved to the level at which crewmembers would find the speech interface useful. The developed speech human/machine interface will enable both crewmember usability and operational efficiency. It can enjoy a fast rate of data/text entry, small overall size, and can be lightweight. In addition, this design will free the hands and eyes of a suited crewmember. The system components and steps include beam forming/multi-channel noise reduction, single-channel noise reduction, speech feature extraction, feature transformation and normalization, feature compression, model adaption, ASR HMM (Hidden Markov Model) training, and ASR decoding. A state-of-the-art phoneme recognizer can obtain an accuracy rate of 65 percent when the training and testing data are free of noise. When it is used in spacesuits, the rate drops to about 33 percent. With the developed microphone array speech-processing technologies, the performance is improved and the phoneme recognition accuracy rate rises to 44 percent. The recognizer can be further improved by combining the microphone array and HMM model adaptation techniques and using speech samples collected from inside spacesuits. In addition, arithmetic complexity models for the major HMMbased ASR components were developed. They can help real-time ASR system designers select proper tasks when in the face of constraints in computational resources.

Huang, Yiteng↗
NASA NTRS1987

Space station interior noise analysis program

Documentation is provided for a microcomputer program which was developed to evaluate the effect of the vibroacoustic environment on speech communication inside a space station. The program, entitled Space Station Interior Noise Analysis Program (SSINAP), combines a Statistical Energy Analysis (SEA) prediction of sound and vibration levels within the space station with a speech intelligibility model based on the Modulation Transfer Function and the Speech Transmission Index (MTF/STI). The SEA model provides an effective analysis tool for predicting the acoustic environment based on proposed space station design. The MTF/STI model provides a method for evaluating speech communication in the relatively reverberant and potentially noisy environments that are likely to occur in space stations. The combinations of these two models provides a powerful analysis tool for optimizing the acoustic design of space stations from the point of view of speech communications. The mathematical algorithms used in SSINAP are presented to implement the SEA and MTF/STI models. An appendix provides an explanation of the operation of the program along with details of the program structure and code.

Stusnick, E.↗
NASA NTRS1998

Improving Acoustic Models by Watching Television

Obtaining sufficient labelled training data is a persistent difficulty for speech recognition research. Although well transcribed data is expensive to produce, there is a constant stream of challenging speech data and poor transcription broadcast as closed-captioned television. We describe a reliable unsupervised method for identifying accurately transcribed sections of these broadcasts, and show how these segments can be used to train a recognition system. Starting from acoustic models trained on the Wall Street Journal database, a single iteration of our training method reduced the word error rate on an independent broadcast television news test set from 62.2% to 59.5%.

Witbrock, Michael J.↗
NASA NTRS1980

Role of the middle ear muscle apparatus in mechanisms of speech signal discrimination

A method of impedance reflexometry was used to examine 101 students with hearing impairment in order to clarify the interrelation between speech discrimination and the state of the middle ear muscles. Ability to discriminate speech signals depends to some extent on the functional state of intraaural muscles. Speech discrimination was greatly impaired in the absence of stapedial muscle acoustic reflex, in the presence of low thresholds of stimulation and in very small values of reflex amplitude increase. Discrimination was not impeded in positive AR, high values of relative thresholds and normal increase of reflex amplitude in response to speech signals with augmenting intensity.

Moroz, B. S.↗
NASA NTRS2017

Incorporating Speech Recognition into a Natural User Interface

The Augmented/ Virtual Reality (AVR) Lab has been working to study the applicability of recent virtual and augmented reality hardware and software to KSC operations. This includes the Oculus Rift, HTC Vive, Microsoft HoloLens, and Unity game engine. My project in this lab is to integrate voice recognition and voice commands into an easy to modify system that can be added to an existing portion of a Natural User Interface (NUI). A NUI is an intuitive and simple to use interface incorporating visual, touch, and speech recognition. The inclusion of speech recognition capability will allow users to perform actions or make inquiries using only their voice. The simplicity of needing only to speak to control an on-screen object or enact some digital action means that any user can quickly become accustomed to using this system. Multiple programs were tested for use in a speech command and recognition system. Sphinx4 translates speech to text using a Hidden Markov Model (HMM) based Language Model, an Acoustic Model, and a word Dictionary running on Java. PocketSphinx had similar functionality to Sphinx4 but instead ran on C. However, neither of these programs were ideal as building a Java or C wrapper slowed performance. The most ideal speech recognition system tested was the Unity Engine Grammar Recognizer. A Context Free Grammar (CFG) structure is written in an XML file to specify the structure of phrases and words that will be recognized by Unity Grammar Recognizer. Using Speech Recognition Grammar Specification (SRGS) 1.0 makes modifying the recognized combinations of words and phrases very simple and quick to do. With SRGS 1.0, semantic information can also be added to the XML file, which allows for even more control over how spoken words and phrases are interpreted by Unity. Additionally, using a CFG with SRGS 1.0 produces a Finite State Machine (FSM) functionality limiting the potential for incorrectly heard words or phrases. The purpose of my project was to investigate options for a Speech Recognition System. To that end I attempted to integrate Sphinx4 into a user interface. Sphinx4 had great accuracy and is the only free program able to perform offline speech dictation. However it had a limited dictionary of words that could be recognized, single syllable words were almost impossible for it to hear, and since it ran on Java it could not be integrated into the Unity based NUI. PocketSphinx ran much faster than Sphinx4 which would've made it ideal as a plugin to the Unity NUI, unfortunately creating a C# wrapper for the C code made the program unusable with Unity due to the wrapper slowing code execution and class files becoming unreachable. Unity Grammar Recognizer is the ideal speech recognition interface, it is flexible in recognizing multiple variations of the same command. It is also the most accurate program in recognizing speech due to using an XML grammar to specify speech structure instead of relying solely on a Dictionary and Language model. The Unity Grammar Recognizer will be used with the NUI for these reasons as well as being written in C# which further simplifies the incorporation.

Chapa, Nicholas↗
NASA NTRS2010

Cabin Noise Studies for the Orion Spacecraft Crew Module

Controlling cabin acoustic noise levels in the Crew Module (CM) of the Orion spacecraft is critical for adequate speech intelligibility, to avoid fatigue and to prevent any possibility of temporary and permanent hearing loss. A vibroacoustic model of the Orion CM cabin has been developed using Statistical Energy Analysis (SEA) to assess compliance with acoustic Constellation Human Systems Integration Requirements (HSIR) for the on-orbit mission phase. Cabin noise in the Orion CM needs to be analyzed at the vehicle-level to assess the cumulative acoustic effect of various Orion systems at the crewmember's ear. The SEA model includes all major structural and acoustic subsystems inside the CM including the Environmental Control and Life Support System (ECLSS), which is the primary noise contributor in the cabin during the on-orbit phase. The ECLSS noise sources used to excite the vehicle acoustic model were derived using a combination of established empirical predictions and fan development acoustic testing. Baseline noise predictions were compared against acoustic HSIR requirements. Key noise offenders and paths were identified and ranked using noise transfer path analysis. Parametric studies were conducted with various acoustic treatment packages in the cabin to reduce the noise levels and define vehicle-level mass impacts. An acoustic test mockup of the CM cabin has also been developed and noise treatment optimization tests were conducted to validate the results of the analyses.

Dandaroy, Indranil↗
NASA NTRS1991

Virtual acoustics displays

The real time acoustic display capabilities are described which were developed for the Virtual Environment Workstation (VIEW) Project at NASA-Ames. The acoustic display is capable of generating localized acoustic cues in real time over headphones. An auditory symbology, a related collection of representational auditory 'objects' or 'icons', can be designed using ACE (Auditory Cue Editor), which links both discrete and continuously varying acoustic parameters with information or events in the display. During a given display scenario, the symbology can be dynamically coordinated in real time with 3-D visual objects, speech, and gestural displays. The types of displays feasible with the system range from simple warnings and alarms to the acoustic representation of multidimensional data or events.

Wenzel, Elizabeth M.↗
NASA NTRS2001

Acoustical Testing Laboratory Developed to Support the Low-Noise Design of Microgravity Space Flight Hardware

The NASA John H. Glenn Research Center at Lewis Field has designed and constructed an Acoustical Testing Laboratory to support the low-noise design of microgravity space flight hardware. This new laboratory will provide acoustic emissions testing and noise control services for a variety of customers, particularly for microgravity space flight hardware that must meet International Space Station limits on noise emissions. These limits have been imposed by the space station to support hearing conservation, speech communication, and safety goals as well as to prevent noise-induced vibrations that could impact microgravity research data. The Acoustical Testing Laboratory consists of a 23 by 27 by 20 ft (height) convertible hemi/anechoic chamber and separate sound-attenuating test support enclosure. Absorptive 34-in. fiberglass wedges in the test chamber provide an anechoic environment down to 100 Hz. A spring-isolated floor system affords vibration isolation above 3 Hz. These criteria, along with very low design background levels, will enable the acquisition of accurate and repeatable acoustical measurements on test articles, up to a full space station rack in size, that produce very little noise. Removable floor wedges will allow the test chamber to operate in either a hemi/anechoic or anechoic configuration, depending on the size of the test article and the specific test being conducted. The test support enclosure functions as a control room during normal operations but, alternatively, may be used as a noise-control enclosure for test articles that require the operation of noise-generating test support equipment.

Cooper, Beth A.↗
NASA NTRSDate not supplied

Predicting Team Functioning in Long Term Space Missions Using Acoustic and Linguistic Measures

Maintaining optimal team functioning is critical for long-duration space exploration missions, yet traditional monitoring methods, such as self-reports and wearable sensors, often impose operational burdens or suffer from bias. This paper investigates a non-intrusive speech-based artificial intelligence (AI) framework to predict degradations in team functioning using data from the Human Exploration Research Analog (HERA) of the U.S. National Aeronautics and Space Administration (NASA). Using acoustic features, linguistic descriptors, and semantic embeddings, we evaluate static non-linear and temporal machine learning models to predict both objective (task accuracy) and subjective (self-reported efficacy and cohesion) team functioning outcomes. Results indicate that temporal models outperform static approaches, with prediction of objective task accuracy in Team Interaction Battery (TIB) improving from near chance to 71%. Self-reported outcomes, including team efficacy and cohesion, are predicted more reliably than task performance, achieving balanced accuracies of up to 85.56% and 78.12%, respectively, and are found to be most strongly associated with acoustic features. In a second interdependent task, the MMSEV–EVA, accuracies of up to 78% are achieved using temporal models with acoustic features. Furthermore, incorporating just 1–2 days of team-specific historical data systematically improved performance, and acoustic markers from informal pre-task interactions provided modest predictive gains. Finally, while automated preprocessing yielded viable accuracy, humancorrected data provided moderate performance gains, though transcription error rates did not significantly correlate with model performance. These findings highlight the potential of speech as a passive, high-fidelity monitoring tool for autonomous habitats.

Temporal modeling↗
NASA NTRSDate not supplied

Development of Acoustic Mufflers for Cabin Noise Reduction in Orion Spacecraft

Controlling cabin acoustic noise levels in the Crew Module (CM) of the Orion spacecraft is critical to ensure adequate speech intelligibility, to avoid fatigue, and prevent any possibility of temporary and permanent hearing loss to the crew. The primary source of cabin noise for the on-orbit phase of the mission is from the Environmental Control and Life Support System (ECLSS) which recycles and conditions breathing air and maintains cabin pressurization through its duct network and components. Unfortunately, as a side effect, noise from the ECLSS fans propagates through theses ducts and emanate into the cabin habitable volume via the ECLSS inlet and outlets. To mitigate excessive duct-borne noise, two ECLSS mufflers have been designed to provide significant acoustic transmission loss (TL) so that the cabin noise requirements can be met. Each muffler is meant to be installed in the ducting of the ECLSS air inlet and outlet sides, respectively. Packaging constraints and tight volume requirements necessitated the mufflers to be of complex geometry and compatible with the bends of the ECLSS duct layout. To design and characterize the acoustic performance of the inlet and outlet mufflers, computational acoustic models were developed using the Finite Element Method (FEM) with 𝑤𝑎𝑣𝑒଺ vibroacoustic software. Characterization of the acoustic material and perforations in the mufflers were addressed with poroelastic theory. Once the mufflers were designed on paper and its TL predicted, prototypes of these mufflers were created using additive manufacturing. The muffler prototypes were subsequently tested for acoustic TL in the laboratory with various con-figurations of acoustic materials. Comparing the analytical predictions to the test performance yielded excellent correlation for acoustic TL and demonstrated significant broadband noise attenuation. The ECLSS mufflers are currently scheduled to be installed on the Artemis II Crew Module (CM) of the Orion spacecraft and will provide significant cabin comfort to crew during the mission.

Indranil Dandaroy↗
NASA NTRS1991

Watch what you say, your computer might be listening: A review of automated speech recognition

Spoken language is the most convenient and natural means by which people interact with each other and is, therefore, a promising candidate for human-machine interactions. Speech also offers an additional channel for hands-busy applications, complementing the use of motor output channels for control. Current speech recognition systems vary considerably across a number of important characteristics, including vocabulary size, speaking mode, training requirements for new speakers, robustness to acoustic environments, and accuracy. Algorithmically, these systems range from rule-based techniques through more probabilistic or self-learning approaches such as hidden Markov modeling and neural networks. This tutorial begins with a brief summary of the relevant features of current speech recognition systems and the strengths and weaknesses of the various algorithmic approaches.

Degennaro, Stephen V.↗
NASA NTRS2011

Analysis of Noise Exposure Measurements Made Onboard the International Space Station

The International Space Station (ISS) is a unique workplace environment for U.S. astronauts and Russian cosmonauts to conduct research and live for a period of six months or more. Noise has been an enduring environmental physical hazard that has been a challenge for the U.S. space program since before the Apollo era. Noise exposure in ISS poses significant risks to the crewmembers, such as; hearing loss (temporary or permanent), possible disruptions of crew sleep, interference with speech intelligibility and communication, possible interference with crew task performance, and possible reduction in alarm audibility. Acoustic measurements are made aboard ISS and compared to requirements in order to assess the acoustic environment to which the crewmembers are exposed. The purpose of this paper is to describe in detail the noise exposure monitoring program as well as an assessment of the acoustic dosimeter data collected to date. The hardware currently being used for monitoring the noise exposure onboard ISS will be discussed. Acoustic data onboard ISS has been collected since the beginning of ISS (Increment 1, November 2000). Noise exposure data analysis will include acoustic dosimetry logged data from crew-worn during work and sleep periods and also fixed-location measurements from Increment 1 to present day. Noise exposure levels (8-, 16- and 24-hr), LEQ, will also be provided and discussed in this paper. Discussions related to hearing protection will also be included. Future directions and recommendations for the noise exposure monitoring program will be highlighted. This acoustic data is used to ensure a safe and healthy working and living environment for the crewmembers aboard the ISS.

Limardo, Jose G.↗
NASA NTRS2011

Analysis of Noise Exposure Measurements Acquired Onboard the International Space Station

The International Space Station (ISS) is a unique workplace environment for U.S. astronauts and Russian cosmonauts to conduct research and live for a period of six months or more. Noise has been an enduring environmental physical hazard that has been a challenge for the U.S. space program since before the Apollo era. Noise exposure in ISS poses significant risks to the crewmembers, such as; hearing loss (temporary or permanent), possible disruptions of crew sleep, interference with speech intelligibility and communication, possible interference with crew task performance, and possible reduction in alarm audibility. Acoustic measurements were made onboard ISS and compared to requirements in order to assess the acoustic environment to which the crewmembers are exposed. The purpose of this paper is to describe in detail the noise exposure monitoring program as well as an assessment of the acoustic dosimeter data collected to date. The hardware currently being used for monitoring the noise exposure onboard ISS will be discussed. Acoustic data onboard ISS has been collected since the beginning of ISS (Increment 1, November 2001). Noise exposure data analysis will include acoustic dosimetry logged data from crew-worn dosimeters during work and sleep periods and also fixed-location measurements from Increment 1 to present day. Noise exposure levels (8-, 16- and 24-hr), LEQ, will also be provided and discussed in this paper. Future directions and recommendations for the noise exposure monitoring program will be highlighted. This acoustic data is used to ensure a safe and healthy working and living environment for the crewmembers onboard the ISS.

Limardo, Jose G.↗