Search NASA⌕ Search

SEARCH · Search NASA

Results for “Speech”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

xEMU Suit Integrated Audio Communications System: Ambient and EVA Pressure Testing System Performance

Testing across several airlock and EVA thermal and pressure scenarios has demonstrated that the Integrated Audio System of NASA’s Exploration Extravehicular Mobility Unit (xEMU) spacesuits transmits and receives intelligible audio communications without the use of a commcap or similar worn device. The xEMU audio system consists of internal loudspeakers and digital microphones (Integrated Communications System –ICS) combined with an adaptive Acoustic Echo Canceller (AEC), outbound voice operated transmission (VOX), and automatic gain control (AGC). Transducers are mounted in an “exploded commcap” configuration with helmet-attached speakers near the ears and three microphones positioned at the collar. The AGC removes inbound audio signals (e.g.,suit, Mission Control, Lander, C&W tones) from the outbound comms stream, reducing echo and feedback (squeal) in low-noise suit environments. The reduction of worn communication equipment increases crewmember comfort, range of movement, and situational awareness. However, test results also highlight the need for proper fan, duct, pump, and gas flow integration with suit acoustics and audio. Ductwork may serve as waveguides for various component and structure-borne noise. Sharply angled ducts can generate turbulent-flow noise. Gas flow from inlets above the crewmember’s head can generate noise when cascading over the faceplate and collar (or commcap) microphones. Sufficient acoustic noise levels (1) require increased gain to boost inbound audio, and (2) may distort signals resulting in AEC disruption or artifacts. Suit-noise levels decline with reduced pressure (density), but then elevated speech and audio effort/power become necessary. Whether the Integrated Audio System, commcap, or other device is used, suit acoustic noise can mask speech in outbound comms. This reduces intelligibility and requires other AECs/devices to suppress comms noise. Yet, adjusting a few components may yield significant improvement. We discuss xEMU audio functionality, demonstrate how acoustical treatment combined with inbound signal conditioning improved clarity during tests, and discuss future modifications.

xEMU↗

Predicting Team Functioning in Long Term Space Missions Using Acoustic and Linguistic Measures

Maintaining optimal team functioning is critical for long-duration space exploration missions, yet traditional monitoring methods, such as self-reports and wearable sensors, often impose operational burdens or suffer from bias. This paper investigates a non-intrusive speech-based artificial intelligence (AI) framework to predict degradations in team functioning using data from the Human Exploration Research Analog (HERA) of the U.S. National Aeronautics and Space Administration (NASA). Using acoustic features, linguistic descriptors, and semantic embeddings, we evaluate static non-linear and temporal machine learning models to predict both objective (task accuracy) and subjective (self-reported efficacy and cohesion) team functioning outcomes. Results indicate that temporal models outperform static approaches, with prediction of objective task accuracy in Team Interaction Battery (TIB) improving from near chance to 71%. Self-reported outcomes, including team efficacy and cohesion, are predicted more reliably than task performance, achieving balanced accuracies of up to 85.56% and 78.12%, respectively, and are found to be most strongly associated with acoustic features. In a second interdependent task, the MMSEV–EVA, accuracies of up to 78% are achieved using temporal models with acoustic features. Furthermore, incorporating just 1–2 days of team-specific historical data systematically improved performance, and acoustic markers from informal pre-task interactions provided modest predictive gains. Finally, while automated preprocessing yielded viable accuracy, humancorrected data provided moderate performance gains, though transcription error rates did not significantly correlate with model performance. These findings highlight the potential of speech as a passive, high-fidelity monitoring tool for autonomous habitats.

Temporal modeling↗

Skip-Connected Self-Recurrent Spiking Neural Networks with Joint Intrinsic Parameter and Synaptic Weight Training

As an important class of spiking neural networks (SNNs), recurrent spiking neural networks (RSNNs) possess great computational power and have been widely used for processing sequential data like audio and text. However, most RSNNs suffer from two problems. 1. Due to the lack of architectural guidance, random recurrent connectivity is often adopted, which does not guarantee good performance. 2. Training of RSNNs is in general challenging, bottlenecking achievable model accuracy. To address these problems, we propose a new type of RSNNs called Skip-Connected Self-Recurrent SNNs (ScSr-SNNs). Recurrence in ScSr-SNNs is introduced in a stereotyped manner by adding self-recurrent connections to spiking neurons. The SNNs with self-recurrent connections can realize recurrent behaviors similar to those of more complex RSNNs while the error gradients can be more straightforwardly calculated due to the mostly feedforward nature of the network. The network dynamics is enriched by skip connections between nonadjacent layers. Moreover, we propose a new backpropagation (BP) method called backpropagated intrinsic plasticity (BIP) to further boost the performance of ScSr-SNNs by training intrinsic model parameters. Unlike standard intrinsic plasticity rules that adjust the neuron's intrinsic parameters according to neuronal activity, the proposed BIP method optimizes intrinsic parameters based on the backpropagated error gradient of a well-defined global loss function in addition to synaptic weight training. Here, based on challenging speech, neuromorphic speech, and neuromorphic image datasets, the proposed ScSr-SNNs can boost performance by up to 2.85% compared with other types of RSNNs trained by state-of-the-art BP methods.

97 MATHEMATICS AND COMPUTING↗

Orthogonal transform feasibility study

The application of various orthogonal transformations to communication was investigated, with particular emphasis placed on speech and visual signal processing. The fundamentals of the one- and two-dimensional orthogonal transforms and their application to speech and visual signals are treated in detail.

Robinson, G. S.↗

Multipath/RFI/modulation study for DRSS-RFI problem: Voice coding and intelligibility testing for a satellite-based air traffic control system

Analog and digital voice coding techniques for application to an L-band satellite-basedair traffic control (ATC) system for over ocean deployment are examined. In addition to performance, the techniques are compared on the basis of cost, size, weight, power consumption, availability, reliability, and multiplexing features. Candidate systems are chosen on the bases of minimum required RF bandwidth and received carrier-to-noise density ratios. A detailed survey of automated and nonautomated intelligibility testing methods and devices is presented and comparisons given. Subjective evaluation of speech system by preference tests is considered. Conclusion and recommendations are developed regarding the selection of the voice system. Likewise, conclusions and recommendations are developed for the appropriate use of intelligibility tests, speech quality measurements, and preference tests with the framework of the proposed ATC system.

Birch, J. N.↗

Human Factors Research Problems in Electronic Voice Warning System Design

The speech messages issued by voice warning systems must be carefully designed in accordance with general principles of human decision making processes, human speech comprehension, and the conditions in which the warnings can occur. The operator's effectiveness must not be degraded by messages that are either inappropriate or difficult to comprehend. Important experimental variables include message content, linguistic redundancy, signal/noise ratio, interference with concurrent tasks, and listener expectations generated by the pragmatic or real world context in which the messages are presented.

C A Simpson↗

Relative effectiveness of several simulated jet engine noise spectral treatments in reducing annoyance in a TV-viewing situation

An experiment was conducted in order to determine the relative effectiveness of several hypothetical jet engine noise treatments and to test hypothesis that speech interference, at least in part, mediates annoyance in a TV-viewing situation. Twenty-four subjects watched television in a simulated living room. Recorded jet flyover noises were presented in such a way as to create the illusion that aircraft were actually flying overhead. There were 27 stimuli (nine spectra at three overall levels) presented at an average rate of approximately one flight every 2 minutes. Subjects judged the annoyance value of individual stimuli using either a category rating method or magnitude estimation method in each of two 1-hour sessions. The spectral treatments most effective in reducing annoyance were at 1.6 Khz and 800 Hz, in that order. The degree of annoyance reduction resulting from all treatments was affected by the overall sound level of the stimuli, with the greatest reduction at the intermediate overall sound level, about 88 to 89 db(A), peak value. The results are interpreted as supporting the hypothesis that speech interference, at least in part, mediates annoyance with aircraft noise in a TV-viewing situation.

Gunn, W. J.↗

Perception and performance in flight simulators: The contribution of vestibular, visual, and auditory information

The pilot's perception and performance in flight simulators is examined. The areas investigated include: vestibular stimulation, flight management and man cockpit information interfacing, and visual perception in flight simulation. The effects of higher levels of rotary acceleration on response time to constant acceleration, tracking performance, and thresholds for angular acceleration are examined. Areas of flight management examined are cockpit display of traffic information, work load, synthetic speech call outs during the landing phase of flight, perceptual factors in the use of a microwave landing system, automatic speech recognition, automation of aircraft operation, and total simulation of flight training.

Source record↗

Linguistic methodology for the analysis of aviation accidents

A linguistic method for the analysis of small group discourse, was developed and the use of this method on transcripts of commercial air transpot accidents is demonstrated. The method identifies the discourse types that occur and determine their linguistic structure; it identifies significant linguistic variables based upon these structures or other linguistic concepts such as speech act and topic; it tests hypotheses that support significance and reliability of these variables; and it indicates the implications of the validated hypotheses. These implications fall into three categories: (1) to train crews to use more nearly optimal communication patterns; (2) to use linguistic variables as indices for aspects of crew performance such as attention; and (3) to provide guidelines for the design of aviation procedures and equipment, especially those that involve speech.

Goguen, J. A.↗

Voice interactive electronic warning systems (VIEWS) - An applied approach to voice technology in the helicopter cockpit

The cockpit has been one of the most rapidly changing areas of new aircraft design over the past thirty years. In connection with these developments, a pilot can now be considered a decision maker/system manager as well as a vehicle controller. There is, however, a trend towards an information overload in the cockpit, and information processing problems begin to occur for the rotorcraft pilot. One approach to overcome the arising difficulties is based on the utilization of voice technology to improve the information transfer rate in the cockpit with respect to both input and output. Attention is given to the background of speech technology, the application of speech technology within the cockpit, voice interactive electronic warning system (VIEWS) simulation, and methodology. Information subsystems are considered along with a dynamic simulation study, and data collection.

Voorhees, J. W.↗

Summary of the high-efficiency crystalline solar cell research forum

An outline is given listing the speeches given in each session and the pertinent points is some speeches. There were six session, besides the overview session they were: (1) high efficiency concepts; (2) surface/interface effects; (3) bulk effects; (4) modeling; and (5) high efficiency device processing. Besides the emphasis placed on increasing efficiency of energy conversion, a great amount of discussion was spent on ways to reduce recombination and reducing surface defects.

Wolf, M.↗

Increased productivity in flight with voice commanding

Automatic Speech Recognition technology has matured to the point where it can provide a viable means of increasing productivity by naturalizing the man-machine interface. With ever increasing workloads being placed on astronauts, speech recognition may provide an alternative means of system controlling that would reduce the task burden. Voice commanding, allowing hands-free operation, can be especially effective during operations requiring simultaneous system control. A flight experiment is under development to demonstrate the operational effectiveness of voice control by commanding the Space Shuttle's Closed Circuit Television (CCIV) system. This experiment will help direct future applications of voice entry to space operations.

Jordan, W. T.↗

A survey of the state-of-the-art and focused research in range systems, task 1

This final report presents the latest research activity in voice compression. We have designed a non-real time simulation system that is implemented around the IBM-PC where the IBM-PC is used as a speech work station for data acquisition and analysis of voice samples. A real-time implementation is also proposed. This real-time Voice Compression Board (VCB) is built around the Texas Instruments TMS-3220. The voice compression algorithm investigated here was described in an earlier report titled, Low Cost Voice Compression for Mobile Digital Radios, by the author. We will assume the reader is familiar with the voice compression algorithm discussed in this report. The VCB compresses speech waveforms at data rates ranging from 4.8 K bps to 16 K bps. This board interfaces to the IBM-PC 8-bit bus, and plugs into a single expansion slot on the mother board.

Omura, J. K.↗

Artificial intelligence, expert systems, computer vision, and natural language processing

An overview of artificial intelligence (AI), its core ingredients, and its applications is presented. The knowledge representation, logic, problem solving approaches, languages, and computers pertaining to AI are examined, and the state of the art in AI is reviewed. The use of AI in expert systems, computer vision, natural language processing, speech recognition and understanding, speech synthesis, problem solving, and planning is examined. Basic AI topics, including automation, search-oriented problem solving, knowledge representation, and computational logic, are discussed.

Gevarter, W. B.↗

The effects of display-control I/O, compatibility, and integrality on dual-task performance and subjective workload

The utility of speech technology was evaluated in terms of three dual task principles: resource competition between the time shared tasks, stimulus central processing response compatibility, and task integrality. Empirical support for these principles was reviewed. Two studies investigating the interactive effects of the three principles were described. Objective performance and subjective workload ratings for both single and dual tasks were examined. It was found that the single task measures were not necessarily good predictors for the dual task measures. It was shown that all three principles played an important role in determining an optimal task configuration. This was reflected in both the performance measures and the subjective measures. Therefore, consideration of all three principles is required to insure proper use of speech technology in a complex environment.

Tsang, Pamela S.↗

Space-Station-Interior Noise-Analysis Program

Intelligibility of speech evaluated for specified acoustical environments. Program makes systematic prediction of noise and vibration environment of craft defined by user and evaluates relative acceptability of predicted environment for effective communication by speech. Written in MicroSoft FORTRAN Version 3.3.

Stusnick, Eric↗

Integrated voice and visual systems research topics

A series of studies was performed to investigate factors of helicopter speech and visual system design and measure the effects of these factors on human performance, both for pilots and non-pilots. The findings and conclusions of these studies were applied by the U.S. Army to the design of the Army's next generation threat warning system for helicopters and to the linguistic functional requirements for a joint Army/NASA flightworthy, experimental speech generation and recognition system.

Williams, Douglas H.↗