Search NASA⌕ Search

SEARCH · Search NASA

Results for “Speech Acoustics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

11 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Deep learning approaches for neural decoding across architectures and recording modalities

Decoding behavior, perception or cognitive state directly from neural signals is critical for brain–computer interface research and an important tool for systems neuroscience. In the last decade, deep learning has become the state-of-the-art method in many machine learning tasks ranging from speech recognition to image segmentation. The success of deep networks in other domains has led to a new wave of applications in neuroscience. In this article, we review deep learning approaches to neural decoding. Here, we describe the architectures used for extracting useful features from neural recording modalities ranging from spikes to functional magnetic resonance imaging. Furthermore, we explore how deep learning has been leveraged to predict common outputs including movement, speech and vision, with a focus on how pretrained deep networks can be incorporated as priors for complex decoding targets like acoustic speech or images. Deep learning has been shown to be a useful tool for improving the accuracy and flexibility of neural decoding across a wide range of tasks, and we point out areas for future scientific development.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

The effect of simultaneous exposure on the attention selection and integration of segments and lexical tones by Urdu-Cantonese bilingual speakers

In the perceptual learning of lexical tones, an automatic and robust attention-to-phonology system enables native tonal listeners to adapt to acoustically non-optimal speech, such as phonetic conflicts in daily communications. Previous tone research reveals that non-native listeners who do not linguistically employ lexical tones in their mother tongue may find it challenging to attend to the tonal dimension or integrate it with the segmental features. However, it is unknown whether the attentional interference initially caused by a maternal attentional system would continue influencing the non-optimal tone perception for simultaneous bilingual teenagers. From an endpoint in the age of language acquisition, we investigate whether the tone-specific attention mechanism developed by the Urdu-Cantonese simultaneous bilinguals is automatic enough to assist them in adapting to a phonetically-conflicting environment. Three groups of teenagers engaged in a four-condition ABX task: Urdu-Cantonese simultaneous bilinguals, Cantonese native listeners, and Urdu-speaking, late learners of Cantonese. The results showed that although the simultaneous bilinguals could phonologically process Cantonese tones in a Cantonese-like way under a conflict-free listening condition, they still failed in adapting to the phonetic conflicts, especially the segment-induced ones. It thus demonstrated that the simultaneous exposure and years of regular education in Hong Kong local schools still could not automatically guarantee simultaneous bilingual processing of Cantonese tones. In interpreting the findings, it hypothesized that, except for simultaneous exposure, the development of a tone-specific attention mechanism is also likely to be L1-inhibitory, tone experience-driven, and language-specific for simultaneous bilinguals.

Ning, Jinghong↗
DOE OSTI2020

Necessary and sufficient conditions for resonant mixing of plane waves in elastic solids with quadratic nonlinearity

This paper studies the interactions of two plane waves in elastic solids with quadratic nonlinearity. In particular, the necessary and sufficient conditions for resonant mixing of two plane waves are derived. It is shown that the conventional resonance condition for resonant mixing of plane waves is only a necessary condition, not sufficient. Based on the newly derived necessary and sufficient conditions, resonant mixing of various types of plane waves are investigated and specific conditions for generating a resonant mixed wave are obtained for each case. These results are useful for developing nonlinear ultrasonic nondestructive evaluation techniques using the wave mixing method.

Gao, Xiang↗
DOE OSTI2020

Heat-induced drift reduction of time of flight in fused quartz acoustic waveguides via annealing process

High temperature structural acoustic sensors play an important role in many applications. Fused quartz waveguide is a popular choice due to its resistance to harsh environments and its convenience of modification. However, time of flight between pulse and echo, which is widely used in these sensors, tends to encounter drifts in fast temperature changing process even after temperature returns to initial value. In this article, different annealing process are performed for a special modified fused quartz waveguide with a sensor node. Annealing treatment is found able to reduce the drift when the waveguide undergoes a sudden temperature spike to 1000 °C at 500 kHz operating acoustic frequency, and the best annealing condition could make the drift one magnitude smaller. A following temperature test up to 1000 °C shows consistent measurement readings.

Hileman, Zachary (ORCID:0000000226529274)↗
DOE OSTI2023

Rapid method for computing the mechanical resonances of irregular objects

A solid object's geometry, density, and elastic moduli completely determine its spectrum of normal modes. Solving the inverse problem—determining a material's elastic moduli given a set of resonance frequencies and sample geometry—relies on the ability to compute resonance spectra accurately and efficiently. Established methods for calculating these spectra are either fast but limited to simple geometries, or are applicable to arbitrarily shaped samples at the cost of being prohibitively slow. Here, we describe a method to rapidly compute the normal modes of irregularly shaped objects using entirely open-source software. Our method's accuracy compares favorably with existing methods for simple geometries and shows a significant improvement in speed over existing methods for irregular geometries.

Acoustics↗
DOE OSTI2023

Acoustic scattering by smooth elastic cylinders insonified by directional transceivers: Monostatic theory and experiments

A theoretical model for predicting the acoustic field scattered by an elastic cylinder that is partially insonified by a directional transceiver is proposed in the form of a simple approximate one-dimensional integral. This model accounts for spherical spreading and directivity of the incident waves and extends the formulation used in a preceding article by including effects due to oblique insonification of a long cylinder assuming negligible end-contributions. The scattered field of an infinitely long cylinder for obliquely incident plane waves and point receivers is used to approximate the apparent volume flow of cylinders partially insonified by directional transceivers. The scattered pressure that is derived using the apparent volume flow, in contrast to the previous formulation, is capable of predicting axially propagating guided wave resonances; these natural modes are excited, in addition to circumferential ones, at off-normal incident angles. The model is compared with exact numerical simulations and with previously published as well as new laboratory data. The analysis illustrates the different realistic effects associated with scattering from elastic cylinders insonified by a directional transceiver both theoretically and experimentally.

42 ENGINEERING↗
DOE OSTI2024

Phased array-based nonlinear wave mixing technique: Application to lack-of-fusion porosity characterization in additively manufactured metals

The objective of this research is to demonstrate the effectiveness of a phased array-based nonlinear wave mixing technique to characterize internal, localized microscale damage in an additively manufactured (AM) component. By using phased arrays for the generation of the incident waves, it is possible to produce a nonlinear wave mixing scanning technique without the need for immersion or changing coupling conditions. The phased arrays can be configured to generate incident waves in multiple directions that meet the resonance conditions required for nonlinear wave mixing at a variety of internal locations. This allows for the scanning of a specimen without the removal and re-coupling of the source transducers, leading to greater scanning speed and repeatability. To demonstrate the accuracy of this phased array wave mixing approach, measurements of acoustic nonlinearity in an AM component are first made with a bulk wave second harmonic generation through thickness measurement. Next, nonlinear wave mixing measurements are made with single element transducers to confirm the sensitivity of the proposed nonlinear wave mixing approach to lack-of-fusion porosity in AM metals. Finally, phased arrays are used to highlight the effectiveness of the proposed nonlinear wave mixing technique in these same AM components.

Acoustics↗
DOE OSTI2022

Assessment methods for determining small changes in hearing performance over time

Although the behavioral pure-tone threshold audiogram is considered the gold standard for quantifying hearing loss, assessment of speech understanding, especially in noise, is more relevant to quality of life but is only partly related to the audiogram. Metrics of speech understanding in noise are therefore an attractive target for assessing hearing over time. However, speech-in-noise assessments have more potential sources of variability than pure-tone threshold measures, making it a challenge to obtain results reliable enough to detect small changes in performance. Here, this review examines the benefits and limitations of speech-understanding metrics and their application to longitudinal hearing assessment, and identifies potential sources of variability, including learning effects, differences in item difficulty, and between- and within-individual variations in effort and motivation. We conclude by recommending the integration of non-speech auditory tests, which provide information about aspects of auditory health that have reduced variability and fewer central influences than speech tests, in parallel with the traditional audiogram and speech-based assessments.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Speaker-targeted Synthetic Speech Detection

Text-to-speech technologies are evolving quickly towards realistic-sounding human-like voices. As this technology improves, so does the opportunity for malpractice in speaker identification (SID) via spoofing, the process of impersonating a voice biometric via synthesis. More data typically equates to a more realistic voice model, which poses an issue for well-known subjects, such as politicians and celebrities, who have vast amounts of multimedia available online. Detection of synthetic speech has relied on signal processing techniques that focus on the generation of new acoustic features and train deep learning models to detect when an audio file has been manipulated through the characterization of unnatural changes or artifacts. However, these techniques do not use any information from the speaker they are evaluating. This paper proposes to incorporate information from the speaker-of-interest (SoI) into the models to avoid specific spoofing attacks for certain vulnerable people. The wealth of data for well-known people can also be used to train a speaker-specific spoofing detector with a higher level of accuracy than a speaker-independent model. The paper proposes a new xResNet-PLDA system and compares it to three different baseline systems: a state-of-the-art speaker identification system, an xResNet system trained to discriminate between bona fide and fake speech, and a speaker identification system in which the PLDA and calibration models were trained with bona fide and fake speech. We evaluated the systems in two different scenarios — a cross-validation scenario and a hold-out scenario — with three different databases. We show how the proposed system outperforms dramatically the baseline systems in each scenario and for each database. Finally, we show how using a small amount of the SoI’s speech to adapt global calibration parameters improves the performance of the system, especially in unseen conditions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

Audible enclaves crafted by nonlinear self-bending ultrasonic beams

Delivering audible content to a targeted listener without disturbing others is paramount in audio engineering. However, achieving this goal has long been challenging due to the diffraction of low-frequency (long-wavelength) audio waves in linear acoustics. Here, we introduce an approach for creating remote audio spots, dubbed audible enclaves, by harnessing the local nonlinear interaction of two self-bending ultrasonic beams with distinct spectra. The self-bending ultrasonic beams created by acoustic metasurfaces, though inaudible, can bypass obstacles such as human heads. At their intersection behind obstacles, highly localized audible enclaves are formed due to the local nonlinear interactions. Additionally, we demonstrate the ultrabroadband capabilities of our metasurface-based implementation both numerically and experimentally, spanning from 125 Hz to 4 kHz (6 octave bands), covering the majority of the audible frequency range. The practicality of our proposed technique is underscored by its compact implementation size (0.16 m, equivalent to 0.06 wavelengths at 125 Hz), as well as its robust performance under wideband transient audio signal excitation and in a common room with reverberations. Our proposed audible enclaves hold significant potential for various applications in advanced audio engineering, including private speech communications, immersive spatial audio reproduction, and high-resolution sound/quiet zone control.

Science & Technology - Other Topics↗