Search NASA⌕ Search

SEARCH · Search NASA

Results for “Audio”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Classification and regression models of audio and vibration signals for machine state monitoring in precision machining systems

Here we present a data-driven method for monitoring machine status in manufacturing processes. Audio and vibration data from precision machining are used for inference in two operating scenarios: (a) variable machine health states (anomaly detection); and (b) settings of machine operation (state estimation). Audio and vibration signals are first processed through Fast Fourier Transform and Principal Component Analysis to extract transformed and informative features. These features are then used in the training of classification and regression models for machine state monitoring. Specifically, three classifiers (K-nearest neighbors, convolutional neural networks and support vector machines) and two regressors (support vector regression and neural network regression) were explored, in terms of their accuracy in machine state prediction. It is shown that the audio and vibration signals are sufficiently rich in information about the machine that 100% state classification accuracy could be accomplished. Data fusion was also explored, showing overall superior accuracy of data-driven regression models.

42 ENGINEERING↗
DOE OSTI2023

Many but not all deep neural network audio models capture brain responses and exhibit correspondence between model stages and brain regions

Models that predict brain responses to stimuli provide one measure of understanding of a sensory system and have many potential applications in science and engineering. Deep artificial neural networks have emerged as the leading such predictive models of the visual system but are less explored in audition. Prior work provided examples of audio-trained neural networks that produced good predictions of auditory cortical fMRI responses and exhibited correspondence between model stages and brain regions, but left it unclear whether these results generalize to other neural network models and, thus, how to further improve models in this domain. We evaluated model-brain correspondence for publicly available audio neural network models along with in-house models trained on 4 different tasks. Most tested models outpredicted standard spectromporal filter-bank models of auditory cortex and exhibited systematic model-brain correspondence: Middle stages best predicted primary auditory cortex, while deep stages best predicted non-primary cortex. However, some state-of-the-art models produced substantially worse brain predictions. Models trained to recognize speech in background noise produced better brain predictions than models trained to recognize speech in quiet, potentially because hearing in noise imposes constraints on biological auditory representations. The training task influenced the prediction quality for specific cortical tuning properties, with best overall predictions resulting from models trained on multiple tasks. The results generally support the promise of deep neural networks as models of audition, though they also indicate that current models do not explain auditory cortical responses in their entirety.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Explosion Detection Using Smartphones: Ensemble Learning with the Smartphone High-Explosive Audio Recordings Dataset and the ESC-50 Dataset

Explosion monitoring is performed by infrasound and seismoacoustic sensor networks that are distributed globally, regionally, and locally. However, these networks are unevenly and sparsely distributed, especially at the local scale, as maintaining and deploying networks is costly. With increasing interest in smaller-yield explosions, the need for more dense networks has increased. To address this issue, we propose using smartphone sensors for explosion detection as they are cost-effective and easy to deploy. Although there are studies using smartphone sensors for explosion detection, the field is still in its infancy and new technologies need to be developed. We applied a machine learning model for explosion detection using smartphone microphones. The data used were from the Smartphone High-explosive Audio Recordings Dataset (SHAReD), a collection of 326 waveforms from 70 high-explosive (HE) events recorded on smartphones, and the ESC-50 dataset, a benchmarking dataset commonly used for environmental sound classification. Two machine learning models were trained and combined into an ensemble model for explosion detection. The resulting ensemble model classified audio signals as either “explosion”, “ambient”, or “other” with true positive rates (recall) greater than 96% for all three categories.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2021

Blending Machine Learning and Interaction Design in Audio Explorer

The results of machine learning models can often be difficult to interpret, especially for domain experts. Audio Explorer, the winning entry of the 2018 VAST Challenge, is an interactive data exploration tool that effectively communicates machine learning results, using coordinated geospatial, temporal, and auditory visualizations to promote information discovery.

Visual analytics, VAST Challenge↗
DOE OSTI2025

Rocket Launch Detection with Smartphone Audio and Transfer Learning

Rocket launches generate infrasound signatures that have been detected at great distances. Due to the sparsity of the networks that have made these detections, however, most signals are detected tens of minutes to hours after the rocket launch. In this work, a method of near-real-time detection of rocket launches using data from a network of smartphones located 10–70 km from launch sites is presented. A machine learning model is trained and tested on the open-access Aggregated Smartphone Timeseries of Rocket-generated Acoustics (ASTRA), Smartphone High-explosive Audio Recordings Dataset (SHAReD), and ESC-50 datasets, resulting in a final accuracy of 97% and a false positive rate of <1%. The performance and behavior of the model are summarized, and its suitability for persistent monitoring applications is discussed.

acoustics↗
DOE OSTI2023

Trial-based calibration for audio-based identification, recognition, and detection system

The disclosed technologies include methods for generating a calibration model using data that is selected to match the conditions of a particular trial that involves an automated comparison of data samples, such as a comparison-based trial performed by an audio-based recognition, identification, or detection system. The disclosed technologies also include improved methods for selecting candidate data used to build the calibration model. The disclosed technologies further include methods for evaluating the performance of the calibration model and for rejecting a trial when not enough matched candidate data is available to build the calibration model. The disclosed technologies additionally include the use of regularization and automated data generation techniques to further improve the robustness of the calibration model.

McLaren, Mitchell Leigh↗
DOE OSTI2026

Velocity Extraction Using Complete Time-Domain Waveform Data and Audio Machine Learning

We developed a new machine learning-based tool for extracting information from interferometry measurements: MIDWAZE (Modular Interferometry Direct Waveform AnalyZEr). This paper showcases MIDWAZE’s ability to extract an object’s velocity information from Photonic Doppler Velocimetry (PDV) data at near-human accuracy with little to no human intervention. MIDWAZE can extract velocities roughly 350 times as fast as a human analyst "rushing" to complete their extractions, with similar extraction accuracy. MIDWAZE’s most outstanding feature is that it operates directly in waveform/temporal space, freeing analysis from certain limitations imposed by traditional spectrogram-based approaches and opening the way to "phase aware" PDV analysis. MIDWAZE also has limited ability to discriminate between different solid objects, which we develop as a first step towards automated discrimination of different kinds of objects such as ejecta clouds.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Audio misinformation encoding via an on-phone sub-terahertz metasurface

We demonstrate a wireless security application to protect the weakest link in phone-to-phone communication, using a terahertz metasurface. To our knowledge, this is the first example of an eavesdropping countermeasure in which the attacker is actively misled.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Tampering detection and location identification of digital audio recordings

Systems and methods for detecting a tampering and identifying a location of a digital recording are provided. A frequency sequence and a phase angle sequence may be extracted from the digital recording. A portion of the frequency sequence may be matched to one of a plurality of reference frequency sequences, and a portion of the phase angle sequence may be matched to one of a plurality of reference phase angle sequences. Tampering of the digital recording may be detected when the frequency and phase sequences differ from the matched reference sequences. Moreover, a noise sequence may be extracted from the extracted frequency sequence. A location of the digital recording may be identified by matching the noise sequence to one of a plurality of noise sequences of the plurality of reference frequency sequences.

Chai, Jidong↗
DOE OSTI2025

Audible enclaves crafted by nonlinear self-bending ultrasonic beams

Delivering audible content to a targeted listener without disturbing others is paramount in audio engineering. However, achieving this goal has long been challenging due to the diffraction of low-frequency (long-wavelength) audio waves in linear acoustics. Here, we introduce an approach for creating remote audio spots, dubbed audible enclaves, by harnessing the local nonlinear interaction of two self-bending ultrasonic beams with distinct spectra. The self-bending ultrasonic beams created by acoustic metasurfaces, though inaudible, can bypass obstacles such as human heads. At their intersection behind obstacles, highly localized audible enclaves are formed due to the local nonlinear interactions. Additionally, we demonstrate the ultrabroadband capabilities of our metasurface-based implementation both numerically and experimentally, spanning from 125 Hz to 4 kHz (6 octave bands), covering the majority of the audible frequency range. The practicality of our proposed technique is underscored by its compact implementation size (0.16 m, equivalent to 0.06 wavelengths at 125 Hz), as well as its robust performance under wideband transient audio signal excitation and in a common room with reverberations. Our proposed audible enclaves hold significant potential for various applications in advanced audio engineering, including private speech communications, immersive spatial audio reproduction, and high-resolution sound/quiet zone control.

Science & Technology - Other Topics↗
DOE OSTI2020

Recovery and Calibration of Legacy Underground Nuclear Test Seismic Data from the Leo Brady Seismic Network

The Leo Brady Seismic Network (LBSN, originally the Sandia Seismic Network) was established in 1960 by Sandia National Laboratories to monitor underground nuclear tests (UGTs) at the Nevada National Security Site (NNSS, formerly named the Nevada Test Site). The LBSN has been in various configurations throughout its existence, but it has generally been comprised of four to six stations at regional distances (~150–400 km) from the NNSS with approximately evenly spaced azimuthal coverage. Between 1962 and the end of nuclear testing in 1992, the LBSN—and a sister network operated by Lawrence Livermore National Laboratories—was the most comprehensive United States source of regional seismic data of UGTs. Approximately 75% of all UGTs performed by the United States occurred in the predigital era. At that time, LBSN data were transmitted as frequency-modulated (FM) audio over telephone lines to a central location and recorded as analog waveforms on high-fidelity magnetic audio tapes. These tapes have been in dry temperature-stable storage for decades and contain the sole record of this irreplaceable data; full waveforms of LBSN-recorded UGTs from this era were not routinely digitized or otherwise published. We have developed a process to recover and calibrate data from these tapes. First, we play back and digitize the tapes as audio. Next, we demodulate the FM “audio” into individual waveforms. We then estimate the various instrument constants through careful measurement of “weight-lift” tests performed prior to each UGT on each instrument. Finally, these coefficients allow us to scale and shape the derived instrument response of the seismographs and compute poles and zeros. Finally, the result of this process is a digital record of the recorded seismic ground motion in a modern data format, stored in a searchable database. To date, we have digitized tapes from 592 UGTs.

58 GEOSCIENCES↗
DOE OSTI2024

Thinking Beyond the Default User: The Impact of Gender, Stereotypes, and Modality on Interpretation of User Needs

Throughout the mechanical design process, designers, the majority of whom are men, often fail to consider the needs of women, resulting in consequences ranging from inconvenience to increased risk of serious injury or death. Although these biases are well studied in other fields of research, the mechanical design field lacks formal investigation into this phenomenon. In this study, engineering students (n = 301) took a survey in which they read a Persona describing a student makerspace user and a Walkthrough describing the user’s interaction with the makerspace while completing a project. During the Walkthrough, the user encountered various obstacles or Pain Points. Participants were asked to recall and evaluate the Pain Points that the user encountered and then evaluated their perceptions of the makerspace and user. Furthermore, the independent variables under investigation were the gender of the user Persona (woman, gender-neutral, or man), the Walkthrough room case (crafting or woodworking makerspace), and the modality of the Persona and Walkthrough (text- or audio-based). Results showed that participants from the Text-based modality were better able to recall Pain Points compared to participants from the Audio-based modality. Pain Points were assessed as more severe when they impacted women users, potentially stemming from protective paternalism. In addition to finding that the gender of a user impacted the way a task environment was perceived, results confirmed the presence of androcentrism, or “default man” assumptions, in the way designers view end users of unknown gender. Promisingly, providing user Persona information in an audio modality significantly reduced this bias compared to text-based modalities, indicating that providing richer detail in user personas has the capability to reduce gender bias in designers.

cognitive-based design↗
DOE OSTI2022

Power System Waveform Classification Using Time-Frequency and CNN

Many modern reclosers and circuit breakers have microprocessor relays that record waveforms of system events. In some cases, utilities may record a half-a-dozen event captures for every event. This is thousands of events per year. The industry needs faster, more automated, more conclusive, and easy-to-use systems that can process massive amounts of event recordings without extensive input/support from power system engineers. To address the need for a commercially viable solution that can classify waveform data, energies were directed to develop a universal neural network (NN) structure (deep learning algorithm) that works for a wide variety of system event types. The structure that showed the most promise was one that included the use of spectrograms. The technique has shown positive results in audio engineering, particularly with respect to speech recognition. A waveform signature could be treated as a spoken word like audio waveforms for specific things such as “YES” or “UP”. No two people produce the exact same waveform when speaking each of these words, but audio processing algorithms based on spectrograms and convolutional neural networks (CNN) can still distinguish the word regardless of the speaker. No two circuits produce the exact same waveform for a given event, but the NN can be trained to classify the event type regardless of the circuit or location on the circuit. A Power System Neural Network (PSNN) has been developed to use a CNN to classify events within waveform data for power systems. The waveform is converted to an array of values by way of spectrograms and interpreted as an image. This image is passed into the CNN. The test results on independent simulated test and validation datasets show greater than 99% accuracy. While the results thus far are based on simulated data, the performance of the PSNN is very promising and should work for a wide variety of power system conditions of interest. Ultimately, much of the custom code and tools used today and much of the manual effort expended today may be automated using this PSNN.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Unraveling the Noise: An Investigation Plan for Signal Interference in Hearing Aids

Bluetooth Low Energy (BLE) has revolutionized the performance of hearing aids with functionalities like seamless audio streaming and enhanced auditory functions. However, BLE operates within the highly congested 2.4 GHz frequency band, making it susceptible to signal interference that can degrade performance, reduce audio quality, and impact user experience. This paper documents interference patterns in BLE communication and introduces practical mitigation techniques aimed at improving the reliability of hearing aids. Attack vectors associated with Bluetooth enabled hearing aids include communication jamming, the interception of data between target devices, and GATT handle exploitation. Attackers could also use the vulnerabilities to block communications or intercept sensitive audio streams, posing significant security and privacy risks. These threats compromise two critical components of the CIA triad: (1) availability, by causing persistent connectivity issues, and (2) integrity, by enabling unauthorized data modifications. It is necessary to deal with these problems to ensure hearing aids work well and safely. This study investigates the impact of BLE signal interference on hearing aids, using tools such as HackRF [1], a Python tool to simulate interference scenarios, and Ubertooth [2] to sniff Bluetooth traffic between hearing aids and the device with the application. This paper investigates testing of BLE traffic in search of specific interference patterns that would impact the functionality of hearing aids, including jamming and flooding. This research focuses on developing robust mitigation techniques with the aim of securing BLE-enabled hearing aids against those vulnerabilities.

Baldwin, David [Savannah River National Laboratory↗