Search NASA⌕ Search

SEARCH · Search NASA

Results for “Audio”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

The exit-wave power-cepstrum transform for scanning nanobeam electron diffraction: robust strain mapping at subnanometer resolution and subpicometer precision

Scanning nanobeam electron diffraction (NBED) with fast pixelated detectors is a valuable technique for rapid, spatially resolved mapping of lattice structure over a wide range of length scales. However, intensity variations caused by dynamical diffraction and sample mistilts can hinder the measurement of diffracted disk centers as necessary for quantification. Robust data processing techniques are needed to provide accurate and precise measurements for complex samples and non-ideal conditions. Here we present an approach to address these challenges using a transform, called the exit wave power cepstrum (EWPC), inspired by cepstral analysis in audio signal processing. The EWPC transforms NBED patterns into real-space patterns with sharp peaks corresponding to inter-atomic spacings. We describe a simple analytical model for interpretation of these patterns that cleanly decouples lattice information from the intensity variations in NBED patterns caused by tilt and thickness. With tracking the inter-atomic spacing peaks in EWPC patterns, strain mapping is demonstrated for two practical applications: mapping of ferroelectric domains in epitaxially strained PbTiO 3 films and mapping of strain profiles in arbitrarily oriented core-shell Pt-Co nanoparticle fuel-cell catalysts. The EWPC transform enables lattice structure measurement at sub-pm precision and sub-nm resolution that is robust to small sample mistilts and random orientations.

42 ENGINEERING↗
DOE OSTI2025

Automatic speech recognition predicts contemporaneous earthquake fault displacement

Abstract Significant progress has been made in probing the state of an earthquake fault by applying machine learning to continuous seismic waveforms. The breakthroughs were originally obtained from laboratory shear experiments and numerical simulations of fault shear, then successfully extended to slow-slipping faults. Here we apply the Wav2Vec-2.0 self-supervised framework for automatic speech recognition to continuous seismic signals emanating from a sequence of moderate magnitude earthquakes during the 2018 caldera collapse at the Kīlauea volcano on the island of Hawai’i. We pre-train the Wav2Vec-2.0 model using caldera seismic waveforms and augment the model architecture to predict contemporaneous surface displacement during the caldera collapse sequence, a proxy for fault displacement. We find the model displacement predictions to be excellent. The model is adapted for near-future prediction information and found hints of prediction capability, but the results are not robust. The results demonstrate that earthquake faults emit seismic signatures in a similar manner to laboratory and numerical simulation faults, and artificial intelligence models developed for encoding audio of speech may have important applications in studying active fault zones.

58 GEOSCIENCES↗
DOE OSTI2023

Advances in machine-learning-based sampling motivated by lattice quantum chromodynamics

Sampling from known probability distributions is a ubiquitous task in computational science, underlying calculations in domains from linguistics to biology and physics. Generative machine-learning (ML) models have emerged as a promising tool in this space, building on the success of this approach in applications such as image, text, and audio generation. Often, however, generative tasks in scientific domains have unique structures and features—such as complex symmetries and the requirement of exactness guarantees—that present both challenges and opportunities for ML. This Perspective outlines the advances in ML-based sampling motivated by lattice quantum field theory, in particular for the theory of quantum chromodynamics. Enabling calculations of the structure and interactions of matter from our most fundamental understanding of particle physics, lattice quantum chromodynamics is one of the main consumers of open-science supercomputing worldwide. Here, the design of ML algorithms for this application faces profound challenges, including the necessity of scaling custom ML architectures to the largest supercomputers, but also promises immense benefits, and is spurring a wave of development in ML-based sampling more broadly. In lattice field theory, if this approach can realize its early promise it will be a transformative step towards first-principles physics calculations in particle, nuclear and condensed matter physics that are intractable with traditional approaches.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Sound propagation in realistic interactive 3D scenes with parameterized sources using deep neural operators

We address the challenge of acoustic simulations in three-dimensional (3D) virtual rooms with parametric source positions, which have applications in virtual/augmented reality, game audio, and spatial computing. The wave equation can fully describe wave phenomena such as diffraction and interference. However, conventional numerical discretization methods are computationally expensive when simulating hundreds of source and receiver positions, making simulations with parametric source positions impractical. To overcome this limitation, we propose using deep operator networks to approximate linear wave-equation operators. This enables the rapid prediction of sound propagation in realistic 3D acoustic scenes with parametric source positions, achieving millisecond-scale computations. By learning a compact surrogate model, we avoid the offline calculation and storage of impulse responses for all relevant source/listener pairs. Our experiments, including various complex scene geometries, show good agreement with reference solutions, with root mean squared errors ranging from 0.02 to 0.10 Pa. Notably, our method signifies a paradigm shift as—to our knowledge—no prior machine learning approach has achieved precise predictions of complete wave fields within realistic domains.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Use of vision and sound to classify feller-buncher operational state

Productivity measures in logging involve simultaneous recognition and classification of event occurrence and timing, and the volume of stems being handled. In full-tree felling systems these measurements are difficult to implement in an autonomous manner because of the unfavorable working environment and the abundance of confounding extraneous events. This paper proposed a vision method that used a lowcost camera to recognize feller-buncher operational events including tree cutting and piling. It used a fine K-nearest neighbors (fKNN) algorithm as the final classifier based on both audio and video features derived from short video segments as inputs. The classifier’s calibration accuracy exceeds 94%. The trained model was tested on videos recorded under various conditions. The overall accurate rates for short segments were greater than 89%. Comparisons were made between the human- and algorithm derived event detection rates, events’ durations, and inter-event timing using continuously recorded videos taken during feller operation. Video results between the fKNN model and manual observation were similar. Statistical comparison using the Kolmogorov–Smirnov test to evaluate measured parameters’ distributions (manual versus automated event duration and inter-event timing) did not show significant differences with the lowest P-value among all Kolmogorov–Smirnov tests equal to 0.12. Here the result indicated the feasibility and potential of using the method for the automatic time study of drive-to-tree feller bunchers.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Low-temperature high-frequency dynamic magnetic susceptibility of classical spin-ice Dy 2 Ti 2 O 7

In this study, radio-frequency (14.6 MHz) AC magnetic susceptibility, , of Dy 2 Ti 2 O 7 was measured using self-oscillating tunnel-diode resonator. Measurements were made with the excitation AC field parallel to the superimposed DC magnetic field up to 5 T in a wide temperature range from 50 mK to 100 K. At 14.6 MHz, a known broad peak of from kHz—range audio-frequency measurements around 15 K for both [111] and [110] directions shifts to 45 K, continuing the Arrhenius activated behavior with the same activation energy barrier of E a ≈ 230 K. Magnetic field dependence of along [111] reproduces previously reported low-temperature two-in-two-out to three-in-one-out spin configuration transition at about 1 T, and an intermediate phase between 1 and 1.5 T. The boundaries of the intermediate phase show reasonable overlap with the literature data and connect at a critical endpoint of the first order transition line, suggesting that these features are frequency independent. An unusual upturn of the magnetic susceptibility at T → 0 was observed in magnetic fields between 1.5 T and 2 T for both magnetic field directions, before fully polarized configuration sets in above 2 T.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2025

Combining quantum noise reduction resources: A practical approach

Optomechanical sensors are capable of transducing external perturbations to resolvable optical signals. A particular regime of interest is that of high-bandwidth force detection, where an impulse is delivered to the system over a short period of time. Exceedingly sensitive impulse detection has been proposed to observe very weak signals like those due to long-range interactions with dark matter that require much higher sensitivities than current sensors can provide. Quantum resources to go beyond the traditional standard quantum limit of these sensors include squeezing of the light used to transduce the signal, backaction evasion by measuring the optimal quadrature, and quantum nondemolition (QND) measurements that reduce backaction directly. These methods have been developed in the context of gravitational wave detection for target frequencies in the audio band range. Here, we provide the theoretical limits to quantum noise reduction for higher and broader frequency targets, such as those from dark matter signals, while combining quantum-enhanced readout techniques based on squeezed light and QND measurements with optomechanical sensors. Here, we demonstrate that backaction evasion through QND techniques dramatically reduces the technical challenges presented when using squeezed light for broadband force detection, paving the way for combining multiple quantum noise reduction techniques for enhanced sensitivity in the context of impulse metrology.

Optomechanics↗
DOE OSTI2025

TRIM: AI Guided Random Number Generation for Resource-Constrained IoT Systems

Random numbers often serve as the backbone for many security solutions in diverse domains such as cryptography, side channel leakage prevention, and moving target defense. However, generating true random numbers requires a physical source of entropy (e.g. hardware, quantum, environmental phenomenon) making it difficult to realize at a large scale and at a low cost. On the flip side, pseudorandom number generators (easy to implement) following a specific distribution (e.g. Gaussian) can be easily compromised given a sufficient amount of traces. In this work, we have developed a machine learning-guided generative approach that can be used to create portable, resource-efficient, and cost-effective random number generators with high throughput and true randomness characteristics. We implement the proposed approach as a highly parameterized framework and perform extensive evaluation for different settings. The framework was able to learn from true random sources such as irrational numbers and environmental audio noise and imitate those sources towards generating new good quality random numbers on demand. We have generated more than 1 billion bits and observed robust performance in terms of true randomness metrics obtained from NIST SP 800-22 and FIPS 140-1 randomness test suites achieving a throughput of up to 142.85 Mbps. Compared to the state-of-the-art (SOTA) technique, the iso-cost setup of our framework can achieve more than 500 Mbps in a distributed setting. We have evaluated the efficacy of running the true randomness imitation AI models on target edge devices such as Raspberry Pi 4 (Model B), Nvidia Jetson Nano, Nvidia Jetson Orin Nano and Nvidia Jetson Xavier. We have also looked at the security of the TRIM framework itself against different adversarial threat models.

Cybersecurity↗
DOE OSTI2020

Robust Group Subspace Recovery: A New Approach for Multi-Modality Data Fusion

Robust Subspace Recovery (RoSuRe) algorithm was recently introduced as a principled and numerically efficient algorithm that unfolds underlying Unions of Subspaces (UoS) structure, present in the data. The union of Subspaces (UoS) is capable of identifying more complex trends in data sets than simple linear models. In this work, we build on and extend RoSuRe to prospect the structure of different data modalities individually. We propose a novel multi-modal data fusion approach based on group sparsity which we refer to as Robust Group Subspace Recovery (RoGSuRe). Relying on a bi-sparsity pursuit paradigm and non-smooth optimization techniques, the introduced framework learns a new joint representation of the time series from different data modalities, respecting an underlying UoS model. We subsequently integrate the obtained structures to form a unified subspace structure. The proposed approach exploits the structural dependencies between the different modalities data to cluster the associated target objects. The resulting fusion of the unlabeled sensors’ data from experiments on audio and magnetic data has shown that our method is competitive with other state of the art subspace clustering methods. The resulting UoS structure is employed to classify newly observed data points, highlighting the abstraction capacity of the proposed method.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

AWB-GCN: A Graph Convolutional Network Accelerator with Runtime Workload Rebalancing

The recent development of deep learning has been mostly focusing on Euclidean data, such as images, videos, audios, etc. However, most real-world information and relation are often expressed as graphs. To efficiently learn from graph data, graph convolutional networks (GCNs) emerge as a promising approach, showing advantages in several practical applications such as social network analysis, knowledge discovery, 3D modeling, motion capturing, etc. Real-world graphs are usually extremely large and imbalanced, posting significant performance demand and design challenges on the hardware dedicated for GCN inference. In this paper, we propose an architecture design called UW-GCN to accelerate graph convolutional network inference. To tackle the major performance bottleneck from workload imbalance, we propose dynamic neighborhood stealing and remote chunk shuffling techniques, relying on hardware flexibility to achieve hardware auto-tuning under negligible area or delay overhead. Specifically, UW-GCN is able to smartly profile the sparse graph pattern while continuously adjusting the workload distribution via routing reconfiguration among parallel processing elements (PEs). The ideal configuration is then reused in the remaining iterations. To the best of our knowledge, this is the first accelerator design particularly for GCN and the first work relying on hardware auto-tuning, which is normally based on software, to achieve near-optimal workload balance in processing sparse structures.

Geng, Tong↗
DOE OSTI2024

Universal Fourier Attack for Time Series

A wide variety of adversarial attacks have been proposed and explored using image and audio data. These attacks are notoriously easy to generate digitally when the attacker can directly manipulate the input to a model, but are much more difficult to implement in the real world. In this paper we present a universal, time invariant attack for general time series data such that the attack has a frequency spectrum primarily composed of the frequencies present in the original data. The universality of the attack makes it fast and easy to implement as no computation is required to add it to an input, while time invariance is useful for real world deployment. Additionally, the frequency constraint ensures the attack can withstand filtering defenses. We demonstrate the effectiveness of the attack on two different classification tasks through both digital and real world experiments, and show that the attack is robust against common transform-and-compare defense pipelines.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Separation of overlapping sources in bioacoustic mixtures

Source separation is an important step to study signals that are not easy or possible to record individually. Common methods such as deep clustering, however, cannot be applied to signals of an unknown number of sources and/or signals that overlap in time and/or frequency—a common problem in bioacoustic recordings. This work presents an approach, using a supervised learning framework, to parse individual sources from a spectrogram of a mixture that contains a variable number of overlapping sources. This method isolates individual sources in the time-frequency domain using only one function but in two separate steps, one for the detection of the number of sources and corresponding bounding boxes, and a second step for the segmentation in which masks of individual sounds are extracted. This approach handles the full separation of overlapping sources in both time and frequency using deep neural networks in an applicable manner to other tasks such as bird audio detection. This paper presents method and reports on its performance to parse individual bat signals from recordings containing hundreds of overlapping bat echolocation signals. This method can be extended to other bioacoustic recordings with a variable number of sources and signals that overlap in time and/or frequency.

Izadi, Mohammad Rasool↗
DOE OSTI2025

Dirty Word Scanner

SAND2025-09142O Dirty Word Scanner helps prevent the accidental inclusion of sensitive terms by scaning files in repositories to catch "dirty words" before they are committed. While there are existing solutions focused on passwords and API keys, this tool offers additional features tailored to specific security needs. It will function as a standalone tool, incorporating advanced capabilities from similar tools to provide a comprehensive solution. This tool can unpack HDF5 files and examine their contents. It can display image, audio, and visual files to the user and request a manual determination of whether they are safe. It can also detect arbitrary binary files and ask the user to verify that they're safe. The tool enables sophisticated whitelisting of strings and regular expressions for cases where a term is sensitive in certain contexts but not in others. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Gates, Jason [Sandia National Lab. (SNL-CA), Liver↗
DOE OSTI2021

Skip-Connected Self-Recurrent Spiking Neural Networks with Joint Intrinsic Parameter and Synaptic Weight Training

As an important class of spiking neural networks (SNNs), recurrent spiking neural networks (RSNNs) possess great computational power and have been widely used for processing sequential data like audio and text. However, most RSNNs suffer from two problems. 1. Due to the lack of architectural guidance, random recurrent connectivity is often adopted, which does not guarantee good performance. 2. Training of RSNNs is in general challenging, bottlenecking achievable model accuracy. To address these problems, we propose a new type of RSNNs called Skip-Connected Self-Recurrent SNNs (ScSr-SNNs). Recurrence in ScSr-SNNs is introduced in a stereotyped manner by adding self-recurrent connections to spiking neurons. The SNNs with self-recurrent connections can realize recurrent behaviors similar to those of more complex RSNNs while the error gradients can be more straightforwardly calculated due to the mostly feedforward nature of the network. The network dynamics is enriched by skip connections between nonadjacent layers. Moreover, we propose a new backpropagation (BP) method called backpropagated intrinsic plasticity (BIP) to further boost the performance of ScSr-SNNs by training intrinsic model parameters. Unlike standard intrinsic plasticity rules that adjust the neuron's intrinsic parameters according to neuronal activity, the proposed BIP method optimizes intrinsic parameters based on the backpropagated error gradient of a well-defined global loss function in addition to synaptic weight training. Here, based on challenging speech, neuromorphic speech, and neuromorphic image datasets, the proposed ScSr-SNNs can boost performance by up to 2.85% compared with other types of RSNNs trained by state-of-the-art BP methods.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Reproductive intentions among HIV-negative gay and bisexual men initiating pre-exposure prophylaxis in the Sustainable Health Center Implementation pre-exposure prophylaxis pilot study, 2014–2016

Introduction We assessed reproductive intentions and associated characteristics among men enrolled in the Sustainable Health Center Implementation pre-exposure prophylaxis (PrEP) Pilot (SHIPP) Study. Methods We analyzed baseline data from 1275 men who self-identified as gay or bisexual and participated in the SHIPP study. SHIPP was a cohort study of PrEP implementation in five community health centers in Chicago, Jackson, Philadelphia, and Washington, D.C. conducted from 2014 to 2016. Participants completed audio computer-assisted self-interviews querying intentions to have a child in the future. We estimated the association between participants’ reproductive intentions and their characteristics using Poisson regression models. Results Approximately 47% of participants indicated their intentions to have a child. Black/non-Hispanic (aPR = 1.40; 95% CI: 1.10–1.78) and other/non-Hispanic participants (aPR = 1.40; 95% CI: 1.01–1.93) were more likely to report intentions to have a child than white/non-Hispanic participants. Participants were less likely to report intentions to have children as age increased (18–29 years, reference group; 30–39 years, aPR = 0.80, 95% CI: 0.64–0.99; 40–49 years, aPR = 0.49, 95% CI: 0.33–0.72; 50+ years, aPR = 0.07, 95% CI: 0.02–0.21). Conclusions Clinicians offering PrEP to black and other/non-Hispanic gay and bisexual men should assess their reproductive intentions as family-planning counseling may be an opportunity to introduce PrEP to HIV-negative gay and bisexual men.

Immunology↗
DOE OSTI2020

Design and feasibility of a novel program of cervical screening in Nigeria: self-sampled HPV testing paired with visual triage

Background: Accelerated global control of cervical cancer would require primary prevention with human papillomavirus (HPV) vaccination in addition to novel screening program strategies that are simple, inexpensive, and effective. We present the feasibility and outcome of a community-based HPV self-sampled screening program. Methods: In Ile Ife, Nigeria, 9406 women aged 30–49 years collected vaginal self-samples, which were tested for HPV in the local study laboratory using Hybrid Capture-2 (HC2) (Qiagen). HPV-positive women were referred to the colposcopy clinic. Gynecologist colposcopic impression dictated immediate management; biopsies were taken when definite acetowhitening was present to produce a histopathologic reference standard of precancer (and to determine final clinical management). Retrospective linkage to the medical records identified 442 of 9406 women living with HIV (WLWH). Results: With self-sampling, it was possible to screen more than 100 women per day per clinic. Following an audio-visual presentation and in-person instructions, overall acceptability of self-sampling was very high (81.2% women preferring self-sampling over clinician collection). HPV positivity was found in 17.3% of women. Intensive follow-up contributed to 85.9% attendance at the colposcopy clinic. Of those referred, 8.2% were initially treated with thermal ablation and 5.6% with large loop excision of transformation zone (LLETZ). Full visibility of the squamocolumnar junction, necessary for optimal visual triage and ablation, declined from 68.5% at age 30 to 35.4% at age 49. CIN2+ and CIN3+ (CIN- Cervical intraepithelial neoplasia), including five cancers, were identified by histology in 5.9 and 3.2% of the HPV-positive women, respectively (0.9 and 0.5% of the total screening population), leading to additional treatment as indicated. The prevalences of HPV infection and CIN2+ were substantially higher (40.5 and 2.5%, respectively) among WLWH. Colposcopic impression led to over- and under-treatment compared to the histopathology reference standard. Conclusion: A cervical cancer screening program using self-sampled HPV testing, with colposcopic immediate management of women positive for HPV, proved feasible in Nigeria. Based on the collected specimens and images, we are now evaluating the use of a combination of partial HPV typing and automated visual evaluation (AVE) of cervical images to improve the accuracy of the screening program.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Optical calibration of the SuperCam instrument body unit spectrometers

The SuperCam remote sensing instrument on NASA’s Perseverance rover is capable of four spectroscopic techniques, remote micro-imaging, and audio recording. These analytical techniques provide details of the chemistry and mineralogy of the rocks and soils probed in the Jezero Crater on Mars. Here we present the methods used for optical calibration of the three spectrometers covering the 243–853 nm range used by three of the four spectroscopic techniques. We derive the instrument optical response, which characterizes the instrument sensitivity to incident radiation as a function of a wavelength. The instrument optical response function derived here is an essential step in the interpretation of the spectra returned by SuperCam as it converts the observed spectra, reported by the instrument as “digital counts” from an analog to digital converter, into physical values of spectral radiance.

Legett, Carey (ORCID:0000000247412841)↗
DOE OSTI2026

Audi e-tron Green Light Optimized Speed Advisory On-Road Data

To aid researchers in studying the capabilities and benefits of vehicle-to-infrastructure communication, Argonne National Laboratory collected a robust set of on-road driving data of the Audi Green Light Optimized Speed Advisory (GLOSA) system implemented in the e-tron battery electric vehicle. This dataset includes 33 tests, each roughly 27 miles in length and roughly 45 to 75 minutes in duration. The team selected Kane County Highway Route 34 from Main Street in Batavia, Illinois to Middlecreek Lane in St. Charles, Illinois as the route do to its high density of GLOSA-active lights and the most opportunities to observe the system per hour of test time. The data include parameters from the following sources: GLOSA system driving the dash indicators, multiple powertrain parameters including real-time battery power/energy consumption, GPS, front radar gap, and rear radar gap. ![audio-e-tron image](audi-e-tron.jpg)

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗