Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bioacoustics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

6 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Separation of overlapping sources in bioacoustic mixtures

Source separation is an important step to study signals that are not easy or possible to record individually. Common methods such as deep clustering, however, cannot be applied to signals of an unknown number of sources and/or signals that overlap in time and/or frequency—a common problem in bioacoustic recordings. This work presents an approach, using a supervised learning framework, to parse individual sources from a spectrogram of a mixture that contains a variable number of overlapping sources. This method isolates individual sources in the time-frequency domain using only one function but in two separate steps, one for the detection of the number of sources and corresponding bounding boxes, and a second step for the segmentation in which masks of individual sounds are extracted. This approach handles the full separation of overlapping sources in both time and frequency using deep neural networks in an applicable manner to other tasks such as bird audio detection. This paper presents method and reports on its performance to parse individual bat signals from recordings containing hundreds of overlapping bat echolocation signals. This method can be extended to other bioacoustic recordings with a variable number of sources and signals that overlap in time and/or frequency.

Izadi, Mohammad Rasool↗
DOE OSTI2022

Classification of animal sounds in a hyperdiverse rainforest using convolutional neural networks with data augmentation

To protect tropical forest biodiversity, we need to be able to detect it reliably, cheaply, and at scale. Automated detection of sound producing animals from passively recorded soundscapes via machine-learning approaches is a promising technique towards this goal, but it is constrained by the necessity of large training data sets. Using soundscapes from a tropical forest in Borneo and a Convolutional Neural Network model (CNN), we investigate i) the minimum viable training data set size for accurate prediction of call types (‘sonotypes’), and ii) the extent to which data augmentation and transfer learning can overcome the issue of small and imbalanced training data sets. We found that even relatively high sample sizes (>80 per sonotype) lead to mediocre accuracy, which however improved significantly with data augmentation and transfer learning, including at extremely small sample sizes (3 per sonotype), regardless of taxonomic group or call characteristics. Neither transfer learning nor data augmentation alone achieved high accuracy. Our results suggest that transfer learning and data augmentation could make the use of CNNs to classify species’ vocalizations feasible even for small soundscape-based projects with many rare species. Retraining our open-source model requires only basic programming skills which makes it possible for individual conservation initiatives to match their local context, in order to enable more evidence-informed management of biodiversity.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

The variable influence of anthropogenic noise on summer season coastal underwater soundscapes near a port and marine reserve

Monitoring soundscapes is essential for assessing environmental conditions for soniferous species, yet little is known about sound levels and contributors in Oregon coastal regions. From 2017-2021, during June-September, two hydrophones were deployed near Newport, Oregon to sample 10-13,000Hz underwater sound. One hydrophone was deployed near the Port of Newport in a high vessel activity area, and another 17km north within a protected Marine Reserve. Vessel noise and whale vocalizations were detected at both sites, but whales were recorded on more days at the Marine Reserve. Median sound levels in frequencies related to noise from various vessel types and sizes (50-4,000Hz) were up to 6dB higher at the Port of Newport, with greater diel variability compared to the Marine Reserve. In addition to documenting summer season conditions in Oregon waters, these results exemplify how underwater soundscapes can differ over short distances depending on anthropogenic activity.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Time series methods for the analysis of soundscapes and other cyclical ecological data

Biodiversity monitoring has entered an era of ‘big data’, exemplified by a near-continuous collection of sounds, images, chemical and other signals from organisms in diverse ecosystems. Such data streams have the potential to help identify new threats, assess the effectiveness of conservation interventions, as well as generate new ecological insights. However, appropriate analytical methods are often still missing, particularly with respect to characterizing cyclical temporal patterns. Here, we present a framework for characterizing and analysing ecological responses that represent nonstationary, complex temporal patterns and demonstrate the value of using Fourier transforms to decorrelate continuous data points. In our example, we use a framework based on three approaches (spectral analysis, magnitude squared coherence, and principal component analysis) to characterize differences in tropical forest soundscapes within and across sites and seasons in Gabon. By reconstructing the underlying, cyclic behaviour of the soundscape for each site, we show how one can identify circadian patterns in acoustic activity. Soundscapes in the dry season had a complex diel cycle, requiring multiple harmonics to represent daily variation, while in the wet season there was less variance attributable to the daily cyclic patterns. Our framework can be applied to most continuous, or near-continuous ecological data collected at a fine temporal resolution, allowing ecologists to explore patterns of temporal autocorrelation at multiple levels for biologically meaningful trends. Such methods will become indispensable as biological big data are used to understand the impact of anthropogenic pressures on biodiversity and to inform efforts to mitigate them.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Many but not all deep neural network audio models capture brain responses and exhibit correspondence between model stages and brain regions

Models that predict brain responses to stimuli provide one measure of understanding of a sensory system and have many potential applications in science and engineering. Deep artificial neural networks have emerged as the leading such predictive models of the visual system but are less explored in audition. Prior work provided examples of audio-trained neural networks that produced good predictions of auditory cortical fMRI responses and exhibited correspondence between model stages and brain regions, but left it unclear whether these results generalize to other neural network models and, thus, how to further improve models in this domain. We evaluated model-brain correspondence for publicly available audio neural network models along with in-house models trained on 4 different tasks. Most tested models outpredicted standard spectromporal filter-bank models of auditory cortex and exhibited systematic model-brain correspondence: Middle stages best predicted primary auditory cortex, while deep stages best predicted non-primary cortex. However, some state-of-the-art models produced substantially worse brain predictions. Models trained to recognize speech in background noise produced better brain predictions than models trained to recognize speech in quiet, potentially because hearing in noise imposes constraints on biological auditory representations. The training task influenced the prediction quality for specific cortical tuning properties, with best overall predictions resulting from models trained on multiple tasks. The results generally support the promise of deep neural networks as models of audition, though they also indicate that current models do not explain auditory cortical responses in their entirety.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Observations of marine animal interactions with a small tidal turbine

The risk of collisions between animals and operating tidal turbines remains a concern in the scientific and regulatory communities. A sensor package including optical cameras was deployed to monitor animal interactions with a small-scale (1 m 2 ) cross-flow tidal turbine. The turbine was deployed in Washington State, USA for 141 days at a site with peak flow speeds of 2.5 m/s. We analyze optical camera imagery spanning 109 days of turbine operation. The analyzed images contain 1044 observations of fish, fish schools, seabirds, or seals in the vicinity of the turbine. No instances of collision with seabirds or seals were observed. Seabirds were only observed during daylight hours and while the turbine was stationary. Both seals and fish were observed during both day and night and while the turbine was stationary and rotating. Four fish were observed colliding with the moving turbine and in all but one case the animals swam away following the collision. Over the same period of time, over fifty times more fish (224 individual fish and 5 fish schools) were observed passing the moving turbine without collision. Fish encounters were likely under counted due to the difficulty in discerning small fish from plant matter in the water column. These observations represent the first optical camera imagery showing fish, bird, and marine mammal interactions with a tidal turbine in North America. In addition to quantitative and qualitative discussion of the implications of our observations for collision risk, we discuss lessons learned on sampling schemes and deployment of machine learning for detection of animals to inform future data collection strategies in future monitoring campaigns.

16 TIDAL AND WAVE POWER↗