Direction of Arrival Estimation of Sound Sources Using Icosahedral CNNs

Abstract

In this paper, we present a new model for Direction of Arrival (DOA) estimation of sound sources based on an Icosahedral Convolutional Neural Network (CNN) applied over SRP-PHAT power maps computed from the signals received by a microphone array. This icosahedral CNN is equivariant to the 60 rotational symmetries of the icosahedron, which represent a good approximation of the continuous space of spherical rotations, and can be implemented using standard 2D convolutional layers, having a lower computational cost than most of the spherical CNNs. In addition, instead of using fully connected layers after the icosahedral convolutions, we propose a new soft-argmax function that can be seen as a differentiable version of the argmax function and allows us to solve the DOA estimation as a regression problem interpreting the output of the convolutional layers as a probability distribution. We prove that using models that fit the equivariances of the problem allows us to outperform other state-of-the-art models with a lower computational cost and more robustness, obtaining root mean square localization errors lower than 10° even in scenarios with a reverberation time $T_{60}$ of 1.5 s.

arXiv commentThe code to reproduce this work can be found in our GitHub repository: https://github.com/DavidDiazGuerra/icoDOA

References in corpus (13)

• Adam: A Method for Stochastic Optimization
• Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges
• Sound Event Localization and Detection of Overlapping Sources Using Convolutional Recurrent Neural Networks
• A Survey of Sound Source Localization with Deep Learning Methods
• Multi-Speaker DOA Estimation Using Deep Convolutional Networks Trained with Noise Signals
• DeepSphere: Efficient spherical Convolutional Neural Network with HEALPix sampling for cosmological applications
• Gauge Equivariant Convolutional Networks and the Icosahedral CNN
• gpuRIR: A Python Library for Room Impulse Response Simulation with GPU Acceleration
• Towards End-to-End Acoustic Localization using Deep Learning: from Audio Signal to Source Position Coordinates
• Robust Sound Source Tracking Using SRP-PHAT and 3D Convolutional Neural Networks
• Indoor Sound Source Localization with Probabilistic Neural Network
• Regression and Classification for Direction-of-Arrival Estimation with Convolutional Recurrent Neural Networks
• BeamLearning: an end-to-end Deep Learning approach for the angular localization of sound sources using raw multichannel acoustic pressure data