Quaternion Convolutional Neural Networks for Detection and Localization of 3D Sound Events

Abstract

Learning from data in the quaternion domain enables us to exploit internal dependencies of 4D signals and treating them as a single entity. One of the models that perfectly suits with quaternion-valued data processing is represented by 3D acoustic signals in their spherical harmonics decomposition. In this paper, we address the problem of localizing and detecting sound events in the spatial sound field by using quaternion-valued data processing. In particular, we consider the spherical harmonic components of the signals captured by a first-order ambisonic microphone and process them by using a quaternion convolutional neural network. Experimental results show that the proposed approach exploits the correlated nature of the ambisonic signals, thus improving accuracy results in 3D sound event detection and localization.

Submitted to ICASSP 2019

References in corpus (4)

• Convolutional Recurrent Neural Networks for Polyphonic Sound Event Detection
• Sound Event Localization and Detection of Overlapping Sources Using Convolutional Recurrent Neural Networks
• Broadband DOA estimation using Convolutional neural networks trained with noise signals
• Quaternion Recurrent Neural Networks

Cited by in corpus (15)

• A Survey of Sound Source Localization with Deep Learning Methods
• PHNNs: Lightweight Neural Networks via Parameterized Hypercomplex Convolutions
• Quaternion Generative Adversarial Networks
• Learning Speech Emotion Representations in the Quaternion Domain
• BeamLearning: an end-to-end Deep Learning approach for the angular localization of sound sources using raw multichannel acoustic pressure data
• Compressing deep quaternion neural networks with targeted regularization
• Quaternion Convolutional Neural Networks: Current Advances and Future Directions
• Lightweight and Efficient Neural Natural Language Processing with Quaternion Networks
• ACCDOA: Activity-Coupled Cartesian Direction of Arrival Representation for Sound Event Localization and Detection
• Hypercomplex Image-to-Image Translation
• Neural Networks at a Fraction with Pruned Quaternions
• Quaternion Neural Networks for Multi-channel Distant Speech Recognition
• A Quaternion-Valued Variational Autoencoder
• C-SL: Contrastive Sound Localization with Inertial-Acoustic Sensors
• Quaternion Factorization Machines: A Lightweight Solution to Intricate Feature Interaction Modelling