Ensemble of ACCDOA- and EINV2-based Systems with D3Nets and Impulse Response Simulation for Sound Event Localization and Detection

Abstract

This report describes our systems submitted to the DCASE2021 challenge task 3: sound event localization and detection (SELD) with directional interference. Our previous system based on activity-coupled Cartesian direction of arrival (ACCDOA) representation enables us to solve a SELD task with a single target. This ACCDOA-based system with efficient network architecture called RD3Net and data augmentation techniques outperformed state-of-the-art SELD systems in terms of localization and location-dependent detection. Using the ACCDOA-based system as a base, we perform model ensembles by averaging outputs of several systems trained with different conditions such as input features, training folds, and model architectures. We also use the event independent network v2 (EINV2)-based system to increase the diversity of the model ensembles. To generalize the models, we further propose impulse response simulation (IRS), which generates simulated multi-channel signals by convolving simulated room impulse responses (RIRs) with source signals extracted from the original dataset. Our systems significantly improved over the baseline system on the development dataset.

arXiv comment5 pages, 3 figures, submitted to DCASE2021 task3

References in corpus (8)

• SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition
• Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour
• A Comparative Study on Transformer vs RNN in Speech Applications
• Pyroomacoustics: A Python package for audio room simulations and array processing algorithms
• Deep Convolutional Neural Networks and Data Augmentation for Acoustic Event Detection
• A Dataset of Reverberant Spatial Sound Scenes with Moving Sources for Sound Event Localization and Detection
• A Four-Stage Data Augmentation Approach to ResNet-Conformer Based Acoustic Modeling for Sound Event Localization and Detection
• A Dataset of Dynamic Reverberant Sound Scenes with Directional Interferers for Sound Event Localization and Detection

Cited by in corpus (6)

• A Survey of Sound Source Localization with Deep Learning Methods
• SALSA: Spatial Cue-Augmented Log-Spectrogram Features for Polyphonic Sound Event Localization and Detection
• SALSA-Lite: A Fast and Effective Feature for Polyphonic Sound Event Localization and Detection with Microphone Arrays
• End-to-End Complex-Valued Multidilated Convolutional Neural Network for Joint Acoustic Echo Cancellation and Noise Suppression
• Spatial mixup: Directional loudness modification as data augmentation for sound event localization and detection
• What Makes Sound Event Localization and Detection Difficult? Insights from Error Analysis