CNN depth analysis with different channel inputs for Acoustic Scene Classification

Abstract

Acoustic scene classification (ASC) has been approached in the last years using deep learning techniques such as convolutional neural networks or recurrent neural networks. Many state-of-the-art solutions are based on image classification frameworks and, as such, a 2D representation of the audio signal is considered for training these networks. Finding the most suitable audio representation is still a research area of interest. In this paper, different log-Mel representations and combinations are analyzed. Experiments show that the best results are obtained using the harmonic and percussive components plus the difference between left and right stereo channels, (L-R). On the other hand, it is a common strategy to ensemble different models in order to increase the final accuracy. Even though averaging different model predictions is a common choice, an exhaustive analysis of different ensemble techniques has not been presented in ASC problems. In this paper, geometric and arithmetic mean plus the Ordered Weighted Averaging (OWA) operator are studied as aggregation operators for the output of the different models of the ensemble. Finally, the work carried out in this paper is highly oriented towards real-time implementations. In this context, as the number of applications for audio classification on edge devices is increasing exponentially, we also analyze different network depths and efficient solutions for aggregating ensemble predictions.

Accepted at URSI 2020, Malaga, Spain

References in corpus (6)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• A multi-device dataset for urban acoustic scene classification
• Acoustic scene classification using convolutional neural network and multiple-width frequency-delta data augmentation
• DCASE 2018 Challenge Surrey Cross-Task convolutional neural network baseline
• Understanding Audio Pattern Using Convolutional Neural Network From Raw Waveforms
• Acoustic scene classification using multi-layer temporal pooling based on convolutional neural network

Cited by in corpus (3)

• Acoustic Scene Classification with Squeeze-Excitation Residual Networks
• Squeeze-Excitation Convolutional Recurrent Neural Networks for Audio-Visual Scene Classification
• Beyond Categorical Label Representations for Image Classification