Deep Learning for Audio Transcription on Low-Resource Datasets

Abstract

In training a deep learning system to perform audio transcription, two practical problems may arise. Firstly, most datasets are weakly labelled, having only a list of events present in each recording without any temporal information for training. Secondly, deep neural networks need a very large amount of labelled training data to achieve good quality performance, yet in practice it is difficult to collect enough samples for most classes of interest. In this paper, we propose factorising the final task of audio transcription into multiple intermediate tasks in order to improve the training performance when dealing with this kind of low-resource datasets. We evaluate three data-efficient approaches of training a stacked convolutional and recurrent neural network for the intermediate tasks. Our results show that different methods of training have different advantages and disadvantages.

arXiv comment20 pages, 5 figures

References in corpus (8)

• Automatic tagging using deep convolutional neural networks
• Audio Event Detection using Weakly Labeled Data
• Unsupervised Feature Learning Based on Deep Models for Environmental Audio Tagging
• Sound event detection using weakly labeled dataset with stacked convolutional and recurrent neural network
• Deep CNN Framework for Audio Event Recognition using Weakly Labeled Web Data
• Deep Networks tag the location of bird vocalisations on audio spectrograms
• Convolutional Gated Recurrent Neural Network Incorporating Spatial Features for Audio Tagging
• Comparing the Max and Noisy-Or Pooling Functions in Multiple Instance Learning for Weakly Supervised Sequence Learning Tasks