Group Communication with Context Codec for Lightweight Source Separation

Abstract

Despite the recent progress on neural network architectures for speech separation, the balance between the model size, model complexity and model performance is still an important and challenging problem for the deployment of such models to low-resource platforms. In this paper, we propose two simple modules, group communication and context codec, that can be easily applied to a wide range of architectures to jointly decrease the model size and complexity without sacrificing the performance. A group communication module splits a high-dimensional feature into groups of low-dimensional features and captures the inter-group dependency. A separation module with a significantly smaller model size can then be shared by all the groups. A context codec module, containing a context encoder and a context decoder, is designed as a learnable downsampling and upsampling module to decrease the length of a sequential feature processed by the separation module. The combination of the group communication and the context codec modules is referred to as the GC3 design. Experimental results show that applying GC3 on multiple network architectures for speech separation can achieve on-par or better performance with as small as 2.5% model size and 17.6% model complexity, respectively.

arXiv commentIEEE/ACM Transactions on Audio, Speech, and Language Processing (TASLP)

References in corpus (7)

• Res2Net: A New Multi-scale Backbone Architecture
• Conv-TasNet: Surpassing Ideal Time-Frequency Magnitude Masking for Speech Separation
• A Comparative Study on Transformer vs RNN in Speech Applications
• Speaker-independent Speech Separation with Deep Attractor Network
• gpuRIR: A Python Library for Room Impulse Response Simulation with GPU Acceleration
• Sudo rm -rf: Efficient Networks for Universal Audio Source Separation
• Incremental Binarization On Recurrent Neural Networks For Single-Channel Source Separation

Cited by in corpus (4)

• Automatic Speech Recognition using Advanced Deep Learning Approaches: A survey
• Deep Transfer Learning for Automatic Speech Recognition: Towards Better Generalization
• Real-time multichannel deep speech enhancement in hearing aids: Comparing monaural and binaural processing in complex acoustic scenarios
• U-shaped Transformer with Frequency-Band Aware Attention for Speech Enhancement