Efficient Integration of Multi-channel Information for Speaker-independent Speech Separation
arXiv:2005.11612
Abstract
Although deep-learning-based methods have markedly improved the performance of speech separation over the past few years, it remains an open question how to integrate multi-channel signals for speech separation. We propose two methods, namely, early-fusion and late-fusion methods, to integrate multi-channel information based on the time-domain audio separation network, which has been proven effective in single-channel speech separation. We also propose channel-sequential-transfer learning, which is a transfer learning framework that applies the parameters trained for a lower-channel network as the initial values of a higher-channel network. For fair comparison, we evaluated our proposed methods using a spatialized version of the wsj0-2mix dataset, which is open-sourced. It was found that our proposed methods can outperform multi-channel deep clustering and improve the performance proportionally to the number of microphones. It was also proven that the performance of the late-fusion method is consistently higher than that of the single-channel method regardless of the angle difference between speakers.
References in corpus (9)
- Adam: A Method for Stochastic Optimization
- MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
- An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling
- Conv-TasNet: Surpassing Ideal Time-Frequency Magnitude Masking for Speech Separation
- Speaker-independent Speech Separation with Deep Attractor Network
- CHiME-6 Challenge:Tackling Multispeaker Speech Recognition for Unsegmented Recordings
- End-to-End Multi-Channel Speech Separation
- On End-to-end Multi-channel Time Domain Speech Separation in Reverberant Environments
- FaSNet: Low-latency Adaptive Beamforming for Multi-microphone Audio Processing