On Loss Functions and Recurrency Training for GAN-based Speech Enhancement Systems
arXiv:2007.14974
Abstract
Recent work has shown that it is feasible to use generative adversarial networks (GANs) for speech enhancement, however, these approaches have not been compared to state-of-the-art (SOTA) non GAN-based approaches. Additionally, many loss functions have been proposed for GAN-based approaches, but they have not been adequately compared. In this study, we propose novel convolutional recurrent GAN (CRGAN) architectures for speech enhancement. Multiple loss functions are adopted to enable direct comparisons to other GAN-based systems. The benefits of including recurrent layers are also explored. Our results show that the proposed CRGAN model outperforms the SOTA GAN-based models using the same loss functions and it outperforms other non-GAN based systems, indicating the benefits of using a GAN for speech enhancement. Overall, the CRGAN model that combines an objective metric loss function with the mean squared error (MSE) provides the best performance over comparison approaches across many evaluation metrics.
accepted by Interspeech2020, 5 pages, 2 figures
References in corpus (4)
- Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)
- The relativistic discriminator: a key element missing from standard GAN
- Monaural Speech Enhancement using Deep Neural Networks by Maximizing a Short-Time Objective Intelligibility Measure
- Deep Recurrent Convolutional Neural Network: Improving Performance For Speech Recognition