A Time-domain Monaural Speech Enhancement with Feedback Learning

Abstract

In this paper, we propose a type of neural network with feedback learning in the time domain called FTNet for monaural speech enhancement, where the proposed network consists of three principal components. The first part is called stage recurrent neural network, which is introduced to effectively aggregate the deep feature dependencies across different stages with a memory mechanism and also remove the interference stage by stage. The second part is the convolutional auto-encoder. The third part consists of a series of concatenated gated linear units, which are capable of facilitating the information flow and gradually increasing the receptive fields. Feedback learning is adopted to improve the parameter efficiency and therefore, the number of trainable parameters is effectively reduced without sacrificing its performance. Numerous experiments are conducted on TIMIT corpus and experimental results demonstrate that the proposed network can achieve consistently better performance in terms of both PESQ and STOI scores than two state-of-the-art time domain-based baselines in different conditions.

arXiv commentAccepted by APSIPA 2020

References in corpus (6)

• Adam: A Method for Stochastic Optimization
• Conditional Image Generation with PixelCNN Decoders
• Delving Deeper into Convolutional Networks for Learning Video Representations
• Complex spectrogram enhancement by convolutional neural network with multi-metrics learning
• Convolutional Recurrent Neural Network Based Progressive Learning for Monaural Speech Enhancement
• RHR-Net: A Residual Hourglass Recurrent Neural Network for Speech Enhancement

Cited by in corpus (3)

• A Recursive Network with Dynamic Attention for Monaural Speech Enhancement
• Latent Iterative Refinement for Modular Source Separation
• A Deep Learning Loss Function based on Auditory Power Compression for Speech Enhancement