Phase-Aware Deep Speech Enhancement: It's All About The Frame Length

Abstract

Algorithmic latency in speech processing is dominated by the frame length used for Fourier analysis, which in turn limits the achievable performance of magnitude-centric approaches. As previous studies suggest the importance of phase grows with decreasing frame length, this work presents a systematical study on the contribution of phase and magnitude in modern Deep Neural Network (DNN)-based speech enhancement at different frame lengths. Results indicate that DNNs can successfully estimate phase when using short frames, with similar or better overall performance compared to using longer frames. Thus, interestingly, modern phase-aware DNNs allow for low-latency speech enhancement at high quality.

arXiv commentThe following article has been accepted by JASA Express Letters. After it is published, it will be found at http://asa.scitation.org/journal/jel

References in corpus (9)

• Conv-TasNet: Surpassing Ideal Time-Frequency Magnitude Masking for Speech Separation
• On The Compensation Between Magnitude and Phase in Speech Separation
• Phasebook and Friends: Leveraging Discrete Representations for Source Separation
• A Multi-Phase Gammatone Filterbank for Speech Separation via TasNet
• DCCRN: Deep Complex Convolution Recurrent Network for Phase-Aware Speech Enhancement
• Dual-path RNN: efficient long sequence modeling for time-domain single-channel speech separation
• Exploring the Best Loss Function for DNN-Based Low-latency Speech Enhancement with Temporal Convolutional Networks
• Attention is All You Need in Speech Separation
• Phase reconstruction based on recurrent phase unwrapping with deep neural networks

Cited by in corpus (2)

• Speech Enhancement and Dereverberation with Diffusion-based Generative Models
• Efficient Transformer-based Speech Enhancement Using Long Frames and STFT Magnitudes