Modeling the Comb Filter Effect and Interaural Coherence for Binaural Source Separation

Abstract

Typical methods for binaural source separation consider only the direct sound as the target signal in a mixture. However, in most scenarios, this assumption limits the source separation performance. It is well known that the early reflections interact with the direct sound, producing acoustic effects at the listening position, e.g. the so-called comb filter effect. In this article, we propose a novel source separation model, that utilizes both the direct sound and the first early reflection information to model the comb filter effect. This is done by observing the interaural phase difference obtained from the time-frequency representation of binaural mixtures. Furthermore, a method is proposed to model the interaural coherence of the signals. Including information related to the sound multipath propagation, the performance of the proposed separation method is improved with respect to the baselines that did not use such information, as illustrated by using binaural recordings made in four rooms, having different sizes and reverberation times.

IEEE Copyright. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2019

References in corpus (6)

• Joint Optimization of Masks and Deep Recurrent Neural Networks for Monaural Source Separation
• Supervised and Unsupervised Speech Enhancement Using Nonnegative Matrix Factorization
• Robust Localization and Tracking of Simultaneous Moving Sound Sources Using Beamforming and Particle Filtering
• Acoustic Space Learning for Sound Source Separation and Localization on Binaural Manifolds
• Raking the Cocktail Party
• Acoustic Reflector Localization: Novel Image Source Reversion and Direct Localization Methods