Audio-visual Contrastive Alignment for Diffusion-based Visual-conditioned Speech Enhancement

Colombe Mboungou, Mostafa Sadeghi, Jean-Eudes Ayilo +1

Audio-visual speech enhancement (AVSE) exploits visual cues such as lip movements to recover speech in noisy environments. Recent work introduced diffusion-based unsupervised AVSE,…