5 papers
Audio-visual Contrastive Alignment for Diffusion-based Visual-conditioned Speech Enhancement
Colombe Mboungou, Mostafa Sadeghi, Jean-Eudes Ayilo +1
Audio-visual speech enhancement (AVSE) exploits visual cues such as lip movements to recover speech in noisy environments. Recent work introduced diffusion-based unsupervised AVSE,…
Diffusion-based Frameworks for Unsupervised Speech Enhancement
Jean-Eudes Ayilo, Mostafa Sadeghi, Romain Serizel +1
This paper addresses unsupervised diffusion-based single-channel speech enhancement (SE). Prior work in this direction combines a score-based diffusion model trained on clean speec…
Posterior Transition Modeling for Unsupervised Diffusion-Based Speech Enhancement
Mostafa Sadeghi, Jean-Eudes Ayilo, Romain Serizel +1
We explore unsupervised speech enhancement using diffusion models as expressive generative priors for clean speech. Existing approaches guide the reverse diffusion process using no…
Diffusion-based Unsupervised Audio-visual Speech Enhancement
Jean-Eudes Ayilo, Mostafa Sadeghi, Romain Serizel +1
This paper proposes a new unsupervised audio-visual speech enhancement (AVSE) approach that combines a diffusion-based audio-visual speech generative model with a non-negative matr…
Diffusion-based speech enhancement with a weighted generative-supervised learning loss
Jean-Eudes Ayilo, Mostafa Sadeghi, Romain Serizel
Diffusion-based generative models have recently gained attention in speech enhancement (SE), providing an alternative to conventional supervised methods. These models transform cle…