90 citations · 178 across the 45 of their papers we have counts for
5 papers · 1 filter
Leveraging Pretrained Image-text Models for Improving Audio-Visual Learning
Saurabhchand Bhati, Jesús Villalba, Laureano Moro-Velazquez +2
Visually grounded speech systems learn from paired images and their spoken captions. Recently, there have been attempts to utilize the visually grounded models trained from images…
DuTa-VC: A Duration-aware Typical-to-atypical Voice Conversion Approach with Diffusion Probabilistic Model
Helin Wang, Thomas Thebaud, Jesus Villalba +4
We present a novel typical-to-atypical voice conversion approach (DuTa-VC), which (i) can be trained with nonparallel data (ii) first introduces diffusion probabilistic model (iii)…
Regularizing Contrastive Predictive Coding for Speech Applications
Saurabhchand Bhati, Jesús Villalba, Piotr Żelasko +2
Self-supervised methods such as Contrastive predictive Coding (CPC) have greatly improved the quality of the unsupervised representations. These representations significantly reduc…
Stabilized training of joint energy-based models and their practical applications
Martin Sustek, Samik Sadhu, Lukas Burget +4
The recently proposed Joint Energy-based Model (JEM) interprets discriminatively trained classifier as an energy model, which is also trained as a generative model describ…
Self-FiLM: Conditioning GANs with self-supervised representations for bandwidth extension based speaker recognition
Saurabh Kataria, Jesús Villalba, Laureano Moro-Velázquez +2
Speech super-resolution/Bandwidth Extension (BWE) can improve downstream tasks like Automatic Speaker Verification (ASV). We introduce a simple novel technique called Self-FiLM to…