29 citations · 73 across the 22 of their papers we have counts for
4 papers · 1 filter
BEST-RQ-Based Self-Supervised Learning for Whisper Domain Adaptation
Raphaël Bagat, Irina Illina, Emmanuel Vincent
Automatic Speech Recognition (ASR) systems, despite large multilingual training, struggle in low-resource scenarios where labeled data is scarce. We propose BEARD (BEST-RQ Encoder…
BaldWhisper: Faster Whisper with Head Shearing and Layer Merging
Yaya Sy, Christophe Cerisara, Irina Illina
Pruning large pre-trained transformers in a data-scarce scenario is challenging, as it often requires massive retraining data to recover performance. For instance, Distill-Whisper…
Speech Language Models for Under-Represented Languages: Insights from Wolof
Yaya Sy, Dioula Doucouré, Christophe Cerisara +1
We present our journey in training a speech language model for Wolof, an underrepresented language spoken in West Africa, and share key insights. We first emphasize the importance…
Mixture of LoRA Experts for Low-Resourced Multi-Accent Automatic Speech Recognition
Raphaël Bagat, Irina Illina, Emmanuel Vincent
We aim to improve the robustness of Automatic Speech Recognition (ASR) systems against non-native speech, particularly in low-resourced multi-accent settings. We introduce Mixture…