3 citations · 5 across the 16 of their papers we have counts for
5 papers · 1 filter
Multi-layer attentive probing improves transfer of audio representations for bioacoustics
Marius Miron, David Robinson, Masato Hagiwara +15
Probing heads map the representations learned from audio by a machine learning model to downstream task labels and are a key component in evaluating representation learning. Most b…
A Study of Data Selection Strategies for Pre-training Self-Supervised Speech Models
Ryan Whetten, Titouan Parcollet, Marco Dinarelli +1
Self-supervised learning (SSL) has transformed speech processing, yet its reliance on massive pre-training datasets remains a bottleneck. While robustness is often attributed to sc…
Towards Early Prediction of Self-Supervised Speech Model Performance
Ryan Whetten, Lucas Maison, Titouan Parcollet +2
In Self-Supervised Learning (SSL), pre-training and evaluation are resource intensive. In the speech domain, current indicators of the quality of SSL models during pre-training, su…
Linear Time Complexity Conformers with SummaryMixing for Streaming Speech Recognition
Titouan Parcollet, Rogier van Dalen, Shucong Zhang +1
Automatic speech recognition (ASR) with an encoder equipped with self-attention, whether streaming or non-streaming, takes quadratic time in the length of the speech utterance. Thi…
Enhancing expressivity transfer in textless speech-to-speech translation
Jarod Duret, Benjamin O'Brien, Yannick Estève +1
Textless speech-to-speech translation systems are rapidly advancing, thanks to the integration of self-supervised learning techniques. However, existing state-of-the-art systems fa…