2 papers
cs.SD2024
Linear Time Complexity Conformers with SummaryMixing for Streaming Speech Recognition
Titouan Parcollet, Rogier van Dalen, Shucong Zhang +1
Automatic speech recognition (ASR) with an encoder equipped with self-attention, whether streaming or non-streaming, takes quadratic time in the length of the speech utterance. Thi…
cs.LG2024
An Analysis of Linear Complexity Attention Substitutes with BEST-RQ
Ryan Whetten, Titouan Parcollet, Adel Moumen +2
Self-Supervised Learning (SSL) has proven to be effective in various domains, including speech processing. However, SSL is computationally and memory expensive. This is in part due…