Efficient conformer: Progressive downsampling and grouped attention for automatic speech recognition

Maxime Burchi, Valentin Vielzeuf

The recently proposed Conformer architecture has shown state-of-the-art performances in Automatic Speech Recognition by combining convolution with attention to model both local and…