Do we really need Self-Attention for Streaming Automatic Speech Recognition?

Youness Dkhissi, Valentin Vielzeuf, Elys Allesiardo +1

Transformer-based architectures are the most used architectures in many deep learning fields like Natural Language Processing, Computer Vision or Speech processing. It may encourag…