Rethinking Depth: A study of the Recursive-Transformer for Speech Recognition

Thomas Rolland, Carlos Carvalho, Alberto Abad

Transformer-based architectures have led to significant improvements in Automatic Speech Recognition (ASR), often at the cost of substantially increased model sizes. A promising ap…