Benchmarking Rotary Position Embeddings for Automatic Speech Recognition

Shucong Zhang, Titouan Parcollet, Rogier van Dalen +1

Self-attention relies on positional embeddings to encode input order. Relative Position (RelPos) embeddings are widely used in Automatic Speech Recognition (ASR). However, RelPos h…