On the Interplay between Positional Encodings, Morphological Complexity, and Word Order Flexibility

Kushal Tatariya, Wessel Poelman, Miryam de Lhoneux

Language model architectures are predominantly first created for English and subsequently applied to other languages. It is an open question whether this architectural bias leads t…