Exploring the Relationship between Alignment and Cross-lingual Transfer in Multilingual Transformers

Félix Gaschi, Patricio Cerda, Parisa Rastin +1

Without any explicit cross-lingual training data, multilingual language models can achieve cross-lingual transfer. One common way to improve this transfer is to perform realignment…