Multilingual Transformer Encoders: a Word-Level Task-Agnostic Evaluation

Félix Gaschi, François Plesse, Parisa Rastin +1

Some Transformer-based models can perform cross-lingual transfer learning: those models can be trained on a specific task in one language and give relatively good results on the sa…