FinEst BERT and CroSloEngual BERT: less is more in multilingual models

Matej Ulčar, Marko Robnik-Šikonja

Large pretrained masked language models have become state-of-the-art solutions for many NLP problems. The research has been mostly focused on English language, though. While massiv…