A Family of Pretrained Transformer Language Models for Russian

Dmitry Zmitrovich, Alexander Abramov, Andrey Kalmykov +10

Transformer language models (LMs) are fundamental to NLP research methodologies and applications in various languages. However, developing such models specifically for the Russian…