32 citations · 37 across the 4 of their papers we have counts for
4 papers
Gamayun's Path to Multilingual Mastery: Cost-Efficient Training of a 1.5B-Parameter LLM
Alexander Podolskiy, Semen Molokov, Timofey Gerasin +14
We present Gamayun, a 1.5B-parameter multilingual language model trained entirely from scratch on 2.5T tokens. Designed for efficiency and deployment in resource-constrained enviro…
KazQAD: Kazakh Open-Domain Question Answering Dataset
Rustem Yeshpanov, Pavel Efimov, Leonid Boytsov +2
We introduce KazQAD -- a Kazakh open-domain question answering (ODQA) dataset -- that can be used in both reading comprehension and full ODQA settings, as well as for information r…
The Impact of Cross-Lingual Adjustment of Contextual Word Representations on Zero-Shot Transfer
Pavel Efimov, Leonid Boytsov, Elena Arslanova +1
Large multilingual language models such as mBERT or XLM-R enable zero-shot cross-lingual transfer in various IR and NLP tasks. Cao et al. (2020) proposed a data- and compute-effici…
SberQuAD -- Russian Reading Comprehension Dataset: Description and Analysis
Pavel Efimov, Andrey Chertok, Leonid Boytsov +1
SberQuAD -- a large scale analog of Stanford SQuAD in the Russian language - is a valuable resource that has not been properly presented to the scientific community. We fill this g…