49 citations · 190 across the 36 of their papers we have counts for
9 papers · 1 filter
RuCoLA: Russian Corpus of Linguistic Acceptability
Vladislav Mikhailov, Tatiana Shamardina, Max Ryabinin +3
Linguistic acceptability (LA) attracts the attention of the research community due to its many uses, such as testing the grammatical knowledge of language models and filtering impl…
TAPE: Assessing Few-shot Russian Language Understanding
Ekaterina Taktasheva, Tatiana Shavrina, Alena Fenogenova +11
Recent advances in zero-shot and few-shot learning have shown promise for a scope of research and practical purposes. However, this fast-growing area lacks standardized evaluation…
Vote'n'Rank: Revision of Benchmarking with Social Choice Theory
Mark Rofin, Vladislav Mikhailov, Mikhail Florinskiy +5
The development of state-of-the-art systems in different applied areas of machine learning (ML) is driven by benchmarks, which have shaped the paradigm of evaluating generalisation…
Template-based Approach to Zero-shot Intent Recognition
Dmitry Lamanov, Pavel Burnyshev, Ekaterina Artemova +3
The recent advances in transfer learning techniques and pre-training of large contextualized encoders foster innovation in real-life applications, including dialog assistants. Prac…
Findings of the The RuATD Shared Task 2022 on Artificial Text Detection in Russian
Tatiana Shamardina, Vladislav Mikhailov, Daniil Chernianskii +7
We present the shared task on artificial text detection in Russian, which is organized as a part of the Dialogue Evaluation initiative, held in 2022. The shared task dataset includ…
RuNNE-2022 Shared Task: Recognizing Nested Named Entities
Ekaterina Artemova, Maxim Zmeev, Natalia Loukachevitch +4
The RuNNE Shared Task approaches the problem of nested named entity recognition. The annotation schema is designed in such a way, that an entity may partially overlap or even be ne…