42 citations
- Inje UniversityKR11 papers
- National Research University Higher School of EconomicsRU6 papers
- Huawei Technologies (Sweden)SE4 papers
- LMU KlinikumDE4 papers
- Ludwig-Maximilians-Universität MünchenDE4 papers
- Kyungnam UniversityKR3 papers
- Skolkovo Institute of Science and TechnologyRU3 papers
- Allen Institute for Artificial IntelligenceUS2 papers
- Artificial Intelligence in Medicine (Canada)CA2 papers
- Artificial Intelligence Research InstituteES2 papers
- Institut de Mathématiques de Jussieu-Paris Rive GaucheFR2 papers
- Sorbonne UniversitéFR2 papers
22 papers
RuCoLA: Russian Corpus of Linguistic Acceptability
Vladislav Mikhailov, Tatiana Shamardina, Max Ryabinin +3
Linguistic acceptability (LA) attracts the attention of the research community due to its many uses, such as testing the grammatical knowledge of language models and filtering impl…
TAPE: Assessing Few-shot Russian Language Understanding
Ekaterina Taktasheva, Tatiana Shavrina, Alena Fenogenova +11
Recent advances in zero-shot and few-shot learning have shown promise for a scope of research and practical purposes. However, this fast-growing area lacks standardized evaluation…
Vote'n'Rank: Revision of Benchmarking with Social Choice Theory
Mark Rofin, Vladislav Mikhailov, Mikhail Florinskiy +5
The development of state-of-the-art systems in different applied areas of machine learning (ML) is driven by benchmarks, which have shaped the paradigm of evaluating generalisation…
Findings of the The RuATD Shared Task 2022 on Artificial Text Detection in Russian
Tatiana Shamardina, Vladislav Mikhailov, Daniil Chernianskii +7
We present the shared task on artificial text detection in Russian, which is organized as a part of the Dialogue Evaluation initiative, held in 2022. The shared task dataset includ…
Acceptability Judgements via Examining the Topology of Attention Maps
Daniil Cherniavskii, Eduard Tulchinskii, Vladislav Mikhailov +7
The role of the attention mechanism in encoding linguistic knowledge has received special interest in NLP. However, the ability of the attention heads to judge the grammatical acce…
Artificial Text Detection via Examining the Topology of Attention Maps
Laida Kushnareva, Daniil Cherniavskii, Vladislav Mikhailov +6
The impressive capabilities of recent generative models to create texts that are challenging to distinguish from the human-written ones can be misused for generating fake news, pro…