49 citations · 201 across the 21 of their papers we have counts for
5 papers · 1 filter
Shaking Syntactic Trees on the Sesame Street: Multilingual Probing with Controllable Perturbations
Ekaterina Taktasheva, Vladislav Mikhailov, Ekaterina Artemova
Recent research has adopted a new experimental field centered around the concept of text perturbations which has revealed that shuffled word order has little to no impact on the do…
Artificial Text Detection via Examining the Topology of Attention Maps
Laida Kushnareva, Daniil Cherniavskii, Vladislav Mikhailov +6
The impressive capabilities of recent generative models to create texts that are challenging to distinguish from the human-written ones can be misused for generating fake news, pro…
Morph Call: Probing Morphosyntactic Content of Multilingual Transformers
Vladislav Mikhailov, Oleg Serikov, Ekaterina Artemova
The outstanding performance of transformer-based language models on a great variety of NLP and NLU tasks has stimulated interest in exploring their inner workings. Recent research…
MOROCCO: Model Resource Comparison Framework
Valentin Malykh, Alexander Kukushkin, Ekaterina Artemova +3
The new generation of pre-trained NLP models push the SOTA to the new limits, but at the cost of computational resources, to the point that their use in real production environment…
RuSentEval: Linguistic Source, Encoder Force!
Vladislav Mikhailov, Ekaterina Taktasheva, Elina Sigdel +1
The success of pre-trained transformer language models has brought a great deal of interest on how these models work, and what they learn about language. However, prior research in…