3 citations · 5 across the 4 of their papers we have counts for
6 papers
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
BigScience Workshop, :, Teven Le Scao +391
Large language models (LLMs) have been shown to be able to perform new tasks based on a few demonstrations or natural language instructions. While these capabilities have led to wi…
Universal and Independent: Multilingual Probing Framework for Exhaustive Model Interpretation and Evaluation
Oleg Serikov, Vitaly Protasov, Ekaterina Voloshina +2
Linguistic analysis of language models is one of the ways to explain and describe their reasoning, weaknesses, and limitations. In the probing part of the model interpretability re…
Is neural language acquisition similar to natural? A chronological probing study
Ekaterina Voloshina, Oleg Serikov, Tatiana Shavrina
The probing methodology allows one to obtain a partial representation of linguistic phenomena stored in the inner layers of the neural network, using external classifiers and stati…
Razmecheno: Named Entity Recognition from Digital Archive of Diaries "Prozhito"
Timofey Atnashev, Veronika Ganeeva, Roman Kazakov +5
The vast majority of existing datasets for Named Entity Recognition (NER) are built primarily on news, research papers and Wikipedia with a few exceptions, created from historical…
Morph Call: Probing Morphosyntactic Content of Multilingual Transformers
Vladislav Mikhailov, Oleg Serikov, Ekaterina Artemova
The outstanding performance of transformer-based language models on a great variety of NLP and NLU tasks has stimulated interest in exploring their inner workings. Recent research…
Teaching a Massive Open Online Course on Natural Language Processing
Ekaterina Artemova, Murat Apishev, Veronika Sarkisyan +3
This paper presents a new Massive Open Online Course on Natural Language Processing, targeted at non-English speaking students. The course lasts 12 weeks; every week consists of le…