1 citations · 2 across the 5 of their papers we have counts for
4 papers · 1 filter
Probing the Category of Verbal Aspect in Transformer Language Models
Anisia Katinskaia, Roman Yangarber
We investigate how pretrained language models (PLM) encode the grammatical category of verbal aspect in Russian. Encoding of aspect in transformer LMs has not been studied previous…
GPT-3.5 for Grammatical Error Correction
Anisia Katinskaia, Roman Yangarber
This paper investigates the application of GPT-3.5 for Grammatical Error Correction (GEC) in multiple languages in several settings: zero-shot GEC, fine-tuning for GEC, and using G…
What do Transformers Know about Government?
Jue Hou, Anisia Katinskaia, Lari Kotilainen +3
This paper investigates what insights about linguistic features and what knowledge about the structure of natural language can be obtained from the encodings in transformer languag…
Effects of sub-word segmentation on performance of transformer language models
Jue Hou, Anisia Katinskaia, Anh-Duc Vu +1
Language modeling is a fundamental task in natural language processing, which has been thoroughly explored with various architectures and hyperparameters. However, few studies focu…