16 citations · 23 across the 7 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.CL2024
RuBLiMP: Russian Benchmark of Linguistic Minimal Pairs
Ekaterina Taktasheva, Maxim Bazhukov, Kirill Koncha +3
Minimal pairs are a well-established approach to evaluating the grammatical knowledge of language models. However, existing resources for minimal pairs address a limited number of…
cs.CL2024
LUNA: A Framework for Language Understanding and Naturalness Assessment
Marat Saidov, Aleksandra Bakalova, Ekaterina Taktasheva +2
The evaluation of Natural Language Generation (NLG) models has gained increased attention, urging the development of metrics that evaluate various aspects of generated text. LUNA a…