2 citations · 3 across the 7 of their papers we have counts for
8 papers
Universal NER v2: Towards a Massively Multilingual Named Entity Recognition Benchmark
Terra Blevins, Stephen Mayhew, Marek Šuppa +11
While multilingual language models promise to bring the benefits of LLMs to speakers of many languages, gold-standard evaluation benchmarks in most languages to interrogate these a…
Coconstructions in spoken data: UD annotation guidelines and first results
Ludovica Pannitto, Sylvain Kahane, Kaja Dobrovoljc +4
The paper proposes annotation guidelines for syntactic dependencies that span across speaker turns - including collaborative coconstructions proper, wh-question answers, and backch…
A Parallel Cross-Lingual Benchmark for Multimodal Idiomaticity Understanding
Dilara Torunoğlu-Selamet, Dogukan Arslan, Rodrigo Wilkens +75
Potentially idiomatic expressions (PIEs) construe meanings inherently tied to the everyday experience of a given language community. As such, they constitute an interesting challen…
Evaluating Metalinguistic Knowledge in Large Language Models across the World's Languages
Tjaša Arčon, Matej Klemen, Marko Robnik-Šikonja +1
LLMs are routinely evaluated on language use, yet their explicit knowledge about linguistic structure remains poorly understood. Existing linguistic benchmarks focus on narrow phen…
Towards Corpus-Grounded Agentic LLMs for Multilingual Grammatical Analysis
Matej Klemen, Tjaša Arčon, Luka Terčon +2
Empirical grammar research has become increasingly data-driven, but the systematic analysis of annotated corpora still requires substantial methodological and technical effort. We…
Linguistic Characteristics of AI-Generated Text: A Survey
Luka Terčon, Kaja Dobrovoljc
Large language models (LLMs) are solidifying their position in the modern world as effective tools for the automatic generation of text. Their use is quickly becoming commonplace i…
Counting trees: A treebank-driven exploration of syntactic variation in speech and writing across languages
Kaja Dobrovoljc
This paper presents a novel treebank-driven approach to comparing syntactic structures in speech and writing using dependency-parsed corpora. Adopting a fully inductive, bottom-up…
Tracking Semantic Change in Slovene: A Novel Dataset and Optimal Transport-Based Distance
Marko Pranjić, Kaja Dobrovoljc, Senja Pollak +1
In this paper, we focus on the detection of semantic changes in Slovene, a less resourced Slavic language with two million speakers. Detecting and tracking semantic changes provide…