17 citations · 47 across the 22 of their papers we have counts for
32 papers · 1 filter
Form and Meaning in Intrinsic Multilingual Evaluations
Wessel Poelman, Miryam de Lhoneux
Intrinsic evaluation metrics for conditional language models, such as perplexity or bits-per-character, are widely used in both mono- and multilingual settings. These metrics are r…
On the Interplay between Positional Encodings, Morphological Complexity, and Word Order Flexibility
Kushal Tatariya, Wessel Poelman, Miryam de Lhoneux
Language model architectures are predominantly first created for English and subsequently applied to other languages. It is an open question whether this architectural bias leads t…
Confounding Factors in Relating Model Performance to Morphology
Wessel Poelman, Thomas Bauwens, Miryam de Lhoneux
The extent to which individual language characteristics influence tokenization and language modeling is an open question. Differences in morphological systems have been suggested a…
The Roles of English in Evaluating Multilingual Language Models
Wessel Poelman, Miryam de Lhoneux
Multilingual natural language processing is getting increased attention, with numerous models, benchmarks, and methods being released for many languages. English is often used in m…
How Good is Your Wikipedia? Auditing Data Quality for Low-resource and Multilingual NLP
Kushal Tatariya, Artur Kulmizev, Wessel Poelman +6
Wikipedia's perceived high quality and broad language coverage have established it as a fundamental resource in NLP. However, in recent years, such assumptions of high quality have…
Pixology: Probing the Linguistic and Visual Capabilities of Pixel-based Language Models
Kushal Tatariya, Vladimir Araujo, Thomas Bauwens +1
Pixel-based language models have emerged as a compelling alternative to subword-based language modelling, particularly because they can represent virtually any script. PIXEL, a can…