9 citations · 11 across the 12 of their papers we have counts for
13 papers
Seeing the Unseen: Visual Similarity for Pixel Language Model Adaptation
Ran Zhang, Miryam de Lhoneux, Wessel Poelman
Pixel-based language models (LMs) replace traditional tokenizers by processing rendered images of text, making cross-lingual transfer heavily dependent on the visual and structural…
QQ: A Language Metadata Toolkit for Multilingual NLP
Wessel Poelman, Yiyi Chen, Miryam de Lhoneux
Multilingual NLP research increasingly involves hundreds or thousands of languages across different datasets. Managing, discovering, and reporting language metadata becomes a commo…
Typologically Informed Parameter Aggregation
Stef Accou, Wessel Poelman
Massively multilingual language models enable cross-lingual generalization but underperform on low-resource and unseen languages. While adapter-based fine-tuning offers a parameter…
Form and Meaning in Intrinsic Multilingual Evaluations
Wessel Poelman, Miryam de Lhoneux
Intrinsic evaluation metrics for conditional language models, such as perplexity or bits-per-character, are widely used in both mono- and multilingual settings. These metrics are r…
On the Interplay between Positional Encodings, Morphological Complexity, and Word Order Flexibility
Kushal Tatariya, Wessel Poelman, Miryam de Lhoneux
Language model architectures are predominantly first created for English and subsequently applied to other languages. It is an open question whether this architectural bias leads t…
Confounding Factors in Relating Model Performance to Morphology
Wessel Poelman, Thomas Bauwens, Miryam de Lhoneux
The extent to which individual language characteristics influence tokenization and language modeling is an open question. Differences in morphological systems have been suggested a…
Type and Complexity Signals in Multilingual Question Representations
Robin Kokot, Wessel Poelman
This work investigates how a multilingual transformer model represents morphosyntactic properties of questions. We introduce the Question Type and Complexity (QTC) dataset with sen…
The Roles of English in Evaluating Multilingual Language Models
Wessel Poelman, Miryam de Lhoneux
Multilingual natural language processing is getting increased attention, with numerous models, benchmarks, and methods being released for many languages. English is often used in m…
How Good is Your Wikipedia? Auditing Data Quality for Low-resource and Multilingual NLP
Kushal Tatariya, Artur Kulmizev, Wessel Poelman +6
Wikipedia's perceived high quality and broad language coverage have established it as a fundamental resource in NLP. However, in recent years, such assumptions of high quality have…
A Principled Framework for Evaluating on Typologically Diverse Languages
Esther Ploeger, Wessel Poelman, Andreas Holck Høeg-Petersen +3
Beyond individual languages, multilingual natural language processing (NLP) research increasingly aims to develop models that perform well across languages generally. However, eval…
Engineering Conversational Search Systems: A Review of Applications, Architectures, and Functional Components
Phillip Schneider, Wessel Poelman, Michael Rovatsos +1
Conversational search systems enable information retrieval via natural language interactions, with the goal of maximizing users' information gain over multiple dialogue turns. The…
What is "Typological Diversity" in NLP?
Esther Ploeger, Wessel Poelman, Miryam de Lhoneux +1
The NLP research community has devoted increased attention to languages beyond English, resulting in considerable improvements for multilingual NLP. However, these improvements onl…
Detecting ChatGPT: A Survey of the State of Detecting ChatGPT-Generated Text
Mahdi Dhaini, Wessel Poelman, Ege Erdogan
While recent advancements in the capabilities and widespread accessibility of generative language models, such as ChatGPT (OpenAI, 2022), have brought about various benefits by gen…