1 citations · 1 across the 4 of their papers we have counts for
5 papers
STRUCTURALCOST: A controlled reading time dataset for modeling human sentence processing difficulty
Nina Nusbaumer, Iria de-Dios-Flores, Corentin Bel +3
We introduce STRUCTURALCOST, a self-paced reading dataset of 475 participants and 40,800 observations isolating the processing cost of long-distance subject-verb dependency resolut…
The Grammar of Transformers: A Systematic Review of Interpretability Research on Syntactic Knowledge in Language Models
Nora Graichen, Iria de-Dios-Flores, Gemma Boleda
We present a systematic review of 337 articles evaluating the syntactic abilities of Transformer-based language models (TLMs), reporting on over 3,000 datapoints spanning a wide ra…
Tracing the complexity profiles of different linguistic phenomena through the intrinsic dimension of LLM representations
Marco Baroni, Emily Cheng, Iria de-Dios-Flores +1
We explore intrinsic dimension (ID) of LLM representations as a marker of linguistic complexity. Specifically, we test whether ID differences across model layers reflect well-known…
Truth Knows No Language: Evaluating Truthfulness Beyond English
Blanca Calvo Figueras, Eneko Sagarzazu, Julen Etxaniz +4
We introduce a professionally translated extension of the TruthfulQA benchmark designed to evaluate truthfulness in Basque, Catalan, Galician, and Spanish. Truthfulness evaluations…
Open Generative Large Language Models for Galician
Pablo Gamallo, Pablo Rodríguez, Iria de-Dios-Flores +5
Large language models (LLMs) have transformed natural language processing. Yet, their predominantly English-centric training has led to biases and performance disparities across la…