3 papers
cs.CL2025
BOE-XSUM: Extreme Summarization in Clear Language of Spanish Legal Decrees and Notifications
Andrés Fernández GarcÃa, Javier de la Rosa, Julio Gonzalo +9
The ability to summarize long documents succinctly is increasingly important in daily life due to information overload, yet there is a notable lack of such summaries for Spanish do…
cs.CL2025
None of the Others: a General Technique to Distinguish Reasoning from Memorization in Multiple-Choice LLM Evaluation Benchmarks
Eva Sánchez Salido, Julio Gonzalo, Guillermo Marco
In LLM evaluations, reasoning is often distinguished from recall/memorization by performing numerical variations to math-oriented questions. Here we introduce a general variation m…
cs.CL2025
Bilingual Evaluation of Language Models on General Knowledge in University Entrance Exams with Minimal Contamination
Eva Sánchez Salido, Roser Morante, Julio Gonzalo +8
In this article we present UNED-ACCESS 2024, a bilingual dataset that consists of 1003 multiple-choice questions of university entrance level exams in Spanish and English. Question…