3 papers
cs.CL2025
It's the same but not the same: Do LLMs distinguish Spanish varieties?
Marina Mayor-Rocher, Cristina Pozo, Nina Melero +3
In recent years, large language models (LLMs) have demonstrated a high capacity for understanding and generating text in Spanish. However, with five hundred million native speakers…
cs.CL2024
Evaluating Large Language Models with Tests of Spanish as a Foreign Language: Pass or Fail?
Marina Mayor-Rocher, Nina Melero, Elena Merino-Gómez +3
Large Language Models (LLMs) have been profusely evaluated on their ability to answer questions on many topics and their performance on different natural language understanding tas…
cs.CL2024
Spanish and LLM Benchmarks: is MMLU Lost in Translation?
Irene Plaza, Nina Melero, Cristina del Pozo +4
The evaluation of Large Language Models (LLMs) is a key element in their continuous improvement process and many benchmarks have been developed to assess the performance of LLMs in…