benchmark creation 1cross-lingual evaluation 1cultural alignment 1large language models 1multilingual question answering 1
From the 1 of 3 linked papers with an AI index.
Showing cs.CLShow all
2 papers · 1 filter
cs.CL2026
MSQA: A Natively Sourced Multilingual and Multicultural SimpleQA Benchmark
Xianru Chen, Yukai Huang, Mingxiang Chen +6
The paper introduces MSQA, a benchmark of over a thousand native questions in 11 languages designed to evaluate whether multilingual models also understand the cultures behind thos…
cs.CL2025
Inverse IFEval: Can LLMs Unlearn Stubborn Training Conventions to Follow Real Instructions?
Qinyan Zhang, Xinping Lei, Ruijie Miao +18
Large Language Models (LLMs) achieve strong performance on diverse tasks but often exhibit cognitive inertia, struggling to follow instructions that conflict with the standardized…