benchmark creation 1cross-lingual evaluation 1cultural alignment 1large language models 1multilingual question answering 1
From the 1 of 3 linked papers with an AI index.
3 papers
cs.AI2026
Harness-IF: Evaluating Instruction Following Across Instruction Surfaces in Coding Agents
Zining Huang, Haoran Que, Hong Zeng +8
When a coding agent obeys a rule, it may simply have been going to do that anyway. Existing instruction-following benchmarks cannot tell the difference: they concentrate rules in t…
cs.CL2026
MSQA: A Natively Sourced Multilingual and Multicultural SimpleQA Benchmark
Xianru Chen, Yukai Huang, Mingxiang Chen +6
The paper introduces MSQA, a benchmark of over a thousand native questions in 11 languages designed to evaluate whether multilingual models also understand the cultures behind thos…
cs.CL2025
Inverse IFEval: Can LLMs Unlearn Stubborn Training Conventions to Follow Real Instructions?
Qinyan Zhang, Xinping Lei, Ruijie Miao +18
Large Language Models (LLMs) achieve strong performance on diverse tasks but often exhibit cognitive inertia, struggling to follow instructions that conflict with the standardized…