Showing 2026 · cs.CLShow all
3 papers · 2 filters
cs.CL2026
Every Wrong Answer Counts: Option-Level Psychometrics for LLM Multiple-Choice Benchmarks
Xiao Fei, Yang Zhang, Sarah Almeida Carneiro +1
Most multiple-choice question (MCQ) benchmarks evaluate Large Language Models (LLMs) only by whether they select the correct answers. This binary scoring treats all incorrect respo…
cs.CL2026
The Masked Advantage: Uncovering Local-Language Access to Cultural Knowledge in LLMs
Yang Zhang, Xiao Fei, Amr Mohamed +6
Large language models are increasingly used to answer culturally grounded questions across languages, yet it remains unclear whether local cultural knowledge is better accessed thr…
cs.CL2026
CARTE: A Benchmark for Mapping Language Model Knowledge Across France
Sarah Almeida Carneiro, Christos Xypolopoulos, Xiao Fei +2
We introduce CARTE 1 (Culturally Anchored Regional-Territorial Evaluation), a multiplechoice benchmark for evaluating the ability of large language models (LLMs) to perform fine-gr…