2 papers
cs.SE2026
When Elo Lies: Hidden Biases in Codeforces-Based Evaluation of Large Language Models
Shenyu Zheng, Ximing Dong, Xiaoshuang Liu +6
As Large Language Models (LLMs) achieve breakthroughs in complex reasoning, Codeforces-based Elo ratings have emerged as a prominent metric for evaluating competitive programming c…
cs.SE2025
Humanity's Last Code Exam: Can Advanced LLMs Conquer Human's Hardest Code Competition?
Xiangyang Li, Xiaopeng Li, Kuicai Dong +7
Code generation is a core capability of large language models (LLMs), yet mainstream benchmarks (e.g., APPs and LiveCodeBench) contain questions with medium-level difficulty and po…