Does CoT-Pass@k Really Check the CoT? A Multilingual Mathematical Audit

Tarık Tuna Taşaltı, Burcu Hüdaverdi, David Semedo

Pass@k measures whether a model reaches a correct answer under repeated sampling, but never how: a lucky guess counts the same as sound reasoning. CoT-Pass@k was proposed to close…