When Self-Consistency Hurts: The Hidden Cost of Majority Voting in Small Language Models

Wanrong Yang, Lingfang Li, Jun Zhang +1

We study prompted chain-of-thought (CoT) with self-consistency (SC), i.e. sampling N traces and plurality-voting, on small language models, a regime where per-query compute budgets…