Consensus is Not Verification: Why Crowd Wisdom Strategies Fail for LLM Truthfulness

Yegor Denisov-Blanch, Joshua Kazdan, Jessica Chudnovsky +4

Pass@k and other methods of scaling inference compute can improve language model performance in domains with external verifiers, including mathematics and code, where incorrect can…