Wrong Votes, Right Gradients: Why Majority-Vote Rewards Track Verifiable RL

Dylan P. Wilson, Chengsong Huang, Jiaxin Huang

Reinforcement learning with self-generated labels, such as majority vote over a model's own samples, often recovers most of the gain of training with verifiable rewards. This is pu…