Multi-Rollout On-Policy Distillation via Peer Successes and Failures

Weichen Yu, Xiaomin Li, Yizhou Zhao +8

Large language models are often post-trained with sparse verifier rewards, which indicate whether a sampled trajectory succeeds but provide limited guidance about where reasoning s…