SIPO: Unifying Reinforcement Learning with On-Policy Self-Distillation

Zhenrui Yue, Huimin Zeng, Yueqi Wang +8

Reinforcement learning with verifiable rewards (RLVR) has become a standard paradigm for improving large language models (LLMs) on various tasks, yet its sparse outcome rewards lac…