Transfer-Stratified On-Policy Distillation for RL-Improved Reasoning Teachers

Xiaoyu Chen, Bo Shao, Tiangang Zhu +5

Reinforcement learning can substantially improve a reasoning teacher, but it is unclear which of those improvements survive when the teacher supervises a smaller on-policy student.…