Mitigating the Length-Scaling Tax with Online Distillation

Xu Wan, Wenyue Xu, Shengjie Zhao +1

Length scaling during reinforcement-learning (RL) post-training is often viewed as a sign of improved reasoning ability, especially on difficult problems, but may also make respons…