Improving Reasoning Ability via Asynchronous On-Policy Self-Distillation under Positive Rollouts

Mingwei Xu, Hao Fang

Distillation and reinforcement learning through verifiable rewards (RLVR) have achieved progress in enhancing the reasoning ability of large language models (LLMs). However, we not…