Scaling Laws for Collapse in Asynchronous GRPO

Jingwei Song, Haofeng Xu, Jie Xiao +10

Asynchronous reinforcement learning improves the throughput of large language model post-training by decoupling rollout generation from policy optimization, but introduces a mismat…