COPC: Coupled Off-Policy Correction for Asynchronous LLM Reinforcement Learning

Zicheng Hu, Zhijian Zhou, Xuan Zhang +7

Asynchronous RL accelerates large language model post-training by decoupling rollout generation from optimization, but trains on stale trajectories. Existing methods primarily corr…