SPEC-RL: Accelerating On-Policy Reinforcement Learning with Speculative Rollouts

Bingshuai Liu, Ante Wang, Zijun Min +7

Large Language Models (LLMs) increasingly rely on reinforcement learning with verifiable rewards (RLVR) to elicit reliable chain-of-thought reasoning. However, the training process…