SPARK: Learning from Verification in Speculative GRPO Rollouts

Nhat Minh Pham, Duy Tung Doan, Thi Duyen Ngo +3

Group Relative Policy Optimization (GRPO) has become a standard approach for improving the reasoning abilities of large language models, but its training is costly because each ste…