CoDistill-GRPO: A Co-Distillation Recipe for Efficient Group Relative Policy Optimization

Soo Min Kwon, Ziteng Sun, Ananda Theertha Suresh +2

Group Relative Policy Optimization (GRPO) has emerged as a powerful algorithm for improving the reasoning capabilities of language models, but often fails to improve small models d…