HiLoRe: What to Store, Compress, or Recompute for Efficient GRPO Training

Xinrui Chen, Mengyang Li, Ou Wu +1

Group-relative policy optimization (GRPO) makes learner-side activations a major memory-computation bottleneck: gradient checkpointing reduces activation memory through recomputati…