Advantage Collapse in Group Relative Policy Optimization: Diagnosis and Mitigation

Xixiang He, Qiyao Sun, Ao Cheng +5

Group Relative Policy Optimization (GRPO), a prominent algorithm within the Reinforcement Learning from Verifiable Rewards (RLVR) framework, has achieved strong results in improvin…