Save Your Saturated Data: Learning Beyond Reward Saturation in Group-Based RL

Ziyuan Yang, Yike Wang, Shangbin Feng +1

Group-relative reinforcement learning (RL) relies on reward variation among sampled responses to estimate informative relative advantages. As language models become increasingly ca…