Are Dense Rewards Worth Their Tokens in GRPO?

Vikash Singh, Weicong Chen, Debargha Ganguly +16

RLVR trains language models to reason by rewarding correct final answers. A widely used algorithm, group-relative policy optimization (GRPO), gives every token of a solution the sa…