Scaling Laws for Generative Reward Models

Angel Raychev, Nathan Lile, Rafael Rafailov

We study generative reward models (GenRMs) as online preference providers for policy optimization in creative writing. Across Qwen3 reward-model sizes from 0.6B to 14B, Thinking ju…