Verifier Errors in RLVR: Reward Hacking, Limits of Feedback, and Selective Control

Christian Moya, Elliott Thornley, Guang Lin

In reinforcement learning with verifiable rewards (RLVR), imperfect verifiers can reward incorrect responses, creating opportunities for reward hacking. Using gradient flow with a…