Who Sets the Pace of Judge Hacking? Judge Capability versus the Policy-Judge Gap

Haosen Wang

Under GRPO against a frozen, reference-free LLM judge, RL exploits the judge's false positives. Does the policy-judge capability gap or the judge itself set how fast and how far? W…