Judging the Judges: Confidence and Disagreement in Rubrics as Rewards

Michael Tian-Yue Liu, Anne Harrington, Trevor Darrell +1

Rubrics as Rewards (RaR) extends reinforcement learning to non-verifiable domains by using an LLM judge to score responses against a structured rubric. Prior work has focused on im…