Grounded but Not Immune: Confirmation Bias in Agent-as-a-judge

Drake Benjamin Brown, Khushbu Pahwa, Yubin Ge +5

Evaluating open-ended agent tasks increasingly falls to an Agent-as-a-Judge: an evaluator handed tools and the agent's full trajectory so it can verify a result against the environ…