LLM-as-a-Judge Version Shift: The Instrument Changed, Not the Standard

Guijia Zhang, Harry Yang

Automated research pipelines increasingly rely on fixed LLM judges to rank, filter, and revise proposals, yet these judges are routinely replaced by newer versions. We study whethe…