Beyond Correctness: Validity-Oriented Evaluation of Biomedical LLM Judges

Rodrigo de Oliveira, Federico Pittino, James Gwinnutt +1

We propose a scalable, validity-oriented pipeline for evaluating biomedical LLM judges when high-quality human judgments are scarce. First, we augment existing human-labelled biome…