The Format is the Filter: Scoring Format Fixes What an LLM Judge Can Express

Lovedeep Gondara, Jekaterina Novikova, Sagarika Suresh +2

When an LLM judge filters instruction-tuning data, its scoring format (binary verdict, 1--5 rating, 0--100 score, or comparison) is rarely justified or ablated. Holding the candida…