Heterogeneous Judge-Aware Ranking with Sensitivity, Disagreement, and Confidence

Shibo Yu, Yingzhou Wang, Yan Chen +2

Pairwise comparisons from multiple judges are central to large language model evaluation and preference modeling, yet standard ranking pipelines often pool judgments into a single…