OSCAR: Order-aware Sensitivity Correction for AI Rankings

You Liu, Yue Liu, Quanchao Lu +2

LLM judges evaluate candidate language models through pairwise comparisons of their responses. Judge-aware Bradley--Terry models aggregate pairwise comparisons by jointly estimatin…