Resolution Diagnostics for Paired LLM Evaluation

Anany Kotawala

Across two public LLM leaderboards, many displayed pairwise rankings do not meet a conventional paired-test resolution target under the actual paired evaluation design: 11 of 40 Op…