Human-Anchored Inference for Ranking New Models with Large Language Model Judges

Xin Zhou, Sinian Zhang, Zhanyan Yang +3

Human pairwise comparisons provide a reference for evaluating large language models (LLMs), but collecting sufficient judgments for each new release is costly and time-consuming. L…