Pairwise Reference Alignment as a Model-Level Ordinal Observable

Mujing Li

Pairwise preference data is widely used in language-model evaluation and alignment, often for model ranking, reward modeling, or preference optimization. This note formulates a mor…