Preference learning made easy: Everything should be understood through win rate

Lily H. Zhang, Rajesh Ranganath

Preference learning, or the task of aligning generative models to preference comparison data, has yet to reach the conceptual maturity of classification, density estimation, etc. T…