What Does Preference Learning Recover from Pairwise Comparison Data?

Rattana Pukdee, Maria-Florina Balcan, Pradeep Ravikumar

Pairwise preference learning is central to machine learning, with recent applications in aligning language models with human preferences. A typical dataset consists of triplets $(x…