Carrot and Stick: Eliciting Comparison Data and Beyond

Yiling Chen, Shi Feng, Fang-Yi Yu

Comparison data elicited from people are fundamental to many machine learning tasks, including reinforcement learning from human feedback for large language models and estimating r…