New Desiderata for Direct Preference Optimization

Xiangkun Hu, Tong He, David Wipf

Large language models in the past have typically relied on some form of reinforcement learning with human feedback (RLHF) to better align model responses with human preferences. Ho…