Mult-DPO: Multinomial Direct Preference Optimization for Recommender Systems

Yaochen Zhu, Harald Steck, James McInerney +4

Direct preference optimization (DPO) is a simple and effective alignment strategy for large language models (LLMs) based on pairwise preferences. In recommender systems, however, u…