Uni-DPO: A Unified Paradigm for Dynamic Preference Optimization of LLMs

Shangpin Peng, Weinong Wang, Zhuotao Tian +7

Direct Preference Optimization (DPO) has emerged as a cornerstone of reinforcement learning from human feedback (RLHF) due to its simplicity and efficiency. However, existing DPO-b…