Plug-and-Play Training Framework for Preference Optimization

Jingyuan Ma, Rui Li, Zheng Li +2

Recently, preference optimization methods such as DPO have significantly enhanced large language models (LLMs) in wide tasks including dialogue and question-answering. However, cur…