Private Direct Preference Optimization for LLM Alignment

Yangfan Jiang, Fei Wei, Ergute Bao +3

Direct preference optimization (DPO) is now a standard method for aligning large language models (LLMs) using human preference data. Each DPO example contains a prompt and a pair o…