Token-level Direct Preference Optimization

Yongcheng Zeng, Guoqing Liu, Weiyu Ma +3

Fine-tuning pre-trained Large Language Models (LLMs) is essential to align them with human values and intentions. This process often utilizes methods like pairwise comparisons and…