Token-Importance Guided Direct Preference Optimization

Ning Yang, Hai Lin, Yibo Liu +3

Aligning Large Language Models (LLMs) with human preferences is crucial for safe and effective AI interactions. While popular methods like Direct Preference Optimization (DPO) have…