Reflective Preference Optimization (RPO): Enhancing On-Policy Alignment via Hint-Guided Reflection

Zihui Zhao, Zechang Li

Direct Preference Optimization (DPO) has emerged as a lightweight and effective alternative to Reinforcement Learning from Human Feedback (RLHF) and Reinforcement Learning with AI…