Self-Improving Robust Preference Optimization

Eugene Choi, Arash Ahmadian, Matthieu Geist +2

Online and offline RLHF methods, such as PPO and DPO, have been highly successful in aligning AI with human preferences. Despite their success, however, these methods suffer from f…