Leveraging Machine Unlearning for Cost-Efficient Preference Alignment

Xiaohua Feng, Yuyuan Li, Huwei Ji +4

Despite advances in Preference Alignment (PA) for Large Language Models (LLMs), mainstream methods like reinforcement learning with human feedback face notable challenges. These ap…