Model Extrapolation Expedites Alignment

Chujie Zheng, Ziqi Wang, Heng Ji +2

Given the high computational cost of preference alignment training of large language models (LLMs), exploring efficient methods to reduce the training overhead remains an important…