Mutual-Taught for Co-adapting Policy and Reward Models

Tianyuan Shi, Canbin Huang, Fanqi Wan +5

During the preference optimization of large language models (LLMs), distribution shifts may arise between newly generated model samples and the data used to train the reward model…