Reward Dropout Improves Control: Bi-objective Perspective on Reinforced LM

Changhun Lee, Chiehyeon Lim

We study the theoretical aspects of Reinforced Language Models (RLMs) from a bi-objective optimization perspective. Specifically, we consider the RLMs as a Pareto optimization prob…