Teacher Forcing Recovers Reward Functions for Text Generation

Yongchang Hao, Yuxin Liu, Lili Mou

Reinforcement learning (RL) has been widely used in text generation to alleviate the exposure bias issue or to utilize non-parallel datasets. The reward function plays an important…