A New Data Normalization Method to Improve Dialogue Generation by Minimizing Long Tail Effect

Zhiqiang Zhan, Zifeng Hou, Yang Zhang

Recent neural models have shown significant progress in dialogue generation. Most generation models are based on language models. However, due to the Long Tail Phenomenon in lingui…