Language-Independent Representations Improve Zero-Shot Summarization

Vladimir Solovyev, Danni Liu, Jan Niehues

Finetuning pretrained models on downstream generation tasks often leads to catastrophic forgetting in zero-shot conditions. In this work, we focus on summarization and tackle the p…