Selective Knowledge Distillation for Neural Machine Translation

Fusheng Wang, Jianhao Yan, Fandong Meng +1

Neural Machine Translation (NMT) models achieve state-of-the-art performance on many translation benchmarks. As an active research field in NMT, knowledge distillation is widely ap…