Selective Knowledge Distillation for Non-Autoregressive Neural Machine Translation

Min Liu, Yu Bao, Chengqi Zhao +1

Benefiting from the sequence-level knowledge distillation, the Non-Autoregressive Transformer (NAT) achieves great success in neural machine translation tasks. However, existing kn…