19 citations · 42 across the 13 of their papers we have counts for
3 papers · 1 filter
ALP-KD: Attention-Based Layer Projection for Knowledge Distillation
Peyman Passban, Yimeng Wu, Mehdi Rezagholizadeh +1
Knowledge distillation is considered as a training and compression strategy in which two neural networks, namely a teacher and a student, are coupled together during training. The…
Revisiting Robust Neural Machine Translation: A Transformer Case Study
Peyman Passban, Puneeth S. M. Saladi, Qun Liu
Transformers (Vaswani et al., 2017) have brought a remarkable improvement in the performance of neural machine translation (NMT) systems but they could be surprisingly vulnerable t…
Document Graph for Neural Machine Translation
Mingzhou Xu, Liangyou Li, Derek. F. Wong +2
Previous works have shown that contextual information can improve the performance of neural machine translation (NMT). However, most existing document-level NMT methods only consid…