most citedEnsemble Distillation for Neural Machine Translation

62 citations · 189 across the 5 of their papers we have counts for

collaborators

5 papers

cs.CL2017★ 5 cited

Attention-based Vocabulary Selection for NMT Decoding

Baskaran Sankaran, Markus Freitag, Yaser Al-Onaizan

Neural Machine Translation (NMT) models usually use large target vocabulary sizes to capture most of the words in the target language. The vocabulary size is a big factor when deco…

cs.CL2017★ 62 cited

Ensemble Distillation for Neural Machine Translation

Markus Freitag, Yaser Al-Onaizan, Baskaran Sankaran

Knowledge distillation describes a method for training a student network to perform better by learning from a stronger teacher network. Translating a sentence with an Neural Machin…

cs.CL2016★ 53 cited

Temporal Attention Model for Neural Machine Translation

Baskaran Sankaran, Haitao Mi, Yaser Al-Onaizan +1

Attention-based Neural Machine Translation (NMT) models suffer from attention deficiency issues as has been observed in recent research. We propose a novel mechanism to address som…

cs.CL2016★ 34 cited

Zero-Resource Translation with Multi-Lingual Neural Machine Translation

Orhan Firat, Baskaran Sankaran, Yaser Al-Onaizan +2

In this paper, we propose a novel finetuning algorithm for the recently introduced multi-way, mulitlingual neural machine translate that enables zero-resource machine translation.…

cs.CL2016★ 35 cited

Coverage Embedding Models for Neural Machine Translation

Haitao Mi, Baskaran Sankaran, Zhiguo Wang +1

In this paper, we enhance the attention-based neural machine translation (NMT) by adding explicit coverage embedding models to alleviate issues of repeating and dropping translatio…