6 citations · 25 across the 11 of their papers we have counts for
Showing 2020Show all
2 papers · 1 filter
cs.CL2020
Rethinking Document-level Neural Machine Translation
Zewei Sun, Mingxuan Wang, Hao Zhou +4
This paper does not aim at introducing a novel model for document-level neural machine translation. Instead, we head back to the original Transformer model and hope to answer the f…
cs.CL2020★ 6 cited
Alleviating the Inequality of Attention Heads for Neural Machine Translation
Zewei Sun, Shujian Huang, Xin-Yu Dai +1
Recent studies show that the attention heads in Transformer are not equal. We relate this phenomenon to the imbalance training of multi-head attention and the model dependence on s…