72 citations · 209 across the 10 of their papers we have counts for
8 papers · 1 filter
IOT: Instance-wise Layer Reordering for Transformer Structures
Jinhua Zhu, Lijun Wu, Yingce Xia +5
With sequentially stacked self-attention, (optional) encoder-decoder attention, and feed-forward layers, Transformer achieves big success in natural language processing (NLP), and…
Multi-branch Attentive Transformer
Yang Fan, Shufang Xie, Yingce Xia +4
While the multi-branch architecture is one of the key ingredients to the success of computer vision tasks, it has not been well investigated in natural language processing, especia…
Microsoft Research Asia's Systems for WMT19
Yingce Xia, Xu Tan, Fei Tian +11
We Microsoft Research Asia made submissions to 11 language directions in the WMT19 news translation tasks. We won the first place for 8 of the 11 directions and the second place fo…
Efficient Bidirectional Neural Machine Translation
Xu Tan, Yingce Xia, Lijun Wu +1
The encoder-decoder based neural machine translation usually generates a target sequence token by token from left to right. Due to error propagation, the tokens in the right side o…
Multilingual Neural Machine Translation with Language Clustering
Xu Tan, Jiale Chen, Di He +3
Multilingual neural machine translation (NMT), which translates multiple languages using a single model, is of great practical importance due to its advantages in simplifying the t…
Depth Growing for Neural Machine Translation
Lijun Wu, Yiren Wang, Yingce Xia +5
While very deep neural networks have shown effectiveness for computer vision and text classification applications, how to increase the network depth of neural machine translation (…