82 citations · 250 across the 20 of their papers we have counts for
4 papers · 1 filter
Acquiring Knowledge from Pre-trained Model to Neural Machine Translation
Rongxiang Weng, Heng Yu, Shujian Huang +2
Pre-training and fine-tuning have achieved great success in the natural language process field. The standard paradigm of exploiting them includes two steps: first, pre-training a m…
Contrastive Attention Mechanism for Abstractive Sentence Summarization
Xiangyu Duan, Hoongfei Yu, Mingming Yin +3
We propose a contrastive attention mechanism to extend the sequence-to-sequence framework for abstractive sentence summarization task, which aims to generate a brief summary of a g…
Improving Neural Machine Translation with Pre-trained Representation
Rongxiang Weng, Heng Yu, Shujian Huang +2
Monolingual data has been demonstrated to be helpful in improving the translation quality of neural machine translation (NMT). The current methods stay at the usage of word-level k…
Code-Switching for Enhancing NMT with Pre-Specified Translation
Kai Song, Yue Zhang, Heng Yu +3
Leveraging user-provided translation to constrain NMT has practical significance. Existing methods can be classified into two main categories, namely the use of placeholder tags fo…