113 citations · 1.1k across the 69 of their papers we have counts for
18 papers · 1 filter
Code Structure Guided Transformer for Source Code Summarization
Shuzheng Gao, Cuiyun Gao, Yulan He +4
Code summaries help developers comprehend programs and reduce their time to infer the program functionalities during software maintenance. Recent efforts resort to deep learning te…
BinaryBERT: Pushing the Limit of BERT Quantization
Haoli Bai, Wei Zhang, Lu Hou +6
The rapid development of large pre-trained language models has greatly increased the demand for model compression techniques, among which quantization is a popular solution. In thi…
Data Rejuvenation: Exploiting Inactive Training Examples for Neural Machine Translation
Wenxiang Jiao, Xing Wang, Shilin He +3
Large-scale training datasets lie at the core of the recent success of neural machine translation (NMT) models. However, the complex patterns and potential noises in the large-scal…
Multi-Task Learning with Shared Encoder for Non-Autoregressive Machine Translation
Yongchang Hao, Shilin He, Wenxiang Jiao +3
Non-Autoregressive machine Translation (NAT) models have demonstrated significant inference speedup but suffer from inferior translation accuracy. The common practice to tackle the…
Unsupervised Text Generation by Learning from Search
Jingjing Li, Zichao Li, Lili Mou +3
In this work, we present TGLS, a novel framework to unsupervised Text Generation by Learning from Search. We start by applying a strong search algorithm (in particular, simulated a…
Neuron Interaction Based Representation Composition for Neural Machine Translation
Jian Li, Xing Wang, Baosong Yang +3
Recent NLP studies reveal that substantial linguistic information can be attributed to single neurons, i.e., individual dimensions of the representation vectors. We hypothesize tha…