151 citations · 157 across the 7 of their papers we have counts for
Showing 2021Show all
3 papers · 1 filter
cs.CL2021★ 151 cited
A Survey of Natural Language Generation
Chenhe Dong, Yinghui Li, Haifan Gong +4
This paper offers a comprehensive review of the research on Natural Language Generation (NLG) over the past two decades, especially in relation to data-to-text generation and text-…
cs.CL2021
HRKD: Hierarchical Relational Knowledge Distillation for Cross-domain Language Model Compression
Chenhe Dong, Yaliang Li, Ying Shen +1
On many natural language processing tasks, large pre-trained language models (PLMs) have shown overwhelming performances compared with traditional neural network methods. Neverthel…
cs.CL2021
EfficientBERT: Progressively Searching Multilayer Perceptron via Warm-up Knowledge Distillation
Chenhe Dong, Guangrun Wang, Hang Xu +3
Pre-trained language models have shown remarkable results on various NLP tasks. Nevertheless, due to their bulky size and slow inference speed, it is hard to deploy them on edge de…