7 citations · 7 across the 2 of their papers we have counts for
2 papers
cs.CL2023
AMTSS: An Adaptive Multi-Teacher Single-Student Knowledge Distillation Framework For Multilingual Language Inference
Qianglong Chen, Feng Ji, Feng-Lin Li +4
Knowledge distillation is of key importance to launching multilingual pre-trained language models for real applications. To support cost-effective language inference in multilingua…
cs.CL2022★ 7 cited
DictBERT: Dictionary Description Knowledge Enhanced Language Model Pre-training via Contrastive Learning
Qianglong Chen, Feng-Lin Li, Guohai Xu +3
Although pre-trained language models (PLMs) have achieved state-of-the-art performance on various natural language processing (NLP) tasks, they are shown to be lacking in knowledge…