most citedDictBERT: Dictionary Description Knowledge Enhanced Language Model Pre-training via Contrastive Learning

7 citations · 9 across the 5 of their papers we have counts for

collaborators

5 papers

cs.CL20232 cited

Distinguish Before Answer: Generating Contrastive Explanation as Knowledge for Commonsense Question Answering

Qianglong Chen, Guohai Xu, Ming Yan +4

Existing knowledge-enhanced methods have achieved remarkable results in certain QA tasks via obtaining diverse knowledge from different knowledge bases. However, limited by the pro…

cs.CL2023

AMTSS: An Adaptive Multi-Teacher Single-Student Knowledge Distillation Framework For Multilingual Language Inference

Qianglong Chen, Feng Ji, Feng-Lin Li +4

Knowledge distillation is of key importance to launching multilingual pre-trained language models for real applications. To support cost-effective language inference in multilingua…

cs.LG2023

Task Difficulty Aware Parameter Allocation & Regularization for Lifelong Learning

Wenjin Wang, Yunqing Hu, Qianglong Chen +1

Parameter regularization or allocation methods are effective in overcoming catastrophic forgetting in lifelong learning. However, they solve all tasks in a sequence uniformly and i…

cs.CL20227 cited

DictBERT: Dictionary Description Knowledge Enhanced Language Model Pre-training via Contrastive Learning

Qianglong Chen, Feng-Lin Li, Guohai Xu +3

Although pre-trained language models (PLMs) have achieved state-of-the-art performance on various natural language processing (NLP) tasks, they are shown to be lacking in knowledge…

cs.CL2022

Rethinking the Value of Gazetteer in Chinese Named Entity Recognition

Qianglong Chen, Xiangji Zeng, Jiangang Zhu +4

Gazetteer is widely used in Chinese named entity recognition (NER) to enhance span boundary detection and type classification. However, to further understand the generalizability a…