60 citations · 112 across the 8 of their papers we have counts for
5 papers · 1 filter
AMTSS: An Adaptive Multi-Teacher Single-Student Knowledge Distillation Framework For Multilingual Language Inference
Qianglong Chen, Feng Ji, Feng-Lin Li +4
Knowledge distillation is of key importance to launching multilingual pre-trained language models for real applications. To support cost-effective language inference in multilingua…
DictBERT: Dictionary Description Knowledge Enhanced Language Model Pre-training via Contrastive Learning
Qianglong Chen, Feng-Lin Li, Guohai Xu +3
Although pre-trained language models (PLMs) have achieved state-of-the-art performance on various natural language processing (NLP) tasks, they are shown to be lacking in knowledge…
REPT: Bridging Language Models and Machine Reading Comprehension via Retrieval-Based Pre-training
Fangkai Jiao, Yangyang Guo, Yilin Niu +3
Pre-trained Language Models (PLMs) have achieved great success on Machine Reading Comprehension (MRC) over the past few years. Although the general language representation learned…
Predict-then-Decide: A Predictive Approach for Wait or Answer Task in Dialogue Systems
Zehao Lin, Shaobo Cui, Guodun Li +6
Different people have different habits of describing their intents in conversations. Some people tend to deliberate their intents in several successive utterances, i.e., they use s…
AliMe Assist: An Intelligent Assistant for Creating an Innovative E-commerce Experience
Feng-Lin Li, Minghui Qiu, Haiqing Chen +9
We present AliMe Assist, an intelligent assistant designed for creating an innovative online shopping experience in E-commerce. Based on question answering (QA), AliMe Assist offer…