15 citations · 39 across the 11 of their papers we have counts for
6 papers · 1 filter
Towards More Effective and Economic Sparsely-Activated Model
Hao Jiang, Ke Zhan, Jianwei Qu +14
The sparsely-activated models have achieved great success in natural language processing through large-scale parameters and relatively low computational cost, and gradually become…
Towards Efficient NLP: A Standard Evaluation and A Strong Baseline
Xiangyang Liu, Tianxiang Sun, Junliang He +7
Supersized pre-trained language models have pushed the accuracy of various natural language processing (NLP) tasks to a new state-of-the-art (SOTA). Rather than pursuing the reachl…
YES SIR!Optimizing Semantic Space of Negatives with Self-Involvement Ranker
Ruizhi Pu, Xinyu Zhang, Ruofei Lai +7
Pre-trained model such as BERT has been proved to be an effective tool for dealing with Information Retrieval (IR) problems. Due to its inspiring performance, it has been widely us…
Pre-training for Ad-hoc Retrieval: Hyperlink is Also You Need
Zhengyi Ma, Zhicheng Dou, Wei Xu +4
Designing pre-training objectives that more closely resemble the downstream tasks for pre-trained language models can lead to better performance at the fine-tuning stage, especiall…
Early Exiting with Ensemble Internal Classifiers
Tianxiang Sun, Yunhua Zhou, Xiangyang Liu +5
As a simple technique to accelerate inference of large-scale pre-trained models, early exiting has gained much attention in the NLP community. It allows samples to exit early at in…
Emotion Eliciting Machine: Emotion Eliciting Conversation Generation based on Dual Generator
Hao Jiang, Yutao Zhu, Xinyu Zhang +4
Recent years have witnessed great progress on building emotional chatbots. Tremendous methods have been proposed for chatbots to generate responses with given emotions. However, th…