15 citations · 44 across the 25 of their papers we have counts for
Showing 2020Show all
2 papers · 1 filter
cs.CL2020★ 3 cited
Distilling Knowledge from Pre-trained Language Models via Text Smoothing
Xing Wu, Yibing Liu, Xiangyang Zhou +1
This paper studies compressing pre-trained language models, like BERT (Devlin et al.,2019), via teacher-student knowledge distillation. Previous works usually force the student mod…
cs.CL2020★ 3 cited
Data Augmentation for Copy-Mechanism in Dialogue State Tracking
Xiaohui Song, Liangjun Zang, Yipeng Su +3
While several state-of-the-art approaches to dialogue state tracking (DST) have shown promising performances on several benchmarks, there is still a significant performance gap bet…