3 citations · 6 across the 2 of their papers we have counts for
1 paper · 1 filter
Xing Wu, Yibing Liu, Xiangyang Zhou +1
This paper studies compressing pre-trained language models, like BERT (Devlin et al.,2019), via teacher-student knowledge distillation. Previous works usually force the student mod…