29 citations · 34 across the 8 of their papers we have counts for
1 paper · 1 filter
Taiqiang Wu, Cheng Hou, Shanshan Lao +4
Knowledge Distillation (KD) is a predominant approach for BERT compression. Previous KD-based methods focus on designing extra alignment losses for the student model to mimic the b…