8 citations · 16 across the 6 of their papers we have counts for
1 paper · 1 filter
Qizhen Lan, Qing Tian
In recent years, knowledge distillation (KD) has been widely used to derive efficient models. Through imitating a large teacher model, a lightweight student model can achieve compa…