3 citations · 8 across the 6 of their papers we have counts for
1 paper · 1 filter
Junzhuo Li, Xinwei Wu, Weilong Dong +3
Knowledge distillation (KD) has been widely used for model compression and knowledge transfer. Typically, a big teacher model trained on sufficient data transfers knowledge to a sm…