3 citations · 3 across the 1 of their papers we have counts for
2 papers
cs.LG2021★ 3 cited
Revisiting Knowledge Distillation: An Inheritance and Exploration Framework
Zhen Huang, Xu Shen, Jun Xing +6
Knowledge Distillation (KD) is a popular technique to transfer knowledge from a teacher model or ensemble to a student model. Its success is generally attributed to the privileged…
cs.CV2019
Quantization Networks
Jiwei Yang, Xu Shen, Jun Xing +5
Although deep neural networks are highly effective, their high computational and memory costs severely challenge their applications on portable devices. As a consequence, low-bit q…