3 citations · 5 across the 18 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
cs.CV2022
Knowledge Distillation via the Target-aware Transformer
Sihao Lin, Hongwei Xie, Bing Wang +4
Knowledge distillation becomes a de facto standard to improve the performance of small neural networks. Most of the previous works propose to regress the representational features…
cs.CV2022★ 1 cited
Exploring Inter-Channel Correlation for Diversity-preserved KnowledgeDistillation
Li Liu, Qingle Huang, Sihao Lin +4
Knowledge Distillation has shown very promising abil-ity in transferring learned representation from the largermodel (teacher) to the smaller one (student).Despitemany efforts, pri…