111 citations · 275 across the 9 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
cs.CV2022★ 6 cited
Decoupled Knowledge Distillation
Borui Zhao, Quan Cui, Renjie Song +2
State-of-the-art distillation methods are mainly based on distilling deep features from intermediate layers, while the significance of logit distillation is greatly overlooked. To…
cs.CV2022
Discriminability-Transferability Trade-Off: An Information-Theoretic Perspective
Quan Cui, Bingchen Zhao, Zhao-Min Chen +5
This work simultaneously considers the discriminability and transferability properties of deep representations in the typical supervised learning task, i.e., image classification.…