74 citations · 186 across the 49 of their papers we have counts for
5 papers · 1 filter
MixSKD: Self-Knowledge Distillation from Mixup for Image Recognition
Chuanguang Yang, Zhulin An, Helong Zhou +5
Unlike the conventional Knowledge Distillation (KD), Self-KD allows a network to learn knowledge from itself without any guidance from extra networks. This paper proposes to perfor…
Online Knowledge Distillation via Mutual Contrastive Learning for Visual Recognition
Chuanguang Yang, Zhulin An, Helong Zhou +3
The teacher-free online Knowledge Distillation (KD) aims to train an ensemble of multiple student models collaboratively and distill knowledge from each other. Although existing on…
Localizing Semantic Patches for Accelerating Image Classification
Chuanguang Yang, Zhulin An, Yongjun Xu
Existing works often focus on reducing the architecture redundancy for accelerating image classification but ignore the spatial redundancy of the input image. This paper proposes a…
Cross-Image Relational Knowledge Distillation for Semantic Segmentation
Chuanguang Yang, Helong Zhou, Zhulin An +3
Current Knowledge Distillation (KD) methods for semantic segmentation often guide the student to mimic the teacher's structured information generated from individual data samples.…
Lifelong Generative Learning via Knowledge Reconstruction
Libo Huang, Zhulin An, Xiang Zhi +1
Generative models often incur the catastrophic forgetting problem when they are used to sequentially learning multiple tasks, i.e., lifelong generative learning. Although there are…