30 citations · 63 across the 10 of their papers we have counts for
3 papers · 1 filter
MixSKD: Self-Knowledge Distillation from Mixup for Image Recognition
Chuanguang Yang, Zhulin An, Helong Zhou +5
Unlike the conventional Knowledge Distillation (KD), Self-KD allows a network to learn knowledge from itself without any guidance from extra networks. This paper proposes to perfor…
Online Knowledge Distillation via Mutual Contrastive Learning for Visual Recognition
Chuanguang Yang, Zhulin An, Helong Zhou +3
The teacher-free online Knowledge Distillation (KD) aims to train an ensemble of multiple student models collaboratively and distill knowledge from each other. Although existing on…
Contrastive Siamese Network for Semi-supervised Speech Recognition
Soheil Khorram, Jaeyoung Kim, Anshuman Tripathi +3
This paper introduces contrastive siamese (c-siam) network, an architecture for leveraging unlabeled acoustic data in speech recognition. c-siam is the first network that extracts…