3 papers
cs.LG2024
Exploring Dark Knowledge under Various Teacher Capacities and Addressing Capacity Mismatch
Wen-Shu Fan, Xin-Chun Li, De-Chuan Zhan
Knowledge Distillation (KD) could transfer the ``dark knowledge" of a well-performed yet large neural network to a weaker but lightweight one. From the view of output logits and so…
cs.LG2023
Twice Class Bias Correction for Imbalanced Semi-Supervised Learning
Lan Li, Bowen Tao, Lu Han +2
Differing from traditional semi-supervised learning, class-imbalanced semi-supervised learning presents two distinct challenges: (1) The imbalanced distribution of training samples…
cs.CV2023
CLAF: Contrastive Learning with Augmented Features for Imbalanced Semi-Supervised Learning
Bowen Tao, Lan Li, Xin-Chun Li +1
Due to the advantages of leveraging unlabeled data and learning meaningful representations, semi-supervised learning and contrastive learning have been progressively combined to ac…