5 citations · 9 across the 24 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.LG2023
Low-redundancy Distillation for Continual Learning
RuiQi Liu, Boyu Diao, Libo Huang +4
Continual learning (CL) aims to learn new tasks without erasing previous knowledge. However, current CL methods primarily emphasize improving accuracy while often neglecting traini…
cs.CV2023★ 2 cited
CLIP-KD: An Empirical Study of CLIP Model Distillation
Chuanguang Yang, Zhulin An, Libo Huang +5
Contrastive Language-Image Pre-training (CLIP) has become a promising language-supervised visual pre-training framework. This paper aims to distill small CLIP models supervised by…