9 citations · 25 across the 21 of their papers we have counts for
4 papers · 1 filter
CLIP-KD: An Empirical Study of CLIP Model Distillation
Chuanguang Yang, Zhulin An, Libo Huang +5
Contrastive Language-Image Pre-training (CLIP) has become a promising language-supervised visual pre-training framework. This paper aims to distill small CLIP models supervised by…
Categories of Response-Based, Feature-Based, and Relation-Based Knowledge Distillation
Chuanguang Yang, Xinqiang Yu, Zhulin An +1
Deep neural networks have achieved remarkable performance for artificial intelligence tasks. The success behind intelligent systems often relies on large-scale models with high com…
Modeling Dual Period-Varying Preferences for Takeaway Recommendation
Yuting Zhang, Yiqing Wu, Ran Le +7
Takeaway recommender systems, which aim to accurately provide stores that offer foods meeting users' interests, have served billions of users in our daily life. Different from trad…
eTag: Class-Incremental Learning with Embedding Distillation and Task-Oriented Generation
Libo Huang, Yan Zeng, Chuanguang Yang +3
Class-Incremental Learning (CIL) aims to solve the neural networks' catastrophic forgetting problem, which refers to the fact that once the network updates on a new task, its perfo…