24 citations · 66 across the 8 of their papers we have counts for
9 papers
Contrastive Language-Image Pre-Training with Knowledge Graphs
Xuran Pan, Tianzhu Ye, Dongchen Han +2
Recent years have witnessed the fast development of large-scale pre-training frameworks that can extract multi-modal representations in a unified form and achieve promising perform…
Efficient Knowledge Distillation from Model Checkpoints
Chaofei Wang, Qisen Yang, Rui Huang +2
Knowledge distillation is an effective approach to learn compact models (students) with the supervision of large and strong models (teachers). As empirically there exists a strong…
Latency-aware Spatial-wise Dynamic Networks
Yizeng Han, Zhihang Yuan, Yifan Pu +4
Spatial-wise dynamic convolution has become a promising approach to improving the inference efficiency of deep networks. By allocating more computation to the most informative pixe…
AdaFocusV3: On Unified Spatial-temporal Dynamic Video Recognition
Yulin Wang, Yang Yue, Xinhong Xu +6
Recent research has revealed that reducing the temporal and spatial redundancy are both effective approaches towards efficient video recognition, e.g., allocating the majority of c…
Learning to Weight Samples for Dynamic Early-exiting Networks
Yizeng Han, Yifan Pu, Zihang Lai +6
Early exiting is an effective paradigm for improving the inference efficiency of deep networks. By constructing classifiers with varying resource demands (the exits), such networks…
Learn From the Past: Experience Ensemble Knowledge Distillation
Chaofei Wang, Shaowei Zhang, Shiji Song +1
Traditional knowledge distillation transfers "dark knowledge" of a pre-trained teacher network to a student network, and ignores the knowledge in the training process of the teache…