62 citations · 117 across the 10 of their papers we have counts for
5 papers · 1 filter
Masked Generative Distillation
Zhendong Yang, Zhe Li, Mingqi Shao +3
Knowledge distillation has been applied to various tasks successfully. The current distillation algorithm usually improves students' performance by imitating the output of the teac…
Focal and Global Knowledge Distillation for Detectors
Zhendong Yang, Zhe Li, Xiaohu Jiang +4
Knowledge distillation has been applied to image classification successfully. However, object detection is much more sophisticated and most knowledge distillation methods have fail…
ConTNet: Why not use convolution and transformer at the same time?
Haotian Yan, Zhe Li, Weijian Li +3
Although convolutional networks (ConvNets) have enjoyed great success in computer vision (CV), it suffers from capturing global information crucial to dense prediction tasks such a…
Temporal Action Segmentation from Timestamp Supervision
Zhe Li, Yazan Abu Farha, Juergen Gall
Temporal action segmentation approaches have been very successful recently. However, annotating videos with frame-wise labels to train such models is very expensive and time consum…
Long Short-Term Sample Distillation
Liang Jiang, Zujie Wen, Zhongping Liang +7
In the past decade, there has been substantial progress at training increasingly deep neural networks. Recent advances within the teacher--student training paradigm have establishe…