1 citations · 1 across the 3 of their papers we have counts for
3 papers
cs.CV2022
Establishing a stronger baseline for lightweight contrastive models
Wenye Lin, Yifeng Ding, Zhixiong Cao +1
Recent research has reported a performance degradation in self-supervised contrastive learning for specially designed efficient networks, such as MobileNet and EfficientNet. A comm…
cs.NI2022
Tree-structured Auxiliary Online Knowledge Distillation
Wenye Lin, Yangning Li, Yifeng Ding +1
Traditional knowledge distillation adopts a two-stage training process in which a teacher model is pre-trained and then transfers the knowledge to a compact student model. To overc…
cs.LG2022★ 1 cited
Efficient Sub-structured Knowledge Distillation
Wenye Lin, Yangming Li, Lemao Liu +2
Structured prediction models aim at solving a type of problem where the output is a complex structure, rather than a single variable. Performing knowledge distillation for such mod…