activity
20212023
most citedHET: Scaling out Huge Embedding Model Training via Cache-enabled Distributed Framework

57 citations · 129 across the 8 of their papers we have counts for

collaborators
Showing cs.CVShow all

2 papers · 1 filter

cs.CV2023

Adaptive Multi-Teacher Knowledge Distillation with Meta-Learning

Hailin Zhang, Defang Chen, Can Wang

Multi-Teacher knowledge distillation provides students with additional supervision from multiple pre-trained teachers with diverse information sources. Most existing methods explor…

cs.CV2022★ 14 cited

Knowledge Distillation with the Reused Teacher Classifier

Defang Chen, Jian-Ping Mei, Hailin Zhang +3

Knowledge distillation aims to compress a powerful yet cumbersome teacher model into a lightweight student model without much sacrifice of performance. For this purpose, various ap…