4 citations · 4 across the 1 of their papers we have counts for
2 papers
cs.CV2020
Cross-Layer Distillation with Semantic Calibration
Defang Chen, Jian-Ping Mei, Yuan Zhang +3
Knowledge distillation is a technique to enhance the generalization ability of a student model by exploiting outputs from a teacher model. Recently, feature-map based variants expl…
cs.LG2019★ 4 cited
Online Knowledge Distillation with Diverse Peers
Defang Chen, Jian-Ping Mei, Can Wang +2
Distillation is an effective knowledge-transfer technique that uses predicted distributions of a powerful teacher model as soft targets to train a less-parameterized student model.…