Knowledge Distillation from Single to Multi Labels: an Empirical Study

Youcai Zhang, Yuzhuo Qin, Hengwei Liu +3

Knowledge distillation (KD) has been extensively studied in single-label image classification. However, its efficacy for multi-label classification remains relatively unexplored. I…