203 citations · 229 across the 13 of their papers we have counts for
1 paper · 1 filter
Wanyun Cui, Sen Yan
Knowledge distillation uses both real hard labels and soft labels predicted by teacher models as supervision. Intuitively, we expect the soft labels and hard labels to be concordan…