most citedQuantifying the Knowledge in a DNN to Explain Knowledge Distillation for Classification

7 citations · 7 across the 1 of their papers we have counts for

collaborators

2 papers

cs.LG2022★ 7 cited

Quantifying the Knowledge in a DNN to Explain Knowledge Distillation for Classification

Quanshi Zhang, Xu Cheng, Yilan Chen +1

Compared to traditional learning from scratch, knowledge distillation sometimes makes the DNN achieve superior performance. This paper provides a new perspective to explain the suc…

cs.LG2020

Explaining Knowledge Distillation by Quantifying the Knowledge

Xu Cheng, Zhefan Rao, Yilan Chen +1

This paper presents a method to interpret the success of knowledge distillation by quantifying and analyzing task-relevant and task-irrelevant visual concepts that are encoded in i…