Trust the uncertain teacher: distilling dark knowledge via calibrated uncertainty

Jeonghyun Kim, SooKyung Kim, Richeng Xuan +1

The core of knowledge distillation lies in transferring the teacher's rich 'dark knowledge'-subtle probabilistic patterns that reveal how classes are related and the distribution o…