Learning From Biased Soft Labels

Hua Yuan, Ning Xu, Yu Shi +2

Knowledge distillation has been widely adopted in a variety of tasks and has achieved remarkable successes. Since its inception, many researchers have been intrigued by the dark kn…