Role-Wise Data Augmentation for Knowledge Distillation

Jie Fu, Xue Geng, Zhijian Duan +6

Knowledge Distillation (KD) is a common method for transferring the ``knowledge'' learned by one machine learning model (the \textit{teacher}) into another model (the \textit{stude…