Intra-class Patch Swap for Self-Distillation

Hongjun Choi, Eun Som Jeon, Ankita Shukla +1

Knowledge distillation (KD) is a valuable technique for compressing large deep learning models into smaller, edge-suitable networks. However, conventional KD frameworks rely on pre…