AI-KD: Adversarial learning and Implicit regularization for self-Knowledge Distillation

Hyungmin Kim, Sungho Suh, Sunghyun Baek +4

We present a novel adversarial penalized self-knowledge distillation method, named adversarial learning and implicit regularization for self-knowledge distillation (AI-KD), which r…