Beyond Dark Knowledge: Mixup-Based Distillation for Reliable Predictions

José Medina, Paul Honeine, Abdelaziz Bensrhair +1

Knowledge Distillation (KD) and mixup have proven effective at inducing smoothness in class boundaries; KD captures inherent class relationships in probability distributions, and m…