2 papers
cs.CV2026
Beyond Dark Knowledge: Mixup-Based Distillation for Reliable Predictions
José Medina, Paul Honeine, Abdelaziz Bensrhair +1
Knowledge Distillation (KD) and mixup have proven effective at inducing smoothness in class boundaries; KD captures inherent class relationships in probability distributions, and m…
cs.LG2025
Mamba base PKD for efficient knowledge compression
José Medina, Amnir Hadachi, Paul Honeine +1
Deep neural networks (DNNs) have remarkably succeeded in various image processing tasks. However, their large size and computational complexity present significant challenges for d…