ERDE: Entropy-Regularized Distillation for Early-exit

Martial Guidez, Stefan Duffner, Yannick Alpou +2

Although deep neural networks and in particular Convolutional Neural Networks have demonstrated state-of-the-art performance in image classification with relatively high efficiency…