AUTOKD: Automatic Knowledge Distillation Into A Student Architecture Family

Roy Henha Eyono, Fabio Maria Carlucci, Pedro M Esperança +2

State-of-the-art results in deep learning have been improving steadily, in good part due to the use of larger models. However, widespread use is constrained by device hardware limi…