Model compression using knowledge distillation with integrated gradients

David E. Hernandez, Jose Chang, Torbjörn E. M. Nordling

Model compression is critical for deploying deep learning models on resource-constrained devices. We introduce a novel method enhancing knowledge distillation with integrated gradi…