Pacemaker: Intermediate Teacher Knowledge Distillation For On-The-Fly Convolutional Neural Network

Wonchul Son, Youngbin Kim, Wonseok Song +2

There is a need for an on-the-fly computational process with very low performance system such as system-on-chip (SoC) and embedded device etc. This paper presents pacemaker knowled…