Variational Student: Learning Compact and Sparser Networks in Knowledge Distillation Framework

Srinidhi Hegde, Ranjitha Prasad, Ramya Hebbalaguppe +1

The holy grail in deep neural network research is porting the memory- and computation-intensive network models on embedded platforms with a minimal compromise in model accuracy. To…