NetDistiller: Empowering Tiny Deep Learning via In-Situ Distillation

Shunyao Zhang, Yonggan Fu, Shang Wu +4

Boosting the task accuracy of tiny neural networks (TNNs) has become a fundamental challenge for enabling the deployments of TNNs on edge devices which are constrained by strict li…