Teacher-Student Architecture for Knowledge Distillation: A Survey

Chengming Hu, Xuan Li, Dan Liu +4

Although Deep neural networks (DNNs) have shown a strong capacity to solve large-scale problems in many areas, such DNNs are hard to be deployed in real-world systems due to their…