Teacher-Class Network: A Neural Network Compression Mechanism

Shaiq Munir Malik, Muhammad Umair Haider, Mohbat Tharani +2

To reduce the overwhelming size of Deep Neural Networks (DNN) teacher-student methodology tries to transfer knowledge from a complex teacher network to a simple student network. We…