Deep Mutual Learning

Ying Zhang, Tao Xiang, Timothy M. Hospedales +1

Model distillation is an effective and widely used technique to transfer knowledge from a teacher to a student network. The typical application is to transfer from a powerful large…