A Novel Self-Knowledge Distillation Approach with Siamese Representation Learning for Action Recognition

Duc-Quang Vu, Trang Phung, Jia-Ching Wang

Knowledge distillation is an effective transfer of knowledge from a heavy network (teacher) to a small network (student) to boost students' performance. Self-knowledge distillation…