Education distillation:getting student models to learn in shcools

Ling Feng, Tianhao Wu, Xiangrong Ren +2

This paper introduces a new knowledge distillation method, called education distillation (ED), which is inspired by the structured and progressive nature of human learning. ED mimi…