Distilling Holistic Knowledge with Graph Neural Networks

Sheng Zhou, Yucheng Wang, Defang Chen +4

Knowledge Distillation (KD) aims at transferring knowledge from a larger well-optimized teacher network to a smaller learnable student network.Existing KD methods have mainly consi…