Graph-Free Knowledge Distillation for Graph Neural Networks

Xiang Deng, Zhongfei Zhang

Knowledge distillation (KD) transfers knowledge from a teacher network to a student by enforcing the student to mimic the outputs of the pretrained teacher on training data. Howeve…