24 citations · 48 across the 7 of their papers we have counts for
9 papers
Online Cross-Layer Knowledge Distillation on Graph Neural Networks with Deep Supervision
Jiongyu Guo, Defang Chen, Can Wang
Graph neural networks (GNNs) have become one of the most popular research topics in both academia and industry communities for their strong ability in handling irregular graph data…
Alignahead: Online Cross-Layer Knowledge Extraction on Graph Neural Networks
Jiongyu Guo, Defang Chen, Can Wang
Existing knowledge distillation methods on graph neural networks (GNNs) are almost offline, where the student model extracts knowledge from a powerful teacher model to improve its…
Knowledge Distillation with the Reused Teacher Classifier
Defang Chen, Jian-Ping Mei, Hailin Zhang +3
Knowledge distillation aims to compress a powerful yet cumbersome teacher model into a lightweight student model without much sacrifice of performance. For this purpose, various ap…
Confidence-Aware Multi-Teacher Knowledge Distillation
Hailin Zhang, Defang Chen, Can Wang
Knowledge distillation is initially introduced to utilize additional supervision from a single teacher model for the student model training. To boost the student performance, some…
Distilling Holistic Knowledge with Graph Neural Networks
Sheng Zhou, Yucheng Wang, Defang Chen +4
Knowledge Distillation (KD) aims at transferring knowledge from a larger well-optimized teacher network to a smaller learnable student network.Existing KD methods have mainly consi…
Cross-Layer Distillation with Semantic Calibration
Defang Chen, Jian-Ping Mei, Yuan Zhang +3
Knowledge distillation is a technique to enhance the generalization ability of a student model by exploiting outputs from a teacher model. Recently, feature-map based variants expl…