2 papers
cs.CV2025
Enriching Knowledge Distillation with Cross-Modal Teacher Fusion
Amir M. Mansourian, Amir Mohammad Babaei, Shohreh Kasaei
Multi-teacher knowledge distillation (KD), a more effective technique than traditional single-teacher methods, transfers knowledge from expert teachers to a compact student model u…
cs.CV2025
A Comprehensive Survey on Knowledge Distillation
Amir M. Mansourian, Rozhan Ahmadi, Masoud Ghafouri +8
Deep Neural Networks (DNNs) have achieved notable performance in the fields of computer vision and natural language processing with various applications in both academia and indust…