Showing 2024Show all
2 papers · 1 filter
cs.CV2024
Hybrid Data-Free Knowledge Distillation
Jialiang Tang, Shuo Chen, Chen Gong
Data-free knowledge distillation aims to learn a compact student network from a pre-trained large teacher network without using the original training data of the teacher network. E…
cs.LG2024
Direct Distillation between Different Domains
Jialiang Tang, Shuo Chen, Gang Niu +4
Knowledge Distillation (KD) aims to learn a compact student network using knowledge from a large pre-trained teacher network, where both networks are trained on data from the same…