103 citations · 556 across the 52 of their papers we have counts for
3 papers · 1 filter
Data-Free Adversarial Distillation
Gongfan Fang, Jie Song, Chengchao Shen +3
Knowledge Distillation (KD) has made remarkable progress in the last few years and become a popular paradigm for model compression and knowledge transfer. However, almost all exist…
Deep Model Transferability from Attribution Maps
Jie Song, Yixin Chen, Xinchao Wang +2
Exploring the transferability between heterogeneous tasks sheds light on their intrinsic interconnections, and consequently enables knowledge transfer from one task to another so a…
Customizing Student Networks From Heterogeneous Teachers via Adaptive Knowledge Amalgamation
Chengchao Shen, Mengqi Xue, Xinchao Wang +3
A massive number of well-trained deep networks have been released by developers online. These networks may focus on different tasks and in many cases are optimized for different da…