4 citations · 6 across the 2 of their papers we have counts for
4 papers · 1 filter
DistPro: Searching A Fast Knowledge Distillation Process via Meta Optimization
Xueqing Deng, Dawei Sun, Shawn Newsam +1
Recent Knowledge distillation (KD) studies show that different manually designed schemes impact the learned results significantly. Yet, in KD, automatically searching an optimal di…
Knowledge Transfer via Dense Cross-Layer Mutual-Distillation
Anbang Yao, Dawei Sun
Knowledge Distillation (KD) based methods adopt the one-way Knowledge Transfer (KT) scheme in which training a lower-capacity student network is guided by a pre-trained high-capaci…
Learning Two-View Correspondences and Geometry Using Order-Aware Network
Jiahui Zhang, Dawei Sun, Zixin Luo +6
Establishing correspondences between two images requires both local and global spatial context. Given putative correspondences of feature points in two views, in this paper, we pro…
Deeply-supervised Knowledge Synergy
Dawei Sun, Anbang Yao, Aojun Zhou +1
Convolutional Neural Networks (CNNs) have become deeper and more complicated compared with the pioneering AlexNet. However, current prevailing training scheme follows the previous…