56 citations · 61 across the 2 of their papers we have counts for
3 papers
cs.CV2019
A Comprehensive Overhaul of Feature Distillation
Byeongho Heo, Jeesoo Kim, Sangdoo Yun +3
We investigate the design aspects of feature distillation methods achieving network compression and propose a novel feature distillation method in which the distillation loss is de…
cs.CV2019★ 5 cited
Backbone Can Not be Trained at Once: Rolling Back to Pre-trained Network for Person Re-Identification
Youngmin Ro, Jongwon Choi, Dae Ung Jo +3
In person re-identification (ReID) task, because of its shortage of trainable dataset, it is common to utilize fine-tuning method using a classification network pre-trained on a la…
cs.LG2018★ 56 cited
Knowledge Transfer via Distillation of Activation Boundaries Formed by Hidden Neurons
Byeongho Heo, Minsik Lee, Sangdoo Yun +1
An activation boundary for a neuron refers to a separating hyperplane that determines whether the neuron is activated or deactivated. It has been long considered in neural networks…