13 citations · 26 across the 3 of their papers we have counts for
3 papers
cs.CV2023★ 2 cited
Cosine Similarity Knowledge Distillation for Individual Class Information Transfer
Gyeongdo Ham, Seonghak Kim, Suin Lee +2
Previous logits-based Knowledge Distillation (KD) have utilized predictions about multiple categories within each sample (i.e., class predictions) and have employed Kullback-Leible…
cs.CV2023★ 13 cited
Maximizing Discrimination Capability of Knowledge Distillation with Energy Function
Seonghak Kim, Gyeongdo Ham, Suin Lee +2
To apply the latest computer vision techniques that require a large computational cost in real industrial applications, knowledge distillation methods (KDs) are essential. Existing…
cs.CV2023★ 11 cited
Robustness-Reinforced Knowledge Distillation with Correlation Distance and Network Pruning
Seonghak Kim, Gyeongdo Ham, Yucheol Cho +1
The improvement in the performance of efficient and lightweight models (i.e., the student model) is achieved through knowledge distillation (KD), which involves transferring knowle…