122 citations · 180 across the 8 of their papers we have counts for
Showing 2019Show all
2 papers · 1 filter
cs.CV2019
Metric-based Regularization and Temporal Ensemble for Multi-task Learning using Heterogeneous Unsupervised Tasks
Dae Ha Kim, Seung Hyun Lee, Byung Cheol Song
One of the ways to improve the performance of a target task is to learn the transfer of abundant knowledge of a pre-trained network. However, learning of the pre-trained network re…
cs.LG2019★ 38 cited
Graph-based Knowledge Distillation by Multi-head Attention Network
Seunghyun Lee, Byung Cheol Song
Knowledge distillation (KD) is a technique to derive optimal performance from a small student network (SN) by distilling knowledge of a large teacher network (TN) and transferring…