122 citations · 289 across the 9 of their papers we have counts for
4 papers · 1 filter
Task-Adaptive Pseudo Labeling for Transductive Meta-Learning
Sanghyuk Lee, Seunghyun Lee, Byung Cheol Song
Meta-learning performs adaptation through a limited amount of support set, which may cause a sample bias problem. To solve this problem, transductive meta-learning is getting more…
Ensemble Knowledge Guided Sub-network Search and Fine-tuning for Filter Pruning
Seunghyun Lee, Byung Cheol Song
Conventional NAS-based pruning algorithms aim to find the sub-network with the best validation performance. However, validation performance does not successfully represent test per…
Graph-based Knowledge Distillation by Multi-head Attention Network
Seunghyun Lee, Byung Cheol Song
Knowledge distillation (KD) is a technique to derive optimal performance from a small student network (SN) by distilling knowledge of a large teacher network (TN) and transferring…
Self-supervised Knowledge Distillation Using Singular Value Decomposition
Seung Hyun Lee, Dae Ha Kim, Byung Cheol Song
To solve deep neural network (DNN)'s huge training dataset and its high computation issue, so-called teacher-student (T-S) DNN which transfers the knowledge of T-DNN to S-DNN has b…