45 citations · 70 across the 3 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2022★ 4 cited
PAC-Net: A Model Pruning Approach to Inductive Transfer Learning
Sanghoon Myung, In Huh, Wonik Jang +5
Inductive transfer learning aims to learn from a small amount of training data for the target task by utilizing a pre-trained model from the source task. Most strategies that invol…
cs.LG2021★ 45 cited
Learning Student-Friendly Teacher Networks for Knowledge Distillation
Dae Young Park, Moon-Hyun Cha, Changwook Jeong +2
We propose a novel knowledge distillation approach to facilitate the transfer of dark knowledge from a teacher to a student. Contrary to most of the existing methods that rely on e…