16 citations · 17 across the 2 of their papers we have counts for
2 papers
cs.CV2023★ 16 cited
What Do Self-Supervised Vision Transformers Learn?
Namuk Park, Wonjae Kim, Byeongho Heo +2
We present a comparative study on how and why contrastive learning (CL) and masked image modeling (MIM) differ in their representations and in their performance of downstream tasks…
cs.LG2022★ 1 cited
Improving Ensemble Distillation With Weight Averaging and Diversifying Perturbation
Giung Nam, Hyungi Lee, Byeongho Heo +1
Ensembles of deep neural networks have demonstrated superior performance, but their heavy computational cost hinders applying them for resource-limited environments. It motivates d…