Rethinking Random Masking in Self-Distillation on ViT

Jihyeon Seong, Hyunkyung Han

Vision Transformers (ViTs) have demonstrated remarkable performance across a wide range of vision tasks. In particular, self-distillation frameworks such as DINO have contributed s…