Rethinking Evaluation Protocols of Visual Representations Learned via Self-supervised Learning

Jae-Hun Lee, Doyoung Yoon, ByeongMoon Ji +2

Linear probing (LP) (and $k$-NN) on the upstream dataset with labels (e.g., ImageNet) and transfer learning (TL) to various downstream datasets are commonly employed to evaluate th…