Self-Distilled Self-Supervised Representation Learning

Jiho Jang, Seonhoon Kim, Kiyoon Yoo +3

State-of-the-art frameworks in self-supervised learning have recently shown that fully utilizing transformer-based models can lead to performance boost compared to conventional CNN…