Towards Demystifying Representation Learning with Non-contrastive Self-supervision

Xiang Wang, Xinlei Chen, Simon S. Du +1

Non-contrastive methods of self-supervised learning (such as BYOL and SimSiam) learn representations by minimizing the distance between two views of the same image. These approache…