Understanding the Benefits of SimCLR Pre-Training in Two-Layer Convolutional Neural Networks

Han Zhang, Yuan Cao

SimCLR is one of the most popular contrastive learning methods for vision tasks. It pre-trains deep neural networks based on a large amount of unlabeled data by teaching the model…