Effect of Rotation Angle in Self-Supervised Pre-training is Dataset-Dependent

Amy Saranchuk, Michael Guerzhoy

Self-supervised learning for pre-training (SSP) can help the network learn better low-level features, especially when the size of the training set is small. In contrastive pre-trai…