Augmentations vs Algorithms: What Works in Self-Supervised Learning

Warren Morningstar, Alex Bijamov, Chris Duvarney +8

We study the relative effects of data augmentations, pretraining algorithms, and model architectures in Self-Supervised Learning (SSL). While the recent literature in this space le…