A Theoretical Characterization of Optimal Data Augmentations in Self-Supervised Learning

Shlomo Libo Feigin, Maximilian Fleissner, Debarghya Ghoshdastidar

Data augmentations play an important role in the recent success of self-supervised learning (SSL). While augmentations are commonly understood to encode invariances between differe…