Representation Learning Dynamics of Self-Supervised Models

Pascal Esser, Satyaki Mukherjee, Debarghya Ghoshdastidar

Self-Supervised Learning (SSL) is an important paradigm for learning representations from unlabelled data, and SSL with neural networks has been highly successful in practice. Howe…