Self-Supervised Representation Learning as Mutual Information Maximization

Akhlaqur Rahman Sabby, Yi Sui, Tongzi Wu +2

Self-supervised representation learning (SSRL) has demonstrated remarkable empirical success, yet its underlying principles remain insufficiently understood. While recent works att…