$\lambda$-JEPA Spectral Anti-Collapse Regularization for Self-Supervised Learning

Berker Demirel, Clémentine Dominé, Valentino Maiorca +3

Joint-embedding self-supervised learning typically combines an invariance objective across augmented views with additional mechanisms to prevent representational collapse. These ob…