On Partial Prototype Collapse in the DINO Family of Self-Supervised Methods

Hariprasath Govindarajan, Per Sidén, Jacob Roll +1

A prominent self-supervised learning paradigm is to model the representations as clusters, or more generally as a mixture model. Learning to map the data samples to compact represe…