Bringing Generative Learning to Representation Learning: Self-Supervised Transfer Learning as Distribution Matching

Yuling Jiao, Wensen Ma, Defeng Sun +2

Most self-supervised learning objectives defend against collapse but leave the target representation law unspecified. We formulate representation learning as Distribution Matching…