Non-contrastive sentence representations via self-supervision

Marco Farina, Duccio Pappadopulo

Sample contrastive methods, typically referred to simply as contrastive are the foundation of most unsupervised methods to learn text and sentence embeddings. On the other hand, a…