4 papers · 1 filter
Soft Task-Aware Routing of Experts for Equivariant Representation Learning
Jaebyeong Jeon, Hyeonseo Jang, Jy-yong Sohn +1
Equivariant representation learning aims to capture variations induced by input transformations in the representation space, whereas invariant representation learning encodes seman…
On the Similarities of Embeddings in Contrastive Learning
Chungpa Lee, Sehee Lim, Kibok Lee +1
Contrastive learning operates on a simple yet effective principle: Embeddings of positive pairs are pulled together, while those of negative pairs are pushed apart. In this paper,…
A Theoretical Framework for Preventing Class Collapse in Supervised Contrastive Learning
Chungpa Lee, Jeongheon Oh, Kibok Lee +1
Supervised contrastive learning (SupCL) has emerged as a prominent approach in representation learning, leveraging both supervised and self-supervised losses. However, achieving an…
On the Effectiveness of Supervision in Asymmetric Non-Contrastive Learning
Jeongheon Oh, Kibok Lee
Supervised contrastive representation learning has been shown to be effective in various transfer learning scenarios. However, while asymmetric non-contrastive learning (ANCL) ofte…