3 papers · 1 filter
Neural Collapse by Design: Learning Class Prototypes on the Hypersphere
Panagiotis Koromilas, Theodoros Giannakopoulos, Mihalis A. Nicolaou +1
Supervised classification has a theoretical optimum, Neural Collapse (NC), yet neither of its two dominant paradigms reaches it in practice. Cross entropy (CE) leaves radial degree…
A Principled Framework for Multi-View Contrastive Learning
Panagiotis Koromilas, Efthymios Georgiou, Giorgos Bouritsas +3
Contrastive Learning (CL), a leading paradigm in Self-Supervised Learning (SSL), typically relies on pairs of data views generated through augmentation. While multiple augmentation…
Bridging Mini-Batch and Asymptotic Analysis in Contrastive Learning: From InfoNCE to Kernel-Based Losses
Panagiotis Koromilas, Giorgos Bouritsas, Theodoros Giannakopoulos +2
What do different contrastive learning (CL) losses actually optimize for? Although multiple CL methods have demonstrated remarkable representation learning capabilities, the differ…