48 citations · 114 across the 9 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
cs.LG2022★ 13 cited
The Hidden Uniform Cluster Prior in Self-Supervised Learning
Mahmoud Assran, Randall Balestriero, Quentin Duval +6
A successful paradigm in representation learning is to perform self-supervised pretraining using tasks based on mini-batch statistics (e.g., SimCLR, VICReg, SwAV, MSN). We show tha…
cs.CV2022★ 48 cited
Vision Models Are More Robust And Fair When Pretrained On Uncurated Images Without Supervision
Priya Goyal, Quentin Duval, Isaac Seessel +5
Discriminative self-supervised learning allows training models on any random group of internet images, and possibly recover salient information that helps differentiate between the…