Vision Learners Meet Web Image-Text Pairs

Bingchen Zhao, Quan Cui, Hao Wu +3

Many self-supervised learning methods are pre-trained on the well-curated ImageNet-1K dataset. In this work, given the excellent scalability of web data, we consider self-supervise…