The Counterattack of CNNs in Self-Supervised Learning: Larger Kernel Size might be All You Need

Tianjin Huang, Tianlong Chen, Zhangyang Wang +1

Vision Transformers have been rapidly uprising in computer vision thanks to their outstanding scaling trends, and gradually replacing convolutional neural networks (CNNs). Recent w…