128 citations · 363 across the 11 of their papers we have counts for
4 papers · 1 filter
LightViT: Towards Light-Weight Convolution-Free Vision Transformers
Tao Huang, Lang Huang, Shan You +3
Vision transformers (ViTs) are usually considered to be less light-weight than convolutional neural networks (CNNs) due to the lack of inductive bias. Recent works thus resort to c…
Green Hierarchical Vision Transformer for Masked Image Modeling
Lang Huang, Shan You, Mingkai Zheng +3
We present an efficient approach for Masked Image Modeling (MIM) with hierarchical Vision Transformers (ViTs), allowing the hierarchical ViTs to discard masked patches and operate…
Learning Where to Learn in Cross-View Self-Supervised Learning
Lang Huang, Shan You, Mingkai Zheng +3
Self-supervised learning (SSL) has made enormous progress and largely narrowed the gap with the supervised ones, where the representation learning is mainly guided by a projection…
SimMatch: Semi-supervised Learning with Similarity Matching
Mingkai Zheng, Shan You, Lang Huang +3
Learning with few labeled data has been a longstanding problem in the computer vision and machine learning research community. In this paper, we introduced a new semi-supervised le…