14 citations · 33 across the 11 of their papers we have counts for
4 papers · 1 filter
SMMix: Self-Motivated Image Mixing for Vision Transformers
Mengzhao Chen, Mingbao Lin, ZhiHang Lin +3
CutMix is a vital augmentation strategy that determines the performance and generalization ability of vision transformers (ViTs). However, the inconsistency between the mixed image…
Super Vision Transformer
Mingbao Lin, Mengzhao Chen, Yuxin Zhang +3
We attempt to reduce the computational costs in vision transformers (ViTs), which increase quadratically in the token number. We present a novel training paradigm that trains only…
CF-ViT: A General Coarse-to-Fine Method for Vision Transformer
Mengzhao Chen, Mingbao Lin, Ke Li +4
Vision Transformers (ViT) have made many breakthroughs in computer vision tasks. However, considerable redundancy arises in the spatial dimension of an input image, leading to mass…
OptG: Optimizing Gradient-driven Criteria in Network Sparsity
Yuxin Zhang, Mingbao Lin, Mengzhao Chen +2
Network sparsity receives popularity mostly due to its capability to reduce the network complexity. Extensive studies excavate gradient-driven sparsity. Typically, these methods ar…