551 citations · 1.3k across the 13 of their papers we have counts for
Showing cs.CVShow all
2 papers · 1 filter
cs.CV2021
Scaled ReLU Matters for Training Vision Transformers
Pichao Wang, Xue Wang, Hao Luo +5
Vision transformers (ViTs) have been an alternative design paradigm to convolutional neural networks (CNNs). However, the training of ViTs is much harder than CNNs, as it is sensit…
cs.CV2021★ 4 cited
KVT: k-NN Attention for Boosting Vision Transformers
Pichao Wang, Xue Wang, Fan Wang +4
Convolutional Neural Networks (CNNs) have dominated computer vision for years, due to its ability in capturing locality and translation invariance. Recently, many vision transforme…