4.4k citations · 5.5k across the 6 of their papers we have counts for
4 papers · 1 filter
Greedy Network Enlarging
Chuanjian Liu, Kai Han, An Xiao +4
Recent studies on deep convolutional neural networks present a simple paradigm of architecture design, i.e., models with more MACs typically achieve better accuracy, such as Effici…
Augmented Shortcuts for Vision Transformers
Yehui Tang, Kai Han, Chang Xu +4
Transformer models have achieved great progress on computer vision tasks recently. The rapid development of vision transformers is mainly contributed by their high representation a…
Transformer in Transformer
Kai Han, An Xiao, Enhua Wu +3
Transformer is a new kind of neural architecture which encodes the input data as powerful features via the attention mechanism. Basically, the visual transformers first divide the…
A Survey on Visual Transformer
Kai Han, Yunhe Wang, Hanting Chen +10
Transformer, first applied to the field of natural language processing, is a type of deep neural network mainly based on the self-attention mechanism. Thanks to its strong represen…