408 citations · 1.3k across the 10 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.CV2021★ 312 cited
P2T: Pyramid Pooling Transformer for Scene Understanding
Yu-Huan Wu, Yun Liu, Xin Zhan +1
Recently, the vision transformer has achieved great success by pushing the state-of-the-art of various vision tasks. One of the most challenging problems in the vision transformer…
cs.CV2021
Vision Transformers with Hierarchical Attention
Yun Liu, Yu-Huan Wu, Guolei Sun +3
This paper tackles the high computational/space complexity associated with Multi-Head Self-Attention (MHSA) in vanilla vision transformers. To this end, we propose Hierarchical MHS…