790 citations · 813 across the 4 of their papers we have counts for
1 paper · 1 filter
Yun Liu, Yu-Huan Wu, Guolei Sun +3
This paper tackles the high computational/space complexity associated with Multi-Head Self-Attention (MHSA) in vanilla vision transformers. To this end, we propose Hierarchical MHS…