Demystify Self-Attention in Vision Transformers from a Semantic Perspective: Analysis and Application

Leijie Wu, Song Guo, Yaohong Ding +4

Self-attention mechanisms, especially multi-head self-attention (MSA), have achieved great success in many fields such as computer vision and natural language processing. However,…