ViT-LSLA: Vision Transformer with Light Self-Limited-Attention

Zhenzhe Hechen, Wei Huang, Yixin Zhao

Transformers have demonstrated a competitive performance across a wide range of vision tasks, while it is very expensive to compute the global self-attention. Many methods limit th…