Axially Expanded Windows for Local-Global Interaction in Vision Transformers

Zhemin Zhang, Xun Gong

Recently, Transformers have shown promising performance in various vision tasks. A challenging issue in Transformer design is that global self-attention is very expensive to comput…