AnchorFormer: Differentiable Anchor Attention for Efficient Vision Transformer

Jiquan Shan, Junxiao Wang, Lifeng Zhao +3

Recently, vision transformers (ViTs) have achieved excellent performance on vision tasks by measuring the global self-attention among the image patches. Given $n$ patches, they wil…