$E(2)$-Equivariant Vision Transformer

Renjun Xu, Kaifan Yang, Ke Liu +1

Vision Transformer (ViT) has achieved remarkable performance in computer vision. However, positional encoding in ViT makes it substantially difficult to learn the intrinsic equivar…