Quick ViTs: Speeding up Vision Transformers through Equivariance

David Nordström, Johan Edstedt, Fredrik Kahl +1

Natural images exhibit strong geometric regularities: local structures, such as edges, corners, and textures, appear in many orientations and mirror configurations. Since Vision Tr…