Spatial Priors via Space Filling Curves for Small and Limited Data Vision Transformers

Leyla Naz Candogan, Arshia Afzal, Pol Puigdemont +1

Though Vision Transformers (ViTs) have become the dominant backbone in many computer vision tasks, due to permutation equivariance, their attention mechanism lacks explicit spatial…