Enhancing compact convolutional transformers with super attention

Simpenzwe Honore Leandre, Natenaile Asmamaw Shiferaw, Dillip Rout

In this paper, we propose a vision model that adopts token mixing, sequence-pooling, and convolutional tokenizers to achieve state-of-the-art performance and efficient inference in…