UtVAA: Ultra-tiny Vision Transformer with Affix Attention for Mobile Image Classification

Romiyal George, Sathiyamohan Nishankar, Selvarajah Thuseethan +1

Vision Transformers (ViTs) have demonstrated strong representation capability in image classification. However, their quadratic self-attention complexity and large parameter counts…