SPOT: Sparsification with Attention Dynamics via Token Relevance in Vision Transformers

Oded Schlesinger, Amirhossein Farzam, J. Matias Di Martino +1

While Vision Transformers (ViT) have demonstrated remarkable performance across diverse tasks, their computational demands are substantial, scaling quadratically with the number of…