Self-attention in Vision Transformers Performs Perceptual Grouping, Not Attention

Paria Mehrani, John K. Tsotsos

Recently, a considerable number of studies in computer vision involves deep neural architectures called vision transformers. Visual processing in these models incorporates computat…