Intriguing Equivalence Structures of the Embedding Space of Vision Transformers

Shaeke Salman, Md Montasir Bin Shams, Xiuwen Liu

Pre-trained large foundation models play a central role in the recent surge of artificial intelligence, resulting in fine-tuned models with remarkable abilities when measured on be…