CubistMerge: Spatial-Preserving Token Merging For Diverse ViT Backbones

Wenyi Gong, Mieszko Lis

Many modern ViT backbones adopt spatial architectural designs, such as window attention, decomposed relative positional embeddings in SAM, and RoPE in DINOv3. Such architectures im…