Training-Free Acceleration of ViTs with Delayed Spatial Merging

Jung Hwan Heo, Seyedarmin Azizi, Arash Fayyazi +1

Token merging has emerged as a new paradigm that can accelerate the inference of Vision Transformers (ViTs) without any retraining or fine-tuning. To push the frontier of training-…