Retraining-Free Depth Pruning of Vision Transformers: A Cross Domain Study of Layer Redundancy

Alessandro Viespoli, Loris Nanni

Transformer architectures have achieved strong results in natural language processing and computer vision, but their deployment is limited by high computational, memory and storage…