Rethinking Vision Transformer Depth via Structural Reparameterization

Chengwei Zhou, Vipin Chaudhary, Gourav Datta

The computational overhead of Vision Transformers in practice stems fundamentally from their deep architectures, yet existing acceleration strategies have primarily targeted algori…