Slicing Vision Transformer for Flexible Inference

Yitian Zhang, Huseyin Coskun, Xu Ma +6

Vision Transformers (ViT) is known for its scalability. In this work, we target to scale down a ViT to fit in an environment with dynamic-changing resource constraints. We observe…