MIA-Former: Efficient and Robust Vision Transformers via Multi-grained Input-Adaptation

Zhongzhi Yu, Yonggan Fu, Sicheng Li +2

ViTs are often too computationally expensive to be fitted onto real-world resource-constrained devices, due to (1) their quadratically increased complexity with the number of input…