Auto-scaling Vision Transformers without Training

Wuyang Chen, Wei Huang, Xianzhi Du +3

This work targets automated designing and scaling of Vision Transformers (ViTs). The motivation comes from two pain spots: 1) the lack of efficient and principled methods for desig…