TVT: Training-Free Vision Transformer Search on Tiny Datasets

Zimian Wei, Hengyue Pan, Lujun Li +4

Training-free Vision Transformer (ViT) architecture search is presented to search for a better ViT with zero-cost proxies. While ViTs achieve significant distillation gains from CN…