GrowTAS: Progressive Expansion from Small to Large Subnets for Efficient ViT Architecture Search

Hyunju Lee, Youngmin Oh, Jeimin Jeon +2

Transformer architecture search (TAS) aims to automatically discover efficient vision transformers (ViTs), reducing the need for manual design. Existing TAS methods typically train…