CageViT: Convolutional Activation Guided Efficient Vision Transformer

Hao Zheng, Jinbao Wang, Xiantong Zhen +3

Recently, Transformers have emerged as the go-to architecture for both vision and language modeling tasks, but their computational efficiency is limited by the length of the input…