CvT: Introducing Convolutions to Vision Transformers

Haiping Wu, Bin Xiao, Noel Codella +4

We present in this paper a new architecture, named Convolutional vision Transformer (CvT), that improves Vision Transformer (ViT) in performance and efficiency by introducing convo…