Pruning Self-attentions into Convolutional Layers in Single Path

Haoyu He, Jianfei Cai, Jing Liu +4

Vision Transformers (ViTs) have achieved impressive performance over various computer vision tasks. However, modeling global correlations with multi-head self-attention (MSA) layer…