Attentive Convolution: Unifying the Expressivity of Self-Attention with Convolutional Efficiency

Hao Yu, Haoyu Chen, Yan Jiang +4

Self-attention (SA) has become the cornerstone of modern vision backbones for its powerful expressivity over traditional Convolutions (Conv). However, its quadratic complexity rema…