Interpreting and Improving Attention From the Perspective of Large Kernel Convolution

Chenghao Li, Chaoning Zhang, Boheng Zeng +7

Attention mechanisms have significantly advanced visual models by capturing global context effectively. However, their reliance on large-scale datasets and substantial computationa…