A Close Look at Spatial Modeling: From Attention to Convolution

Xu Ma, Huan Wang, Can Qin +4

Vision Transformers have shown great promise recently for many vision tasks due to the insightful architecture design and attention mechanism. By revisiting the self-attention resp…