AxWin Transformer: A Context-Aware Vision Transformer Backbone with Axial Windows

Fangjian Lin, Yizhe Ma, Sitong Wu +2

Recently Transformer has shown good performance in several vision tasks due to its powerful modeling capabilities. To reduce the quadratic complexity caused by the attention, some…