Swin-Free: Achieving Better Cross-Window Attention and Efficiency with Size-varying Window

Jinkyu Koo, John Yang, Le An +2

Transformer models have shown great potential in computer vision, following their success in language tasks. Swin Transformer is one of them that outperforms convolution-based arch…