Factorization Vision Transformer: Modeling Long Range Dependency with Local Window Cost

Haolin Qin, Daquan Zhou, Tingfa Xu +2

Transformers have astounding representational power but typically consume considerable computation which is quadratic with image resolution. The prevailing Swin transformer reduces…