Iwin Transformer: Hierarchical Vision Transformer using Interleaved Windows

Simin Huo, Ning Li

Vision Transformers (ViTs) face two limitations: the rigid resolution dependency of positional embeddings, which complicates cross-resolution fine-tuning, and the quadratic complex…