SoLA-Vision: Fine-grained Layer-wise Linear Softmax Hybrid Attention

Ruibang Li, Guan Luo, Yiwei Zhang +3

Standard softmax self-attention excels in vision tasks but incurs quadratic complexity O(N^2), limiting high-resolution deployment. Linear attention reduces the cost to O(N), yet i…