2 papers
cs.CV2026
Linearizing Vision Transformer with Test-Time Training
Yining Li, Dongchen Han, Zeyu Liu +3
While linear-complexity attention mechanisms offer a promising alternative to Softmax attention for overcoming the quadratic bottleneck, training such models from scratch remains p…
cs.CV2026
Linear-Time Global Visual Modeling without Explicit Attention
Ruize He, Dongchen Han, Gao Huang
Existing research largely attributes the global sequence modeling capability of Transformers to the explicit computation of attention weights, a process that inherently incurs quad…