4 citations · 7 across the 7 of their papers we have counts for
1 paper · 1 filter
Weikang Meng, Liangyu Huo, Yadan Luo +3
Linear attention significantly reduces the computational complexity of Transformers from quadratic to linear, yet it consistently lags behind softmax-based attention in performance…