2 citations · 2 across the 3 of their papers we have counts for
1 paper · 1 filter
Gabriel Mongaras, Eric C. Larson
Linear attention transformers have become a strong alternative to softmax attention due to their efficiency. However, linear attention tends to be less expressive and results in re…