2 citations · 2 across the 3 of their papers we have counts for
1 paper · 2 filters
Gabriel Mongaras, Eric C. Larson
Linear attention transformers have become a strong alternative to softmax attention due to their efficiency. However, linear attention tends to be less expressive and results in re…