activity
20232026
most citedTaylorShift: Shifting the Complexity of Self-Attention from Squared to Linear (and Back) using Taylor-Softmax

10 citations · 10 across the 16 of their papers we have counts for

collaborators
Showing 2023Show all

1 paper · 1 filter

cs.CV2023

Which Transformer to Favor: A Comparative Analysis of Efficiency in Vision Transformers

Tobias Christian Nauen, Sebastian Palacio, Federico Raue +1

Self-attention in Transformers comes with a high computational cost because of their quadratic computational complexity, but their effectiveness in addressing problems in language…