1 paper
Vedant Puri, Aditya Joglekar, Sri Datta Ganesh Bandreddi +4
The quadratic complexity of self-attention limits the scalability of transformers on long sequences. We introduce Fast Low-rank Attention Routing Engine (FLARE), a token-mixing ope…