collaborators

1 paper

cs.CL2021

Memory-efficient Transformers via Top- Attention

Ankit Gupta, Guy Dar, Shaya Goodman +2

Following the success of dot-product attention in Transformers, numerous approximations have been recently proposed to address its quadratic complexity with respect to the input le…