73 citations · 226 across the 12 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.CL2021
Memory-efficient Transformers via Top- Attention
Ankit Gupta, Guy Dar, Shaya Goodman +2
Following the success of dot-product attention in Transformers, numerous approximations have been recently proposed to address its quadratic complexity with respect to the input le…
cs.LG2021
Value-aware Approximate Attention
Ankit Gupta, Jonathan Berant
Following the success of dot-product attention in Transformers, numerous approximations have been recently proposed to address its quadratic complexity with respect to the input le…