24 citations · 43 across the 5 of their papers we have counts for
1 paper · 2 filters
Yusheng Zhao, Hourun Li, Bohan Wu +5
The attention mechanism has been the core component in modern transformer architectures. However, the computation of standard full attention scales quadratically with the sequence…