101 citations · 114 across the 3 of their papers we have counts for
1 paper · 1 filter
Yao Fu, Jiahan Chang, Cyrus Chang +12
Indexer-based sparse attention reduces the cost of core attention by passing only a fixed, small number of important tokens to it. However, the indexer must still score the entire…