most citedSAttention: Improving Long Sequence Attention with Smoothed Skeleton Sketching

2 citations · 2 across the 1 of their papers we have counts for

collaborators

1 paper

cs.LG2024★ 2 cited

SAttention: Improving Long Sequence Attention with Smoothed Skeleton Sketching

Xue Wang, Tian Zhou, Jianqing Zhu +6

Attention based models have achieved many remarkable breakthroughs in numerous applications. However, the quadratic complexity of Attention makes the vanilla Attention based models…