551 citations · 1.3k across the 13 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.LG2024★ 2 cited
SAttention: Improving Long Sequence Attention with Smoothed Skeleton Sketching
Xue Wang, Tian Zhou, Jianqing Zhu +6
Attention based models have achieved many remarkable breakthroughs in numerous applications. However, the quadratic complexity of Attention makes the vanilla Attention based models…
cs.LG2024★ 2 cited
Attention as Robust Representation for Time Series Forecasting
PeiSong Niu, Tian Zhou, Xue Wang +2
Time series forecasting is essential for many practical applications, with the adoption of transformer-based models on the rise due to their impressive performance in NLP and CV. T…