15 citations · 15 across the 4 of their papers we have counts for
1 paper · 1 filter
Yu Sun, Xinhao Li, Karan Dalal +9
Self-attention performs well in long context but has quadratic complexity. Existing RNN layers have linear complexity, but their performance in long context is limited by the expre…