393 citations · 835 across the 28 of their papers we have counts for
1 paper · 2 filters
Li Nanbo, Firas Laakom, Yilan Zhang +10
Linear attention promises the efficiency needed for long-context language modelling, yet its fixed-size recurrent state must simultaneously support ongoing computation and preserve…