23 citations · 24 across the 6 of their papers we have counts for
1 paper · 1 filter
Li Nanbo, Firas Laakom, Yilan Zhang +10
Linear attention promises the efficiency needed for long-context language modelling, yet its fixed-size recurrent state must simultaneously support ongoing computation and preserve…