1 citations · 1 across the 3 of their papers we have counts for
1 paper · 1 filter
Xingyu Xie, Zhaochen Yu, Yue Liao +3
Long-context autoregressive decoding remains expensive because each decoding step must repeatedly process a growing history. We observe a consistent pattern during decoding: within…