2 citations · 4 across the 4 of their papers we have counts for
1 paper · 1 filter
Zheyu Shen, Guanhua Wang, Dezhan Tu +5
Long-context large language model inference is bottlenecked by KV caches that grow linearly with sequence length. This burden is especially severe for long, reusable context prefix…