23 citations · 81 across the 24 of their papers we have counts for
1 paper · 1 filter
Yingfa Chen, Xingyu Shen, Chaojun Xiao +1
Long contexts enlarge key--value (KV) caches, increasing memory use and attention costs during generation. Compressing these caches must preserve information for unseen questions.…