5 citations · 9 across the 10 of their papers we have counts for
1 paper · 2 filters
Taiga Ikeda, Daisuke Miyashita, Jun Deguchi
KV-cache reuse in large language model serving is commonly limited to exact prompt prefixes, preventing reuse when the same retrieved document appears after different system prompt…