2 citations · 3 across the 6 of their papers we have counts for
1 paper · 1 filter
Taiga Ikeda, Daisuke Miyashita, Jun Deguchi
KV-cache reuse in large language model serving is commonly limited to exact prompt prefixes, preventing reuse when the same retrieved document appears after different system prompt…