26 citations · 34 across the 12 of their papers we have counts for
1 paper · 1 filter
Haomiao Qiu, Yining Tang, Zijia Song +3
KV caches make long-context serving efficient by reusing past computation, but model switching breaks this reuse and forces the receiver to prefill the context again. We study \emp…