1 paper · 1 filter
Zhiwei Lin, Jiahao Liu, Yan Liu +1
Cross-model KV cache sharing reduces prefill computation by allowing a receiver model to reuse prefix KV states generated by a related sender model. Existing methods optimize such…