Beyond K/V Caches: Cross-Model State Handoff in Hybrid Linear-Attention LLMs

Jiacheng Cai, Tao Zhang, Siqi Liang +2

Production deployments often use different models to balance cost and quality through cascading, routing, and switching models during long conversations. Context accumulates across…