Mixture-of-Translators: Translating KV Caches Across Heterogeneous Large Language Models

Jin-woo Lee, Minkyung Song, Junghyun Oh +4

Heterogeneous Large Language Model (LLM) systems increasingly rely on shared contexts, retrieved evidence, and multi-agent dialogue histories, yet their internal key-value (KV) cac…