Persistent Memory in Multi-Agent LLM Inference: What It Costs, What It Buys, and When You Can Tell

Hochan Son, Kyungdoe Han, Jaehan Koh +3

Decomposing long-context inference across cooperating agents bounds the active KV cache per call rather than total evidence, which matters when KV-cache memory binds. Many such sys…