Parallel Context Compaction for Long-Horizon LLM Agent Serving

Musa Cim, Burak Topcu, Chita Das +1

Long-horizon LLM agents accumulate growing conversation histories that eventually exceed the model's context window. Context compaction via LLM-based summarization keeps the conver…