Context Compaction Theory

Hayder Tirmazi, Sam Markelon, Allison Bishop +1

Large Language Models (LLMs) have a bounded context window. The context window is the maximum input size an LLM can consume for a single inference. AI agents rely on a process call…