Combating the Memory Walls: Optimization Pathways for Long-Context Agentic LLM Inference

Haoran Wu, Can Xiao, Jiayi Nie +15

LLMs now form the backbone of AI agents across a diverse range of applications, including tool use, command-line interfaces, and web or computer interaction. These agentic LLM infe…