Benchmarking LLM Serving Systems for Agentic AI Workloads with XPerf

Michael Wang, Yikang Yue, Shaobo Li +3

We present XPerf, a benchmarking framework that load-tests LLM serving systems with diverse agentic AI workloads. It provides detailed profiling of the serving system and hardware,…