TELLER: Non-intrusive Cross-Layer Root-Cause Analysis for LLM Inference

Ruilin Xu, Junyi Li, Pengfei Chen +1

Large language model (LLM) inference has evolved from an offline workload into a continuously operated software service, yet root-cause analysis remains difficult because a single…