Beyond Microservices: Testing Web-Scale RCA Methods on GPU-Driven LLM Workloads

Dominik Scheinert, Alexander Acker, Thorsten Wittkopp +6

Large language model (LLM) services have become an integral part of search, assistance, and decision-making applications. However, unlike traditional web or microservices, the hard…