4 papers
LLMPrism: Black-box Performance Diagnosis for Production LLM Training Platforms
Zhihan Jiang, Rui Ren, Guangba Yu +8
Large Language Models (LLMs) have brought about revolutionary changes in diverse fields, rendering LLM training of utmost importance for modern enterprises. To meet this demand, mu…
L4: Diagnosing Large-scale LLM Training Failures via Automated Log Analysis
Zhihan Jiang, Junjie Huang, Zhuangbin Chen +6
As Large Language Models (LLMs) show their capabilities across various applications, training customized LLMs has become essential for modern enterprises. However, due to the compl…
Identifying Performance Issues in Cloud Service Systems Based on Relational-Temporal Features
Wenwei Gu, Jinyang Liu, Zhuangbin Chen +7
Cloud systems are susceptible to performance issues, which may cause service-level agreement violations and financial losses. In current practice, crucial metrics are monitored per…
Demystifying and Extracting Fault-indicating Information from Logs for Failure Diagnosis
Junjie Huang, Zhihan Jiang, Jinyang Liu +7
Logs are imperative in the maintenance of online service systems, which often encompass important information for effective failure mitigation. While existing anomaly detection met…