19 citations · 31 across the 9 of their papers we have counts for
7 papers · 1 filter
LLMPrism: Black-box Performance Diagnosis for Production LLM Training Platforms
Zhihan Jiang, Rui Ren, Guangba Yu +8
Large Language Models (LLMs) have brought about revolutionary changes in diverse fields, rendering LLM training of utmost importance for modern enterprises. To meet this demand, mu…
L4: Diagnosing Large-scale LLM Training Failures via Automated Log Analysis
Zhihan Jiang, Junjie Huang, Zhuangbin Chen +6
As Large Language Models (LLMs) show their capabilities across various applications, training customized LLMs has become essential for modern enterprises. However, due to the compl…
Demystifying and Extracting Fault-indicating Information from Logs for Failure Diagnosis
Junjie Huang, Zhihan Jiang, Jinyang Liu +7
Logs are imperative in the maintenance of online service systems, which often encompass important information for effective failure mitigation. While existing anomaly detection met…
Knowledge-aware Alert Aggregation in Large-scale Cloud Systems: a Hybrid Approach
Jinxi Kuang, Jinyang Liu, Junjie Huang +6
Due to the scale and complexity of cloud systems, a system failure would trigger an "alert storm", i.e., massive correlated alerts. Although these alerts can be traced back to a fe…
FaultProfIT: Hierarchical Fault Profiling of Incident Tickets in Large-scale Cloud Systems
Junjie Huang, Jinyang Liu, Zhuangbin Chen +7
Postmortem analysis is essential in the management of incidents within cloud systems, which provides valuable insights to improve system's reliability and robustness. At CloudA, fa…
Practical Anomaly Detection over Multivariate Monitoring Metrics for Online Services
Jinyang Liu, Tianyi Yang, Zhuangbin Chen +4
As modern software systems continue to grow in terms of complexity and volume, anomaly detection on multivariate monitoring metrics, which profile systems' health status, becomes m…
Prism: Revealing Hidden Functional Clusters from Massive Instances in Cloud Systems
Jinyang Liu, Zhihan Jiang, Jiazhen Gu +6
Ensuring the reliability of cloud systems is critical for both cloud vendors and customers. Cloud systems often rely on virtualization techniques to create instances of hardware re…