4 papers
MicroAgent: Context-Augmented Multi-Agent Framework for Automatic Microservice Decomposition
Zishan Su, Junjie Huang, Shiwen Shan +5
The adoption of Microservice Architecture (MSA) has revolutionized software engineering by enhancing scalability, agility, and maintainability over traditional monolithic applicati…
CodeAD: Synthesize Code of Rules for Log-based Anomaly Detection with LLMs
Junjie Huang, Minghua He, Jinyang Liu +3
Log-based anomaly detection (LogAD) is critical for maintaining the reliability and availability of large-scale online service systems. While machine learning, deep learning, and l…
Hierarchical Prediction-based Management for LMaaS Systems
Zhihan Jiang, Yujie Huang, Guangba Yu +3
Large Language Models (LLMs) have revolutionized numerous domains, driving the rise of Language-Model-as-a-Service (LMaaS) platforms that process millions of queries daily. These p…
L4: Diagnosing Large-scale LLM Training Failures via Automated Log Analysis
Zhihan Jiang, Junjie Huang, Zhuangbin Chen +6
As Large Language Models (LLMs) show their capabilities across various applications, training customized LLMs has become essential for modern enterprises. However, due to the compl…