7 papers
A Benchmark for Language Models in Real-World System Building
Weilin Jin, Chenyu Zhao, Zeshun Huang +12
During migration across instruction set architectures (ISAs), software package build repair is a critical task for ensuring the reliability of software deployment and the stability…
Triage in Software Engineering: A Systematic Review of Research and Practice
Yongxin Zhao, Shenglin Zhang, Yujia Wu +5
As modern software systems continue to grow in complexity, triage has become a fundamental process in system operations and maintenance. Triage aims to efficiently prioritize, assi…
R-Log: Incentivizing Log Analysis Capability in LLMs via Reasoning-based Reinforcement Learning
Yilun Liu, Ziang Chen, Song Xu +10
The growing complexity of log data in modern software systems has prompted the use of Large Language Models (LLMs) for automated log analysis. Current approaches typically rely on…
ClusterRCA: An End-to-End Approach for Network Fault Localization and Classification for HPC System
Yongqian Sun, Xijie Pan, Xiao Xiong +6
Network failure diagnosis is challenging yet critical for high-performance computing (HPC) systems. Existing methods cannot be directly applied to HPC scenarios due to data heterog…
TrioXpert: An Automated Incident Management Framework for Microservice System
Yongqian Sun, Yu Luo, Xidao Wen +5
Automated incident management plays a pivotal role in large-scale microservice systems. However, many existing methods rely solely on single-modal data (e.g., metrics, logs, and tr…
An Empirical Study of Production Incidents in Generative AI Cloud Services
Haoran Yan, Yinfang Chen, Minghua Ma +10
The ever-increasing demand for generative artificial intelligence (GenAI) has motivated cloud-based GenAI services such as Azure OpenAI Service and Amazon Bedrock. Like any large-s…