13 papers
A Multi-Dataset Benchmark for Evaluating LLM Agents in Microservice Failure Diagnosis
Yuanhong Cai, Xiaohui Nie, Kanglin Yin +8
LLM-based agents are reshaping microservice operations into AgentOps, where benchmarks are key to evaluating failure diagnosis over multimodal observability data. However, existing…
A Benchmark for Language Models in Real-World System Building
Weilin Jin, Chenyu Zhao, Zeshun Huang +12
During migration across instruction set architectures (ISAs), software package build repair is a critical task for ensuring the reliability of software deployment and the stability…
LogPurge: Log Data Purification for Anomaly Detection via Rule-Enhanced Filtering
Shenglin Zhang, Ziang Chen, Zijing Que +5
Log anomaly detection, which is critical for identifying system failures and preempting security breaches, detects irregular patterns within large volumes of log data, and impacts…
Triage in Software Engineering: A Systematic Review of Research and Practice
Yongxin Zhao, Shenglin Zhang, Yujia Wu +5
As modern software systems continue to grow in complexity, triage has become a fundamental process in system operations and maintenance. Triage aims to efficiently prioritize, assi…
RationAnomaly: Log Anomaly Detection with Rationality via Chain-of-Thought and Reinforcement Learning
Song Xu, Yilun Liu, Minggui He +10
Logs constitute a form of evidence signaling the operational status of software systems. Automated log anomaly detection is crucial for ensuring the reliability of modern software…
R-Log: Incentivizing Log Analysis Capability in LLMs via Reasoning-based Reinforcement Learning
Yilun Liu, Ziang Chen, Song Xu +10
The growing complexity of log data in modern software systems has prompted the use of Large Language Models (LLMs) for automated log analysis. Current approaches typically rely on…