29 citations · 110 across the 38 of their papers we have counts for
11 papers · 1 filter
Change2Task: From Repository Changes to Executable Coding Agent Tasks and Environments
Haomin Qi, Xingliang Wang, Xuanqi Gao +9
Scaling coding agents requires a continuing supply of executable data for training, benchmarking, and continuous evaluation. Each task must couple a realistic software state with a…
SWE-bench Goes Live!
Linghao Zhang, Shilin He, Chaoyun Zhang +12
The issue-resolving task, where a model generates patches to fix real-world bugs, has emerged as a critical benchmark for evaluating the capabilities of large language models (LLMs…
AllHands: Ask Me Anything on Large-scale Verbatim Feedback via Large Language Models
Chaoyun Zhang, Zicheng Ma, Yuhao Wu +12
Verbatim feedback constitutes a valuable repository of user experiences, opinions, and requirements essential for software development. Effectively and efficiently extracting valua…
Xpert: Empowering Incident Management with Query Recommendations via Large Language Models
Yuxuan Jiang, Chaoyun Zhang, Shilin He +8
Large-scale cloud systems play a pivotal role in modern IT infrastructure. However, incidents occurring within these systems can lead to service disruptions and adversely affect us…
TraceDiag: Adaptive, Interpretable, and Efficient Root Cause Analysis on Large-Scale Microservice Systems
Ruomeng Ding, Chaoyun Zhang, Lu Wang +11
Root Cause Analysis (RCA) is becoming increasingly crucial for ensuring the reliability of microservice systems. However, performing RCA on modern microservice systems can be chall…
Robust Multimodal Failure Detection for Microservice Systems
Chenyu Zhao, Minghua Ma, Zhenyu Zhong +10
Proactive failure detection of instances is vitally essential to microservice systems because an instance failure can propagate to the whole system and degrade the system's perform…
Assess and Summarize: Improve Outage Understanding with Large Language Models
Pengxiang Jin, Shenglin Zhang, Minghua Ma +13
Cloud systems have become increasingly popular in recent years due to their flexibility and scalability. Each time cloud computing applications and services hosted on the cloud are…
Automatic Root Cause Analysis via Large Language Models for Cloud Incidents
Yinfang Chen, Huaibing Xie, Minghua Ma +15
Ensuring the reliability and availability of cloud services necessitates efficient root cause analysis (RCA) for cloud incidents. Traditional RCA methods, which rely on manual inve…
Did We Miss Something Important? Studying and Exploring Variable-Aware Log Abstraction
Zhenhao Li, Chuan Luo, Tse-Hsun Chen +4
Due to the sheer size of software logs, developers rely on automated techniques for log analysis. One of the first and most important steps of automated log analysis is log abstrac…
Incident-aware Duplicate Ticket Aggregation for Cloud Systems
Jinyang Liu, Shilin He, Zhuangbin Chen +10
In cloud systems, incidents are potential threats to customer satisfaction and business revenue. When customers are affected by incidents, they often request customer support servi…
Enhanced Fairness Testing via Generating Effective Initial Individual Discriminatory Instances
Minghua Ma, Zhao Tian, Max Hort +4
Fairness testing aims at mitigating unintended discrimination in the decision-making process of data-driven AI systems. Individual discrimination may occur when an AI model makes d…