2 citations · 9 across the 42 of their papers we have counts for
8 papers · 1 filter
Computer-Using World Model
Yiming Guan, Rui Yu, John Zhang +15
Agents operating in complex software environments benefit from reasoning about the consequences of their actions, as even a single incorrect user interface (UI) operation can derai…
A Benchmark for Language Models in Real-World System Building
Weilin Jin, Chenyu Zhao, Zeshun Huang +12
During migration across instruction set architectures (ISAs), software package build repair is a critical task for ensuring the reliability of software deployment and the stability…
RepoGenesis: Benchmarking End-to-End Microservice Generation from Readme to Repository
Zhiyuan Peng, Xin Yin, Pu Zhao +7
Large language models and agents have achieved remarkable progress in code generation. However, existing benchmarks focus on isolated function/class-level generation (e.g., ClassEv…
From Task to Tutorial: An Automated GUI Framework for Excel Tutorial Document and Video Creation
Yuhang Xie, Jian Mu, Xiaojun Ma +9
Excel is one of the most widely used productivity tools across domains, offering rich functionality but also overwhelming users with its complexity. This creates a persistent deman…
SWE-bench Goes Live!
Linghao Zhang, Shilin He, Chaoyun Zhang +12
The issue-resolving task, where a model generates patches to fix real-world bugs, has emerged as a critical benchmark for evaluating the capabilities of large language models (LLMs…
Enabling Autonomic Microservice Management through Self-Learning Agents
Fenglin Yu, Fangkai Yang, Xiaoting Qin +8
The increasing complexity of modern software systems necessitates robust autonomic self-management capabilities. While Large Language Models (LLMs) demonstrate potential in this do…