10 papers
AutoSaddler: Automatic Harness Optimization with Durable Updates from Agent Execution Traces
Sungho Park, Wonjoong Kim, Rongyuan Tan +10
LLM agents remain unreliable on long-horizon tasks, where small local failures can compound over extended interactions and lead to overall task failure. Although external harnesses…
RepoLaunch: Automating Build and Management of Code Repositories across Languages and Platforms
Kenan Li, Rongzhi Li, Linghao Zhang +17
Language model (LM) agents have driven substantial progress in automated software engineering (SWE), yet building and testing software repositories at scale remains a largely manua…
ORACLE-SWE: Quantifying the Contribution of Oracle Information Signals on SWE Agents
Kenan Li, Qirui Jin, Liao Zhu +13
Recent advances in language model (LM) agents have significantly improved automated software engineering (SWE). Prior work has proposed various agentic workflows and training strat…
SWE-Edit: Rethinking Code Editing for Efficient SWE-Agent
Yikai Zhang, Jiaxin Pei, Kenan Li +9
Large language model agents have made strong progress on software engineering, yet current systems suffer from a context coupling problem: the standard code editing interface confl…
DevBench: A Realistic, Developer-Informed Benchmark for Code Generation Models
Adarsh Kumarappan, Pareesa Ameneh Golnari, Wen Wen +5
DevBench is a telemetry-driven benchmark designed to evaluate Large Language Models (LLMs) on realistic code completion tasks. It includes 1,800 evaluation instances across six pro…
Sphinx: Benchmarking and Modeling for LLM-Driven Pull Request Review
Daoan Zhang, Shuo Zhang, Zijian Jin +3
Pull request (PR) review is essential for ensuring software quality, yet automating this task remains challenging due to noisy supervision, limited contextual understanding, and in…