9 papers
RepoRescue: An Empirical Study of LLM Agents on Whole-Repository Compatibility Rescue
Zhihao Lin, Mingyi Zhou, Zhensu Sun +4
Open-source libraries and tools are widely reused, but compatibility maintenance is expensive. Once maintainers leave, useful repositories can stop working as runtimes and dependen…
To Run or Not to Run: Analyzing the Cost-Effectiveness of Code Execution in LLM-Based Program Repair
Zhihao Lin, Junhua Zhu, Mingyi Zhou +5
LLM-based agents for program repair are increasingly built on a "generate-run-revise" paradigm, iteratively executing tests to evaluate and refine patches. This execution-based app…
Executing as You Generate: Hiding Execution Latency in LLM Code Interpreters
Zhensu Sun, Zhihao Lin, Zhi Chen +4
Current LLM systems are increasingly equipped with a code interpreter that executes generated code to obtain results. This works serially: the model first generates the complete co…
Towards Agentic Runtime Healing
Zhensu Sun, Haotian Zhu, Bowen Xu +3
Self-healing systems have long been a focus of research, aiming to enable software to recover from unexpected runtime errors without human intervention. Traditional approaches rely…
TestDecision: Sequential Test Suite Generation via Greedy Optimization and Reinforcement Learning
Guoqing Wang, Chengran Yang, Xiaoxuan Zhou +4
With the rapid evolution of LLMs, automated software testing is witnessing a paradigm shift. While proprietary models like GPT-4o demonstrate impressive capabilities, their high de…
BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution
Terry Yue Zhuo, Xiaolong Jin, Hange Liu +37
Crowdsourced model evaluation platforms, such as Chatbot Arena, enable real-time evaluation from human perspectives to assess the quality of model responses. In the coding domain,…