7 papers
Analyzing and Mitigating Cost-Inefficient Behaviors in Coding Agents
Yiran Hu, Nan Jiang, Shanchao Liang +3
Although effective, coding agents often incur substantial monetary costs. Their recurring cost-inefficient behaviors remain underexplored. We conduct the first study of behavioral…
TENET: One Step Toward Test-Driven Development for Repository-Level Code Generation
Yiran Hu, Shanchao Liang, Nan Jiang +2
Test-Driven Development (TDD) is a widely adopted practice that requires developers to create and execute tests alongside implementation. With recent advances in Large Language Mod…
Unified Software Engineering Agent as AI Software Engineer
Leonhard Applis, Yuntong Zhang, Shanchao Liang +3
The growth of Large Language Model (LLM) technology has raised expectations for automated coding. However, software engineering is more than coding and is concerned with activities…
Show Me Why It's Correct: Saving 1/3 of Debugging Time in Program Repair with Interactive Runtime Comparison
Ruixin Wang, Zhongkai Zhao, Le Fang +4
Automated Program Repair (APR) holds the promise of alleviating the burden of debugging and fixing software bugs. Despite this, developers still need to manually inspect each patch…
Collu-Bench: A Benchmark for Predicting Language Model Hallucinations in Code
Nan Jiang, Qi Li, Lin Tan +1
Despite their success, large language models (LLMs) face the critical challenge of hallucinations, generating plausible but incorrect content. While much research has focused on ha…
Can Language Models Replace Programmers for Coding? REPOCOD Says 'Not Yet'
Shanchao Liang, Yiran Hu, Nan Jiang +1
Recently, a number of repository-level code generation benchmarks-such as CoderEval, DevEval, RepoEval, RepoBench, and LongCodeArena-have emerged to evaluate the capabilities of la…
WAFFLE: Finetuning Multi-Modal Models for Automated Front-End Development
Shanchao Liang, Nan Jiang, Shangshu Qian +1
Web development involves turning UI designs into functional webpages, which can be difficult for both beginners and experienced developers due to the complexity of HTML's hierarchi…