5 papers
Beyond Fixed Tests: Repository-Level Issue Resolution as Coevolution of Code and Behavioral Constraints
Kefan Li, Yuan Yuan, Mengfei Wang +5
Software engineers resolving repository-level issues do not treat existing tests as immutable correctness oracles. Instead, they iteratively refine both code and the tests used to…
RepoMasterEval: Evaluating Code Completion via Real-World Repositories
Qinyun Wu, Chao Peng, Pengfei Gao +9
With the growing reliance on automated code completion tools in software development, the need for comprehensive evaluation benchmarks has become critical. Existing benchmarks focu…
CoReQA: Uncovering Potentials of Language Models in Code Repository Question Answering
Jialiang Chen, Kaifa Zhao, Jie Liu +6
Large language models that enhance software development tasks, such as code generation, code completion, and code question answering (QA), have been extensively studied in both aca…
Prompting Large Language Models to Tackle the Full Software Development Lifecycle: A Case Study
Bowen Li, Wenhan Wu, Ziwei Tang +13
Recent advancements in large language models (LLMs) have significantly enhanced their coding capabilities. However, existing benchmarks predominantly focused on simplified or isola…
VersiCode: Towards Version-controllable Code Generation
Tongtong Wu, Weigang Wu, Xingyu Wang +7
Large Language Models (LLMs) have made tremendous strides in code generation, but existing research fails to account for the dynamic nature of software development, marked by frequ…