3 papers
cs.SE2025
RepoMasterEval: Evaluating Code Completion via Real-World Repositories
Qinyun Wu, Chao Peng, Pengfei Gao +9
With the growing reliance on automated code completion tools in software development, the need for comprehensive evaluation benchmarks has become critical. Existing benchmarks focu…
cs.SE2025
CoReQA: Uncovering Potentials of Language Models in Code Repository Question Answering
Jialiang Chen, Kaifa Zhao, Jie Liu +6
Large language models that enhance software development tasks, such as code generation, code completion, and code question answering (QA), have been extensively studied in both aca…
cs.CL2024
Prompting Large Language Models to Tackle the Full Software Development Lifecycle: A Case Study
Bowen Li, Wenhan Wu, Ziwei Tang +13
Recent advancements in large language models (LLMs) have significantly enhanced their coding capabilities. However, existing benchmarks predominantly focused on simplified or isola…