3 papers
cs.SE2026
Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution
Kai Yu, Zhenhao Zhou, Junhao Zeng +8
Repository-level issue resolution benchmarks have become a standard testbed for evaluating LLM-based agents, yet success is still predominantly measured by test pass rates. In prac…
cs.SE2025
Extracting Conceptual Knowledge to Locate Software Issues
Ying Wang, Wenjun Mao, Chong Wang +5
Issue localization, which identifies faulty code elements such as files or functions, is critical for effective bug fixing. While recent LLM-based and LLM-agent-based approaches im…
cs.SE2025
Code Copycat Conundrum: Demystifying Repetition in LLM-based Code Generation
Mingwei Liu, Juntao Li, Ying Wang +9
Despite recent advances in Large Language Models (LLMs) for code generation, the quality of LLM-generated code still faces significant challenges. One significant issue is code rep…