5 papers
BulkPR-Bench: Benchmarking Queue-Level Governance of Interacting Pull Requests
Zetong Xiong, Qiao Zhao, Jun Zhang +20
Coding-agent benchmarks increasingly cover long-horizon, end-to-end, and interactive development, but typically retain one requested outcome or a fixed change sequence. Sequential…
Effective LLM Code Refinement via Property-Oriented and Structurally Minimal Feedback
Lehan He, Zeren Chen, Zhe Zhang +2
LLMs excel at code generation, yet ensuring the functional correctness of their outputs remains a persistent challenge. While recent studies have applied Test-Driven Development (T…
Code2Bench: Scaling Source and Rigor for Dynamic Benchmark Construction
Zhe Zhang, Runlin Liu, Aishan Liu +3
The evaluation of code-generating Large Language Models (LLMs) is fundamentally constrained by two intertwined challenges: a reliance on static, easily contaminated problem sources…
Type-aware LLM-based Regression Test Generation for Python Programs
Runlin Liu, Zhe Zhang, Yunge Hu +3
Automated regression test generation has been extensively explored, yet generating high-quality tests for Python programs remains particularly challenging. Because of the Python's…
LLM-based Unit Test Generation via Property Retrieval
Zhe Zhang, Xingyu Liu, Yuanzhang Lin +3
Automated unit test generation has been widely studied, with Large Language Models (LLMs) recently showing significant potential. Moreover, in the context of unit test generation,…