3 papers
cs.SE2026
BulkPR-Bench: Benchmarking Queue-Level Governance of Interacting Pull Requests
Zetong Xiong, Qiao Zhao, Jun Zhang +20
Coding-agent benchmarks increasingly cover long-horizon, end-to-end, and interactive development, but typically retain one requested outcome or a fixed change sequence. Sequential…
cs.SE2026
SWE-Future: Forecast-Conditioned Data Synthesis for Future-Oriented Software Engineering Agents
Qiao Zhao, JianYing Qu, Jun Zhang +3
Realistic coding-agent benchmarks often replay public GitHub issues and pull requests, making them vulnerable to overlap with model pretraining, fine-tuning, synthetic-data generat…
cs.SE2026
Code-QA-Bench: Separating Code Reasoning from Documentation Memorization in Repository-Level QA
Jun Zhang, JianYing Qu, Hanwen Du +3
We present Code-QA-Bench, a fully automated framework for synthesizing repository-level code understanding benchmarks that separates genuine code comprehension from documentation r…