benchmark reliability 1coding agents 1leaderboard scoring 1performance optimization 1software engineering 1
From the 1 of 3 linked papers with an AI index.
3 papers
cs.SE2026
Are Performance-Optimization Benchmarks Reliably Measuring Coding Agents?
Zhi Chen, Zhensu Sun, Yuling Shi +2
The paper audits three repository-level performance‑optimization benchmarks (GSO, SWE‑Perf, SWE‑efficiency) to assess how reliably they measure coding agents, revealing issues with…
cs.CL2026
Seeing is Coding: On the Effectiveness of Vision Language Models in Code Understanding
Yuling Shi, Chaoxiang Xie, Zhensu Sun +7
Large Language Models (LLMs) have achieved remarkable success in source code understanding, yet as software systems grow in scale, computational efficiency has become a critical bo…
cs.SE2026
Rethinking the Value of Agent-Generated Tests for LLM-Based Software Engineering Agents
Zhi Chen, Zhensu Sun, Yuling Shi +4
Large Language Model (LLM) code agents increasingly resolve repository-level issues by iteratively editing code, invoking tools, and validating candidate patches. In these workflow…