97 citations · 102 across the 24 of their papers we have counts for
1 paper · 1 filter
Nishant Balepur, Kiran Tomlinson, Tobias Schnabel
Repository benchmarks (e.g., SWE-bench) for coding agents often assume that lines of code edited can predict task difficulty, but such datasets' poor control over code and task typ…