74 citations · 132 across the 14 of their papers we have counts for
4 papers · 1 filter
TestSuiteBench: Coding Agents Struggle to Generate Strong Test Suites from Specifications
Kazuki Egashira, Niels Mündler-Sasahara, Mark Niklas Müller +1
Coding agents are increasingly used to create large software projects. While code-generation benchmarks have scaled accordingly to full applications, test-generation benchmarks rem…
Coding Agents Don't Know When to Act
Thibaud Gloaguen, Niels Mündler, Mark Müller +2
Coding agents are increasingly deployed to autonomously maintain software, including to resolve user-reported issues: a bug report comes in and the agent creates a patch to address…
Automated Benchmark Generation for Repository-Level Coding Tasks
Konstantinos Vergopoulos, Mark Niklas Müller, Martin Vechev
Code Agent development is an extremely active research area, where a reliable performance metric is critical for tracking progress and guiding new developments. This demand is unde…
SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code Agents
Niels Mündler, Mark Niklas Müller, Jingxuan He +1
Rigorous software testing is crucial for developing and maintaining high-quality code, making automated test generation a promising avenue for both improving software quality and b…