27 citations · 96 across the 18 of their papers we have counts for
3 papers · 1 filter
Does SWE-Bench-Verified Test Agent Ability or Model Memory?
Thanosan Prathifkumar, Noble Saji Mathews, Meiyappan Nagappan
SWE-Bench-Verified, a dataset comprising 500 issues, serves as a de facto benchmark for evaluating various large language models (LLMs) on their ability to resolve GitHub issues. B…
AssertFlip: Reproducing Bugs via Inversion of LLM-Generated Passing Tests
Lara Khatib, Noble Saji Mathews, Meiyappan Nagappan
Bug reproduction is critical in the software debugging and repair process, yet the majority of bugs in open-source and industrial settings lack executable tests to reproduce them a…
Is Your Automated Software Engineer Trustworthy?
Noble Saji Mathews, Meiyappan Nagappan
Large Language Models (LLMs) are being increasingly used in software engineering tasks, with an increased focus on bug report resolution over the past year. However, most proposed…