activity
20232025
most citedAre Large Language Models Memorizing Bug Benchmarks?

4 citations · 8 across the 6 of their papers we have counts for

collaborators

6 papers

cs.SE2025

Improving Examples in Web API Specifications using Iterated-Calls In-Context Learning

Kush Jain, Kiran Kate, Jason Tsay +2

Examples in web API specifications can be essential for API testing, API understanding, and even building chat-bots for APIs. Unfortunately, most API specifications lack human-writ…

cs.SE2025★ 3 cited

TestForge: Feedback-Driven, Agentic Test Suite Generation

Kush Jain, Claire Le Goues

Automated test generation holds great promise for alleviating the burdens of manual test creation. However, existing search-based techniques compromise on test readability, while L…

cs.SE2024★ 4 cited

Are Large Language Models Memorizing Bug Benchmarks?

Daniel Ramos, Claudia Mamede, Kush Jain +3

Large Language Models (LLMs) have become integral to various software engineering tasks, including code generation, bug detection, and repair. To evaluate model performance in thes…

cs.SE2024★ 1 cited

TestGenEval: A Real World Unit Test Generation and Test Completion Benchmark

Kush Jain, Gabriel Synnaeve, Baptiste Rozière

Code generation models can help improve many common software tasks ranging from code completion to defect prediction. Most of the existing benchmarks for code generation LLMs focus…

cs.SE2023

CAT-LM: Training Language Models on Aligned Code And Tests

Nikitha Rao, Kush Jain, Uri Alon +2

Testing is an integral part of the software development process. Yet, writing tests is time-consuming and therefore often neglected. Classical test generation tools such as EvoSuit…

cs.SE2023

Contextual Predictive Mutation Testing

Kush Jain, Uri Alon, Alex Groce +1

Mutation testing is a powerful technique for assessing and improving test suite quality that artificially introduces bugs and checks whether the test suites catch them. However, it…