4 citations · 8 across the 6 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.SE2024★ 4 cited
Are Large Language Models Memorizing Bug Benchmarks?
Daniel Ramos, Claudia Mamede, Kush Jain +3
Large Language Models (LLMs) have become integral to various software engineering tasks, including code generation, bug detection, and repair. To evaluate model performance in thes…
cs.SE2024★ 1 cited
TestGenEval: A Real World Unit Test Generation and Test Completion Benchmark
Kush Jain, Gabriel Synnaeve, Baptiste Rozière
Code generation models can help improve many common software tasks ranging from code completion to defect prediction. Most of the existing benchmarks for code generation LLMs focus…