The Fault in our Stars: Quality Assessment of Code Generation Benchmarks

Mohammed Latif Siddiq, Simantika Dristi, Joy Saha +1

Large Language Models (LLMs) are gaining popularity among software engineers. A crucial aspect of developing effective code generation LLMs is to evaluate these models using a robu…