Evaluating LLM-Generated Code: A Benchmark and Developer Study

Joanna Szych, Anne Schwerk

Code generation is one of the tasks for which the use of Large Language Models is widely adopted and highly successful. Given this popularity, there are many benchmarks dedicated t…