An evaluation of LLM code generation capabilities through graded exercises

Álvaro Barbero Jiménez

Large Language Models have shown prominent capabilities in generating functional code from natural language descriptions. However, a standardized way to evaluate these capabilities…