Evaluating Code Generation of LLMs in Advanced Computer Science Problems

Emir Catir, Robin Claesson, Rodothea Myrsini Tsoupidi

Large Language Models (LLMs), such as GitHub Copilot and ChatGPT have become popular among programming students. Students use LLMs to assist them in programming courses, including…