activity
20232025
most citedLarge Language Models (GPT) Struggle to Answer Multiple-Choice Questions about Code

4 citations · 9 across the 5 of their papers we have counts for

collaborators
Showing cs.CYShow all

1 paper · 1 filter

cs.CY2023★ 1 cited

From GPT-3 to GPT-4: On the Evolving Efficacy of LLMs to Answer Multiple-choice Questions for Programming Classes in Higher Education

Jaromir Savelka, Arav Agarwal, Christopher Bogart +1

We explore the evolving efficacy of three generative pre-trained transformer (GPT) models in generating answers for multiple-choice questions (MCQ) from introductory and intermedia…