Where LLM Graders Succeed and Break: Evidence from Two Computer-Science Exams

Ali Habibullah, Yazan Alshoibi, Mohammad Alshiekh +2

One long-form exam in a large course costs hundreds of grader-hours, and qualified graders are scarce; LLM graders are a tempting alternative. To show its pitfalls we grade a pract…