PyMETA: Evaluating Student Code Diagnosis on and Beyond the First Execution Error

Chuyue Li, Ziqi Tang, Jingyi Wang +3

Large language models can diagnose a student program from its code, problem statement, and reference solution. Evaluating this ability requires a clear definition of what counts as…