4 papers
Consistently Good vs. Occasionally Great: A Rubric for Open-Ended Feedback Quality from Humans and Machines
Binglin Chen, Rajarshi Haldar, Max Fowler +2
Providing high-quality feedback on student work is essential for learning, yet delivering such feedback at scale remains challenging. In this paper, we focus on feedback for open-e…
Mining Hierarchies with Conviction: Constructing the CS1 Skill Hierarchy with Pairwise Comparisons over Skill Distributions
Dip Kiran Pradhan Newar, Max Fowler, David H. Smith +1
Background and Context: Some skills taught in introductory programming courses are categorized into 1) explaining code, 2) arranging lines of code in correct sequence, 3) tracing t…
Counting the Trees in the Forest: Evaluating Prompt Segmentation for Classifying Code Comprehension Level
David H. Smith, Max Fowler, Paul Denny +1
Reading and understanding code are fundamental skills for novice programmers, and especially important with the growing prevalence of AI-generated code and the need to evaluate its…
ReDefining Code Comprehension: Function Naming as a Mechanism for Evaluating Code Comprehension
David H. Smith, Max Fowler, Paul Denny +1
"Explain in Plain English" (EiPE) questions are widely used to assess code comprehension skills but are challenging to grade automatically. Recent approaches like Code Generation B…