2 papers
cs.CY2024
61A Bot Report: AI Assistants in CS1 Save Students Homework Time and Reduce Demands on Staff. (Now What?)
J. D. Zamfirescu-Pereira, Laryn Qi, Björn Hartmann +2
LLM-based chatbots enable students to get immediate, interactive help on homework assignments, but even a thoughtfully-designed bot may not serve all pedagogical goals. We report h…
cs.CY2024
A Knowledge-Component-Based Methodology for Evaluating AI Assistants
Laryn Qi, J. D. Zamfirescu-Pereira, Taehan Kim +3
We evaluate an automatic hint generator for CS1 programming assignments powered by GPT-4, a large language model. This system provides natural language guidance about how students…