PLAID: Supporting Computing Instructors to Identify Domain-Specific Programming Plans at Scale
arXiv:2502.10618 · doi:10.1145/3706598.3713832
Abstract
Pedagogical approaches focusing on stereotypical code solutions, known as programming plans, can increase problem-solving ability and motivate diverse learners. However, plan-focused pedagogies are rarely used beyond introductory programming. Our formative study (N=10 educators) showed that identifying plans is a tedious process. To advance plan-focused pedagogies in application-focused domains, we created an LLM-powered pipeline that automates the effortful parts of educators' plan identification process by providing use-case-driven program examples and candidate plans. In design workshops (N=7 educators), we identified design goals to maximize instructors' efficiency in plan identification by optimizing interaction with this LLM-generated content. Our resulting tool, PLAID, enables instructors to access a corpus of relevant programs to inspire plan identification, compare code snippets to assist plan refinement, and facilitates them in structuring code snippets into plans. We evaluated PLAID in a within-subjects user study (N=12 educators) and found that PLAID led to lower cognitive demand and increased productivity compared to the state-of-the-art. Educators found PLAID beneficial for generating instructional material. Thus, our findings suggest that human-in-the-loop approaches hold promise for supporting plan-focused pedagogies at scale.
21 pages, 11 figures
References in corpus (11)
- Survey of Hallucination in Natural Language Generation
- Automatic Generation of Programming Exercises and Code Explanations using Large Language Models
- The Robots are Here: Navigating the Generative AI Revolution in Computing Education
- CodeAid: Evaluating a Classroom Deployment of an LLM-based Programming Assistant that Balances Student and Educator Needs
- Comparing Code Explanations Created by Students and Large Language Models
- Mining Idioms from Source Code
- Teach AI How to Code: Using Large Language Models as Teachable Agents for Programming Education
- Exploring the Role of AI Assistants in Computer Science Education: Methods, Implications, and Instructor Perspectives
- Ivie: Lightweight Anchored Explanations of Just-Generated Code
- Validating AI-Generated Code with Live Programming
- Tutorly: Turning Programming Videos Into Apprenticeship Learning Environments with LLMs