6 papers · 1 filter
Raven: Rethinking Automated Assessment for Scratch Programs via Video-Grounded Evaluation
Donglin Li, Daming Li, Hanyuan Shi +1
Block-based programming environments such as Scratch are widely used in introductory computing education, yet scalable and reliable automated assessment remains elusive. Scratch pr…
EcoScratch: Cost-Effective Multimodal Repair for Scratch Using Execution Feedback
Yuan Si, Ming Wang, Daming Li +2
Scratch is the most popular programming environment for novices, with over 1.15 billion projects created worldwide. Unlike traditional languages, correctness in Scratch is defined…
ScratchEval : A Multimodal Evaluation Framework for LLMs in Block-Based Programming
Yuan Si, Simeng Han, Daming Li +2
LLMs have achieved strong performance on text-based programming tasks, yet they remain unreliable for block-based languages such as Scratch. Scratch programs exhibit deeply nested,…
Stitch: Step-by-step LLM Guided Tutoring for Scratch
Yuan Si, Kyle Qi, Daming Li +2
Block-based environments such as Scratch are increasingly popular in programming education. While block syntax reduces surface errors, semantic bugs remain common and challenging f…
A Systematic Study of Time Limit Exceeded Errors in Online Programming Assignments
Jialu Zhang, Jialiang Gu, Wangmeiyu Zhang +5
Online programming platforms such as Codeforces and LeetCode attract millions of users seeking to learn to program or refine their skills for industry interviews. A major challenge…
ViScratch: Using Large Language Models and Gameplay Videos for Automated Feedback in Scratch
Yuan Si, Daming Li, Hanyuan Shi +1
Block-based programming environments such as Scratch are increasingly popular in programming education, in particular for young learners. While the use of blocks helps prevent synt…