ScratchEval : A Multimodal Evaluation Framework for LLMs in Block-Based Programming

Yuan Si, Simeng Han, Daming Li +2

LLMs have achieved strong performance on text-based programming tasks, yet they remain unreliable for block-based languages such as Scratch. Scratch programs exhibit deeply nested,…