5 papers
SpecifyUI: Supporting Iterative UI Design Intent Expression through Structured Specifications and Generative AI
Yunnong Chen, Chengwei Shi, Liuqing Chen
Large language models (LLMs) promise to accelerate UI design, yet current tools struggle with two fundamentals: externalizing designers' intent and controlling iterative change. We…
DesignCoder: Hierarchy-Aware and Self-Correcting UI Code Generation with Large Language Models
Yunnong Chen, Shixian Ding, YingYing Zhang +4
Multimodal large language models (MLLMs) have streamlined front-end interface development by automating code generation. However, these models also introduce challenges in ensuring…
MindScratch: A Visual Programming Support Tool for Classroom Learning Based on Multimodal Generative AI
Yunnong Chen, Shuhong Xiao, Yaxuan Song +3
Programming has become an essential component of K-12 education and serves as a pathway for developing computational thinking skills. Given the complexity of programming and the ad…
CoRemix: Supporting Informal Learning in Scratch Community With Visual Graph and Generative AI
Yunnong Chen, Yishu Shen, Ruiyi Liu +3
Online programming communities provide a space for novices to engage with computing concepts, allowing them to learn and develop computing skills using user-generated projects. How…
Fragmented Layer Grouping in GUI Designs Through Graph Learning Based on Multimodal Information
Yunnong Chen, Shuhong Xiao, Jiazhi Li +5
Automatically constructing GUI groups of different granularities constitutes a critical intelligent step towards automating GUI design and implementation tasks. Specifically, in th…