53 citations · 73 across the 12 of their papers we have counts for
13 papers
SpecifyUI: Supporting Iterative UI Design Intent Expression through Structured Specifications and Generative AI
Yunnong Chen, Chengwei Shi, Liuqing Chen
Large language models (LLMs) promise to accelerate UI design, yet current tools struggle with two fundamentals: externalizing designers' intent and controlling iterative change. We…
DesignCoder: Hierarchy-Aware and Self-Correcting UI Code Generation with Large Language Models
Yunnong Chen, Shixian Ding, YingYing Zhang +4
Multimodal large language models (MLLMs) have streamlined front-end interface development by automating code generation. However, these models also introduce challenges in ensuring…
MindScratch: A Visual Programming Support Tool for Classroom Learning Based on Multimodal Generative AI
Yunnong Chen, Shuhong Xiao, Yaxuan Song +3
Programming has become an essential component of K-12 education and serves as a pathway for developing computational thinking skills. Given the complexity of programming and the ad…
CoRemix: Supporting Informal Learning in Scratch Community With Visual Graph and Generative AI
Yunnong Chen, Yishu Shen, Ruiyi Liu +3
Online programming communities provide a space for novices to engage with computing concepts, allowing them to learn and develop computing skills using user-generated projects. How…
Fragmented Layer Grouping in GUI Designs Through Graph Learning Based on Multimodal Information
Yunnong Chen, Shuhong Xiao, Jiazhi Li +5
Automatically constructing GUI groups of different granularities constitutes a critical intelligent step towards automating GUI design and implementation tasks. Specifically, in th…
An Artificial Intelligence Approach for Interpreting Creative Combinational Designs
Liuqing Chen, Shuhong Xiao, Yunnong Chen +3
Combinational creativity, a form of creativity involving the blending of familiar ideas, is pivotal in design innovation. While most research focuses on how combinational creativit…
Prototype2Code: End-to-end Front-end Code Generation from UI Design Prototypes
Shuhong Xiao, Yunnong Chen, Jiazhi Li +3
UI-to-code technology has streamlined the front-end development process, reducing repetitive tasks for engineers. prior research mainly use design prototypes as inputs, with the ef…
UI Semantic Group Detection: Grouping UI Elements with Similar Semantics in Mobile Graphical User Interface
Shuhong Xiao, Yunnong Chen, Yaxuan Song +4
Texts, widgets, and images on a UI page do not work separately. Instead, they are partitioned into groups to achieve certain interaction functions or visual information. Existing s…
ChatScratch: An AI-Augmented System Toward Autonomous Visual Programming Learning for Children Aged 6-12
Liuqing Chen, Shuhong Xiao, Yunnong Chen +3
As Computational Thinking (CT) continues to permeate younger age groups in K-12 education, established CT platforms such as Scratch face challenges in catering to these younger lea…
EGFE: End-to-end Grouping of Fragmented Elements in UI Designs with Multimodal Learning
Liuqing Chen, Yunnong Chen, Shuhong Xiao +5
When translating UI design prototypes to code in industry, automatically generating code from design prototypes can expedite the development of applications and GUI iterations. How…
UI Layers Group Detector: Grouping UI Layers via Text Fusion and Box Attention
Shuhong Xiao, Tingting Zhou, Yunnong Chen +4
Graphic User Interface (GUI) is facing great demand with the popularization and prosperity of mobile apps. Automatic UI code generation from UI design draft dramatically simplifies…
ULDGNN: A Fragmented UI Layer Detector Based on Graph Neural Networks
Jiazhi Li, Tingting Zhou, Yunnong Chen +4
While some work attempt to generate front-end code intelligently from UI screenshots, it may be more convenient to utilize UI design drafts in Sketch which is a popular UI design s…
UI Layers Merger: Merging UI layers via Visual Learning and Boundary Prior
Yun-nong Chen, Yan-kun Zhen, Chu-ning Shi +6
With the fast-growing GUI development workload in the Internet industry, some work on intelligent methods attempted to generate maintainable front-end code from UI screenshots. It…