53 citations · 101 across the 18 of their papers we have counts for
19 papers
SpecifyUI: Supporting Iterative UI Design Intent Expression through Structured Specifications and Generative AI
Yunnong Chen, Chengwei Shi, Liuqing Chen
Large language models (LLMs) promise to accelerate UI design, yet current tools struggle with two fundamentals: externalizing designers' intent and controlling iterative change. We…
SCENIC: A Location-based System to Foster Cognitive Development in Children During Car Rides
Liuqing Chen, Yaxuan Song, Ke Lyu +3
Car-riding is common for children in modern life. Given the repetitive nature of daily commutes, they often feel bored and turn to electronic devices for entertainment. Meanwhile,…
DesignCoder: Hierarchy-Aware and Self-Correcting UI Code Generation with Large Language Models
Yunnong Chen, Shixian Ding, YingYing Zhang +4
Multimodal large language models (MLLMs) have streamlined front-end interface development by automating code generation. However, these models also introduce challenges in ensuring…
Integrating Sequence and Image Modeling in Irregular Medical Time Series Through Self-Supervised Learning
Liuqing Chen, Shuhong Xiao, Shixian Ding +2
Medical time series are often irregular and face significant missingness, posing challenges for data analysis and clinical decision-making. Existing methods typically adopt a singl…
Understanding Design Fixation in Generative AI
Liuqing Chen, Yaxuan Song, Chunyuan Zheng +3
Generative AI (GenAI) provides new opportunities for creativity support, but the phenomenon of GenAI design fixation remains underexplored. While human design fixation typically co…
How Generative AI supports human in conceptual design
Liuging Chen, Yaxuan Song, Jia Guo +3
Generative Artificial Intelligence (Generative AI) is a collection of AI technologies that can generate new information such as texts and images. With its strong capabilities, Gene…
MindScratch: A Visual Programming Support Tool for Classroom Learning Based on Multimodal Generative AI
Yunnong Chen, Shuhong Xiao, Yaxuan Song +3
Programming has become an essential component of K-12 education and serves as a pathway for developing computational thinking skills. Given the complexity of programming and the ad…
CoRemix: Supporting Informal Learning in Scratch Community With Visual Graph and Generative AI
Yunnong Chen, Yishu Shen, Ruiyi Liu +3
Online programming communities provide a space for novices to engage with computing concepts, allowing them to learn and develop computing skills using user-generated projects. How…
Fragmented Layer Grouping in GUI Designs Through Graph Learning Based on Multimodal Information
Yunnong Chen, Shuhong Xiao, Jiazhi Li +5
Automatically constructing GUI groups of different granularities constitutes a critical intelligent step towards automating GUI design and implementation tasks. Specifically, in th…
TRIZ-GPT: An LLM-augmented method for problem-solving
Liuqing Chen, Yaxuan Song, Shixian Ding +3
TRIZ, the Theory of Inventive Problem Solving, is derived from a comprehensive analysis of patents across various domains, offering a framework and practical tools for problem-solv…
An Artificial Intelligence Approach for Interpreting Creative Combinational Designs
Liuqing Chen, Shuhong Xiao, Yunnong Chen +3
Combinational creativity, a form of creativity involving the blending of familiar ideas, is pivotal in design innovation. While most research focuses on how combinational creativit…
Prototype2Code: End-to-end Front-end Code Generation from UI Design Prototypes
Shuhong Xiao, Yunnong Chen, Jiazhi Li +3
UI-to-code technology has streamlined the front-end development process, reducing repetitive tasks for engineers. prior research mainly use design prototypes as inputs, with the ef…
UI Semantic Group Detection: Grouping UI Elements with Similar Semantics in Mobile Graphical User Interface
Shuhong Xiao, Yunnong Chen, Yaxuan Song +4
Texts, widgets, and images on a UI page do not work separately. Instead, they are partitioned into groups to achieve certain interaction functions or visual information. Existing s…
ChatScratch: An AI-Augmented System Toward Autonomous Visual Programming Learning for Children Aged 6-12
Liuqing Chen, Shuhong Xiao, Yunnong Chen +3
As Computational Thinking (CT) continues to permeate younger age groups in K-12 education, established CT platforms such as Scratch face challenges in catering to these younger lea…
EGFE: End-to-end Grouping of Fragmented Elements in UI Designs with Multimodal Learning
Liuqing Chen, Yunnong Chen, Shuhong Xiao +5
When translating UI design prototypes to code in industry, automatically generating code from design prototypes can expedite the development of applications and GUI iterations. How…
UI Layers Group Detector: Grouping UI Layers via Text Fusion and Box Attention
Shuhong Xiao, Tingting Zhou, Yunnong Chen +4
Graphic User Interface (GUI) is facing great demand with the popularization and prosperity of mobile apps. Automatic UI code generation from UI design draft dramatically simplifies…
WikiLink: an encyclopedia-based semantic network for design innovation
Haoyu Zuo, Qianzhi Jing, Tianqi Song +4
Data-driven design and innovation is a process to reuse and provide valuable and useful information. However, existing semantic networks for design innovation is built on data sour…
ULDGNN: A Fragmented UI Layer Detector Based on Graph Neural Networks
Jiazhi Li, Tingting Zhou, Yunnong Chen +4
While some work attempt to generate front-end code intelligently from UI screenshots, it may be more convenient to utilize UI design drafts in Sketch which is a popular UI design s…
UI Layers Merger: Merging UI layers via Visual Learning and Boundary Prior
Yun-nong Chen, Yan-kun Zhen, Chu-ning Shi +6
With the fast-growing GUI development workload in the Internet industry, some work on intelligent methods attempted to generate maintainable front-end code from UI screenshots. It…