41 citations · 143 across the 20 of their papers we have counts for
8 papers · 1 filter
Towards Human-AI Synergy in UI Design: Supporting Iterative Generation with LLMs
Mingyue Yuan, Jieshan Chen, Yongquan Hu +5
In automated UI design generation, a key challenge is the lack of support for iterative processes, as most systems focus solely on end-to-end output. This stems from limited capabi…
MUD: Towards a Large-Scale and Noise-Filtered UI Dataset for Modern Style UI Modeling
Sidong Feng, Suyu Ma, Han Wang +2
The importance of computational modeling of mobile user interfaces (UIs) is undeniable. However, these require a high-quality UI dataset. Existing datasets are often outdated, coll…
Designing with Language: Wireframing UI Design Intent with Generative Large Language Models
Sidong Feng, Mingyue Yuan, Jieshan Chen +2
Wireframing is a critical step in the UI design process. Mid-fidelity wireframes offer more impactful and engaging visuals compared to low-fidelity versions. However, their creatio…
Video2Action: Reducing Human Interactions in Action Annotation of App Tutorial Videos
Sidong Feng, Chunyang Chen, Zhenchang Xing
Tutorial videos of mobile apps have become a popular and compelling way for users to learn unfamiliar app features. To make the video accessible to the users, video creators always…
Unveiling the Tricks: Automated Detection of Dark Patterns in Mobile Applications
Jieshan Chen, Jiamou Sun, Sidong Feng +4
Mobile apps bring us many conveniences, such as online shopping and communication, but some use malicious designs called dark patterns to trick users into doing things that are not…
Psychologically-Inspired, Unsupervised Inference of Perceptual Groups of GUI Widgets from GUI Images
Mulong Xie, Zhenchang Xing, Sidong Feng +3
Graphical User Interface (GUI) is not merely a collection of individual and unrelated widgets, but rather partitions discrete widgets into groups by various visual cues, thus formi…