173 citations · 784 across the 54 of their papers we have counts for
8 papers · 1 filter
Video2Action: Reducing Human Interactions in Action Annotation of App Tutorial Videos
Sidong Feng, Chunyang Chen, Zhenchang Xing
Tutorial videos of mobile apps have become a popular and compelling way for users to learn unfamiliar app features. To make the video accessible to the users, video creators always…
Unveiling the Tricks: Automated Detection of Dark Patterns in Mobile Applications
Jieshan Chen, Jiamou Sun, Sidong Feng +4
Mobile apps bring us many conveniences, such as online shopping and communication, but some use malicious designs called dark patterns to trick users into doing things that are not…
Towards Real Smart Apps: Investigating Human-AI Interactions in Smartphone On-Device AI Apps
Jason Ching Yuen Siu, Jieshan Chen, Yujin Huang +2
With the emergence of deep learning techniques, smartphone apps are now embedded on-device AI features for enabling advanced tasks like speech translation, to attract users and inc…
Enhancing Virtual Assistant Intelligence: Precise Area Targeting for Instance-level User Intents beyond Metadata
Mengyu Chen, Zhenchang Xing, Jieshan Chen +2
Virtual assistants have been widely used by mobile phone users in recent years. Although their capabilities of processing user intents have been developed rapidly, virtual assistan…
Voicify Your UI: Towards Android App Control with Voice Commands
Minh Duc Vu, Han Wang, Zhuang Li +3
Nowadays, voice assistants help users complete tasks on the smartphone with voice commands, replacing traditional touchscreen interactions when such interactions are inhibited. How…
Psychologically-Inspired, Unsupervised Inference of Perceptual Groups of GUI Widgets from GUI Images
Mulong Xie, Zhenchang Xing, Sidong Feng +3
Graphical User Interface (GUI) is not merely a collection of individual and unrelated widgets, but rather partitions discrete widgets into groups by various visual cues, thus formi…
From Lost to Found: Discover Missing UI Design Semantics through Recovering Missing Tags
Chunyang Chen, Sidong Feng, Zhengyang Liu +2
Design sharing sites provide UI designers with a platform to share their works and also an opportunity to get inspiration from others' designs. To facilitate management and search…
Unblind Your Apps: Predicting Natural-Language Labels for Mobile GUI Components by Deep Learning
Jieshan Chen, Chunyang Chen, Zhenchang Xing +4
According to the World Health Organization(WHO), it is estimated that approximately 1.3 billion people live with some forms of vision impairment globally, of whom 36 million are bl…