41 citations · 143 across the 20 of their papers we have counts for
21 papers
ViBR: Automated Bug Replay from Video-based Reports using Vision-Language Models
Sidong Feng, Dingbang Wang, Nikola Tomic +3
Bug reports play a critical role in software maintenance by helping users convey encountered issues to developers. Recently, GUI screen capture videos have gained popularity as a b…
How Smart Is Your GUI Agent? A Framework for the Future of Software Interaction
Sidong Feng, Chunyang Chen
GUI agents are rapidly becoming a new interaction to software, allowing people to navigate web, desktop and mobile rather than execute them click by click. Yet ``agent'' is describ…
Breaking Single-Tester Limits: Multi-Agent LLMs for Multi-User Feature Testing
Sidong Feng, Changhao Du, Huaxiao Liu +4
The growing dependence on mobile phones and their apps has made multi-user interactive features, like chat calls, live streaming, and video conferencing, indispensable for bridging…
Agent for User: Testing Multi-User Interactive Features in TikTok
Sidong Feng, Changhao Du, Huaxiao Liu +5
TikTok, a widely-used social media app boasting over a billion monthly active users, requires effective app quality assurance for its intricate features. Feature testing is crucial…
An Empirical Study on Leveraging Images in Automated Bug Report Reproduction
Dingbang Wang, Zhaoxu Zhang, Sidong Feng +2
Automated bug reproduction is a challenging task, with existing tools typically relying on textual steps-to-reproduce, videos, or crash logs in bug reports as input. However, image…
Towards Human-AI Synergy in UI Design: Supporting Iterative Generation with LLMs
Mingyue Yuan, Jieshan Chen, Yongquan Hu +5
In automated UI design generation, a key challenge is the lack of support for iterative processes, as most systems focus solely on end-to-end output. This stems from limited capabi…
Enabling Cost-Effective UI Automation Testing with Retrieval-Based LLMs: A Case Study in WeChat
Sidong Feng, Haochuan Lu, Jianqin Jiang +6
UI automation tests play a crucial role in ensuring the quality of mobile applications. Despite the growing popularity of machine learning techniques to generate these tests, they…
Feedback-Driven Automated Whole Bug Report Reproduction for Android Apps
Dingbang Wang, Yu Zhao, Sidong Feng +6
In software development, bug report reproduction is a challenging task. This paper introduces ReBL, a novel feedback-driven approach that leverages GPT-4, a large-scale language mo…
MUD: Towards a Large-Scale and Noise-Filtered UI Dataset for Modern Style UI Modeling
Sidong Feng, Suyu Ma, Han Wang +2
The importance of computational modeling of mobile user interfaces (UIs) is undeniable. However, these require a high-quality UI dataset. Existing datasets are often outdated, coll…
Designing with Language: Wireframing UI Design Intent with Generative Large Language Models
Sidong Feng, Mingyue Yuan, Jieshan Chen +2
Wireframing is a critical step in the UI design process. Mid-fidelity wireframes offer more impactful and engaging visuals compared to low-fidelity versions. However, their creatio…
Towards Efficient Record and Replay: A Case Study in WeChat
Sidong Feng, Haochuan Lu, Ting Xiong +2
WeChat, a widely-used messenger app boasting over 1 billion monthly active users, requires effective app quality assurance for its complex features. Record-and-replay tools are cru…
Video2Action: Reducing Human Interactions in Action Annotation of App Tutorial Videos
Sidong Feng, Chunyang Chen, Zhenchang Xing
Tutorial videos of mobile apps have become a popular and compelling way for users to learn unfamiliar app features. To make the video accessible to the users, video creators always…
Unveiling the Tricks: Automated Detection of Dark Patterns in Mobile Applications
Jieshan Chen, Jiamou Sun, Sidong Feng +4
Mobile apps bring us many conveniences, such as online shopping and communication, but some use malicious designs called dark patterns to trick users into doing things that are not…
Prompting Is All You Need: Automated Android Bug Replay with Large Language Models
Sidong Feng, Chunyang Chen
Bug reports are vital for software maintenance that allow users to inform developers of the problems encountered while using the software. As such, researchers have committed consi…
Read It, Don't Watch It: Captioning Bug Recordings Automatically
Sidong Feng, Mulong Xie, Yinxing Xue +1
Screen recordings of mobile applications are easy to capture and include a wealth of information, making them a popular mechanism for users to inform developers of the problems enc…
Efficiency Matters: Speeding Up Automated Testing with GUI Rendering Inference
Sidong Feng, Mulong Xie, Chunyang Chen
Due to the importance of Android app quality assurance, many automated GUI testing tools have been developed. Although the test algorithms have been improved, the impact of GUI ren…
Psychologically-Inspired, Unsupervised Inference of Perceptual Groups of GUI Widgets from GUI Images
Mulong Xie, Zhenchang Xing, Sidong Feng +3
Graphical User Interface (GUI) is not merely a collection of individual and unrelated widgets, but rather partitions discrete widgets into groups by various visual cues, thus formi…
Auto-Icon+: An Automated End-to-End Code Generation Tool for Icon Designs in UI Development
Sidong Feng, Minmin Jiang, Tingting Zhou +2
Approximately 50% of development resources are devoted to UI development tasks [9]. Occupying a large proportion of development resources, developing icons can be a time-consuming…
Gallery D.C.: Auto-created GUI Component Gallery for Design Search and Knowledge Discovery
Sidong Feng, Chunyang Chen, Zhenchang Xing
GUI design is an integral part of software development. The process of designing a mobile application typically starts with the ideation and inspiration search from existing design…
GIFdroid: Automated Replay of Visual Bug Reports for Android Apps
Sidong Feng, Chunyang Chen
Bug reports are vital for software maintenance that allow users to inform developers of the problems encountered while using software. However, it is difficult for non-technical us…
From Lost to Found: Discover Missing UI Design Semantics through Recovering Missing Tags
Chunyang Chen, Sidong Feng, Zhengyang Liu +2
Design sharing sites provide UI designers with a platform to share their works and also an opportunity to get inspiration from others' designs. To facilitate management and search…