11 papers
ViBR: Automated Bug Replay from Video-based Reports using Vision-Language Models
Sidong Feng, Dingbang Wang, Nikola Tomic +3
Bug reports play a critical role in software maintenance by helping users convey encountered issues to developers. Recently, GUI screen capture videos have gained popularity as a b…
How Smart Is Your GUI Agent? A Framework for the Future of Software Interaction
Sidong Feng, Chunyang Chen
GUI agents are rapidly becoming a new interaction to software, allowing people to navigate web, desktop and mobile rather than execute them click by click. Yet ``agent'' is describ…
Towards Human-AI Synergy in UI Design: Supporting Iterative Generation with LLMs
Mingyue Yuan, Jieshan Chen, Yongquan Hu +5
In automated UI design generation, a key challenge is the lack of support for iterative processes, as most systems focus solely on end-to-end output. This stems from limited capabi…
Breaking Single-Tester Limits: Multi-Agent LLMs for Multi-User Feature Testing
Sidong Feng, Changhao Du, Huaxiao Liu +4
The growing dependence on mobile phones and their apps has made multi-user interactive features, like chat calls, live streaming, and video conferencing, indispensable for bridging…
Agent for User: Testing Multi-User Interactive Features in TikTok
Sidong Feng, Changhao Du, Huaxiao Liu +5
TikTok, a widely-used social media app boasting over a billion monthly active users, requires effective app quality assurance for its intricate features. Feature testing is crucial…
An Empirical Study on Leveraging Images in Automated Bug Report Reproduction
Dingbang Wang, Zhaoxu Zhang, Sidong Feng +2
Automated bug reproduction is a challenging task, with existing tools typically relying on textual steps-to-reproduce, videos, or crash logs in bug reports as input. However, image…