27 citations · 44 across the 6 of their papers we have counts for
6 papers
SusBench: An Online Benchmark for Evaluating Dark Pattern Susceptibility of Computer-Use Agents
Longjie Guo, Chenjie Yuan, Mingyuan Zhong +7
As LLM-based computer-use agents (CUAs) begin to autonomously interact with real-world interfaces, understanding their vulnerability to manipulative interface designs becomes incre…
Caption: Generating Informative Content Labels for Image Buttons Using Next-Screen Context
Mingyuan Zhong, Ajit Mallavarapu, Qing Nie
We present Caption, an LLM-powered content label generation tool for visual interactive elements on mobile devices. Content labels are essential for screen readers to provide annou…
SlideAudit: A Dataset and Taxonomy for Automated Evaluation of Presentation Slides
Zhuohao Jerry Zhang, Ruiqi Chen, Mingyuan Zhong +1
Automated evaluation of specific graphic designs like presentation slides is an open problem. We present SlideAudit, a dataset for automated slide evaluation. We collaborated with…
ScreenAudit: Detecting Screen Reader Accessibility Errors in Mobile Apps Using Large Language Models
Mingyuan Zhong, Ruolin Chen, Xia Chen +2
Many mobile apps are inaccessible, thereby excluding people from their potential benefits. Existing rule-based accessibility checkers aim to mitigate these failures by identifying…
HelpViz: Automatic Generation of Contextual Visual MobileTutorials from Text-Based Instructions
Mingyuan Zhong, Gang Li, Peggy Chi +1
We present HelpViz, a tool for generating contextual visual mobile tutorials from text-based instructions that are abundant on the web. HelpViz transforms text instructions to grap…
Spacewalker: Rapid UI Design Exploration Using Lightweight Markup Enhancement and Crowd Genetic Programming
Mingyuan Zhong, Gang Li, Yang Li
User interface design is a complex task that involves designers examining a wide range of options. We present Spacewalker, a tool that allows designers to rapidly search a large de…