77 citations · 77 across the 3 of their papers we have counts for
4 papers
Online Dense Reinforcement Learning with Planning-Grounding Agent for UI Navigation on Live IOS Apps
Peitong Duan, Khashayar Gatmiry, Jeffrey Nichols +2
While frontier vision-language models demonstrate strong capabilities in user interface (UI) navigation, their high inference costs prohibit everyday use. Conversely, smaller model…
Visual Prompting with Iterative Refinement for Design Critique Generation
Peitong Duan, Chin-Yi Cheng, Bjoern Hartmann +1
Feedback is crucial for every design process, such as user interface (UI) design, and automating design critiques can significantly improve the efficiency of the design workflow. A…
UICrit: Enhancing Automated Design Evaluation with a UICritique Dataset
Peitong Duan, Chin-yi Chen, Gang Li +2
Automated UI evaluation can be beneficial for the design process; for example, to compare different UI designs, or conduct automated heuristic evaluation. LLM-based UI evaluation,…
Generating Automatic Feedback on UI Mockups with Large Language Models
Peitong Duan, Jeremy Warner, Yang Li +1
Feedback on user interface (UI) mockups is crucial in design. However, human feedback is not always readily available. We explore the potential of using large language models for a…