6 papers
CoAdapt-GUI: Joint Workflow Context and Policy Adaptation for Unseen GUI Applications
Linqiang Guo, Li Gu, Zihuan Jiang +8
Mobile GUI agents remain brittle when deployed to applications absent from source training. We study novel-app generalization under a limited target interaction budget and without…
StepReflect: Structured UI Transition Reflection for Mobile GUI Agents
Linqiang Guo, Wei Liu, Li Gu +3
Autonomous mobile GUI agents require accurate action reflection for reliable long-horizon execution. Existing approaches rely on open-ended multimodal reasoning after each action,…
Beyond the GUI Paradigm: Do Mobile Agents Need the Phone Screen?
Li Gu, Zihuan Jiang, Linqiang Guo +6
Recent advances in mobile agents are dominated by the GUI paradigm, in which agents perceive UI information and emit screen interactions. However, mobile platforms also expose a co…
Agent-SAMA: State-Aware Mobile Assistant
Linqiang Guo, Wei Liu, Yi Wen Heng +3
Mobile Graphical User Interface (GUI) agents aim to autonomously complete tasks within or across apps based on user instructions. While recent Multimodal Large Language Models (MLL…
Screencast-Based Analysis of User-Perceived GUI Responsiveness
Wei Liu, Linqiang Guo, Yi Wen Heng +4
GUI responsiveness is critical for a positive user experience in mobile applications. Even brief delays in visual feedback can frustrate users and lead to negative reviews. However…
GUIWatcher: Automatically Detecting GUI Lags by Analyzing Mobile Application Screencasts
Wei Liu, Feng Lin, Linqiang Guo +2
The Graphical User Interface (GUI) plays a central role in mobile applications, directly affecting usability and user satisfaction. Poor GUI performance, such as lag or unresponsiv…