Understanding Tool-Mediated Interaction Failures in Agentic GUI Software: An Empirical Study

Yuchen Shao, Wenjing Liu, Yuheng Huang +6

Large language model (LLM) agents increasingly complete tasks through live graphical user interfaces (GUIs). Because the model cannot directly operate the GUI, these systems often…