Towards Omni-dimensional GUI Agent Navigation with Masked Trajectory Prediction

Yan Zhang, Pei Fu, Daiqing Wu +8

Graphical User Interface (GUI) Agents autonomously interact with software to fulfill user requests, where GUI navigation stands out as the most critical and challenging capability.…