3 citations · 5 across the 18 of their papers we have counts for
4 papers · 1 filter
Towards Omni-dimensional GUI Agent Navigation with Masked Trajectory Prediction
Yan Zhang, Pei Fu, Daiqing Wu +8
Graphical User Interface (GUI) Agents autonomously interact with software to fulfill user requests, where GUI navigation stands out as the most critical and challenging capability.…
DRS-GUI: Dynamic Region Search for Training-Free GUI Grounding
Yichao Liu, Huawen Shen, Liu Yu +3
GUI agents powered by Multimodal Large Language Models (MLLMs) have demonstrated impressive capability in understanding and executing user instructions. However, accurately groundi…
Learn where to Click from Yourself: On-Policy Self-Distillation for GUI Grounding
Yan Zhang, Daiqing Wu, Huawen Shen +2
Graphical User Interface (GUI) grounding maps natural language instructions to the visual coordinates of target elements and serves as a core capability for autonomous GUI agents.…
Does the Question Really Matter? Training-Free Data Selection for Vision-Language SFT
Peng Sun, Yi Yang, Huawen Shen +4
Visual instruction tuning is crucial for improving vision-language large models (VLLMs). However, many samples can be solved via linguistic patterns or common-sense shortcuts, with…