MissClick: Execution-Aware Adversarial Attacks on Coordinate Generation in GUI Grounding Models

Yu Ran, Wentao Zhao, Xin Zhang +1

Recent GUI visual grounding models generate screen coordinates as digit-token sequences that are parsed into numerical values and mapped to executable clicks. This generation-to-ex…