4 papers · 1 filter
Task-State Governance: A Virtual Machine for Verifiable and Recoverable GUI Agent Execution
Wenkui Yang, Yiming Hao, Kai Zhou +6
Graphical user interface (GUI) agents now execute workflows across real applications, but when execution drifts, users must determine what changed, what should have remained untouc…
GaugeVLM: Structuring Spatial Supervision with Measured Geometric Interventions
Hongbo Wang, Zihan Lin, Wenkui Yang +5
Vision-language models (VLMs) can contradict themselves across views of the same spatial relation and fail to respond when that relation changes. Addressing these failures requires…
HalluClear: Diagnosing, Evaluating and Mitigating Hallucinations in GUI Agents
Chao Jin, Wenkui Yang, Hao Sun +6
While progress in GUI agents has been largely driven by industrial-scale training, ungrounded hallucinations often trigger cascading failures in real-world deployments.Unlike gener…
Are GUI Agents Focused Enough? Automated Distraction via Semantic-level UI Element Injection
Wenkui Yang, Chao Jin, Haisu Zhu +7
Existing red-teaming studies on GUI agents face two fundamental limitations: adversarial perturbations require white-box access unavailable in commercial deployments, while prompt…