GUI Knowledge Bench: Revealing the Knowledge Gap of VLMs in GUI Tasks

Chenrui Shi, Zedong Yu, Zhi Gao +7

Vision language models (VLMs) have advanced graphical user interface (GUI) task automation but still lag behind humans. We hypothesize this gap stems from missing core GUI knowledg…