15 citations · 18 across the 2 of their papers we have counts for
2 papers
cs.HC2024★ 15 cited
Graph4GUI: Graph Neural Networks for Representing Graphical User Interfaces
Yue Jiang, Changkong Zhou, Vikas Garg +1
Present-day graphical user interfaces (GUIs) exhibit diverse arrangements of text, graphics, and interactive elements such as buttons and menus, but representations of GUIs have no…
cs.HC2023★ 3 cited
ILuvUI: Instruction-tuned LangUage-Vision modeling of UIs from Machine Conversations
Yue Jiang, Eldon Schoop, Amanda Swearngin +1
Multimodal Vision-Language Models (VLMs) enable powerful applications from their fused understanding of images and language, but many perform poorly on UI tasks due to the lack of…