Spotlight: Mobile UI Understanding using Vision-Language Models with a Focus

Gang Li, Yang Li

Mobile UI understanding is important for enabling various interaction tasks such as UI automation and accessibility. Previous mobile UI modeling often depends on the view hierarchy…