Multi-modal user interface control detection using cross-attention

Milad Moradi, Ke Yan, David Colwell +2

Detecting user interface (UI) controls from software screenshots is a critical task for automated testing, accessibility, and software analytics, yet it remains challenging due to…