1 citations · 2 across the 7 of their papers we have counts for
Showing cs.HCShow all
2 papers · 1 filter
cs.HC2024
ClickAgent: Enhancing UI Location Capabilities of Autonomous Agents
Jakub Hoscilowicz, Bartosz Maj, Bartosz Kozakiewicz +2
With the growing reliance on digital devices equipped with graphical user interfaces (GUIs), such as computers and smartphones, the need for effective automation tools has become i…
cs.HC2024
TinyClick: Single-Turn Agent for Empowering GUI Automation
Pawel Pawlowski, Krystian Zawistowski, Wojciech Lapacz +4
We present an UI agent for user interface (UI) interaction tasks, using Vision-Language Model Florence-2-Base. The agent's primary task is identifying the screen coordinates of the…