Hybrid Computer Use: A Unified Programmatic, Semantic, and Visual Interface for General Agents

Haoqing Wang, Xiaoyi Zhang, Sicheng Fan +5

Computer-use agents increasingly tackle tasks ranging from everyday desktop activities to long-horizon professional workflows. Yet interfaces centered on screenshots and mouse-and-…