Adaptation of Computer Use Agents to New Software with User Manuals

Chulhoon Yoon, Kyungri Park, Jinyeong Yun +3

Recent advances in multimodal foundation models have significantly improved the ability to operate real-world software through graphical user interfaces (GUIs) using visual observa…