3 papers
cs.AI2025
UFO2: The Desktop AgentOS
Chaoyun Zhang, He Huang, Chiming Ni +18
Recent Computer-Using Agents (CUAs), powered by multimodal large language models (LLMs), offer a promising direction for automating complex desktop workflows through natural langua…
cs.AI2024
AI Delegates with a Dual Focus: Ensuring Privacy and Strategic Self-Disclosure
Zhiyang Zhang, Xi Chen, Fangkai Yang +7
Large language model (LLM)-based AI delegates are increasingly utilized to act on behalf of users, assisting them with a wide range of tasks through conversational interfaces. Desp…
cs.AI2024
AXIS: Efficient Human-Agent-Computer Interaction with API-First LLM-Based Agents
Junting Lu, Zhiyang Zhang, Fangkai Yang +7
Multimodal large language models (MLLMs) have enabled LLM-based agents to directly interact with application user interfaces (UIs), enhancing agents' performance in complex tasks.…