4 papers
RoboForge: Physically Optimized Text-guided Whole-Body Locomotion for Humanoids
Xichen Yuan, Zhe Li, Bofan Lyu +4
While generative models have become effective at producing human-like motions from text, transferring these motions to humanoid robots for physical execution remains challenging. E…
From Off-Policy to On-Policy: Enhancing GUI Agents via Bi-level Expert-to-Policy Assimilation
Zezhou Wang, Ziyun Zhang, Xiaoyi Zhang +2
Vision-language models are increasingly deployed as computer-use agents (CUAs) that operate desktops and browsers. Top-performing CUAs are framework-based systems that decompose pl…
UI-Evol: Automatic Knowledge Evolving for Computer Use Agents
Ziyun Zhang, Xinyi Liu, Xiaoyi Zhang +3
External knowledge has played a crucial role in the recent development of computer use agents. We identify a critical knowledge-execution gap: retrieved knowledge often fails to tr…
UI-E2I-Synth: Advancing GUI Grounding with Large-Scale Instruction Synthesis
Xinyi Liu, Xiaoyi Zhang, Ziyun Zhang +1
Recent advancements in Large Vision-Language Models are accelerating the development of Graphical User Interface (GUI) agents that utilize human-like vision perception capabilities…