6 papers
Plan-MCTS: Plan Exploration for Action Exploitation in Web Navigation
Weiming Zhang, Jihong Wang, Jiamu Zhou +9
Large Language Models (LLMs) have empowered autonomous agents to handle complex web navigation tasks. While recent studies integrate tree search to enhance long-horizon reasoning,…
ColorBrowserAgent: Complex Long-Horizon Browser Agent with Adaptive Knowledge Evolution
Jihong Wang, Jiamu Zhou, Weiming Zhang +7
With the advancement of vision-language models, web automation has made significant progress. However, deploying autonomous agents in real-world settings remains challenging, prima…
ColorAgent: Building A Robust, Personalized, and Interactive OS Agent
Ning Li, Qiqiang Lin, Zheng Wu +19
With the advancements in hardware, software, and large language model technologies, the interaction between humans and operating systems has evolved from the command-line interface…
MobileUse: A GUI Agent with Hierarchical Reflection for Autonomous Mobile Operation
Ning Li, Xiangmou Qu, Jiamu Zhou +6
Recent advances in Multimodal Large Language Models (MLLMs) have enabled the development of mobile agents that can understand visual inputs and follow user instructions, unlocking…
HammerBench: Fine-Grained Function-Calling Evaluation in Real Mobile Device Scenarios
Jun Wang, Jiamu Zhou, Muning Wen +7
Evaluating the performance of LLMs in multi-turn human-agent interactions presents significant challenges, particularly due to the complexity and variability of user behavior. In t…
Hammer: Robust Function-Calling for On-Device Language Models via Function Masking
Qiqiang Lin, Muning Wen, Qiuying Peng +8
Large language models have demonstrated impressive value in performing as autonomous agents when equipped with external tools and API calls. Nonetheless, effectively harnessing the…