4 papers
AutoSurfer -- Teaching Web Agents through Comprehensive Surfing, Learning, and Modeling
Fazle Elahi Faisal, Qianhui Wu, Baolin Peng +1
Recent advances in multimodal large language models (LLMs) have revolutionized web agents that can automate complex tasks on websites. However, their accuracy remains limited by th…
WebXSkill: Skill Learning for Autonomous Web Agents
Zhaoyang Wang, Qianhui Wu, Xuchao Zhang +12
Autonomous web agents powered by large language models (LLMs) have shown promise in completing complex browser tasks, yet they still struggle with long-horizon workflows. A key bot…
ActionEngine: From Reactive to Programmatic GUI Agents via State Machine Memory
Hongbin Zhong, Fazle Faisal, Luis França +4
Existing Graphical User Interface (GUI) agents operate through step-by-step calls to vision language models--taking a screenshot, reasoning about the next action, executing it, the…
WAREX: Web Agent Reliability Evaluation on Existing Benchmarks
Su Kara, Fazle Faisal, Suman Nath
Recent advances in browser-based LLM agents have shown promise for automating tasks ranging from simple form filling to hotel booking or online shopping. Current benchmarks measure…