5 citations · 6 across the 7 of their papers we have counts for
9 papers
LongPuzzleBench: Evaluating GUI Agents on Long-Horizon Visual Puzzles
Bingo Zhang, Haochuan Lu, Zongjie Li +3
GUI agents need long-horizon visual reasoning: they must interpret a changing interface while keeping a multi-step plan viable as earlier actions constrain later ones. Existing ben…
UI-Oceanus: Scaling GUI Agents with Synthetic Environmental Dynamics
Mengzhou Wu, Yuzhe Guo, Yuan Cao +16
Scaling generalist GUI agents is hindered by the data scalability bottleneck of expensive human demonstrations and the "distillation ceiling" of synthetic teacher supervision. To t…
From User Interface to Agent Interface: Efficiency Optimization of UI Representations for LLM Agents
Dezhi Ran, Zhi Gong, Yuzhe Guo +10
While Large Language Model (LLM) agents show great potential for automated UI navigation such as automated UI testing and AI assistants, their efficiency has been largely overlooke…
JSProtect: A Scalable Obfuscation Framework for Mini-Games in WeChat
Zhihao Li, Chaozheng Wang, Zongjie Li +12
The WeChat mini-game ecosystem faces rampant intellectual property theft to other platforms via secondary development, yet existing JavaScript obfuscation tools are ill-equipped fo…
JSidentify-V2: Leveraging Dynamic Memory Fingerprinting for Mini-Game Plagiarism Detection
Zhihao Li, Chaozheng Wang, Zongjie Li +9
The explosive growth of mini-game platforms has led to widespread code plagiarism, where malicious users access popular games' source code and republish them with modifications. Wh…
Beyond Pass or Fail: Multi-Dimensional Benchmarking of Foundation Models for Goal-based Mobile UI Navigation
Dezhi Ran, Mengzhou Wu, Hao Yu +15
Recent advances of foundation models (FMs) have made navigating mobile applications (apps) based on high-level goal instructions within reach, with significant industrial applicati…
Enabling Cost-Effective UI Automation Testing with Retrieval-Based LLMs: A Case Study in WeChat
Sidong Feng, Haochuan Lu, Jianqin Jiang +6
UI automation tests play a crucial role in ensuring the quality of mobile applications. Despite the growing popularity of machine learning techniques to generate these tests, they…
Towards Efficient Record and Replay: A Case Study in WeChat
Sidong Feng, Haochuan Lu, Ting Xiong +2
WeChat, a widely-used messenger app boasting over 1 billion monthly active users, requires effective app quality assurance for its complex features. Record-and-replay tools are cru…
Data Sanity Check for Deep Learning Systems via Learnt Assertions
Haochuan Lu, Huanlin Xu, Nana Liu +2
Reliability is a critical consideration to DL-based systems. But the statistical nature of DL makes it quite vulnerable to invalid inputs, i.e., those cases that are not considered…