activity
20242026
most citedLarge Language Model-Brained GUI Agents: A Survey

7 citations · 11 across the 21 of their papers we have counts for

collaborators

23 papers

cs.MA2026

ClawCoin: An Agentic AI-Native Cryptocurrency for Decentralized Agent Economies

Shaoyu Li, Chaoyu Zhang, Hexuan Yu +2

Autonomous AI agents live or die by the API tokens they consume: without paid inference capacity they cannot reason, act, or delegate. Compute-token cost has become the binding res…

cs.SE2026

iScript: A Domain-Adapted Large Language Model and Benchmark for Physical Design Tcl Script Generation

Ning Xu, Zhaoyang Zhang, Senlin Shu +10

Modern EDA flows rely heavily on Tcl scripting, yet general LLMs perform poorly in this domain due to extreme data scarcity, domain-specific semantics, and the high reliability req…

cs.DC2026

Zipage: Maintain High Request Concurrency for LLM Reasoning through Compressed PagedAttention

Mengqi Liao, Lu Wang, Chaoyun Zhang +6

With reasoning becoming the generative paradigm for large language models (LLMs), the memory bottleneck caused by KV cache during the decoding phase has become a critical factor li…

cs.SE2026

Computer-Using World Model

Yiming Guan, Rui Yu, John Zhang +15

Agents operating in complex software environments benefit from reasoning about the consequences of their actions, as even a single incorrect user interface (UI) operation can derai…

cs.SE2026

A Benchmark for Language Models in Real-World System Building

Weilin Jin, Chenyu Zhao, Zeshun Huang +12

During migration across instruction set architectures (ISAs), software package build repair is a critical task for ensuring the reliability of software deployment and the stability…

cs.CL2025

G-KV: Decoding-Time KV Cache Eviction with Global Attention

Mengqi Liao, Lu Wang, Chaoyun Zhang +7

Recent reasoning large language models (LLMs) excel in complex tasks but encounter significant computational and memory challenges due to long sequence lengths. KV cache compressio…

cs.AI2025

GUI-360: A Comprehensive Dataset and Benchmark for Computer-Using Agents

Jian Mu, Chaoyun Zhang, Chiming Ni +14

We introduce GUI-360, a large-scale, comprehensive dataset and benchmark suite designed to advance computer-using agents (CUAs). CUAs present unique challenges and is const…

cs.DC2025

UFO3: Weaving the Digital Agent Galaxy

Chaoyun Zhang, Liqun Li, He Huang +8

Large language model (LLM)-powered agents are transforming digital devices from passive tools into proactive intelligent collaborators. However, most existing frameworks remain con…

cs.AI2025★ 1 cited

StepFly: Agentic Troubleshooting Guide Automation for Incident Diagnosis

Jiayi Mao, Liqun Li, Yanjie Gao +9

Effective incident management in large-scale IT systems relies on troubleshooting guides (TSGs), but their manual execution is slow and error-prone. While recent advances in LLMs o…

cs.SE2025

From Task to Tutorial: An Automated GUI Framework for Excel Tutorial Document and Video Creation

Yuhang Xie, Jian Mu, Xiaojun Ma +9

Excel is one of the most widely used productivity tools across domains, offering rich functionality but also overwhelming users with its complexity. This creates a persistent deman…

cs.CL2025

GUI-Actor: Coordinate-Free Visual Grounding for GUI Agents

Qianhui Wu, Kanzhi Cheng, Rui Yang +15

One of the principal challenges in building VLM-powered GUI agents is visual grounding, i.e., localizing the appropriate screen region for action execution based on both the visual…

cs.SE2025

SWE-bench Goes Live!

Linghao Zhang, Shilin He, Chaoyun Zhang +12

The issue-resolving task, where a model generates patches to fix real-world bugs, has emerged as a critical benchmark for evaluating the capabilities of large language models (LLMs…

cs.CL2025

Text2Grad: Reinforcement Learning from Natural Language Feedback

Hanyang Wang, Lu Wang, Chaoyun Zhang +5

Traditional RLHF optimizes language models with coarse, scalar rewards that mask the fine-grained reasons behind success or failure, leading to slow and opaque learning. Recent wor…

cs.CV2025

Zoomer: Adaptive Image Focus Optimization for Black-box MLLM

Jiaxu Qian, Chendong Wang, Yifan Yang +16

Multimodal large language models (MLLMs) such as GPT-4o, Gemini Pro, and Claude 3.5 have enabled unified reasoning over text and visual inputs, yet they often hallucinate in real w…

cs.AI2025

UFO2: The Desktop AgentOS

Chaoyun Zhang, He Huang, Chiming Ni +18

Recent Computer-Using Agents (CUAs), powered by multimodal large language models (LLMs), offer a promising direction for automating complex desktop workflows through natural langua…

cs.DC2025

An Empirical Study of Production Incidents in Generative AI Cloud Services

Haoran Yan, Yinfang Chen, Minghua Ma +10

The ever-increasing demand for generative artificial intelligence (GenAI) has motivated cloud-based GenAI services such as Azure OpenAI Service and Amazon Bedrock. Like any large-s…

cs.AI2025★ 1 cited

API Agents vs. GUI Agents: Divergence and Convergence

Chaoyun Zhang, Shilin He, Liqun Li +5

Large language models (LLMs) have evolved beyond simple text generation to power software agents that directly translate natural language commands into tangible actions. While API-…

cs.LG2025

VEM: Environment-Free Exploration for Training GUI Agent with Value Environment Model

Jiani Zheng, Lu Wang, Fangkai Yang +7

Training Vision-Language Models (VLMs) for Graphical User Interfaces (GUI) agents via Reinforcement Learning (RL) faces critical challenges: environment-based RL requires costly in…

cs.CL2025

DI-BENCH: Benchmarking Large Language Models on Dependency Inference with Testable Repositories at Scale

Linghao Zhang, Junhao Wang, Shilin He +13

Large Language Models have advanced automated software development, however, it remains a challenge to correctly infer dependencies, namely, identifying the internal components and…

cs.AI2025★ 2 cited

Large Action Models: From Inception to Implementation

Lu Wang, Fangkai Yang, Chaoyun Zhang +15

As AI continues to advance, there is a growing demand for systems that go beyond language-based assistance and move toward intelligent agents capable of performing real-world actio…

cs.AI2024

RuAG: Learned-rule-augmented Generation for Large Language Models

Yudi Zhang, Pei Xiao, Lu Wang +11

In-context learning (ICL) and Retrieval-Augmented Generation (RAG) have gained attention for their ability to enhance LLMs' reasoning by incorporating external knowledge but suffer…

cs.AI2024★ 7 cited

Large Language Model-Brained GUI Agents: A Survey

Chaoyun Zhang, Shilin He, Jiaxu Qian +10

GUIs have long been central to human-computer interaction, providing an intuitive and visually-driven way to access and interact with digital systems. The advent of LLMs, particula…

eess.SY2024

Deoxys: A Causal Inference Engine for Unhealthy Node Mitigation in Large-scale Cloud Infrastructure

Chaoyun Zhang, Randolph Yao, Si Qin +8

The presence of unhealthy nodes in cloud infrastructure signals the potential failure of machines, which can significantly impact the availability and reliability of cloud services…