activity
20242026
most citedIs Grokking Worthwhile? Functional Analysis and Transferability of Generalization Circuits in Transformers

1 citations · 1 across the 14 of their papers we have counts for

collaborators

14 papers

cs.AI2026

CacheBridge: Efficient Cross-Model KV Cache Transfer

Xingyu Qu, Siyuan Lu, Zhiyu Chen +2

Sharing context between LLMs in a multi-model system requires the receiving model to prefill the shared prefix because KV caches are model-specific. Recent closed-form cross-model…

cs.CL2026

Mitigating Exploration Bias in RL for Multi-Instruction Following

Mian Zhang, Yueqin Yin, Kaiyu He +4

RL has emerged as a powerful paradigm for enhancing the instruction following capabilities of LLMs. While existing training recipes achieve substantial gains, we find that they suf…

cs.CL2026

Spine-Branch Coordination for Multi-agent Computer Use

Mian Zhang, Manasi Sharma, Sheng Zhang +5

Computer use agents (CUAs) are increasingly deployed as multi-agent systems that decompose a task into multiple subtasks executed across parallel virtual machines (VMs). However, a…

cs.AI2026

STEPS: Selective On-Policy Self-Distillation for Reasoning

Jiaxuan Wang, Xuan Ouyang, Zhiyu Chen +4

On-policy self-distillation (OPSD) uses a model as its own teacher under privileged context, providing token-level supervision on the model's own reasoning trajectories. However, p…

cs.LG2026

HAServe: Horizon-Aware Scheduling and Memory Co-Design for Efficient LLM Serving

Xingyu Qu, Tianhao Lin, Yiqi Li +2

Online large language model (LLM) services process requests that share context but differ in prefix structure and arrival timing. Finite capacity couples request admission and key-…

cs.AI2026

Mobile-Agent-v3.5: Multi-platform Fundamental GUI Agents

Haiyang Xu, Xi Zhang, Haowei Liu +16

The paper introduces GUI-Owl-1.5, the latest native GUI agent model that features instruct/thinking variants in multiple sizes (2B/4B/8B/32B/235B) and supports a range of platforms…

cs.CL2026★ 1 cited

Is Grokking Worthwhile? Functional Analysis and Transferability of Generalization Circuits in Transformers

Kaiyu He, Zhang Mian, Peilin Wu +2

While Large Language Models (LLMs) excel at factual retrieval, they often struggle with the "curse of two-hop reasoning" in compositional tasks. Recent research suggests that param…

cs.CL2025

HiPRAG: Hierarchical Process Rewards for Efficient Agentic Retrieval Augmented Generation

Peilin Wu, Mian Zhang, Kun Wan +4

Agentic RAG is a powerful technique for incorporating external information that LLMs lack, enabling better problem solving and question answering. However, suboptimal search behavi…

cs.CL2025

GEAR: A General Evaluation Framework for Abductive Reasoning

Kaiyu He, Peilin Wu, Mian Zhang +4

Since the advent of large language models (LLMs), research has focused on instruction following and deductive reasoning. A central question remains: can these models discover new k…

cs.LG2025

Context and Diversity Matter: The Emergence of In-Context Learning in World Models

Fan Wang, Zhiyuan Chen, Yuxuan Zhong +8

The capability of predicting environmental dynamics underpins both biological neural systems and general embodied AI in adapting to their surroundings. Yet prevailing approaches re…

cs.CL2025

LogicIF: Towards Complex Logic Instruction Following

Mian Zhang, Shujian Liu, Sixun Dong +9

Instruction following has catalyzed the recent era of Large Language Models (LLMs) and is the foundational skill underpinning more advanced capabilities such as reasoning and agent…

cs.SE2025

LMR-BENCH: Evaluating LLM Agent's Ability on Reproducing Language Modeling Research

Shuo Yan, Ruochen Li, Ziming Luo +11

Large language model (LLM) agents have demonstrated remarkable potential in advancing scientific discovery. However, their capability in the fundamental yet crucial task of reprodu…

cs.CL2025

From Reasoning to Learning: A Survey on Hypothesis Discovery and Rule Learning with Large Language Models

Kaiyu He, Zhiyu Chen

Since the advent of Large Language Models (LLMs), efforts have largely focused on improving their instruction-following and deductive reasoning abilities, leaving open the question…

cs.CL2024

IDEA: Enhancing the Rule Learning Ability of Large Language Model Agent through Induction, Deduction, and Abduction

Kaiyu He, Mian Zhang, Shuo Yan +2

While large language models (LLMs) have been thoroughly evaluated for deductive and inductive reasoning, their proficiency in holistic rule learning in interactive environments rem…