8 papers
DASH-KV: Accelerating Long-Context LLM Inference via Asymmetric KV Cache Hashing
Jinyu Guo, Zhihan Zhang, Jiehui Xie +7
The quadratic computational complexity of the standard attention mechanism constitutes a fundamental bottleneck for large language models in long-context inference. While existing…
From Similarity to Structure: Training-free LLM Context Compression with Hybrid Graph Priors
Yitian Zhou, Chaoning Zhang, Jiaquan Zhang +6
Long-context large language models remain computationally expensive to run and often fail to reliably process very long inputs, which makes context compression an important compone…
Lightweight LLM Agent Memory with Small Language Models
Jiaquan Zhang, Chaoning Zhang, Shuxu Chen +9
Although LLM agents can leverage tools for complex tasks, they still need memory to maintain cross-turn consistency and accumulate reusable information in long-horizon interactions…
Experience Transfer for Multimodal LLM Agents in Minecraft Game
Chenghao Li, Jun Liu, Songbo Zhang +7
Multimodal LLM agents operating in complex game environments must continually reuse past experience to solve new tasks efficiently. In this work, we propose Echo, a transfer-orient…
TDA-RC: Task-Driven Alignment for Knowledge-Based Reasoning Chains in Large Language Models
Jiaquan Zhang, Qigan Sun, Chaoning Zhang +11
Enhancing the reasoning capability of large language models (LLMs) remains a core challenge in natural language processing. The Chain-of-Thought (CoT) paradigm dominates practical…
Efficient and Interpretable Multi-Agent LLM Routing via Ant Colony Optimization
Xudong Wang, Chaoning Zhang, Jiaquan Zhang +8
Large Language Model (LLM)-driven Multi-Agent Systems (MAS) have demonstrated strong capability in complex reasoning and tool use, and heterogeneous agent pools further broaden the…