2 papers
cs.AR2026
TokenStack: A Heterogeneous HBM-PIM Architecture and Runtime for Efficient LLM Inference
Zhuoran Li, Zhuohang Bian, Zihao Huang +4
Large language model (LLM) serving is now limited by the key-value (KV) cache. During decode, each new token rereads prior KV state, so attention becomes a bandwidth- and capacity-…
cs.DC2025
TokenCake: A KV-Cache-centric Serving Framework for LLM-based Multi-Agent Applications
Zhuohang Bian, Feiyang Wu, Zhuoran Li +2
Large Language Models (LLMs) are increasingly deployed in complex multi-agent applications that rely on external function calls. This workload creates severe performance challenges…