2 papers
cs.CL2026
TokTier: Exact Stateful CPU+GPU Tokenization for Agentic LLM Serving
Zhenyu Zhang, Zhichao Cao
LLM serving caches prompt KV state, yet most front ends still re-tokenize the full request on every call. Coding agents pay most: sessions repeatedly submit a long transcript after…
cs.DB2025
StorageXTuner: An LLM Agent-Driven Automatic Tuning Framework for Heterogeneous Storage Systems
Qi Lin, Zhenyu Zhang, Viraj Thakkar +3
Automatically configuring storage systems is hard: parameter spaces are large and conditions vary across workloads, deployments, and versions. Heuristic and ML tuners are often sys…