dual-token decoding 1kv cache 1llm serving 1long-context inference 1predictive prefetch 1sparse retrieval 1
From the 1 of 2 linked papers with an AI index.
2 papers
cs.DC2026
DualDecoder: Accelerate Long Context LLM Inference by Predictive Prefetch
Zuning Liang, Zhiyi Yao, Qi Chen +6
DualDecoder is a serving system that predicts and prefetches the key‑value cache entries needed for the next token in long‑context LLM inference, reducing GPU memory overhead and b…
cs.AI2026
PGN: Design and Implementation of a Vision-Language Navigation System Based on Pangu Multimodal Foundation Model
Li Xian, Mingxi Li, Yizheng Wang +3
Vision-Language Navigation (VLN) requires an embodied agent to interpret a natural-language instruction and predict actions from temporally ordered visual observations. Adapting a…