dual-token decoding 1kv cache 1llm serving 1long-context inference 1predictive prefetch 1sparse retrieval 1
From the 1 of 2 linked papers with an AI index.
2 papers
cs.DC2026
DualDecoder: Accelerate Long Context LLM Inference by Predictive Prefetch
Zuning Liang, Zhiyi Yao, Qi Chen +6
DualDecoder is a serving system that predicts and prefetches the key‑value cache entries needed for the next token in long‑context LLM inference, reducing GPU memory overhead and b…
cs.SE2026
FuzzPilot: Plateau-Triggered Recipe Validation for Structured Text Fuzzing
Zhiyi Yao
FuzzPilot is a controller for AFL++ that moves expensive reasoning out of the mutation hot path. When coverage plateaus, it snapshots the corpus, prepares candidate mutation recipe…