2 papers
cs.LG2026
Replay the Curvature: Accurate and Scalable NVFP4 Quantization for Large Language Model Inference
Ruiyi Ding, Jie Li, Kang He +4
Large language models make weight storage and memory traffic major inference costs, motivating low-precision formats that represent each weight with only a few bits. Such formats u…
cs.DC2026
DualDecoder: Accelerate Long Context LLM Inference by Predictive Prefetch
Zuning Liang, Zhiyi Yao, Qi Chen +6
Long-context inference is becoming a fundamental capability for modern LLM serving, especially driven by emerging agentic applications. Yet it faces a severe memory wall that the K…