1 citations · 1 across the 9 of their papers we have counts for
Showing cs.DCShow all
2 papers · 1 filter
cs.DC2026
Efficient Remote KV Cache Reuse with GPU-native Video Codec
Liang Mi, Weijun Wang, Jinghan Chen +3
Remote KV cache reuse fetches KV cache for identical contexts from remote storage, avoiding recomputation, accelerating LLM inference. While it excels in high-speed networks, its p…
cs.DC2025★ 1 cited
Vec-LUT: Vector Table Lookup for Parallel Ultra-Low-Bit LLM Inference on Edge Devices
Xiangyu Li, Chengyu Yin, Weijun Wang +3
Large language models (LLMs) are increasingly deployed on edge devices. To meet strict resource constraints, real-world deployment has pushed LLM quantization from 8-bit to 4-bit,…