2 papers
cs.PF2026
Swarm: Co-Activation Aware KVCache Offloading Across Multiple SSDs
Tuowei Wang, Liyun Chu, Ruwen Fan +1
The key-value (KV) cache has become the dominant contributor to memory consumption in large language model (LLM) inference. Although offloading KVCache from GPU high-bandwidth memo…
cs.LG2025
Neuralink: Fast LLM Inference on Smartphones with Neuron Co-Activation Linking
Tuowei Wang, Ruwen Fan, Minxing Huang +6
Large Language Models (LLMs) have achieved remarkable success across various domains, yet deploying them on mobile devices remains an arduous challenge due to their extensive compu…