2 papers
cs.IT2026
Multi-Access Speculative Inference: Uplink or Downlink?
Chang Cai, Kaibin Huang
Multi-access speculative inference (Multi-SPIN) extends SPIN to multi-device edge networks to accelerate cooperative token generation. It allows on-device small language models (SL…
cs.DC2026
Multi-SPIN: Multi-Access Speculative Inference for Cooperative Token Generation at the Edge
Haotian Zheng, Zhanwei Wang, Mingyao Cui +3
Speculative inference (SPIN) was originally developed as an efficient architecture to accelerate Large Language Models (LLMs). In this work, we propose its distributed deployment t…