Multi-Access Speculative Inference: Uplink or Downlink?

Chang Cai, Kaibin Huang

Multi-access speculative inference (Multi-SPIN) extends SPIN to multi-device edge networks to accelerate cooperative token generation. It allows on-device small language models (SL…