StarSD: One-for-Many Speculative Decoding

Junhao He, Feiran You, Hongyang Du

Speculative decoding accelerates autoregressive generation by separating token proposal from verification, but most existing approaches are designed for single-node execution and d…