Closer Look at Efficient Inference Methods: A Survey of Speculative Decoding

Hyun Ryu, Eric Kim

Efficient inference in large language models (LLMs) has become a critical focus as their scale and complexity grow. Traditional autoregressive decoding, while effective, suffers fr…