Tutorial Proposal: Speculative Decoding for Efficient LLM Inference

Heming Xia, Cunxiao Du, Yongqi Li +2

This tutorial presents a comprehensive introduction to Speculative Decoding (SD), an advanced technique for LLM inference acceleration that has garnered significant research intere…