1 paper
Yantao Li, Huanlin Gao, Fang Zhao +12
Speculative decoding accelerates autoregressive generation by allowing a lightweight drafter to propose future tokens while a target model verifies them in parallel. Its lossless g…