1 paper
Haodi Lei, Yafu Li, Haoran Zhang +8
Speculative decoding accelerates large language model inference by pairing a target model with a lightweight draft model whose proposed tokens are verified in parallel. A common wa…