1 paper
Ziteng Sun, Uri Mendlovic, Yaniv Leviathan +4
Speculative decoding is an effective method for lossless acceleration of large language models during inference. It uses a fast model to draft a block of tokens which are then veri…