2 citations · 2 across the 5 of their papers we have counts for
1 paper · 1 filter
Liyuan Zhang, Jiarui Zhang, Jinwei Yao +6
Speculative decoding accelerates autoregressive large language model inference by drafting multiple tokens and verifying them in a single target-model forward pass. Recent diffusio…