4 citations · 6 across the 2 of their papers we have counts for
1 paper · 1 filter
Xiaofan Lu, Yixiao Zeng, Feiyang Ma +2
Speculative Decoding (SD) is a technique to accelerate the inference of Large Language Models (LLMs) by using a lower complexity draft model to propose candidate tokens verified by…