1 citations · 1 across the 9 of their papers we have counts for
1 paper · 1 filter
Zhuocheng Gong, Jiahao Liu, Ziyue Wang +5
Speculative decoding has emerged as a promising technique to accelerate the inference of Large Language Models (LLMs) by employing a small language model to draft a hypothesis sequ…