12 citations · 14 across the 23 of their papers we have counts for
1 paper · 2 filters
Tianhua Xia, Mugilan Ganesan, Yifei Feng +3
Speculative decoding accelerates large language model (LLM) inference by using a lightweight draft model to generate multiple candidate tokens that are verified by the target model…