6 citations · 13 across the 23 of their papers we have counts for
1 paper · 2 filters
Haibo Hu, Lianming Huang, Qiao Li +2
Speculative decoding accelerates large language model inference through collaboration between a lightweight draft model and a target verifier. Existing methods mainly improve the d…