1 paper · 1 filter
Selin Yildirim, Deming Chen
Recent advancements in speculative decoding have demonstrated considerable speedup across a wide array of large language model (LLM) tasks. Speculative decoding inherently relies o…