PARD-2: Target-Aligned Parallel Draft Model for Dual-Mode Speculative Decoding

Zihao An, Taichi Liu, Ziqiong Liu +3

Speculative decoding accelerates Large Language Models (LLMs) inference by using a lightweight draft model to propose candidate tokens that are verified in parallel by the target m…