FastEagle: Cascaded Drafting for Accelerating Speculative Decoding

Haiduo Huang, Jiangcheng Song, Wenzhe Zhao +1

Speculative decoding accelerates generation by drafting candidates and verifying them in parallel, yet state-of-the-art drafters (e.g., EAGLE) still require N sequential passes to…