GRAFT: Adaptive DLM-Based Draft Tree Construction with Target-Distilled Edge Scoring

Xuming Ye, Zeming Ma, Runjie Yu +5

Tree-based speculative decoding raises the mean accepted tokens of standard speculative decoding by verifying multiple draft paths, and existing tree builders typically construct t…