To Copy or Not to Copy: Controlling Speculative Decoding via Intrinsic Model Signals

Roy Eisenstadt, Ido Cohen, Edo Cohen-Karlik +2

Speculative Decoding (SD) has significantly accelerated Large Language Model (LLM) inference, yet existing approaches face a fundamental tradeoff between two drafting strategies: n…