Oilbird: Training-Free Speculative Decoding with Keys the Verifier Already Computes

Tao Jin, Phuong Minh Nguyen, Zhenzhu Yan +2

Training-free speculative decoding drafts by matching an exact suffix of the context against a pool of earlier context. That lookup misses correct drafts already in the pool, most…