Revisiting Judge Decoding from First Principles via Training-Free Distributional Divergence

Shengyin Sun, Yiming Li, Renxi Liu +5

Judge Decoding accelerates LLM inference by relaxing the strict verification of Speculative Decoding, yet it typically relies on expensive and noisy supervision. In this work, we r…