Spec-AUF: Accept-Until-Fail Training under Train-Inference Misalignment for Masked Block Drafters

Tianjian Yang, Meng Li

Speculative decoding accelerates autoregressive generation by drafting a block of tokens that the target model verifies left-to-right, committing only the longest accepted prefix.…