Match the Distribution, Not the Compute: Post-Training Multi-Token Prediction Heads

Prachi Badarayani, Aidan Jay, Chenghui Zhou +8

Multi-token prediction (MTP) improves the throughput of autoregressive generation by enabling the language model to draft multiple next tokens per forward pass, while a verificatio…